[==========] Running 7 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 5 tests from LeaderRebalancerTest
[ RUN ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20251023 07:57:31.801338 16888 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.16.126.62:34949
I20251023 07:57:31.803072 16888 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251023 07:57:31.804225 16888 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251023 07:57:31.821738 16895 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251023 07:57:31.822708 16897 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251023 07:57:31.823357 16888 server_base.cc:1047] running on GCE node
W20251023 07:57:31.821875 16894 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251023 07:57:33.031837 16888 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251023 07:57:33.032115 16888 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251023 07:57:33.032276 16888 hybrid_clock.cc:648] HybridClock initialized: now 1761206253032259 us; error 0 us; skew 500 ppm
I20251023 07:57:33.033172 16888 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20251023 07:57:33.038856 16888 webserver.cc:492] Webserver started at http://127.16.126.62:39989/ using document root <none> and password file <none>
I20251023 07:57:33.039801 16888 fs_manager.cc:362] Metadata directory not provided
I20251023 07:57:33.040010 16888 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251023 07:57:33.040427 16888 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251023 07:57:33.046799 16888 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1761206251627710-16888-0/minicluster-data/master-0-root/instance:
uuid: "0fcd9e92d65245c888b7c618d66cfd9f"
format_stamp: "Formatted at 2025-10-23 07:57:33 on dist-test-slave-m488"
I20251023 07:57:33.055361 16888 fs_manager.cc:696] Time spent creating directory manager: real 0.008s user 0.008s sys 0.000s
I20251023 07:57:33.060909 16903 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251023 07:57:33.062176 16888 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20251023 07:57:33.062505 16888 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1761206251627710-16888-0/minicluster-data/master-0-root
uuid: "0fcd9e92d65245c888b7c618d66cfd9f"
format_stamp: "Formatted at 2025-10-23 07:57:33 on dist-test-slave-m488"
I20251023 07:57:33.062814 16888 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1761206251627710-16888-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1761206251627710-16888-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1761206251627710-16888-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251023 07:57:33.134156 16888 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251023 07:57:33.135699 16888 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251023 07:57:33.136281 16888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251023 07:57:33.211316 16888 rpc_server.cc:307] RPC server started. Bound to: 127.16.126.62:34949
I20251023 07:57:33.211417 16954 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.126.62:34949 every 8 connection(s)
I20251023 07:57:33.219666 16955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:57:33.243067 16955 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0fcd9e92d65245c888b7c618d66cfd9f: Bootstrap starting.
I20251023 07:57:33.249464 16955 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0fcd9e92d65245c888b7c618d66cfd9f: Neither blocks nor log segments found. Creating new log.
I20251023 07:57:33.251412 16955 log.cc:826] T 00000000000000000000000000000000 P 0fcd9e92d65245c888b7c618d66cfd9f: Log is configured to *not* fsync() on all Append() calls
I20251023 07:57:33.256235 16955 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0fcd9e92d65245c888b7c618d66cfd9f: No bootstrap required, opened a new log
I20251023 07:57:33.277520 16955 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0fcd9e92d65245c888b7c618d66cfd9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fcd9e92d65245c888b7c618d66cfd9f" member_type: VOTER }
I20251023 07:57:33.278128 16955 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0fcd9e92d65245c888b7c618d66cfd9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:57:33.278415 16955 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0fcd9e92d65245c888b7c618d66cfd9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fcd9e92d65245c888b7c618d66cfd9f, State: Initialized, Role: FOLLOWER
I20251023 07:57:33.279232 16955 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0fcd9e92d65245c888b7c618d66cfd9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fcd9e92d65245c888b7c618d66cfd9f" member_type: VOTER }
I20251023 07:57:33.279771 16955 raft_consensus.cc:399] T 00000000000000000000000000000000 P 0fcd9e92d65245c888b7c618d66cfd9f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251023 07:57:33.280076 16955 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0fcd9e92d65245c888b7c618d66cfd9f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251023 07:57:33.280443 16955 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0fcd9e92d65245c888b7c618d66cfd9f [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:57:33.284714 16955 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0fcd9e92d65245c888b7c618d66cfd9f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fcd9e92d65245c888b7c618d66cfd9f" member_type: VOTER }
I20251023 07:57:33.285688 16955 leader_election.cc:304] T 00000000000000000000000000000000 P 0fcd9e92d65245c888b7c618d66cfd9f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0fcd9e92d65245c888b7c618d66cfd9f; no voters:
I20251023 07:57:33.287636 16955 leader_election.cc:290] T 00000000000000000000000000000000 P 0fcd9e92d65245c888b7c618d66cfd9f [CANDIDATE]: Term 1 election: Requested vote from peers
I20251023 07:57:33.287972 16958 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0fcd9e92d65245c888b7c618d66cfd9f [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:57:33.290236 16958 raft_consensus.cc:697] T 00000000000000000000000000000000 P 0fcd9e92d65245c888b7c618d66cfd9f [term 1 LEADER]: Becoming Leader. State: Replica: 0fcd9e92d65245c888b7c618d66cfd9f, State: Running, Role: LEADER
I20251023 07:57:33.291265 16958 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0fcd9e92d65245c888b7c618d66cfd9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fcd9e92d65245c888b7c618d66cfd9f" member_type: VOTER }
I20251023 07:57:33.292392 16955 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0fcd9e92d65245c888b7c618d66cfd9f [sys.catalog]: configured and running, proceeding with master startup.
I20251023 07:57:33.302407 16959 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0fcd9e92d65245c888b7c618d66cfd9f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0fcd9e92d65245c888b7c618d66cfd9f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fcd9e92d65245c888b7c618d66cfd9f" member_type: VOTER } }
I20251023 07:57:33.303251 16959 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0fcd9e92d65245c888b7c618d66cfd9f [sys.catalog]: This master's current role is: LEADER
I20251023 07:57:33.302996 16960 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0fcd9e92d65245c888b7c618d66cfd9f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0fcd9e92d65245c888b7c618d66cfd9f. Latest consensus state: current_term: 1 leader_uuid: "0fcd9e92d65245c888b7c618d66cfd9f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fcd9e92d65245c888b7c618d66cfd9f" member_type: VOTER } }
I20251023 07:57:33.303725 16960 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0fcd9e92d65245c888b7c618d66cfd9f [sys.catalog]: This master's current role is: LEADER
I20251023 07:57:33.306922 16967 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251023 07:57:33.319396 16967 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251023 07:57:33.329711 16888 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20251023 07:57:33.339082 16967 catalog_manager.cc:1357] Generated new cluster ID: e65a4e270e70488593731902472c8116
I20251023 07:57:33.339426 16967 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251023 07:57:33.358794 16967 catalog_manager.cc:1380] Generated new certificate authority record
I20251023 07:57:33.361126 16967 catalog_manager.cc:1514] Loading token signing keys...
I20251023 07:57:33.387610 16967 catalog_manager.cc:6022] T 00000000000000000000000000000000 P 0fcd9e92d65245c888b7c618d66cfd9f: Generated new TSK 0
I20251023 07:57:33.388844 16967 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251023 07:57:33.396499 16888 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251023 07:57:33.405731 16977 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251023 07:57:33.406893 16978 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251023 07:57:33.410192 16980 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251023 07:57:33.410964 16888 server_base.cc:1047] running on GCE node
I20251023 07:57:33.411903 16888 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251023 07:57:33.412187 16888 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251023 07:57:33.412401 16888 hybrid_clock.cc:648] HybridClock initialized: now 1761206253412380 us; error 0 us; skew 500 ppm
I20251023 07:57:33.413220 16888 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20251023 07:57:33.417378 16888 webserver.cc:492] Webserver started at http://127.16.126.1:40921/ using document root <none> and password file <none>
I20251023 07:57:33.418155 16888 fs_manager.cc:362] Metadata directory not provided
I20251023 07:57:33.418414 16888 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251023 07:57:33.418787 16888 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251023 07:57:33.420394 16888 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1761206251627710-16888-0/minicluster-data/ts-0-root/instance:
uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641"
format_stamp: "Formatted at 2025-10-23 07:57:33 on dist-test-slave-m488"
I20251023 07:57:33.427574 16888 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20251023 07:57:33.432904 16985 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251023 07:57:33.433802 16888 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20251023 07:57:33.434170 16888 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1761206251627710-16888-0/minicluster-data/ts-0-root
uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641"
format_stamp: "Formatted at 2025-10-23 07:57:33 on dist-test-slave-m488"
I20251023 07:57:33.434568 16888 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1761206251627710-16888-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1761206251627710-16888-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1761206251627710-16888-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251023 07:57:33.484431 16888 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251023 07:57:33.485911 16888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251023 07:57:33.488807 16888 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251023 07:57:33.493024 16888 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251023 07:57:33.493281 16888 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251023 07:57:33.493557 16888 ts_tablet_manager.cc:616] Registered 0 tablets
I20251023 07:57:33.493753 16888 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251023 07:57:33.596236 16888 rpc_server.cc:307] RPC server started. Bound to: 127.16.126.1:45063
I20251023 07:57:33.596311 17047 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.126.1:45063 every 8 connection(s)
I20251023 07:57:33.603703 16888 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251023 07:57:33.613713 17052 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251023 07:57:33.615522 17053 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251023 07:57:33.626806 17055 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251023 07:57:33.627995 16888 server_base.cc:1047] running on GCE node
I20251023 07:57:33.629043 16888 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251023 07:57:33.629352 16888 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251023 07:57:33.629632 16888 hybrid_clock.cc:648] HybridClock initialized: now 1761206253629616 us; error 0 us; skew 500 ppm
I20251023 07:57:33.630453 16888 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20251023 07:57:33.632539 17048 heartbeater.cc:344] Connected to a master server at 127.16.126.62:34949
I20251023 07:57:33.633025 17048 heartbeater.cc:461] Registering TS with master...
I20251023 07:57:33.633791 16888 webserver.cc:492] Webserver started at http://127.16.126.2:41911/ using document root <none> and password file <none>
I20251023 07:57:33.634353 17048 heartbeater.cc:507] Master 127.16.126.62:34949 requested a full tablet report, sending...
I20251023 07:57:33.634474 16888 fs_manager.cc:362] Metadata directory not provided
I20251023 07:57:33.634727 16888 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251023 07:57:33.635049 16888 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251023 07:57:33.636444 16888 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1761206251627710-16888-0/minicluster-data/ts-1-root/instance:
uuid: "a14159c3f4f3468eb16708bfb6c72677"
format_stamp: "Formatted at 2025-10-23 07:57:33 on dist-test-slave-m488"
I20251023 07:57:33.638048 16920 ts_manager.cc:194] Registered new tserver with Master: 1eca84c8bc4e4fd48a9ec0b5146ea641 (127.16.126.1:45063)
I20251023 07:57:33.641047 16920 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43410
I20251023 07:57:33.642388 16888 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.003s sys 0.002s
I20251023 07:57:33.647765 17060 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251023 07:57:33.648643 16888 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20251023 07:57:33.648912 16888 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1761206251627710-16888-0/minicluster-data/ts-1-root
uuid: "a14159c3f4f3468eb16708bfb6c72677"
format_stamp: "Formatted at 2025-10-23 07:57:33 on dist-test-slave-m488"
I20251023 07:57:33.649188 16888 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1761206251627710-16888-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1761206251627710-16888-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1761206251627710-16888-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251023 07:57:33.664045 16888 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251023 07:57:33.665323 16888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251023 07:57:33.667945 16888 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251023 07:57:33.670904 16888 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251023 07:57:33.671089 16888 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251023 07:57:33.671334 16888 ts_tablet_manager.cc:616] Registered 0 tablets
I20251023 07:57:33.671480 16888 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251023 07:57:33.772485 16888 rpc_server.cc:307] RPC server started. Bound to: 127.16.126.2:38731
I20251023 07:57:33.772861 17122 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.126.2:38731 every 8 connection(s)
I20251023 07:57:33.782419 16888 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251023 07:57:33.790853 17126 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251023 07:57:33.793622 17127 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251023 07:57:33.796515 17123 heartbeater.cc:344] Connected to a master server at 127.16.126.62:34949
I20251023 07:57:33.796923 17123 heartbeater.cc:461] Registering TS with master...
I20251023 07:57:33.797936 17123 heartbeater.cc:507] Master 127.16.126.62:34949 requested a full tablet report, sending...
I20251023 07:57:33.799690 16888 server_base.cc:1047] running on GCE node
W20251023 07:57:33.800590 17129 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251023 07:57:33.800546 16920 ts_manager.cc:194] Registered new tserver with Master: a14159c3f4f3468eb16708bfb6c72677 (127.16.126.2:38731)
I20251023 07:57:33.801656 16888 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251023 07:57:33.801865 16888 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251023 07:57:33.802022 16888 hybrid_clock.cc:648] HybridClock initialized: now 1761206253802007 us; error 0 us; skew 500 ppm
I20251023 07:57:33.802564 16888 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20251023 07:57:33.802596 16920 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43416
I20251023 07:57:33.805830 16888 webserver.cc:492] Webserver started at http://127.16.126.3:37565/ using document root <none> and password file <none>
I20251023 07:57:33.806375 16888 fs_manager.cc:362] Metadata directory not provided
I20251023 07:57:33.806553 16888 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251023 07:57:33.806794 16888 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251023 07:57:33.807945 16888 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1761206251627710-16888-0/minicluster-data/ts-2-root/instance:
uuid: "25102c72ce134bd5a7369eda67c041d2"
format_stamp: "Formatted at 2025-10-23 07:57:33 on dist-test-slave-m488"
I20251023 07:57:33.812580 16888 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20251023 07:57:33.815979 17134 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251023 07:57:33.816886 16888 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20251023 07:57:33.817211 16888 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1761206251627710-16888-0/minicluster-data/ts-2-root
uuid: "25102c72ce134bd5a7369eda67c041d2"
format_stamp: "Formatted at 2025-10-23 07:57:33 on dist-test-slave-m488"
I20251023 07:57:33.817524 16888 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1761206251627710-16888-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1761206251627710-16888-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1761206251627710-16888-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251023 07:57:33.843246 16888 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251023 07:57:33.844487 16888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251023 07:57:33.846108 16888 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251023 07:57:33.849617 16888 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251023 07:57:33.849813 16888 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251023 07:57:33.850040 16888 ts_tablet_manager.cc:616] Registered 0 tablets
I20251023 07:57:33.850190 16888 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251023 07:57:33.949038 16888 rpc_server.cc:307] RPC server started. Bound to: 127.16.126.3:46201
I20251023 07:57:33.949107 17196 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.126.3:46201 every 8 connection(s)
I20251023 07:57:33.965986 17197 heartbeater.cc:344] Connected to a master server at 127.16.126.62:34949
I20251023 07:57:33.966406 17197 heartbeater.cc:461] Registering TS with master...
I20251023 07:57:33.967161 17197 heartbeater.cc:507] Master 127.16.126.62:34949 requested a full tablet report, sending...
I20251023 07:57:33.969110 16920 ts_manager.cc:194] Registered new tserver with Master: 25102c72ce134bd5a7369eda67c041d2 (127.16.126.3:46201)
I20251023 07:57:33.969794 16888 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015735032s
I20251023 07:57:33.970767 16920 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43428
I20251023 07:57:33.974126 16888 test_util.cc:276] Using random seed: -920325548
I20251023 07:57:34.021930 16920 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43440:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251023 07:57:34.025619 16920 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251023 07:57:34.126411 17162 tablet_service.cc:1505] Processing CreateTablet for tablet 734cd185b3ff45c59fa612ff8f546f6a (DEFAULT_TABLE table=test-workload [id=ffc46ba670644352adbfa0501947cf93]), partition=RANGE (key) PARTITION VALUES < 238609294
I20251023 07:57:34.128252 17162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 734cd185b3ff45c59fa612ff8f546f6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:57:34.138687 17160 tablet_service.cc:1505] Processing CreateTablet for tablet 6bc67d2b65d64a338ebcfd3326790173 (DEFAULT_TABLE table=test-workload [id=ffc46ba670644352adbfa0501947cf93]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20251023 07:57:34.140125 17160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bc67d2b65d64a338ebcfd3326790173. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:57:34.140264 17161 tablet_service.cc:1505] Processing CreateTablet for tablet 76bacff5c098439cb18968ff9dee3875 (DEFAULT_TABLE table=test-workload [id=ffc46ba670644352adbfa0501947cf93]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20251023 07:57:34.141687 17161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76bacff5c098439cb18968ff9dee3875. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:57:34.146337 17159 tablet_service.cc:1505] Processing CreateTablet for tablet 08671d08202b46c6b16e0271769eb119 (DEFAULT_TABLE table=test-workload [id=ffc46ba670644352adbfa0501947cf93]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20251023 07:57:34.146538 17158 tablet_service.cc:1505] Processing CreateTablet for tablet 8f48d577e386480a905dc2367cf209ab (DEFAULT_TABLE table=test-workload [id=ffc46ba670644352adbfa0501947cf93]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20251023 07:57:34.147719 17159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08671d08202b46c6b16e0271769eb119. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:57:34.149840 17157 tablet_service.cc:1505] Processing CreateTablet for tablet 01f422ecb29f444098d80a283dd67a53 (DEFAULT_TABLE table=test-workload [id=ffc46ba670644352adbfa0501947cf93]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20251023 07:57:34.150727 17156 tablet_service.cc:1505] Processing CreateTablet for tablet bb55cfe6314c4d27bb86dcaa2bb135a8 (DEFAULT_TABLE table=test-workload [id=ffc46ba670644352adbfa0501947cf93]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20251023 07:57:34.153031 17157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01f422ecb29f444098d80a283dd67a53. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:57:34.154505 17156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb55cfe6314c4d27bb86dcaa2bb135a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:57:34.155611 17158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f48d577e386480a905dc2367cf209ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:57:34.158244 17162 tablet_service.cc:1505] Processing CreateTablet for tablet 621b0ed837604654a4fa0c14a0ca9c60 (DEFAULT_TABLE table=test-workload [id=ffc46ba670644352adbfa0501947cf93]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20251023 07:57:34.158937 17214 tablet_bootstrap.cc:492] T 734cd185b3ff45c59fa612ff8f546f6a P 25102c72ce134bd5a7369eda67c041d2: Bootstrap starting.
I20251023 07:57:34.162747 17162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 621b0ed837604654a4fa0c14a0ca9c60. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:57:34.170320 17013 tablet_service.cc:1505] Processing CreateTablet for tablet 734cd185b3ff45c59fa612ff8f546f6a (DEFAULT_TABLE table=test-workload [id=ffc46ba670644352adbfa0501947cf93]), partition=RANGE (key) PARTITION VALUES < 238609294
I20251023 07:57:34.172420 17155 tablet_service.cc:1505] Processing CreateTablet for tablet 30d4cc48296446b49a4e32822c8be1bf (DEFAULT_TABLE table=test-workload [id=ffc46ba670644352adbfa0501947cf93]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20251023 07:57:34.187644 17009 tablet_service.cc:1505] Processing CreateTablet for tablet 8f48d577e386480a905dc2367cf209ab (DEFAULT_TABLE table=test-workload [id=ffc46ba670644352adbfa0501947cf93]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20251023 07:57:34.181699 17088 tablet_service.cc:1505] Processing CreateTablet for tablet 734cd185b3ff45c59fa612ff8f546f6a (DEFAULT_TABLE table=test-workload [id=ffc46ba670644352adbfa0501947cf93]), partition=RANGE (key) PARTITION VALUES < 238609294
I20251023 07:57:34.187664 17011 tablet_service.cc:1505] Processing CreateTablet for tablet 6bc67d2b65d64a338ebcfd3326790173 (DEFAULT_TABLE table=test-workload [id=ffc46ba670644352adbfa0501947cf93]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20251023 07:57:34.192016 17012 tablet_service.cc:1505] Processing CreateTablet for tablet 76bacff5c098439cb18968ff9dee3875 (DEFAULT_TABLE table=test-workload [id=ffc46ba670644352adbfa0501947cf93]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20251023 07:57:34.195410 17013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 734cd185b3ff45c59fa612ff8f546f6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:57:34.202742 17155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30d4cc48296446b49a4e32822c8be1bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:57:34.202795 17088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 734cd185b3ff45c59fa612ff8f546f6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:57:34.210373 17006 tablet_service.cc:1505] Processing CreateTablet for tablet 621b0ed837604654a4fa0c14a0ca9c60 (DEFAULT_TABLE table=test-workload [id=ffc46ba670644352adbfa0501947cf93]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20251023 07:57:34.200587 17084 tablet_service.cc:1505] Processing CreateTablet for tablet 8f48d577e386480a905dc2367cf209ab (DEFAULT_TABLE table=test-workload [id=ffc46ba670644352adbfa0501947cf93]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20251023 07:57:34.201836 17008 tablet_service.cc:1505] Processing CreateTablet for tablet 01f422ecb29f444098d80a283dd67a53 (DEFAULT_TABLE table=test-workload [id=ffc46ba670644352adbfa0501947cf93]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20251023 07:57:34.216816 17011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bc67d2b65d64a338ebcfd3326790173. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:57:34.219587 17087 tablet_service.cc:1505] Processing CreateTablet for tablet 76bacff5c098439cb18968ff9dee3875 (DEFAULT_TABLE table=test-workload [id=ffc46ba670644352adbfa0501947cf93]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20251023 07:57:34.217268 17010 tablet_service.cc:1505] Processing CreateTablet for tablet 08671d08202b46c6b16e0271769eb119 (DEFAULT_TABLE table=test-workload [id=ffc46ba670644352adbfa0501947cf93]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20251023 07:57:34.231731 17084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f48d577e386480a905dc2367cf209ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:57:34.229012 17007 tablet_service.cc:1505] Processing CreateTablet for tablet bb55cfe6314c4d27bb86dcaa2bb135a8 (DEFAULT_TABLE table=test-workload [id=ffc46ba670644352adbfa0501947cf93]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20251023 07:57:34.213153 17085 tablet_service.cc:1505] Processing CreateTablet for tablet 08671d08202b46c6b16e0271769eb119 (DEFAULT_TABLE table=test-workload [id=ffc46ba670644352adbfa0501947cf93]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20251023 07:57:34.221976 17083 tablet_service.cc:1505] Processing CreateTablet for tablet 01f422ecb29f444098d80a283dd67a53 (DEFAULT_TABLE table=test-workload [id=ffc46ba670644352adbfa0501947cf93]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20251023 07:57:34.238638 17005 tablet_service.cc:1505] Processing CreateTablet for tablet 30d4cc48296446b49a4e32822c8be1bf (DEFAULT_TABLE table=test-workload [id=ffc46ba670644352adbfa0501947cf93]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20251023 07:57:34.237380 17009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f48d577e386480a905dc2367cf209ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:57:34.241065 17080 tablet_service.cc:1505] Processing CreateTablet for tablet 30d4cc48296446b49a4e32822c8be1bf (DEFAULT_TABLE table=test-workload [id=ffc46ba670644352adbfa0501947cf93]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20251023 07:57:34.218488 17086 tablet_service.cc:1505] Processing CreateTablet for tablet 6bc67d2b65d64a338ebcfd3326790173 (DEFAULT_TABLE table=test-workload [id=ffc46ba670644352adbfa0501947cf93]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20251023 07:57:34.240094 17082 tablet_service.cc:1505] Processing CreateTablet for tablet bb55cfe6314c4d27bb86dcaa2bb135a8 (DEFAULT_TABLE table=test-workload [id=ffc46ba670644352adbfa0501947cf93]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20251023 07:57:34.237089 17081 tablet_service.cc:1505] Processing CreateTablet for tablet 621b0ed837604654a4fa0c14a0ca9c60 (DEFAULT_TABLE table=test-workload [id=ffc46ba670644352adbfa0501947cf93]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20251023 07:57:34.246503 17087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76bacff5c098439cb18968ff9dee3875. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:57:34.249648 17010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08671d08202b46c6b16e0271769eb119. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:57:34.248955 17085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08671d08202b46c6b16e0271769eb119. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:57:34.253264 17083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01f422ecb29f444098d80a283dd67a53. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:57:34.258131 17080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30d4cc48296446b49a4e32822c8be1bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:57:34.263859 17008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01f422ecb29f444098d80a283dd67a53. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:57:34.274947 17081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 621b0ed837604654a4fa0c14a0ca9c60. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:57:34.289183 17007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb55cfe6314c4d27bb86dcaa2bb135a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:57:34.303449 17005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30d4cc48296446b49a4e32822c8be1bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:57:34.293880 17086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bc67d2b65d64a338ebcfd3326790173. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:57:34.316594 17006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 621b0ed837604654a4fa0c14a0ca9c60. 1 dirs total, 0 dirs full, 0 dirs failed
W20251023 07:57:34.316110 16968 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20251023 07:57:34.327718 17082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb55cfe6314c4d27bb86dcaa2bb135a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:57:34.331946 17012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76bacff5c098439cb18968ff9dee3875. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:57:34.377136 17214 tablet_bootstrap.cc:654] T 734cd185b3ff45c59fa612ff8f546f6a P 25102c72ce134bd5a7369eda67c041d2: Neither blocks nor log segments found. Creating new log.
I20251023 07:57:34.461606 17216 tablet_bootstrap.cc:492] T 6bc67d2b65d64a338ebcfd3326790173 P 1eca84c8bc4e4fd48a9ec0b5146ea641: Bootstrap starting.
I20251023 07:57:34.467826 17214 tablet_bootstrap.cc:492] T 734cd185b3ff45c59fa612ff8f546f6a P 25102c72ce134bd5a7369eda67c041d2: No bootstrap required, opened a new log
I20251023 07:57:34.468331 17214 ts_tablet_manager.cc:1403] T 734cd185b3ff45c59fa612ff8f546f6a P 25102c72ce134bd5a7369eda67c041d2: Time spent bootstrapping tablet: real 0.318s user 0.008s sys 0.027s
I20251023 07:57:34.470436 17217 tablet_bootstrap.cc:492] T 30d4cc48296446b49a4e32822c8be1bf P a14159c3f4f3468eb16708bfb6c72677: Bootstrap starting.
I20251023 07:57:34.490618 17216 tablet_bootstrap.cc:654] T 6bc67d2b65d64a338ebcfd3326790173 P 1eca84c8bc4e4fd48a9ec0b5146ea641: Neither blocks nor log segments found. Creating new log.
I20251023 07:57:34.491043 17217 tablet_bootstrap.cc:654] T 30d4cc48296446b49a4e32822c8be1bf P a14159c3f4f3468eb16708bfb6c72677: Neither blocks nor log segments found. Creating new log.
I20251023 07:57:34.491789 17214 raft_consensus.cc:359] T 734cd185b3ff45c59fa612ff8f546f6a P 25102c72ce134bd5a7369eda67c041d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } } peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } }
I20251023 07:57:34.492581 17214 raft_consensus.cc:385] T 734cd185b3ff45c59fa612ff8f546f6a P 25102c72ce134bd5a7369eda67c041d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:57:34.492878 17214 raft_consensus.cc:740] T 734cd185b3ff45c59fa612ff8f546f6a P 25102c72ce134bd5a7369eda67c041d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25102c72ce134bd5a7369eda67c041d2, State: Initialized, Role: FOLLOWER
I20251023 07:57:34.493779 17214 consensus_queue.cc:260] T 734cd185b3ff45c59fa612ff8f546f6a P 25102c72ce134bd5a7369eda67c041d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } } peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } }
I20251023 07:57:34.498268 17217 tablet_bootstrap.cc:492] T 30d4cc48296446b49a4e32822c8be1bf P a14159c3f4f3468eb16708bfb6c72677: No bootstrap required, opened a new log
I20251023 07:57:34.498781 17217 ts_tablet_manager.cc:1403] T 30d4cc48296446b49a4e32822c8be1bf P a14159c3f4f3468eb16708bfb6c72677: Time spent bootstrapping tablet: real 0.070s user 0.010s sys 0.003s
I20251023 07:57:34.501801 17217 raft_consensus.cc:359] T 30d4cc48296446b49a4e32822c8be1bf P a14159c3f4f3468eb16708bfb6c72677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:34.502548 17217 raft_consensus.cc:385] T 30d4cc48296446b49a4e32822c8be1bf P a14159c3f4f3468eb16708bfb6c72677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:57:34.502861 17217 raft_consensus.cc:740] T 30d4cc48296446b49a4e32822c8be1bf P a14159c3f4f3468eb16708bfb6c72677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a14159c3f4f3468eb16708bfb6c72677, State: Initialized, Role: FOLLOWER
I20251023 07:57:34.503062 17216 tablet_bootstrap.cc:492] T 6bc67d2b65d64a338ebcfd3326790173 P 1eca84c8bc4e4fd48a9ec0b5146ea641: No bootstrap required, opened a new log
I20251023 07:57:34.503718 17216 ts_tablet_manager.cc:1403] T 6bc67d2b65d64a338ebcfd3326790173 P 1eca84c8bc4e4fd48a9ec0b5146ea641: Time spent bootstrapping tablet: real 0.056s user 0.005s sys 0.013s
I20251023 07:57:34.503620 17217 consensus_queue.cc:260] T 30d4cc48296446b49a4e32822c8be1bf P a14159c3f4f3468eb16708bfb6c72677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:34.506577 17197 heartbeater.cc:499] Master 127.16.126.62:34949 was elected leader, sending a full tablet report...
I20251023 07:57:34.507144 17216 raft_consensus.cc:359] T 6bc67d2b65d64a338ebcfd3326790173 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:34.507990 17216 raft_consensus.cc:385] T 6bc67d2b65d64a338ebcfd3326790173 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:57:34.508294 17216 raft_consensus.cc:740] T 6bc67d2b65d64a338ebcfd3326790173 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1eca84c8bc4e4fd48a9ec0b5146ea641, State: Initialized, Role: FOLLOWER
I20251023 07:57:34.508981 17216 consensus_queue.cc:260] T 6bc67d2b65d64a338ebcfd3326790173 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:34.507198 17214 ts_tablet_manager.cc:1434] T 734cd185b3ff45c59fa612ff8f546f6a P 25102c72ce134bd5a7369eda67c041d2: Time spent starting tablet: real 0.039s user 0.013s sys 0.006s
I20251023 07:57:34.512508 17214 tablet_bootstrap.cc:492] T 6bc67d2b65d64a338ebcfd3326790173 P 25102c72ce134bd5a7369eda67c041d2: Bootstrap starting.
I20251023 07:57:34.517642 17048 heartbeater.cc:499] Master 127.16.126.62:34949 was elected leader, sending a full tablet report...
I20251023 07:57:34.518874 17216 ts_tablet_manager.cc:1434] T 6bc67d2b65d64a338ebcfd3326790173 P 1eca84c8bc4e4fd48a9ec0b5146ea641: Time spent starting tablet: real 0.015s user 0.012s sys 0.002s
I20251023 07:57:34.519876 17216 tablet_bootstrap.cc:492] T 8f48d577e386480a905dc2367cf209ab P 1eca84c8bc4e4fd48a9ec0b5146ea641: Bootstrap starting.
I20251023 07:57:34.520445 17214 tablet_bootstrap.cc:654] T 6bc67d2b65d64a338ebcfd3326790173 P 25102c72ce134bd5a7369eda67c041d2: Neither blocks nor log segments found. Creating new log.
I20251023 07:57:34.527004 17216 tablet_bootstrap.cc:654] T 8f48d577e386480a905dc2367cf209ab P 1eca84c8bc4e4fd48a9ec0b5146ea641: Neither blocks nor log segments found. Creating new log.
I20251023 07:57:34.532261 17217 ts_tablet_manager.cc:1434] T 30d4cc48296446b49a4e32822c8be1bf P a14159c3f4f3468eb16708bfb6c72677: Time spent starting tablet: real 0.033s user 0.008s sys 0.000s
W20251023 07:57:34.532617 17124 tablet.cc:2378] T 30d4cc48296446b49a4e32822c8be1bf P a14159c3f4f3468eb16708bfb6c72677: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251023 07:57:34.533116 17123 heartbeater.cc:499] Master 127.16.126.62:34949 was elected leader, sending a full tablet report...
I20251023 07:57:34.534590 17217 tablet_bootstrap.cc:492] T 621b0ed837604654a4fa0c14a0ca9c60 P a14159c3f4f3468eb16708bfb6c72677: Bootstrap starting.
I20251023 07:57:34.548629 17214 tablet_bootstrap.cc:492] T 6bc67d2b65d64a338ebcfd3326790173 P 25102c72ce134bd5a7369eda67c041d2: No bootstrap required, opened a new log
I20251023 07:57:34.549407 17214 ts_tablet_manager.cc:1403] T 6bc67d2b65d64a338ebcfd3326790173 P 25102c72ce134bd5a7369eda67c041d2: Time spent bootstrapping tablet: real 0.037s user 0.014s sys 0.000s
I20251023 07:57:34.553936 17214 raft_consensus.cc:359] T 6bc67d2b65d64a338ebcfd3326790173 P 25102c72ce134bd5a7369eda67c041d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:34.555037 17214 raft_consensus.cc:385] T 6bc67d2b65d64a338ebcfd3326790173 P 25102c72ce134bd5a7369eda67c041d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:57:34.556413 17217 tablet_bootstrap.cc:654] T 621b0ed837604654a4fa0c14a0ca9c60 P a14159c3f4f3468eb16708bfb6c72677: Neither blocks nor log segments found. Creating new log.
I20251023 07:57:34.555461 17214 raft_consensus.cc:740] T 6bc67d2b65d64a338ebcfd3326790173 P 25102c72ce134bd5a7369eda67c041d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25102c72ce134bd5a7369eda67c041d2, State: Initialized, Role: FOLLOWER
I20251023 07:57:34.559759 17214 consensus_queue.cc:260] T 6bc67d2b65d64a338ebcfd3326790173 P 25102c72ce134bd5a7369eda67c041d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:34.563072 17214 ts_tablet_manager.cc:1434] T 6bc67d2b65d64a338ebcfd3326790173 P 25102c72ce134bd5a7369eda67c041d2: Time spent starting tablet: real 0.013s user 0.007s sys 0.001s
I20251023 07:57:34.564250 17214 tablet_bootstrap.cc:492] T 76bacff5c098439cb18968ff9dee3875 P 25102c72ce134bd5a7369eda67c041d2: Bootstrap starting.
I20251023 07:57:34.567520 17216 tablet_bootstrap.cc:492] T 8f48d577e386480a905dc2367cf209ab P 1eca84c8bc4e4fd48a9ec0b5146ea641: No bootstrap required, opened a new log
I20251023 07:57:34.568058 17216 ts_tablet_manager.cc:1403] T 8f48d577e386480a905dc2367cf209ab P 1eca84c8bc4e4fd48a9ec0b5146ea641: Time spent bootstrapping tablet: real 0.048s user 0.018s sys 0.023s
I20251023 07:57:34.572633 17214 tablet_bootstrap.cc:654] T 76bacff5c098439cb18968ff9dee3875 P 25102c72ce134bd5a7369eda67c041d2: Neither blocks nor log segments found. Creating new log.
I20251023 07:57:34.572937 17216 raft_consensus.cc:359] T 8f48d577e386480a905dc2367cf209ab P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:34.573730 17216 raft_consensus.cc:385] T 8f48d577e386480a905dc2367cf209ab P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:57:34.574052 17216 raft_consensus.cc:740] T 8f48d577e386480a905dc2367cf209ab P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1eca84c8bc4e4fd48a9ec0b5146ea641, State: Initialized, Role: FOLLOWER
I20251023 07:57:34.574767 17216 consensus_queue.cc:260] T 8f48d577e386480a905dc2367cf209ab P 1eca84c8bc4e4fd48a9ec0b5146ea641 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:34.578205 17216 ts_tablet_manager.cc:1434] T 8f48d577e386480a905dc2367cf209ab P 1eca84c8bc4e4fd48a9ec0b5146ea641: Time spent starting tablet: real 0.010s user 0.006s sys 0.002s
I20251023 07:57:34.578785 17217 tablet_bootstrap.cc:492] T 621b0ed837604654a4fa0c14a0ca9c60 P a14159c3f4f3468eb16708bfb6c72677: No bootstrap required, opened a new log
I20251023 07:57:34.579170 17216 tablet_bootstrap.cc:492] T 30d4cc48296446b49a4e32822c8be1bf P 1eca84c8bc4e4fd48a9ec0b5146ea641: Bootstrap starting.
I20251023 07:57:34.579257 17217 ts_tablet_manager.cc:1403] T 621b0ed837604654a4fa0c14a0ca9c60 P a14159c3f4f3468eb16708bfb6c72677: Time spent bootstrapping tablet: real 0.045s user 0.007s sys 0.007s
I20251023 07:57:34.582455 17217 raft_consensus.cc:359] T 621b0ed837604654a4fa0c14a0ca9c60 P a14159c3f4f3468eb16708bfb6c72677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:34.583287 17217 raft_consensus.cc:385] T 621b0ed837604654a4fa0c14a0ca9c60 P a14159c3f4f3468eb16708bfb6c72677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:57:34.583601 17217 raft_consensus.cc:740] T 621b0ed837604654a4fa0c14a0ca9c60 P a14159c3f4f3468eb16708bfb6c72677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a14159c3f4f3468eb16708bfb6c72677, State: Initialized, Role: FOLLOWER
I20251023 07:57:34.584605 17217 consensus_queue.cc:260] T 621b0ed837604654a4fa0c14a0ca9c60 P a14159c3f4f3468eb16708bfb6c72677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:34.586371 17216 tablet_bootstrap.cc:654] T 30d4cc48296446b49a4e32822c8be1bf P 1eca84c8bc4e4fd48a9ec0b5146ea641: Neither blocks nor log segments found. Creating new log.
I20251023 07:57:34.587002 17217 ts_tablet_manager.cc:1434] T 621b0ed837604654a4fa0c14a0ca9c60 P a14159c3f4f3468eb16708bfb6c72677: Time spent starting tablet: real 0.007s user 0.005s sys 0.003s
I20251023 07:57:34.588099 17217 tablet_bootstrap.cc:492] T 76bacff5c098439cb18968ff9dee3875 P a14159c3f4f3468eb16708bfb6c72677: Bootstrap starting.
I20251023 07:57:34.595763 17214 tablet_bootstrap.cc:492] T 76bacff5c098439cb18968ff9dee3875 P 25102c72ce134bd5a7369eda67c041d2: No bootstrap required, opened a new log
I20251023 07:57:34.596071 17217 tablet_bootstrap.cc:654] T 76bacff5c098439cb18968ff9dee3875 P a14159c3f4f3468eb16708bfb6c72677: Neither blocks nor log segments found. Creating new log.
I20251023 07:57:34.596325 17214 ts_tablet_manager.cc:1403] T 76bacff5c098439cb18968ff9dee3875 P 25102c72ce134bd5a7369eda67c041d2: Time spent bootstrapping tablet: real 0.032s user 0.003s sys 0.008s
I20251023 07:57:34.599658 17214 raft_consensus.cc:359] T 76bacff5c098439cb18968ff9dee3875 P 25102c72ce134bd5a7369eda67c041d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:34.600701 17214 raft_consensus.cc:385] T 76bacff5c098439cb18968ff9dee3875 P 25102c72ce134bd5a7369eda67c041d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:57:34.601105 17214 raft_consensus.cc:740] T 76bacff5c098439cb18968ff9dee3875 P 25102c72ce134bd5a7369eda67c041d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25102c72ce134bd5a7369eda67c041d2, State: Initialized, Role: FOLLOWER
I20251023 07:57:34.602070 17214 consensus_queue.cc:260] T 76bacff5c098439cb18968ff9dee3875 P 25102c72ce134bd5a7369eda67c041d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:34.604287 17221 raft_consensus.cc:493] T 621b0ed837604654a4fa0c14a0ca9c60 P a14159c3f4f3468eb16708bfb6c72677 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:57:34.604823 17221 raft_consensus.cc:515] T 621b0ed837604654a4fa0c14a0ca9c60 P a14159c3f4f3468eb16708bfb6c72677 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:34.606740 17214 ts_tablet_manager.cc:1434] T 76bacff5c098439cb18968ff9dee3875 P 25102c72ce134bd5a7369eda67c041d2: Time spent starting tablet: real 0.010s user 0.011s sys 0.000s
I20251023 07:57:34.608183 17214 tablet_bootstrap.cc:492] T 8f48d577e386480a905dc2367cf209ab P 25102c72ce134bd5a7369eda67c041d2: Bootstrap starting.
I20251023 07:57:34.610347 17216 tablet_bootstrap.cc:492] T 30d4cc48296446b49a4e32822c8be1bf P 1eca84c8bc4e4fd48a9ec0b5146ea641: No bootstrap required, opened a new log
I20251023 07:57:34.612044 17220 raft_consensus.cc:493] T 6bc67d2b65d64a338ebcfd3326790173 P 25102c72ce134bd5a7369eda67c041d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:57:34.612378 17221 leader_election.cc:290] T 621b0ed837604654a4fa0c14a0ca9c60 P a14159c3f4f3468eb16708bfb6c72677 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1eca84c8bc4e4fd48a9ec0b5146ea641 (127.16.126.1:45063), 25102c72ce134bd5a7369eda67c041d2 (127.16.126.3:46201)
I20251023 07:57:34.612596 17220 raft_consensus.cc:515] T 6bc67d2b65d64a338ebcfd3326790173 P 25102c72ce134bd5a7369eda67c041d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:34.612085 17216 ts_tablet_manager.cc:1403] T 30d4cc48296446b49a4e32822c8be1bf P 1eca84c8bc4e4fd48a9ec0b5146ea641: Time spent bootstrapping tablet: real 0.033s user 0.014s sys 0.001s
I20251023 07:57:34.617079 17220 leader_election.cc:290] T 6bc67d2b65d64a338ebcfd3326790173 P 25102c72ce134bd5a7369eda67c041d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1eca84c8bc4e4fd48a9ec0b5146ea641 (127.16.126.1:45063), a14159c3f4f3468eb16708bfb6c72677 (127.16.126.2:38731)
I20251023 07:57:34.620492 17216 raft_consensus.cc:359] T 30d4cc48296446b49a4e32822c8be1bf P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:34.621526 17216 raft_consensus.cc:385] T 30d4cc48296446b49a4e32822c8be1bf P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:57:34.621932 17216 raft_consensus.cc:740] T 30d4cc48296446b49a4e32822c8be1bf P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1eca84c8bc4e4fd48a9ec0b5146ea641, State: Initialized, Role: FOLLOWER
I20251023 07:57:34.623677 17216 consensus_queue.cc:260] T 30d4cc48296446b49a4e32822c8be1bf P 1eca84c8bc4e4fd48a9ec0b5146ea641 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:34.626272 17216 ts_tablet_manager.cc:1434] T 30d4cc48296446b49a4e32822c8be1bf P 1eca84c8bc4e4fd48a9ec0b5146ea641: Time spent starting tablet: real 0.010s user 0.004s sys 0.004s
I20251023 07:57:34.627339 17216 tablet_bootstrap.cc:492] T 621b0ed837604654a4fa0c14a0ca9c60 P 1eca84c8bc4e4fd48a9ec0b5146ea641: Bootstrap starting.
I20251023 07:57:34.639096 17222 raft_consensus.cc:493] T 6bc67d2b65d64a338ebcfd3326790173 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:57:34.639688 17222 raft_consensus.cc:515] T 6bc67d2b65d64a338ebcfd3326790173 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:34.641067 17216 tablet_bootstrap.cc:654] T 621b0ed837604654a4fa0c14a0ca9c60 P 1eca84c8bc4e4fd48a9ec0b5146ea641: Neither blocks nor log segments found. Creating new log.
I20251023 07:57:34.642381 17222 leader_election.cc:290] T 6bc67d2b65d64a338ebcfd3326790173 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a14159c3f4f3468eb16708bfb6c72677 (127.16.126.2:38731), 25102c72ce134bd5a7369eda67c041d2 (127.16.126.3:46201)
I20251023 07:57:34.658475 17214 tablet_bootstrap.cc:654] T 8f48d577e386480a905dc2367cf209ab P 25102c72ce134bd5a7369eda67c041d2: Neither blocks nor log segments found. Creating new log.
I20251023 07:57:34.691270 17217 tablet_bootstrap.cc:492] T 76bacff5c098439cb18968ff9dee3875 P a14159c3f4f3468eb16708bfb6c72677: No bootstrap required, opened a new log
I20251023 07:57:34.692023 17217 ts_tablet_manager.cc:1403] T 76bacff5c098439cb18968ff9dee3875 P a14159c3f4f3468eb16708bfb6c72677: Time spent bootstrapping tablet: real 0.104s user 0.007s sys 0.047s
I20251023 07:57:34.709618 17216 tablet_bootstrap.cc:492] T 621b0ed837604654a4fa0c14a0ca9c60 P 1eca84c8bc4e4fd48a9ec0b5146ea641: No bootstrap required, opened a new log
I20251023 07:57:34.710438 17216 ts_tablet_manager.cc:1403] T 621b0ed837604654a4fa0c14a0ca9c60 P 1eca84c8bc4e4fd48a9ec0b5146ea641: Time spent bootstrapping tablet: real 0.083s user 0.023s sys 0.028s
I20251023 07:57:34.714586 17098 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6bc67d2b65d64a338ebcfd3326790173" candidate_uuid: "25102c72ce134bd5a7369eda67c041d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a14159c3f4f3468eb16708bfb6c72677" is_pre_election: true
I20251023 07:57:34.715276 17216 raft_consensus.cc:359] T 621b0ed837604654a4fa0c14a0ca9c60 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:34.716444 17216 raft_consensus.cc:385] T 621b0ed837604654a4fa0c14a0ca9c60 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:57:34.716979 17216 raft_consensus.cc:740] T 621b0ed837604654a4fa0c14a0ca9c60 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1eca84c8bc4e4fd48a9ec0b5146ea641, State: Initialized, Role: FOLLOWER
I20251023 07:57:34.718828 17216 consensus_queue.cc:260] T 621b0ed837604654a4fa0c14a0ca9c60 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
W20251023 07:57:34.723563 17135 leader_election.cc:343] T 6bc67d2b65d64a338ebcfd3326790173 P 25102c72ce134bd5a7369eda67c041d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a14159c3f4f3468eb16708bfb6c72677 (127.16.126.2:38731): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:57:34.727084 17222 raft_consensus.cc:493] T 621b0ed837604654a4fa0c14a0ca9c60 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:57:34.727756 17222 raft_consensus.cc:515] T 621b0ed837604654a4fa0c14a0ca9c60 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:34.731977 17220 raft_consensus.cc:493] T 76bacff5c098439cb18968ff9dee3875 P 25102c72ce134bd5a7369eda67c041d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:57:34.732493 17216 ts_tablet_manager.cc:1434] T 621b0ed837604654a4fa0c14a0ca9c60 P 1eca84c8bc4e4fd48a9ec0b5146ea641: Time spent starting tablet: real 0.021s user 0.007s sys 0.000s
I20251023 07:57:34.733604 17216 tablet_bootstrap.cc:492] T 734cd185b3ff45c59fa612ff8f546f6a P 1eca84c8bc4e4fd48a9ec0b5146ea641: Bootstrap starting.
I20251023 07:57:34.725750 17023 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "621b0ed837604654a4fa0c14a0ca9c60" candidate_uuid: "a14159c3f4f3468eb16708bfb6c72677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" is_pre_election: true
I20251023 07:57:34.734740 17023 raft_consensus.cc:2468] T 621b0ed837604654a4fa0c14a0ca9c60 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a14159c3f4f3468eb16708bfb6c72677 in term 0.
I20251023 07:57:34.732527 17220 raft_consensus.cc:515] T 76bacff5c098439cb18968ff9dee3875 P 25102c72ce134bd5a7369eda67c041d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:34.740600 17220 leader_election.cc:290] T 76bacff5c098439cb18968ff9dee3875 P 25102c72ce134bd5a7369eda67c041d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1eca84c8bc4e4fd48a9ec0b5146ea641 (127.16.126.1:45063), a14159c3f4f3468eb16708bfb6c72677 (127.16.126.2:38731)
I20251023 07:57:34.741081 17221 raft_consensus.cc:493] T 30d4cc48296446b49a4e32822c8be1bf P a14159c3f4f3468eb16708bfb6c72677 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:57:34.741564 17221 raft_consensus.cc:515] T 30d4cc48296446b49a4e32822c8be1bf P a14159c3f4f3468eb16708bfb6c72677 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:34.743391 17221 leader_election.cc:290] T 30d4cc48296446b49a4e32822c8be1bf P a14159c3f4f3468eb16708bfb6c72677 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1eca84c8bc4e4fd48a9ec0b5146ea641 (127.16.126.1:45063), 25102c72ce134bd5a7369eda67c041d2 (127.16.126.3:46201)
I20251023 07:57:34.745047 17098 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "76bacff5c098439cb18968ff9dee3875" candidate_uuid: "25102c72ce134bd5a7369eda67c041d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a14159c3f4f3468eb16708bfb6c72677" is_pre_election: true
I20251023 07:57:34.745625 17216 tablet_bootstrap.cc:654] T 734cd185b3ff45c59fa612ff8f546f6a P 1eca84c8bc4e4fd48a9ec0b5146ea641: Neither blocks nor log segments found. Creating new log.
I20251023 07:57:34.732108 17222 leader_election.cc:290] T 621b0ed837604654a4fa0c14a0ca9c60 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a14159c3f4f3468eb16708bfb6c72677 (127.16.126.2:38731), 25102c72ce134bd5a7369eda67c041d2 (127.16.126.3:46201)
W20251023 07:57:34.747596 17135 leader_election.cc:343] T 76bacff5c098439cb18968ff9dee3875 P 25102c72ce134bd5a7369eda67c041d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a14159c3f4f3468eb16708bfb6c72677 (127.16.126.2:38731): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:57:34.754033 17061 leader_election.cc:304] T 621b0ed837604654a4fa0c14a0ca9c60 P a14159c3f4f3468eb16708bfb6c72677 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1eca84c8bc4e4fd48a9ec0b5146ea641, a14159c3f4f3468eb16708bfb6c72677; no voters:
I20251023 07:57:34.754966 17221 raft_consensus.cc:2804] T 621b0ed837604654a4fa0c14a0ca9c60 P a14159c3f4f3468eb16708bfb6c72677 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:57:34.755332 17221 raft_consensus.cc:493] T 621b0ed837604654a4fa0c14a0ca9c60 P a14159c3f4f3468eb16708bfb6c72677 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:57:34.755636 17221 raft_consensus.cc:3060] T 621b0ed837604654a4fa0c14a0ca9c60 P a14159c3f4f3468eb16708bfb6c72677 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:57:34.759423 17023 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "30d4cc48296446b49a4e32822c8be1bf" candidate_uuid: "a14159c3f4f3468eb16708bfb6c72677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" is_pre_election: true
I20251023 07:57:34.760324 17023 raft_consensus.cc:2468] T 30d4cc48296446b49a4e32822c8be1bf P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a14159c3f4f3468eb16708bfb6c72677 in term 0.
I20251023 07:57:34.757665 17222 raft_consensus.cc:493] T 8f48d577e386480a905dc2367cf209ab P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:57:34.765528 17222 raft_consensus.cc:515] T 8f48d577e386480a905dc2367cf209ab P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:34.767181 17221 raft_consensus.cc:515] T 621b0ed837604654a4fa0c14a0ca9c60 P a14159c3f4f3468eb16708bfb6c72677 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:34.756078 17217 raft_consensus.cc:359] T 76bacff5c098439cb18968ff9dee3875 P a14159c3f4f3468eb16708bfb6c72677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:34.769584 17222 leader_election.cc:290] T 8f48d577e386480a905dc2367cf209ab P 1eca84c8bc4e4fd48a9ec0b5146ea641 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a14159c3f4f3468eb16708bfb6c72677 (127.16.126.2:38731), 25102c72ce134bd5a7369eda67c041d2 (127.16.126.3:46201)
I20251023 07:57:34.769639 17217 raft_consensus.cc:385] T 76bacff5c098439cb18968ff9dee3875 P a14159c3f4f3468eb16708bfb6c72677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:57:34.767769 17098 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6bc67d2b65d64a338ebcfd3326790173" candidate_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a14159c3f4f3468eb16708bfb6c72677" is_pre_election: true
I20251023 07:57:34.770874 17217 raft_consensus.cc:740] T 76bacff5c098439cb18968ff9dee3875 P a14159c3f4f3468eb16708bfb6c72677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a14159c3f4f3468eb16708bfb6c72677, State: Initialized, Role: FOLLOWER
I20251023 07:57:34.775527 17217 consensus_queue.cc:260] T 76bacff5c098439cb18968ff9dee3875 P a14159c3f4f3468eb16708bfb6c72677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:34.770735 17097 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "621b0ed837604654a4fa0c14a0ca9c60" candidate_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a14159c3f4f3468eb16708bfb6c72677" is_pre_election: true
I20251023 07:57:34.778888 17097 raft_consensus.cc:2393] T 621b0ed837604654a4fa0c14a0ca9c60 P a14159c3f4f3468eb16708bfb6c72677 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1eca84c8bc4e4fd48a9ec0b5146ea641 in current term 1: Already voted for candidate a14159c3f4f3468eb16708bfb6c72677 in this term.
I20251023 07:57:34.778530 17061 leader_election.cc:304] T 30d4cc48296446b49a4e32822c8be1bf P a14159c3f4f3468eb16708bfb6c72677 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1eca84c8bc4e4fd48a9ec0b5146ea641, a14159c3f4f3468eb16708bfb6c72677; no voters:
W20251023 07:57:34.786513 16986 leader_election.cc:343] T 6bc67d2b65d64a338ebcfd3326790173 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a14159c3f4f3468eb16708bfb6c72677 (127.16.126.2:38731): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:57:34.787000 17221 leader_election.cc:290] T 621b0ed837604654a4fa0c14a0ca9c60 P a14159c3f4f3468eb16708bfb6c72677 [CANDIDATE]: Term 1 election: Requested vote from peers 1eca84c8bc4e4fd48a9ec0b5146ea641 (127.16.126.1:45063), 25102c72ce134bd5a7369eda67c041d2 (127.16.126.3:46201)
I20251023 07:57:34.795507 17097 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8f48d577e386480a905dc2367cf209ab" candidate_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a14159c3f4f3468eb16708bfb6c72677" is_pre_election: true
I20251023 07:57:34.796106 17221 raft_consensus.cc:2804] T 30d4cc48296446b49a4e32822c8be1bf P a14159c3f4f3468eb16708bfb6c72677 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:57:34.799024 17221 raft_consensus.cc:493] T 30d4cc48296446b49a4e32822c8be1bf P a14159c3f4f3468eb16708bfb6c72677 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:57:34.803737 17221 raft_consensus.cc:3060] T 30d4cc48296446b49a4e32822c8be1bf P a14159c3f4f3468eb16708bfb6c72677 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:57:34.802366 17171 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "30d4cc48296446b49a4e32822c8be1bf" candidate_uuid: "a14159c3f4f3468eb16708bfb6c72677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25102c72ce134bd5a7369eda67c041d2" is_pre_election: true
I20251023 07:57:34.806631 17172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "621b0ed837604654a4fa0c14a0ca9c60" candidate_uuid: "a14159c3f4f3468eb16708bfb6c72677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25102c72ce134bd5a7369eda67c041d2" is_pre_election: true
I20251023 07:57:34.807399 17022 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "76bacff5c098439cb18968ff9dee3875" candidate_uuid: "25102c72ce134bd5a7369eda67c041d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" is_pre_election: true
I20251023 07:57:34.808388 17023 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6bc67d2b65d64a338ebcfd3326790173" candidate_uuid: "25102c72ce134bd5a7369eda67c041d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" is_pre_election: true
I20251023 07:57:34.811899 17023 raft_consensus.cc:2468] T 6bc67d2b65d64a338ebcfd3326790173 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25102c72ce134bd5a7369eda67c041d2 in term 0.
I20251023 07:57:34.815512 17217 ts_tablet_manager.cc:1434] T 76bacff5c098439cb18968ff9dee3875 P a14159c3f4f3468eb16708bfb6c72677: Time spent starting tablet: real 0.123s user 0.014s sys 0.008s
W20251023 07:57:34.813006 16986 leader_election.cc:343] T 8f48d577e386480a905dc2367cf209ab P 1eca84c8bc4e4fd48a9ec0b5146ea641 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a14159c3f4f3468eb16708bfb6c72677 (127.16.126.2:38731): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:57:34.816828 17172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "621b0ed837604654a4fa0c14a0ca9c60" candidate_uuid: "a14159c3f4f3468eb16708bfb6c72677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25102c72ce134bd5a7369eda67c041d2"
I20251023 07:57:34.817586 17217 tablet_bootstrap.cc:492] T 8f48d577e386480a905dc2367cf209ab P a14159c3f4f3468eb16708bfb6c72677: Bootstrap starting.
W20251023 07:57:34.817672 17135 leader_election.cc:343] T 76bacff5c098439cb18968ff9dee3875 P 25102c72ce134bd5a7369eda67c041d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1eca84c8bc4e4fd48a9ec0b5146ea641 (127.16.126.1:45063): Illegal state: must be running to vote when last-logged opid is not known
W20251023 07:57:34.818728 17061 leader_election.cc:343] T 621b0ed837604654a4fa0c14a0ca9c60 P a14159c3f4f3468eb16708bfb6c72677 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25102c72ce134bd5a7369eda67c041d2 (127.16.126.3:46201): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:57:34.817991 17214 tablet_bootstrap.cc:492] T 8f48d577e386480a905dc2367cf209ab P 25102c72ce134bd5a7369eda67c041d2: No bootstrap required, opened a new log
I20251023 07:57:34.818965 17135 leader_election.cc:304] T 76bacff5c098439cb18968ff9dee3875 P 25102c72ce134bd5a7369eda67c041d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25102c72ce134bd5a7369eda67c041d2; no voters: 1eca84c8bc4e4fd48a9ec0b5146ea641, a14159c3f4f3468eb16708bfb6c72677
I20251023 07:57:34.822034 17220 raft_consensus.cc:2749] T 76bacff5c098439cb18968ff9dee3875 P 25102c72ce134bd5a7369eda67c041d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:57:34.822161 17023 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "621b0ed837604654a4fa0c14a0ca9c60" candidate_uuid: "a14159c3f4f3468eb16708bfb6c72677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641"
I20251023 07:57:34.822481 17135 leader_election.cc:304] T 6bc67d2b65d64a338ebcfd3326790173 P 25102c72ce134bd5a7369eda67c041d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1eca84c8bc4e4fd48a9ec0b5146ea641, 25102c72ce134bd5a7369eda67c041d2; no voters: a14159c3f4f3468eb16708bfb6c72677
I20251023 07:57:34.822762 17023 raft_consensus.cc:3060] T 621b0ed837604654a4fa0c14a0ca9c60 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:57:34.823684 17220 raft_consensus.cc:2804] T 6bc67d2b65d64a338ebcfd3326790173 P 25102c72ce134bd5a7369eda67c041d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:57:34.824043 17220 raft_consensus.cc:493] T 6bc67d2b65d64a338ebcfd3326790173 P 25102c72ce134bd5a7369eda67c041d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:57:34.824810 17220 raft_consensus.cc:3060] T 6bc67d2b65d64a338ebcfd3326790173 P 25102c72ce134bd5a7369eda67c041d2 [term 0 FOLLOWER]: Advancing to term 1
W20251023 07:57:34.826551 17061 leader_election.cc:343] T 30d4cc48296446b49a4e32822c8be1bf P a14159c3f4f3468eb16708bfb6c72677 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25102c72ce134bd5a7369eda67c041d2 (127.16.126.3:46201): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:57:34.826007 17214 ts_tablet_manager.cc:1403] T 8f48d577e386480a905dc2367cf209ab P 25102c72ce134bd5a7369eda67c041d2: Time spent bootstrapping tablet: real 0.218s user 0.024s sys 0.052s
I20251023 07:57:34.829027 17216 tablet_bootstrap.cc:492] T 734cd185b3ff45c59fa612ff8f546f6a P 1eca84c8bc4e4fd48a9ec0b5146ea641: No bootstrap required, opened a new log
I20251023 07:57:34.829576 17216 ts_tablet_manager.cc:1403] T 734cd185b3ff45c59fa612ff8f546f6a P 1eca84c8bc4e4fd48a9ec0b5146ea641: Time spent bootstrapping tablet: real 0.096s user 0.017s sys 0.012s
W20251023 07:57:34.829526 17061 leader_election.cc:343] T 621b0ed837604654a4fa0c14a0ca9c60 P a14159c3f4f3468eb16708bfb6c72677 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25102c72ce134bd5a7369eda67c041d2 (127.16.126.3:46201): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:57:34.833107 17172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6bc67d2b65d64a338ebcfd3326790173" candidate_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25102c72ce134bd5a7369eda67c041d2" is_pre_election: true
I20251023 07:57:34.838383 17171 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "621b0ed837604654a4fa0c14a0ca9c60" candidate_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25102c72ce134bd5a7369eda67c041d2" is_pre_election: true
I20251023 07:57:34.839463 17170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8f48d577e386480a905dc2367cf209ab" candidate_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25102c72ce134bd5a7369eda67c041d2" is_pre_election: true
W20251023 07:57:34.842499 16986 leader_election.cc:343] T 621b0ed837604654a4fa0c14a0ca9c60 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25102c72ce134bd5a7369eda67c041d2 (127.16.126.3:46201): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:57:34.842931 16986 leader_election.cc:304] T 621b0ed837604654a4fa0c14a0ca9c60 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1eca84c8bc4e4fd48a9ec0b5146ea641; no voters: 25102c72ce134bd5a7369eda67c041d2, a14159c3f4f3468eb16708bfb6c72677
I20251023 07:57:34.847741 17220 raft_consensus.cc:515] T 6bc67d2b65d64a338ebcfd3326790173 P 25102c72ce134bd5a7369eda67c041d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:34.849112 17244 raft_consensus.cc:493] T 734cd185b3ff45c59fa612ff8f546f6a P 25102c72ce134bd5a7369eda67c041d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:57:34.850143 17172 raft_consensus.cc:2393] T 6bc67d2b65d64a338ebcfd3326790173 P 25102c72ce134bd5a7369eda67c041d2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1eca84c8bc4e4fd48a9ec0b5146ea641 in current term 1: Already voted for candidate 25102c72ce134bd5a7369eda67c041d2 in this term.
I20251023 07:57:34.852710 17217 tablet_bootstrap.cc:654] T 8f48d577e386480a905dc2367cf209ab P a14159c3f4f3468eb16708bfb6c72677: Neither blocks nor log segments found. Creating new log.
I20251023 07:57:34.852607 17023 raft_consensus.cc:2468] T 621b0ed837604654a4fa0c14a0ca9c60 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a14159c3f4f3468eb16708bfb6c72677 in term 1.
I20251023 07:57:34.853175 17222 raft_consensus.cc:2749] T 621b0ed837604654a4fa0c14a0ca9c60 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:57:34.854054 16986 leader_election.cc:304] T 6bc67d2b65d64a338ebcfd3326790173 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1eca84c8bc4e4fd48a9ec0b5146ea641; no voters: 25102c72ce134bd5a7369eda67c041d2, a14159c3f4f3468eb16708bfb6c72677
I20251023 07:57:34.850061 17244 raft_consensus.cc:515] T 734cd185b3ff45c59fa612ff8f546f6a P 25102c72ce134bd5a7369eda67c041d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } } peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } }
I20251023 07:57:34.856377 17216 raft_consensus.cc:359] T 734cd185b3ff45c59fa612ff8f546f6a P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } } peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } }
I20251023 07:57:34.857331 17216 raft_consensus.cc:385] T 734cd185b3ff45c59fa612ff8f546f6a P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:57:34.857679 17222 raft_consensus.cc:3060] T 6bc67d2b65d64a338ebcfd3326790173 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:57:34.857753 17216 raft_consensus.cc:740] T 734cd185b3ff45c59fa612ff8f546f6a P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1eca84c8bc4e4fd48a9ec0b5146ea641, State: Initialized, Role: FOLLOWER
I20251023 07:57:34.858884 17097 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6bc67d2b65d64a338ebcfd3326790173" candidate_uuid: "25102c72ce134bd5a7369eda67c041d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a14159c3f4f3468eb16708bfb6c72677"
W20251023 07:57:34.867404 17135 leader_election.cc:343] T 6bc67d2b65d64a338ebcfd3326790173 P 25102c72ce134bd5a7369eda67c041d2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a14159c3f4f3468eb16708bfb6c72677 (127.16.126.2:38731): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:57:34.849756 17221 raft_consensus.cc:515] T 30d4cc48296446b49a4e32822c8be1bf P a14159c3f4f3468eb16708bfb6c72677 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:34.865984 17220 leader_election.cc:290] T 6bc67d2b65d64a338ebcfd3326790173 P 25102c72ce134bd5a7369eda67c041d2 [CANDIDATE]: Term 1 election: Requested vote from peers 1eca84c8bc4e4fd48a9ec0b5146ea641 (127.16.126.1:45063), a14159c3f4f3468eb16708bfb6c72677 (127.16.126.2:38731)
I20251023 07:57:34.866277 17061 leader_election.cc:304] T 621b0ed837604654a4fa0c14a0ca9c60 P a14159c3f4f3468eb16708bfb6c72677 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1eca84c8bc4e4fd48a9ec0b5146ea641, a14159c3f4f3468eb16708bfb6c72677; no voters: 25102c72ce134bd5a7369eda67c041d2
I20251023 07:57:34.874186 17243 raft_consensus.cc:2804] T 621b0ed837604654a4fa0c14a0ca9c60 P a14159c3f4f3468eb16708bfb6c72677 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:57:34.874286 17214 raft_consensus.cc:359] T 8f48d577e386480a905dc2367cf209ab P 25102c72ce134bd5a7369eda67c041d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:34.875141 17214 raft_consensus.cc:385] T 8f48d577e386480a905dc2367cf209ab P 25102c72ce134bd5a7369eda67c041d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:57:34.875483 17214 raft_consensus.cc:740] T 8f48d577e386480a905dc2367cf209ab P 25102c72ce134bd5a7369eda67c041d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25102c72ce134bd5a7369eda67c041d2, State: Initialized, Role: FOLLOWER
I20251023 07:57:34.875036 17243 raft_consensus.cc:697] T 621b0ed837604654a4fa0c14a0ca9c60 P a14159c3f4f3468eb16708bfb6c72677 [term 1 LEADER]: Becoming Leader. State: Replica: a14159c3f4f3468eb16708bfb6c72677, State: Running, Role: LEADER
I20251023 07:57:34.876211 17214 consensus_queue.cc:260] T 8f48d577e386480a905dc2367cf209ab P 25102c72ce134bd5a7369eda67c041d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:34.876861 17243 consensus_queue.cc:237] T 621b0ed837604654a4fa0c14a0ca9c60 P a14159c3f4f3468eb16708bfb6c72677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:34.877874 17216 consensus_queue.cc:260] T 734cd185b3ff45c59fa612ff8f546f6a P 1eca84c8bc4e4fd48a9ec0b5146ea641 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } } peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } }
I20251023 07:57:34.882477 17214 ts_tablet_manager.cc:1434] T 8f48d577e386480a905dc2367cf209ab P 25102c72ce134bd5a7369eda67c041d2: Time spent starting tablet: real 0.054s user 0.006s sys 0.001s
I20251023 07:57:34.883481 17216 ts_tablet_manager.cc:1434] T 734cd185b3ff45c59fa612ff8f546f6a P 1eca84c8bc4e4fd48a9ec0b5146ea641: Time spent starting tablet: real 0.053s user 0.004s sys 0.003s
I20251023 07:57:34.884656 17221 leader_election.cc:290] T 30d4cc48296446b49a4e32822c8be1bf P a14159c3f4f3468eb16708bfb6c72677 [CANDIDATE]: Term 1 election: Requested vote from peers 1eca84c8bc4e4fd48a9ec0b5146ea641 (127.16.126.1:45063), 25102c72ce134bd5a7369eda67c041d2 (127.16.126.3:46201)
I20251023 07:57:34.886047 17170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "30d4cc48296446b49a4e32822c8be1bf" candidate_uuid: "a14159c3f4f3468eb16708bfb6c72677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25102c72ce134bd5a7369eda67c041d2"
I20251023 07:57:34.887022 17214 tablet_bootstrap.cc:492] T bb55cfe6314c4d27bb86dcaa2bb135a8 P 25102c72ce134bd5a7369eda67c041d2: Bootstrap starting.
W20251023 07:57:34.888430 17061 leader_election.cc:343] T 30d4cc48296446b49a4e32822c8be1bf P a14159c3f4f3468eb16708bfb6c72677 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25102c72ce134bd5a7369eda67c041d2 (127.16.126.3:46201): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:57:34.893846 17244 leader_election.cc:290] T 734cd185b3ff45c59fa612ff8f546f6a P 25102c72ce134bd5a7369eda67c041d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1eca84c8bc4e4fd48a9ec0b5146ea641 (127.16.126.1:45063), a14159c3f4f3468eb16708bfb6c72677 (127.16.126.2:38731)
I20251023 07:57:34.894634 17097 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "734cd185b3ff45c59fa612ff8f546f6a" candidate_uuid: "25102c72ce134bd5a7369eda67c041d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a14159c3f4f3468eb16708bfb6c72677" is_pre_election: true
I20251023 07:57:34.895056 17216 tablet_bootstrap.cc:492] T 08671d08202b46c6b16e0271769eb119 P 1eca84c8bc4e4fd48a9ec0b5146ea641: Bootstrap starting.
W20251023 07:57:34.896128 17135 leader_election.cc:343] T 734cd185b3ff45c59fa612ff8f546f6a P 25102c72ce134bd5a7369eda67c041d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a14159c3f4f3468eb16708bfb6c72677 (127.16.126.2:38731): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:57:34.899699 17222 raft_consensus.cc:2749] T 6bc67d2b65d64a338ebcfd3326790173 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:57:34.908313 17217 tablet_bootstrap.cc:492] T 8f48d577e386480a905dc2367cf209ab P a14159c3f4f3468eb16708bfb6c72677: No bootstrap required, opened a new log
I20251023 07:57:34.909740 17217 ts_tablet_manager.cc:1403] T 8f48d577e386480a905dc2367cf209ab P a14159c3f4f3468eb16708bfb6c72677: Time spent bootstrapping tablet: real 0.093s user 0.022s sys 0.011s
I20251023 07:57:34.913568 17216 tablet_bootstrap.cc:654] T 08671d08202b46c6b16e0271769eb119 P 1eca84c8bc4e4fd48a9ec0b5146ea641: Neither blocks nor log segments found. Creating new log.
W20251023 07:57:34.905665 16986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.126.3:46201, user_credentials={real_user=slave}} blocked reactor thread for 51692.8us
I20251023 07:57:34.916546 17214 tablet_bootstrap.cc:654] T bb55cfe6314c4d27bb86dcaa2bb135a8 P 25102c72ce134bd5a7369eda67c041d2: Neither blocks nor log segments found. Creating new log.
I20251023 07:57:34.916616 17023 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "30d4cc48296446b49a4e32822c8be1bf" candidate_uuid: "a14159c3f4f3468eb16708bfb6c72677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641"
I20251023 07:57:34.916900 17022 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6bc67d2b65d64a338ebcfd3326790173" candidate_uuid: "25102c72ce134bd5a7369eda67c041d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641"
W20251023 07:57:34.917136 16986 leader_election.cc:343] T 8f48d577e386480a905dc2367cf209ab P 1eca84c8bc4e4fd48a9ec0b5146ea641 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25102c72ce134bd5a7369eda67c041d2 (127.16.126.3:46201): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:57:34.917256 17023 raft_consensus.cc:3060] T 30d4cc48296446b49a4e32822c8be1bf P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:57:34.917605 16986 leader_election.cc:304] T 8f48d577e386480a905dc2367cf209ab P 1eca84c8bc4e4fd48a9ec0b5146ea641 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1eca84c8bc4e4fd48a9ec0b5146ea641; no voters: 25102c72ce134bd5a7369eda67c041d2, a14159c3f4f3468eb16708bfb6c72677
I20251023 07:57:34.917963 17021 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "734cd185b3ff45c59fa612ff8f546f6a" candidate_uuid: "25102c72ce134bd5a7369eda67c041d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" is_pre_election: true
I20251023 07:57:34.918619 17245 raft_consensus.cc:2749] T 8f48d577e386480a905dc2367cf209ab P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:57:34.918659 17021 raft_consensus.cc:2468] T 734cd185b3ff45c59fa612ff8f546f6a P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25102c72ce134bd5a7369eda67c041d2 in term 0.
I20251023 07:57:34.921855 17135 leader_election.cc:304] T 734cd185b3ff45c59fa612ff8f546f6a P 25102c72ce134bd5a7369eda67c041d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1eca84c8bc4e4fd48a9ec0b5146ea641, 25102c72ce134bd5a7369eda67c041d2; no voters: a14159c3f4f3468eb16708bfb6c72677
I20251023 07:57:34.922897 17244 raft_consensus.cc:2804] T 734cd185b3ff45c59fa612ff8f546f6a P 25102c72ce134bd5a7369eda67c041d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:57:34.923280 17244 raft_consensus.cc:493] T 734cd185b3ff45c59fa612ff8f546f6a P 25102c72ce134bd5a7369eda67c041d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:57:34.923629 17244 raft_consensus.cc:3060] T 734cd185b3ff45c59fa612ff8f546f6a P 25102c72ce134bd5a7369eda67c041d2 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:57:34.927139 17023 raft_consensus.cc:2468] T 30d4cc48296446b49a4e32822c8be1bf P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a14159c3f4f3468eb16708bfb6c72677 in term 1.
I20251023 07:57:34.930608 17061 leader_election.cc:304] T 30d4cc48296446b49a4e32822c8be1bf P a14159c3f4f3468eb16708bfb6c72677 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1eca84c8bc4e4fd48a9ec0b5146ea641, a14159c3f4f3468eb16708bfb6c72677; no voters: 25102c72ce134bd5a7369eda67c041d2
I20251023 07:57:34.931726 17243 raft_consensus.cc:2804] T 30d4cc48296446b49a4e32822c8be1bf P a14159c3f4f3468eb16708bfb6c72677 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:57:34.932597 17243 raft_consensus.cc:697] T 30d4cc48296446b49a4e32822c8be1bf P a14159c3f4f3468eb16708bfb6c72677 [term 1 LEADER]: Becoming Leader. State: Replica: a14159c3f4f3468eb16708bfb6c72677, State: Running, Role: LEADER
I20251023 07:57:34.928907 17022 raft_consensus.cc:2468] T 6bc67d2b65d64a338ebcfd3326790173 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25102c72ce134bd5a7369eda67c041d2 in term 1.
I20251023 07:57:34.933729 17243 consensus_queue.cc:237] T 30d4cc48296446b49a4e32822c8be1bf P a14159c3f4f3468eb16708bfb6c72677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:34.934618 17135 leader_election.cc:304] T 6bc67d2b65d64a338ebcfd3326790173 P 25102c72ce134bd5a7369eda67c041d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1eca84c8bc4e4fd48a9ec0b5146ea641, 25102c72ce134bd5a7369eda67c041d2; no voters: a14159c3f4f3468eb16708bfb6c72677
I20251023 07:57:34.913404 17217 raft_consensus.cc:359] T 8f48d577e386480a905dc2367cf209ab P a14159c3f4f3468eb16708bfb6c72677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:34.935413 17220 raft_consensus.cc:2804] T 6bc67d2b65d64a338ebcfd3326790173 P 25102c72ce134bd5a7369eda67c041d2 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:57:34.935961 17217 raft_consensus.cc:385] T 8f48d577e386480a905dc2367cf209ab P a14159c3f4f3468eb16708bfb6c72677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:57:34.936319 17217 raft_consensus.cc:740] T 8f48d577e386480a905dc2367cf209ab P a14159c3f4f3468eb16708bfb6c72677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a14159c3f4f3468eb16708bfb6c72677, State: Initialized, Role: FOLLOWER
I20251023 07:57:34.936990 17217 consensus_queue.cc:260] T 8f48d577e386480a905dc2367cf209ab P a14159c3f4f3468eb16708bfb6c72677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:34.939756 17217 ts_tablet_manager.cc:1434] T 8f48d577e386480a905dc2367cf209ab P a14159c3f4f3468eb16708bfb6c72677: Time spent starting tablet: real 0.029s user 0.003s sys 0.002s
I20251023 07:57:34.939932 16918 catalog_manager.cc:5649] T 621b0ed837604654a4fa0c14a0ca9c60 P a14159c3f4f3468eb16708bfb6c72677 reported cstate change: term changed from 0 to 1, leader changed from <none> to a14159c3f4f3468eb16708bfb6c72677 (127.16.126.2). New cstate: current_term: 1 leader_uuid: "a14159c3f4f3468eb16708bfb6c72677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } health_report { overall_health: UNKNOWN } } }
I20251023 07:57:34.941216 17217 tablet_bootstrap.cc:492] T 08671d08202b46c6b16e0271769eb119 P a14159c3f4f3468eb16708bfb6c72677: Bootstrap starting.
I20251023 07:57:34.947461 17214 tablet_bootstrap.cc:492] T bb55cfe6314c4d27bb86dcaa2bb135a8 P 25102c72ce134bd5a7369eda67c041d2: No bootstrap required, opened a new log
I20251023 07:57:34.947937 17214 ts_tablet_manager.cc:1403] T bb55cfe6314c4d27bb86dcaa2bb135a8 P 25102c72ce134bd5a7369eda67c041d2: Time spent bootstrapping tablet: real 0.061s user 0.008s sys 0.006s
I20251023 07:57:34.931442 17244 raft_consensus.cc:515] T 734cd185b3ff45c59fa612ff8f546f6a P 25102c72ce134bd5a7369eda67c041d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } } peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } }
I20251023 07:57:34.953326 17220 raft_consensus.cc:697] T 6bc67d2b65d64a338ebcfd3326790173 P 25102c72ce134bd5a7369eda67c041d2 [term 1 LEADER]: Becoming Leader. State: Replica: 25102c72ce134bd5a7369eda67c041d2, State: Running, Role: LEADER
I20251023 07:57:34.946938 17216 tablet_bootstrap.cc:492] T 08671d08202b46c6b16e0271769eb119 P 1eca84c8bc4e4fd48a9ec0b5146ea641: No bootstrap required, opened a new log
I20251023 07:57:34.954823 17216 ts_tablet_manager.cc:1403] T 08671d08202b46c6b16e0271769eb119 P 1eca84c8bc4e4fd48a9ec0b5146ea641: Time spent bootstrapping tablet: real 0.060s user 0.016s sys 0.010s
I20251023 07:57:34.955041 17220 consensus_queue.cc:237] T 6bc67d2b65d64a338ebcfd3326790173 P 25102c72ce134bd5a7369eda67c041d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:34.960682 17022 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "734cd185b3ff45c59fa612ff8f546f6a" candidate_uuid: "25102c72ce134bd5a7369eda67c041d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641"
I20251023 07:57:34.961500 17022 raft_consensus.cc:3060] T 734cd185b3ff45c59fa612ff8f546f6a P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:57:34.958647 17244 leader_election.cc:290] T 734cd185b3ff45c59fa612ff8f546f6a P 25102c72ce134bd5a7369eda67c041d2 [CANDIDATE]: Term 1 election: Requested vote from peers 1eca84c8bc4e4fd48a9ec0b5146ea641 (127.16.126.1:45063), a14159c3f4f3468eb16708bfb6c72677 (127.16.126.2:38731)
I20251023 07:57:34.960713 17097 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "734cd185b3ff45c59fa612ff8f546f6a" candidate_uuid: "25102c72ce134bd5a7369eda67c041d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a14159c3f4f3468eb16708bfb6c72677"
W20251023 07:57:34.973656 17135 leader_election.cc:343] T 734cd185b3ff45c59fa612ff8f546f6a P 25102c72ce134bd5a7369eda67c041d2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a14159c3f4f3468eb16708bfb6c72677 (127.16.126.2:38731): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:57:34.958228 17216 raft_consensus.cc:359] T 08671d08202b46c6b16e0271769eb119 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:34.976835 17214 raft_consensus.cc:359] T bb55cfe6314c4d27bb86dcaa2bb135a8 P 25102c72ce134bd5a7369eda67c041d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:34.977571 17214 raft_consensus.cc:385] T bb55cfe6314c4d27bb86dcaa2bb135a8 P 25102c72ce134bd5a7369eda67c041d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:57:34.977893 17214 raft_consensus.cc:740] T bb55cfe6314c4d27bb86dcaa2bb135a8 P 25102c72ce134bd5a7369eda67c041d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25102c72ce134bd5a7369eda67c041d2, State: Initialized, Role: FOLLOWER
I20251023 07:57:34.978689 17214 consensus_queue.cc:260] T bb55cfe6314c4d27bb86dcaa2bb135a8 P 25102c72ce134bd5a7369eda67c041d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:34.980351 17022 raft_consensus.cc:2468] T 734cd185b3ff45c59fa612ff8f546f6a P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25102c72ce134bd5a7369eda67c041d2 in term 1.
I20251023 07:57:34.975703 17216 raft_consensus.cc:385] T 08671d08202b46c6b16e0271769eb119 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:57:34.986176 17216 raft_consensus.cc:740] T 08671d08202b46c6b16e0271769eb119 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1eca84c8bc4e4fd48a9ec0b5146ea641, State: Initialized, Role: FOLLOWER
I20251023 07:57:34.986268 17135 leader_election.cc:304] T 734cd185b3ff45c59fa612ff8f546f6a P 25102c72ce134bd5a7369eda67c041d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1eca84c8bc4e4fd48a9ec0b5146ea641, 25102c72ce134bd5a7369eda67c041d2; no voters: a14159c3f4f3468eb16708bfb6c72677
I20251023 07:57:34.987155 17244 raft_consensus.cc:2804] T 734cd185b3ff45c59fa612ff8f546f6a P 25102c72ce134bd5a7369eda67c041d2 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:57:34.986977 17216 consensus_queue.cc:260] T 08671d08202b46c6b16e0271769eb119 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:34.987843 17244 raft_consensus.cc:697] T 734cd185b3ff45c59fa612ff8f546f6a P 25102c72ce134bd5a7369eda67c041d2 [term 1 LEADER]: Becoming Leader. State: Replica: 25102c72ce134bd5a7369eda67c041d2, State: Running, Role: LEADER
I20251023 07:57:34.982312 17214 ts_tablet_manager.cc:1434] T bb55cfe6314c4d27bb86dcaa2bb135a8 P 25102c72ce134bd5a7369eda67c041d2: Time spent starting tablet: real 0.033s user 0.006s sys 0.003s
I20251023 07:57:34.990613 17244 consensus_queue.cc:237] T 734cd185b3ff45c59fa612ff8f546f6a P 25102c72ce134bd5a7369eda67c041d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } } peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } }
I20251023 07:57:34.994905 17214 tablet_bootstrap.cc:492] T 08671d08202b46c6b16e0271769eb119 P 25102c72ce134bd5a7369eda67c041d2: Bootstrap starting.
I20251023 07:57:34.995352 16917 catalog_manager.cc:5649] T 6bc67d2b65d64a338ebcfd3326790173 P 25102c72ce134bd5a7369eda67c041d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25102c72ce134bd5a7369eda67c041d2 (127.16.126.3). New cstate: current_term: 1 leader_uuid: "25102c72ce134bd5a7369eda67c041d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } health_report { overall_health: HEALTHY } } }
I20251023 07:57:34.998660 17216 ts_tablet_manager.cc:1434] T 08671d08202b46c6b16e0271769eb119 P 1eca84c8bc4e4fd48a9ec0b5146ea641: Time spent starting tablet: real 0.044s user 0.009s sys 0.000s
I20251023 07:57:35.002645 17216 tablet_bootstrap.cc:492] T 76bacff5c098439cb18968ff9dee3875 P 1eca84c8bc4e4fd48a9ec0b5146ea641: Bootstrap starting.
I20251023 07:57:35.006110 17217 tablet_bootstrap.cc:654] T 08671d08202b46c6b16e0271769eb119 P a14159c3f4f3468eb16708bfb6c72677: Neither blocks nor log segments found. Creating new log.
I20251023 07:57:35.025770 17214 tablet_bootstrap.cc:654] T 08671d08202b46c6b16e0271769eb119 P 25102c72ce134bd5a7369eda67c041d2: Neither blocks nor log segments found. Creating new log.
I20251023 07:57:35.032711 17216 tablet_bootstrap.cc:654] T 76bacff5c098439cb18968ff9dee3875 P 1eca84c8bc4e4fd48a9ec0b5146ea641: Neither blocks nor log segments found. Creating new log.
I20251023 07:57:35.052029 17214 tablet_bootstrap.cc:492] T 08671d08202b46c6b16e0271769eb119 P 25102c72ce134bd5a7369eda67c041d2: No bootstrap required, opened a new log
I20251023 07:57:35.052553 17214 ts_tablet_manager.cc:1403] T 08671d08202b46c6b16e0271769eb119 P 25102c72ce134bd5a7369eda67c041d2: Time spent bootstrapping tablet: real 0.059s user 0.004s sys 0.013s
I20251023 07:57:35.053994 16920 catalog_manager.cc:5649] T 30d4cc48296446b49a4e32822c8be1bf P a14159c3f4f3468eb16708bfb6c72677 reported cstate change: term changed from 0 to 1, leader changed from <none> to a14159c3f4f3468eb16708bfb6c72677 (127.16.126.2). New cstate: current_term: 1 leader_uuid: "a14159c3f4f3468eb16708bfb6c72677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } health_report { overall_health: UNKNOWN } } }
I20251023 07:57:35.055358 17214 raft_consensus.cc:359] T 08671d08202b46c6b16e0271769eb119 P 25102c72ce134bd5a7369eda67c041d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:35.056056 17214 raft_consensus.cc:385] T 08671d08202b46c6b16e0271769eb119 P 25102c72ce134bd5a7369eda67c041d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:57:35.056353 17214 raft_consensus.cc:740] T 08671d08202b46c6b16e0271769eb119 P 25102c72ce134bd5a7369eda67c041d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25102c72ce134bd5a7369eda67c041d2, State: Initialized, Role: FOLLOWER
I20251023 07:57:35.057116 17214 consensus_queue.cc:260] T 08671d08202b46c6b16e0271769eb119 P 25102c72ce134bd5a7369eda67c041d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:35.061784 17217 tablet_bootstrap.cc:492] T 08671d08202b46c6b16e0271769eb119 P a14159c3f4f3468eb16708bfb6c72677: No bootstrap required, opened a new log
I20251023 07:57:35.062369 17217 ts_tablet_manager.cc:1403] T 08671d08202b46c6b16e0271769eb119 P a14159c3f4f3468eb16708bfb6c72677: Time spent bootstrapping tablet: real 0.121s user 0.012s sys 0.006s
I20251023 07:57:35.068881 17214 ts_tablet_manager.cc:1434] T 08671d08202b46c6b16e0271769eb119 P 25102c72ce134bd5a7369eda67c041d2: Time spent starting tablet: real 0.016s user 0.008s sys 0.000s
I20251023 07:57:35.069068 17217 raft_consensus.cc:359] T 08671d08202b46c6b16e0271769eb119 P a14159c3f4f3468eb16708bfb6c72677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:35.070061 17217 raft_consensus.cc:385] T 08671d08202b46c6b16e0271769eb119 P a14159c3f4f3468eb16708bfb6c72677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:57:35.070559 17217 raft_consensus.cc:740] T 08671d08202b46c6b16e0271769eb119 P a14159c3f4f3468eb16708bfb6c72677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a14159c3f4f3468eb16708bfb6c72677, State: Initialized, Role: FOLLOWER
I20251023 07:57:35.071673 17216 tablet_bootstrap.cc:492] T 76bacff5c098439cb18968ff9dee3875 P 1eca84c8bc4e4fd48a9ec0b5146ea641: No bootstrap required, opened a new log
I20251023 07:57:35.071709 17214 tablet_bootstrap.cc:492] T 01f422ecb29f444098d80a283dd67a53 P 25102c72ce134bd5a7369eda67c041d2: Bootstrap starting.
I20251023 07:57:35.072206 17216 ts_tablet_manager.cc:1403] T 76bacff5c098439cb18968ff9dee3875 P 1eca84c8bc4e4fd48a9ec0b5146ea641: Time spent bootstrapping tablet: real 0.071s user 0.032s sys 0.012s
I20251023 07:57:35.075901 17216 raft_consensus.cc:359] T 76bacff5c098439cb18968ff9dee3875 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:35.076673 17216 raft_consensus.cc:385] T 76bacff5c098439cb18968ff9dee3875 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:57:35.077003 17216 raft_consensus.cc:740] T 76bacff5c098439cb18968ff9dee3875 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1eca84c8bc4e4fd48a9ec0b5146ea641, State: Initialized, Role: FOLLOWER
I20251023 07:57:35.077819 17216 consensus_queue.cc:260] T 76bacff5c098439cb18968ff9dee3875 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:35.077916 17217 consensus_queue.cc:260] T 08671d08202b46c6b16e0271769eb119 P a14159c3f4f3468eb16708bfb6c72677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:35.079561 17214 tablet_bootstrap.cc:654] T 01f422ecb29f444098d80a283dd67a53 P 25102c72ce134bd5a7369eda67c041d2: Neither blocks nor log segments found. Creating new log.
I20251023 07:57:35.077244 16917 catalog_manager.cc:5649] T 734cd185b3ff45c59fa612ff8f546f6a P 25102c72ce134bd5a7369eda67c041d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25102c72ce134bd5a7369eda67c041d2 (127.16.126.3). New cstate: current_term: 1 leader_uuid: "25102c72ce134bd5a7369eda67c041d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } health_report { overall_health: UNKNOWN } } }
I20251023 07:57:35.083207 17216 ts_tablet_manager.cc:1434] T 76bacff5c098439cb18968ff9dee3875 P 1eca84c8bc4e4fd48a9ec0b5146ea641: Time spent starting tablet: real 0.011s user 0.004s sys 0.004s
I20251023 07:57:35.084189 17216 tablet_bootstrap.cc:492] T 01f422ecb29f444098d80a283dd67a53 P 1eca84c8bc4e4fd48a9ec0b5146ea641: Bootstrap starting.
I20251023 07:57:35.086369 17244 raft_consensus.cc:493] T bb55cfe6314c4d27bb86dcaa2bb135a8 P 25102c72ce134bd5a7369eda67c041d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:57:35.086846 17244 raft_consensus.cc:515] T bb55cfe6314c4d27bb86dcaa2bb135a8 P 25102c72ce134bd5a7369eda67c041d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:35.088920 17217 ts_tablet_manager.cc:1434] T 08671d08202b46c6b16e0271769eb119 P a14159c3f4f3468eb16708bfb6c72677: Time spent starting tablet: real 0.026s user 0.006s sys 0.000s
I20251023 07:57:35.090018 17217 tablet_bootstrap.cc:492] T 01f422ecb29f444098d80a283dd67a53 P a14159c3f4f3468eb16708bfb6c72677: Bootstrap starting.
I20251023 07:57:35.090485 17244 leader_election.cc:290] T bb55cfe6314c4d27bb86dcaa2bb135a8 P 25102c72ce134bd5a7369eda67c041d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1eca84c8bc4e4fd48a9ec0b5146ea641 (127.16.126.1:45063), a14159c3f4f3468eb16708bfb6c72677 (127.16.126.2:38731)
I20251023 07:57:35.092656 17022 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bb55cfe6314c4d27bb86dcaa2bb135a8" candidate_uuid: "25102c72ce134bd5a7369eda67c041d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" is_pre_election: true
I20251023 07:57:35.093904 17097 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bb55cfe6314c4d27bb86dcaa2bb135a8" candidate_uuid: "25102c72ce134bd5a7369eda67c041d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a14159c3f4f3468eb16708bfb6c72677" is_pre_election: true
I20251023 07:57:35.096966 17216 tablet_bootstrap.cc:654] T 01f422ecb29f444098d80a283dd67a53 P 1eca84c8bc4e4fd48a9ec0b5146ea641: Neither blocks nor log segments found. Creating new log.
I20251023 07:57:35.100796 17217 tablet_bootstrap.cc:654] T 01f422ecb29f444098d80a283dd67a53 P a14159c3f4f3468eb16708bfb6c72677: Neither blocks nor log segments found. Creating new log.
W20251023 07:57:35.098284 17135 leader_election.cc:343] T bb55cfe6314c4d27bb86dcaa2bb135a8 P 25102c72ce134bd5a7369eda67c041d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a14159c3f4f3468eb16708bfb6c72677 (127.16.126.2:38731): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:57:35.101293 17214 tablet_bootstrap.cc:492] T 01f422ecb29f444098d80a283dd67a53 P 25102c72ce134bd5a7369eda67c041d2: No bootstrap required, opened a new log
W20251023 07:57:35.101644 17135 leader_election.cc:343] T bb55cfe6314c4d27bb86dcaa2bb135a8 P 25102c72ce134bd5a7369eda67c041d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1eca84c8bc4e4fd48a9ec0b5146ea641 (127.16.126.1:45063): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:57:35.101869 17214 ts_tablet_manager.cc:1403] T 01f422ecb29f444098d80a283dd67a53 P 25102c72ce134bd5a7369eda67c041d2: Time spent bootstrapping tablet: real 0.030s user 0.011s sys 0.001s
I20251023 07:57:35.102087 17135 leader_election.cc:304] T bb55cfe6314c4d27bb86dcaa2bb135a8 P 25102c72ce134bd5a7369eda67c041d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25102c72ce134bd5a7369eda67c041d2; no voters: 1eca84c8bc4e4fd48a9ec0b5146ea641, a14159c3f4f3468eb16708bfb6c72677
I20251023 07:57:35.103468 17243 raft_consensus.cc:493] T 76bacff5c098439cb18968ff9dee3875 P a14159c3f4f3468eb16708bfb6c72677 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:57:35.104005 17243 raft_consensus.cc:515] T 76bacff5c098439cb18968ff9dee3875 P a14159c3f4f3468eb16708bfb6c72677 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:35.106103 17243 leader_election.cc:290] T 76bacff5c098439cb18968ff9dee3875 P a14159c3f4f3468eb16708bfb6c72677 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1eca84c8bc4e4fd48a9ec0b5146ea641 (127.16.126.1:45063), 25102c72ce134bd5a7369eda67c041d2 (127.16.126.3:46201)
I20251023 07:57:35.105976 17214 raft_consensus.cc:359] T 01f422ecb29f444098d80a283dd67a53 P 25102c72ce134bd5a7369eda67c041d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:35.106783 17214 raft_consensus.cc:385] T 01f422ecb29f444098d80a283dd67a53 P 25102c72ce134bd5a7369eda67c041d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:57:35.107115 17214 raft_consensus.cc:740] T 01f422ecb29f444098d80a283dd67a53 P 25102c72ce134bd5a7369eda67c041d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25102c72ce134bd5a7369eda67c041d2, State: Initialized, Role: FOLLOWER
I20251023 07:57:35.108134 17170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "76bacff5c098439cb18968ff9dee3875" candidate_uuid: "a14159c3f4f3468eb16708bfb6c72677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25102c72ce134bd5a7369eda67c041d2" is_pre_election: true
I20251023 07:57:35.107882 17214 consensus_queue.cc:260] T 01f422ecb29f444098d80a283dd67a53 P 25102c72ce134bd5a7369eda67c041d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:35.108808 17170 raft_consensus.cc:2468] T 76bacff5c098439cb18968ff9dee3875 P 25102c72ce134bd5a7369eda67c041d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a14159c3f4f3468eb16708bfb6c72677 in term 0.
I20251023 07:57:35.109997 17220 raft_consensus.cc:2749] T bb55cfe6314c4d27bb86dcaa2bb135a8 P 25102c72ce134bd5a7369eda67c041d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:57:35.110538 17214 ts_tablet_manager.cc:1434] T 01f422ecb29f444098d80a283dd67a53 P 25102c72ce134bd5a7369eda67c041d2: Time spent starting tablet: real 0.008s user 0.006s sys 0.002s
I20251023 07:57:35.111498 17022 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "76bacff5c098439cb18968ff9dee3875" candidate_uuid: "a14159c3f4f3468eb16708bfb6c72677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" is_pre_election: true
I20251023 07:57:35.111934 17214 tablet_bootstrap.cc:492] T 30d4cc48296446b49a4e32822c8be1bf P 25102c72ce134bd5a7369eda67c041d2: Bootstrap starting.
I20251023 07:57:35.112102 17022 raft_consensus.cc:2468] T 76bacff5c098439cb18968ff9dee3875 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a14159c3f4f3468eb16708bfb6c72677 in term 0.
I20251023 07:57:35.110725 17061 leader_election.cc:304] T 76bacff5c098439cb18968ff9dee3875 P a14159c3f4f3468eb16708bfb6c72677 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25102c72ce134bd5a7369eda67c041d2, a14159c3f4f3468eb16708bfb6c72677; no voters:
I20251023 07:57:35.113745 17221 raft_consensus.cc:2804] T 76bacff5c098439cb18968ff9dee3875 P a14159c3f4f3468eb16708bfb6c72677 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:57:35.114086 17221 raft_consensus.cc:493] T 76bacff5c098439cb18968ff9dee3875 P a14159c3f4f3468eb16708bfb6c72677 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:57:35.114431 17221 raft_consensus.cc:3060] T 76bacff5c098439cb18968ff9dee3875 P a14159c3f4f3468eb16708bfb6c72677 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:57:35.114302 17243 raft_consensus.cc:493] T 8f48d577e386480a905dc2367cf209ab P a14159c3f4f3468eb16708bfb6c72677 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:57:35.115166 17243 raft_consensus.cc:515] T 8f48d577e386480a905dc2367cf209ab P a14159c3f4f3468eb16708bfb6c72677 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:35.118781 17214 tablet_bootstrap.cc:654] T 30d4cc48296446b49a4e32822c8be1bf P 25102c72ce134bd5a7369eda67c041d2: Neither blocks nor log segments found. Creating new log.
I20251023 07:57:35.121317 17221 raft_consensus.cc:515] T 76bacff5c098439cb18968ff9dee3875 P a14159c3f4f3468eb16708bfb6c72677 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:35.121361 17022 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8f48d577e386480a905dc2367cf209ab" candidate_uuid: "a14159c3f4f3468eb16708bfb6c72677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" is_pre_election: true
I20251023 07:57:35.122692 17022 raft_consensus.cc:2468] T 8f48d577e386480a905dc2367cf209ab P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a14159c3f4f3468eb16708bfb6c72677 in term 0.
I20251023 07:57:35.123250 17221 leader_election.cc:290] T 76bacff5c098439cb18968ff9dee3875 P a14159c3f4f3468eb16708bfb6c72677 [CANDIDATE]: Term 1 election: Requested vote from peers 1eca84c8bc4e4fd48a9ec0b5146ea641 (127.16.126.1:45063), 25102c72ce134bd5a7369eda67c041d2 (127.16.126.3:46201)
I20251023 07:57:35.124994 17170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "76bacff5c098439cb18968ff9dee3875" candidate_uuid: "a14159c3f4f3468eb16708bfb6c72677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25102c72ce134bd5a7369eda67c041d2"
I20251023 07:57:35.127483 17170 raft_consensus.cc:3060] T 76bacff5c098439cb18968ff9dee3875 P 25102c72ce134bd5a7369eda67c041d2 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:57:35.126494 17023 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "76bacff5c098439cb18968ff9dee3875" candidate_uuid: "a14159c3f4f3468eb16708bfb6c72677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641"
I20251023 07:57:35.129736 17023 raft_consensus.cc:3060] T 76bacff5c098439cb18968ff9dee3875 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:57:35.130117 17214 tablet_bootstrap.cc:492] T 30d4cc48296446b49a4e32822c8be1bf P 25102c72ce134bd5a7369eda67c041d2: No bootstrap required, opened a new log
I20251023 07:57:35.130571 17214 ts_tablet_manager.cc:1403] T 30d4cc48296446b49a4e32822c8be1bf P 25102c72ce134bd5a7369eda67c041d2: Time spent bootstrapping tablet: real 0.019s user 0.017s sys 0.000s
I20251023 07:57:35.133800 17214 raft_consensus.cc:359] T 30d4cc48296446b49a4e32822c8be1bf P 25102c72ce134bd5a7369eda67c041d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:35.134512 17214 raft_consensus.cc:385] T 30d4cc48296446b49a4e32822c8be1bf P 25102c72ce134bd5a7369eda67c041d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:57:35.134778 17214 raft_consensus.cc:740] T 30d4cc48296446b49a4e32822c8be1bf P 25102c72ce134bd5a7369eda67c041d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25102c72ce134bd5a7369eda67c041d2, State: Initialized, Role: FOLLOWER
I20251023 07:57:35.135538 17214 consensus_queue.cc:260] T 30d4cc48296446b49a4e32822c8be1bf P 25102c72ce134bd5a7369eda67c041d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:35.135937 17061 leader_election.cc:304] T 8f48d577e386480a905dc2367cf209ab P a14159c3f4f3468eb16708bfb6c72677 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1eca84c8bc4e4fd48a9ec0b5146ea641, a14159c3f4f3468eb16708bfb6c72677; no voters:
I20251023 07:57:35.137290 17221 raft_consensus.cc:2804] T 8f48d577e386480a905dc2367cf209ab P a14159c3f4f3468eb16708bfb6c72677 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:57:35.137683 17221 raft_consensus.cc:493] T 8f48d577e386480a905dc2367cf209ab P a14159c3f4f3468eb16708bfb6c72677 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:57:35.137818 17214 ts_tablet_manager.cc:1434] T 30d4cc48296446b49a4e32822c8be1bf P 25102c72ce134bd5a7369eda67c041d2: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20251023 07:57:35.138160 17221 raft_consensus.cc:3060] T 8f48d577e386480a905dc2367cf209ab P a14159c3f4f3468eb16708bfb6c72677 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:57:35.138772 17214 tablet_bootstrap.cc:492] T 621b0ed837604654a4fa0c14a0ca9c60 P 25102c72ce134bd5a7369eda67c041d2: Bootstrap starting.
I20251023 07:57:35.145788 17214 tablet_bootstrap.cc:654] T 621b0ed837604654a4fa0c14a0ca9c60 P 25102c72ce134bd5a7369eda67c041d2: Neither blocks nor log segments found. Creating new log.
I20251023 07:57:35.150978 17023 raft_consensus.cc:2468] T 76bacff5c098439cb18968ff9dee3875 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a14159c3f4f3468eb16708bfb6c72677 in term 1.
I20251023 07:57:35.152209 17243 leader_election.cc:290] T 8f48d577e386480a905dc2367cf209ab P a14159c3f4f3468eb16708bfb6c72677 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1eca84c8bc4e4fd48a9ec0b5146ea641 (127.16.126.1:45063), 25102c72ce134bd5a7369eda67c041d2 (127.16.126.3:46201)
I20251023 07:57:35.154888 17170 raft_consensus.cc:2468] T 76bacff5c098439cb18968ff9dee3875 P 25102c72ce134bd5a7369eda67c041d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a14159c3f4f3468eb16708bfb6c72677 in term 1.
I20251023 07:57:35.153523 17172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8f48d577e386480a905dc2367cf209ab" candidate_uuid: "a14159c3f4f3468eb16708bfb6c72677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25102c72ce134bd5a7369eda67c041d2" is_pre_election: true
I20251023 07:57:35.156262 17214 tablet_bootstrap.cc:492] T 621b0ed837604654a4fa0c14a0ca9c60 P 25102c72ce134bd5a7369eda67c041d2: No bootstrap required, opened a new log
I20251023 07:57:35.155974 17172 raft_consensus.cc:2468] T 8f48d577e386480a905dc2367cf209ab P 25102c72ce134bd5a7369eda67c041d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a14159c3f4f3468eb16708bfb6c72677 in term 0.
I20251023 07:57:35.156780 17214 ts_tablet_manager.cc:1403] T 621b0ed837604654a4fa0c14a0ca9c60 P 25102c72ce134bd5a7369eda67c041d2: Time spent bootstrapping tablet: real 0.018s user 0.011s sys 0.000s
I20251023 07:57:35.156142 17061 leader_election.cc:304] T 76bacff5c098439cb18968ff9dee3875 P a14159c3f4f3468eb16708bfb6c72677 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1eca84c8bc4e4fd48a9ec0b5146ea641, a14159c3f4f3468eb16708bfb6c72677; no voters:
I20251023 07:57:35.159695 17214 raft_consensus.cc:359] T 621b0ed837604654a4fa0c14a0ca9c60 P 25102c72ce134bd5a7369eda67c041d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:35.160365 17214 raft_consensus.cc:385] T 621b0ed837604654a4fa0c14a0ca9c60 P 25102c72ce134bd5a7369eda67c041d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:57:35.160630 17214 raft_consensus.cc:740] T 621b0ed837604654a4fa0c14a0ca9c60 P 25102c72ce134bd5a7369eda67c041d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25102c72ce134bd5a7369eda67c041d2, State: Initialized, Role: FOLLOWER
I20251023 07:57:35.160936 17243 raft_consensus.cc:2804] T 76bacff5c098439cb18968ff9dee3875 P a14159c3f4f3468eb16708bfb6c72677 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:57:35.161309 17214 consensus_queue.cc:260] T 621b0ed837604654a4fa0c14a0ca9c60 P 25102c72ce134bd5a7369eda67c041d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:35.163903 17214 ts_tablet_manager.cc:1434] T 621b0ed837604654a4fa0c14a0ca9c60 P 25102c72ce134bd5a7369eda67c041d2: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20251023 07:57:35.161743 17243 raft_consensus.cc:697] T 76bacff5c098439cb18968ff9dee3875 P a14159c3f4f3468eb16708bfb6c72677 [term 1 LEADER]: Becoming Leader. State: Replica: a14159c3f4f3468eb16708bfb6c72677, State: Running, Role: LEADER
I20251023 07:57:35.166316 17243 consensus_queue.cc:237] T 76bacff5c098439cb18968ff9dee3875 P a14159c3f4f3468eb16708bfb6c72677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:35.170114 17216 tablet_bootstrap.cc:492] T 01f422ecb29f444098d80a283dd67a53 P 1eca84c8bc4e4fd48a9ec0b5146ea641: No bootstrap required, opened a new log
I20251023 07:57:35.170588 17216 ts_tablet_manager.cc:1403] T 01f422ecb29f444098d80a283dd67a53 P 1eca84c8bc4e4fd48a9ec0b5146ea641: Time spent bootstrapping tablet: real 0.087s user 0.013s sys 0.015s
I20251023 07:57:35.171072 17221 raft_consensus.cc:515] T 8f48d577e386480a905dc2367cf209ab P a14159c3f4f3468eb16708bfb6c72677 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:35.173069 17221 leader_election.cc:290] T 8f48d577e386480a905dc2367cf209ab P a14159c3f4f3468eb16708bfb6c72677 [CANDIDATE]: Term 1 election: Requested vote from peers 1eca84c8bc4e4fd48a9ec0b5146ea641 (127.16.126.1:45063), 25102c72ce134bd5a7369eda67c041d2 (127.16.126.3:46201)
I20251023 07:57:35.174188 17023 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8f48d577e386480a905dc2367cf209ab" candidate_uuid: "a14159c3f4f3468eb16708bfb6c72677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641"
I20251023 07:57:35.174755 17023 raft_consensus.cc:3060] T 8f48d577e386480a905dc2367cf209ab P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:57:35.182250 17170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8f48d577e386480a905dc2367cf209ab" candidate_uuid: "a14159c3f4f3468eb16708bfb6c72677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25102c72ce134bd5a7369eda67c041d2"
I20251023 07:57:35.182207 17216 raft_consensus.cc:359] T 01f422ecb29f444098d80a283dd67a53 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:35.183060 17170 raft_consensus.cc:3060] T 8f48d577e386480a905dc2367cf209ab P 25102c72ce134bd5a7369eda67c041d2 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:57:35.183599 17216 raft_consensus.cc:385] T 01f422ecb29f444098d80a283dd67a53 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:57:35.184074 17216 raft_consensus.cc:740] T 01f422ecb29f444098d80a283dd67a53 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1eca84c8bc4e4fd48a9ec0b5146ea641, State: Initialized, Role: FOLLOWER
I20251023 07:57:35.184994 17216 consensus_queue.cc:260] T 01f422ecb29f444098d80a283dd67a53 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:35.187713 17216 ts_tablet_manager.cc:1434] T 01f422ecb29f444098d80a283dd67a53 P 1eca84c8bc4e4fd48a9ec0b5146ea641: Time spent starting tablet: real 0.017s user 0.007s sys 0.000s
I20251023 07:57:35.188755 17216 tablet_bootstrap.cc:492] T bb55cfe6314c4d27bb86dcaa2bb135a8 P 1eca84c8bc4e4fd48a9ec0b5146ea641: Bootstrap starting.
I20251023 07:57:35.191488 17170 raft_consensus.cc:2468] T 8f48d577e386480a905dc2367cf209ab P 25102c72ce134bd5a7369eda67c041d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a14159c3f4f3468eb16708bfb6c72677 in term 1.
I20251023 07:57:35.190549 17217 tablet_bootstrap.cc:492] T 01f422ecb29f444098d80a283dd67a53 P a14159c3f4f3468eb16708bfb6c72677: No bootstrap required, opened a new log
I20251023 07:57:35.192293 17217 ts_tablet_manager.cc:1403] T 01f422ecb29f444098d80a283dd67a53 P a14159c3f4f3468eb16708bfb6c72677: Time spent bootstrapping tablet: real 0.102s user 0.023s sys 0.016s
I20251023 07:57:35.192626 17061 leader_election.cc:304] T 8f48d577e386480a905dc2367cf209ab P a14159c3f4f3468eb16708bfb6c72677 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25102c72ce134bd5a7369eda67c041d2, a14159c3f4f3468eb16708bfb6c72677; no voters:
I20251023 07:57:35.193504 17221 raft_consensus.cc:2804] T 8f48d577e386480a905dc2367cf209ab P a14159c3f4f3468eb16708bfb6c72677 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:57:35.194116 17221 raft_consensus.cc:697] T 8f48d577e386480a905dc2367cf209ab P a14159c3f4f3468eb16708bfb6c72677 [term 1 LEADER]: Becoming Leader. State: Replica: a14159c3f4f3468eb16708bfb6c72677, State: Running, Role: LEADER
I20251023 07:57:35.194929 17221 consensus_queue.cc:237] T 8f48d577e386480a905dc2367cf209ab P a14159c3f4f3468eb16708bfb6c72677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:35.182266 17023 raft_consensus.cc:2468] T 8f48d577e386480a905dc2367cf209ab P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a14159c3f4f3468eb16708bfb6c72677 in term 1.
I20251023 07:57:35.207652 17217 raft_consensus.cc:359] T 01f422ecb29f444098d80a283dd67a53 P a14159c3f4f3468eb16708bfb6c72677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:35.208737 17217 raft_consensus.cc:385] T 01f422ecb29f444098d80a283dd67a53 P a14159c3f4f3468eb16708bfb6c72677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:57:35.208997 17217 raft_consensus.cc:740] T 01f422ecb29f444098d80a283dd67a53 P a14159c3f4f3468eb16708bfb6c72677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a14159c3f4f3468eb16708bfb6c72677, State: Initialized, Role: FOLLOWER
I20251023 07:57:35.209663 17217 consensus_queue.cc:260] T 01f422ecb29f444098d80a283dd67a53 P a14159c3f4f3468eb16708bfb6c72677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:35.210389 16917 catalog_manager.cc:5649] T 76bacff5c098439cb18968ff9dee3875 P a14159c3f4f3468eb16708bfb6c72677 reported cstate change: term changed from 0 to 1, leader changed from <none> to a14159c3f4f3468eb16708bfb6c72677 (127.16.126.2). New cstate: current_term: 1 leader_uuid: "a14159c3f4f3468eb16708bfb6c72677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } health_report { overall_health: UNKNOWN } } }
I20251023 07:57:35.212169 17217 ts_tablet_manager.cc:1434] T 01f422ecb29f444098d80a283dd67a53 P a14159c3f4f3468eb16708bfb6c72677: Time spent starting tablet: real 0.019s user 0.000s sys 0.005s
I20251023 07:57:35.213125 17217 tablet_bootstrap.cc:492] T 734cd185b3ff45c59fa612ff8f546f6a P a14159c3f4f3468eb16708bfb6c72677: Bootstrap starting.
I20251023 07:57:35.213495 17216 tablet_bootstrap.cc:654] T bb55cfe6314c4d27bb86dcaa2bb135a8 P 1eca84c8bc4e4fd48a9ec0b5146ea641: Neither blocks nor log segments found. Creating new log.
I20251023 07:57:35.221014 17217 tablet_bootstrap.cc:654] T 734cd185b3ff45c59fa612ff8f546f6a P a14159c3f4f3468eb16708bfb6c72677: Neither blocks nor log segments found. Creating new log.
I20251023 07:57:35.224153 17216 tablet_bootstrap.cc:492] T bb55cfe6314c4d27bb86dcaa2bb135a8 P 1eca84c8bc4e4fd48a9ec0b5146ea641: No bootstrap required, opened a new log
I20251023 07:57:35.224746 17216 ts_tablet_manager.cc:1403] T bb55cfe6314c4d27bb86dcaa2bb135a8 P 1eca84c8bc4e4fd48a9ec0b5146ea641: Time spent bootstrapping tablet: real 0.036s user 0.013s sys 0.004s
I20251023 07:57:35.227671 16919 catalog_manager.cc:5649] T 8f48d577e386480a905dc2367cf209ab P a14159c3f4f3468eb16708bfb6c72677 reported cstate change: term changed from 0 to 1, leader changed from <none> to a14159c3f4f3468eb16708bfb6c72677 (127.16.126.2). New cstate: current_term: 1 leader_uuid: "a14159c3f4f3468eb16708bfb6c72677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } health_report { overall_health: UNKNOWN } } }
I20251023 07:57:35.228180 17216 raft_consensus.cc:359] T bb55cfe6314c4d27bb86dcaa2bb135a8 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:35.229127 17216 raft_consensus.cc:385] T bb55cfe6314c4d27bb86dcaa2bb135a8 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:57:35.229527 17216 raft_consensus.cc:740] T bb55cfe6314c4d27bb86dcaa2bb135a8 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1eca84c8bc4e4fd48a9ec0b5146ea641, State: Initialized, Role: FOLLOWER
I20251023 07:57:35.230530 17216 consensus_queue.cc:260] T bb55cfe6314c4d27bb86dcaa2bb135a8 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:35.233650 17217 tablet_bootstrap.cc:492] T 734cd185b3ff45c59fa612ff8f546f6a P a14159c3f4f3468eb16708bfb6c72677: No bootstrap required, opened a new log
I20251023 07:57:35.234141 17217 ts_tablet_manager.cc:1403] T 734cd185b3ff45c59fa612ff8f546f6a P a14159c3f4f3468eb16708bfb6c72677: Time spent bootstrapping tablet: real 0.021s user 0.008s sys 0.011s
I20251023 07:57:35.235528 17216 ts_tablet_manager.cc:1434] T bb55cfe6314c4d27bb86dcaa2bb135a8 P 1eca84c8bc4e4fd48a9ec0b5146ea641: Time spent starting tablet: real 0.010s user 0.006s sys 0.000s
I20251023 07:57:35.236958 17217 raft_consensus.cc:359] T 734cd185b3ff45c59fa612ff8f546f6a P a14159c3f4f3468eb16708bfb6c72677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } } peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } }
I20251023 07:57:35.237762 17217 raft_consensus.cc:385] T 734cd185b3ff45c59fa612ff8f546f6a P a14159c3f4f3468eb16708bfb6c72677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:57:35.238050 17217 raft_consensus.cc:740] T 734cd185b3ff45c59fa612ff8f546f6a P a14159c3f4f3468eb16708bfb6c72677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a14159c3f4f3468eb16708bfb6c72677, State: Initialized, Role: FOLLOWER
I20251023 07:57:35.238896 17217 consensus_queue.cc:260] T 734cd185b3ff45c59fa612ff8f546f6a P a14159c3f4f3468eb16708bfb6c72677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } } peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } }
I20251023 07:57:35.240918 17217 ts_tablet_manager.cc:1434] T 734cd185b3ff45c59fa612ff8f546f6a P a14159c3f4f3468eb16708bfb6c72677: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20251023 07:57:35.241844 17217 tablet_bootstrap.cc:492] T 6bc67d2b65d64a338ebcfd3326790173 P a14159c3f4f3468eb16708bfb6c72677: Bootstrap starting.
I20251023 07:57:35.249153 17217 tablet_bootstrap.cc:654] T 6bc67d2b65d64a338ebcfd3326790173 P a14159c3f4f3468eb16708bfb6c72677: Neither blocks nor log segments found. Creating new log.
I20251023 07:57:35.254037 17217 tablet_bootstrap.cc:492] T 6bc67d2b65d64a338ebcfd3326790173 P a14159c3f4f3468eb16708bfb6c72677: No bootstrap required, opened a new log
I20251023 07:57:35.254411 17217 ts_tablet_manager.cc:1403] T 6bc67d2b65d64a338ebcfd3326790173 P a14159c3f4f3468eb16708bfb6c72677: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.005s
I20251023 07:57:35.256132 17217 raft_consensus.cc:359] T 6bc67d2b65d64a338ebcfd3326790173 P a14159c3f4f3468eb16708bfb6c72677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:35.256618 17217 raft_consensus.cc:385] T 6bc67d2b65d64a338ebcfd3326790173 P a14159c3f4f3468eb16708bfb6c72677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:57:35.256814 17217 raft_consensus.cc:740] T 6bc67d2b65d64a338ebcfd3326790173 P a14159c3f4f3468eb16708bfb6c72677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a14159c3f4f3468eb16708bfb6c72677, State: Initialized, Role: FOLLOWER
I20251023 07:57:35.257361 17217 consensus_queue.cc:260] T 6bc67d2b65d64a338ebcfd3326790173 P a14159c3f4f3468eb16708bfb6c72677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:35.259148 17217 ts_tablet_manager.cc:1434] T 6bc67d2b65d64a338ebcfd3326790173 P a14159c3f4f3468eb16708bfb6c72677: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20251023 07:57:35.260138 17217 tablet_bootstrap.cc:492] T bb55cfe6314c4d27bb86dcaa2bb135a8 P a14159c3f4f3468eb16708bfb6c72677: Bootstrap starting.
I20251023 07:57:35.264174 17217 tablet_bootstrap.cc:654] T bb55cfe6314c4d27bb86dcaa2bb135a8 P a14159c3f4f3468eb16708bfb6c72677: Neither blocks nor log segments found. Creating new log.
I20251023 07:57:35.268905 17217 tablet_bootstrap.cc:492] T bb55cfe6314c4d27bb86dcaa2bb135a8 P a14159c3f4f3468eb16708bfb6c72677: No bootstrap required, opened a new log
I20251023 07:57:35.269373 17217 ts_tablet_manager.cc:1403] T bb55cfe6314c4d27bb86dcaa2bb135a8 P a14159c3f4f3468eb16708bfb6c72677: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.003s
I20251023 07:57:35.271857 17217 raft_consensus.cc:359] T bb55cfe6314c4d27bb86dcaa2bb135a8 P a14159c3f4f3468eb16708bfb6c72677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:35.272532 17217 raft_consensus.cc:385] T bb55cfe6314c4d27bb86dcaa2bb135a8 P a14159c3f4f3468eb16708bfb6c72677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:57:35.272790 17217 raft_consensus.cc:740] T bb55cfe6314c4d27bb86dcaa2bb135a8 P a14159c3f4f3468eb16708bfb6c72677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a14159c3f4f3468eb16708bfb6c72677, State: Initialized, Role: FOLLOWER
I20251023 07:57:35.273401 17217 consensus_queue.cc:260] T bb55cfe6314c4d27bb86dcaa2bb135a8 P a14159c3f4f3468eb16708bfb6c72677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:35.275713 17217 ts_tablet_manager.cc:1434] T bb55cfe6314c4d27bb86dcaa2bb135a8 P a14159c3f4f3468eb16708bfb6c72677: Time spent starting tablet: real 0.006s user 0.002s sys 0.004s
I20251023 07:57:35.311636 17245 raft_consensus.cc:493] T 08671d08202b46c6b16e0271769eb119 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:57:35.312412 17245 raft_consensus.cc:515] T 08671d08202b46c6b16e0271769eb119 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:35.314788 17245 leader_election.cc:290] T 08671d08202b46c6b16e0271769eb119 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a14159c3f4f3468eb16708bfb6c72677 (127.16.126.2:38731), 25102c72ce134bd5a7369eda67c041d2 (127.16.126.3:46201)
I20251023 07:57:35.315939 17170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08671d08202b46c6b16e0271769eb119" candidate_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25102c72ce134bd5a7369eda67c041d2" is_pre_election: true
I20251023 07:57:35.316159 17097 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08671d08202b46c6b16e0271769eb119" candidate_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a14159c3f4f3468eb16708bfb6c72677" is_pre_election: true
I20251023 07:57:35.316620 17170 raft_consensus.cc:2468] T 08671d08202b46c6b16e0271769eb119 P 25102c72ce134bd5a7369eda67c041d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1eca84c8bc4e4fd48a9ec0b5146ea641 in term 0.
I20251023 07:57:35.316709 17097 raft_consensus.cc:2468] T 08671d08202b46c6b16e0271769eb119 P a14159c3f4f3468eb16708bfb6c72677 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1eca84c8bc4e4fd48a9ec0b5146ea641 in term 0.
I20251023 07:57:35.317775 16986 leader_election.cc:304] T 08671d08202b46c6b16e0271769eb119 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1eca84c8bc4e4fd48a9ec0b5146ea641, 25102c72ce134bd5a7369eda67c041d2; no voters:
I20251023 07:57:35.318639 17245 raft_consensus.cc:2804] T 08671d08202b46c6b16e0271769eb119 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:57:35.318970 17245 raft_consensus.cc:493] T 08671d08202b46c6b16e0271769eb119 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:57:35.319276 17245 raft_consensus.cc:3060] T 08671d08202b46c6b16e0271769eb119 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:57:35.323832 17245 raft_consensus.cc:515] T 08671d08202b46c6b16e0271769eb119 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:35.325343 17245 leader_election.cc:290] T 08671d08202b46c6b16e0271769eb119 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [CANDIDATE]: Term 1 election: Requested vote from peers a14159c3f4f3468eb16708bfb6c72677 (127.16.126.2:38731), 25102c72ce134bd5a7369eda67c041d2 (127.16.126.3:46201)
I20251023 07:57:35.327000 17097 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08671d08202b46c6b16e0271769eb119" candidate_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a14159c3f4f3468eb16708bfb6c72677"
I20251023 07:57:35.327284 17170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08671d08202b46c6b16e0271769eb119" candidate_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25102c72ce134bd5a7369eda67c041d2"
I20251023 07:57:35.327551 17097 raft_consensus.cc:3060] T 08671d08202b46c6b16e0271769eb119 P a14159c3f4f3468eb16708bfb6c72677 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:57:35.327993 17170 raft_consensus.cc:3060] T 08671d08202b46c6b16e0271769eb119 P 25102c72ce134bd5a7369eda67c041d2 [term 0 FOLLOWER]: Advancing to term 1
W20251023 07:57:35.332095 16968 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20251023 07:57:35.335695 17170 raft_consensus.cc:2468] T 08671d08202b46c6b16e0271769eb119 P 25102c72ce134bd5a7369eda67c041d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1eca84c8bc4e4fd48a9ec0b5146ea641 in term 1.
I20251023 07:57:35.336192 17097 raft_consensus.cc:2468] T 08671d08202b46c6b16e0271769eb119 P a14159c3f4f3468eb16708bfb6c72677 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1eca84c8bc4e4fd48a9ec0b5146ea641 in term 1.
I20251023 07:57:35.336629 17243 raft_consensus.cc:493] T bb55cfe6314c4d27bb86dcaa2bb135a8 P a14159c3f4f3468eb16708bfb6c72677 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:57:35.337105 16986 leader_election.cc:304] T 08671d08202b46c6b16e0271769eb119 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1eca84c8bc4e4fd48a9ec0b5146ea641, 25102c72ce134bd5a7369eda67c041d2; no voters:
I20251023 07:57:35.337066 17243 raft_consensus.cc:515] T bb55cfe6314c4d27bb86dcaa2bb135a8 P a14159c3f4f3468eb16708bfb6c72677 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:35.338703 17245 raft_consensus.cc:2804] T 08671d08202b46c6b16e0271769eb119 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:57:35.339094 17243 leader_election.cc:290] T bb55cfe6314c4d27bb86dcaa2bb135a8 P a14159c3f4f3468eb16708bfb6c72677 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1eca84c8bc4e4fd48a9ec0b5146ea641 (127.16.126.1:45063), 25102c72ce134bd5a7369eda67c041d2 (127.16.126.3:46201)
I20251023 07:57:35.339250 17245 raft_consensus.cc:697] T 08671d08202b46c6b16e0271769eb119 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 1 LEADER]: Becoming Leader. State: Replica: 1eca84c8bc4e4fd48a9ec0b5146ea641, State: Running, Role: LEADER
I20251023 07:57:35.340270 17245 consensus_queue.cc:237] T 08671d08202b46c6b16e0271769eb119 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:35.341760 17172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bb55cfe6314c4d27bb86dcaa2bb135a8" candidate_uuid: "a14159c3f4f3468eb16708bfb6c72677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25102c72ce134bd5a7369eda67c041d2" is_pre_election: true
I20251023 07:57:35.342409 17172 raft_consensus.cc:2468] T bb55cfe6314c4d27bb86dcaa2bb135a8 P 25102c72ce134bd5a7369eda67c041d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a14159c3f4f3468eb16708bfb6c72677 in term 0.
I20251023 07:57:35.343358 17222 raft_consensus.cc:493] T bb55cfe6314c4d27bb86dcaa2bb135a8 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:57:35.343816 17222 raft_consensus.cc:515] T bb55cfe6314c4d27bb86dcaa2bb135a8 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:35.345866 17222 leader_election.cc:290] T bb55cfe6314c4d27bb86dcaa2bb135a8 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a14159c3f4f3468eb16708bfb6c72677 (127.16.126.2:38731), 25102c72ce134bd5a7369eda67c041d2 (127.16.126.3:46201)
I20251023 07:57:35.346812 17061 leader_election.cc:304] T bb55cfe6314c4d27bb86dcaa2bb135a8 P a14159c3f4f3468eb16708bfb6c72677 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25102c72ce134bd5a7369eda67c041d2, a14159c3f4f3468eb16708bfb6c72677; no voters:
I20251023 07:57:35.348023 17243 raft_consensus.cc:2804] T bb55cfe6314c4d27bb86dcaa2bb135a8 P a14159c3f4f3468eb16708bfb6c72677 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:57:35.348383 17243 raft_consensus.cc:493] T bb55cfe6314c4d27bb86dcaa2bb135a8 P a14159c3f4f3468eb16708bfb6c72677 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:57:35.348541 17097 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bb55cfe6314c4d27bb86dcaa2bb135a8" candidate_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a14159c3f4f3468eb16708bfb6c72677" is_pre_election: true
I20251023 07:57:35.350030 17172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bb55cfe6314c4d27bb86dcaa2bb135a8" candidate_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25102c72ce134bd5a7369eda67c041d2" is_pre_election: true
I20251023 07:57:35.350131 17170 raft_consensus.cc:3060] T 621b0ed837604654a4fa0c14a0ca9c60 P 25102c72ce134bd5a7369eda67c041d2 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:57:35.350672 17172 raft_consensus.cc:2468] T bb55cfe6314c4d27bb86dcaa2bb135a8 P 25102c72ce134bd5a7369eda67c041d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1eca84c8bc4e4fd48a9ec0b5146ea641 in term 0.
I20251023 07:57:35.350863 16917 catalog_manager.cc:5649] T 08671d08202b46c6b16e0271769eb119 P 1eca84c8bc4e4fd48a9ec0b5146ea641 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1eca84c8bc4e4fd48a9ec0b5146ea641 (127.16.126.1). New cstate: current_term: 1 leader_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } health_report { overall_health: UNKNOWN } } }
I20251023 07:57:35.352385 17023 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bb55cfe6314c4d27bb86dcaa2bb135a8" candidate_uuid: "a14159c3f4f3468eb16708bfb6c72677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" is_pre_election: true
I20251023 07:57:35.352985 17023 raft_consensus.cc:2468] T bb55cfe6314c4d27bb86dcaa2bb135a8 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a14159c3f4f3468eb16708bfb6c72677 in term 0.
I20251023 07:57:35.354121 16986 leader_election.cc:304] T bb55cfe6314c4d27bb86dcaa2bb135a8 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1eca84c8bc4e4fd48a9ec0b5146ea641, 25102c72ce134bd5a7369eda67c041d2; no voters:
I20251023 07:57:35.355461 17222 raft_consensus.cc:2804] T bb55cfe6314c4d27bb86dcaa2bb135a8 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:57:35.355813 17222 raft_consensus.cc:493] T bb55cfe6314c4d27bb86dcaa2bb135a8 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:57:35.356141 17222 raft_consensus.cc:3060] T bb55cfe6314c4d27bb86dcaa2bb135a8 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:57:35.348711 17243 raft_consensus.cc:3060] T bb55cfe6314c4d27bb86dcaa2bb135a8 P a14159c3f4f3468eb16708bfb6c72677 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:57:35.359354 17221 consensus_queue.cc:1048] T 621b0ed837604654a4fa0c14a0ca9c60 P a14159c3f4f3468eb16708bfb6c72677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:57:35.365670 17243 raft_consensus.cc:515] T bb55cfe6314c4d27bb86dcaa2bb135a8 P a14159c3f4f3468eb16708bfb6c72677 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:35.368753 17097 raft_consensus.cc:2393] T bb55cfe6314c4d27bb86dcaa2bb135a8 P a14159c3f4f3468eb16708bfb6c72677 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1eca84c8bc4e4fd48a9ec0b5146ea641 in current term 1: Already voted for candidate a14159c3f4f3468eb16708bfb6c72677 in this term.
I20251023 07:57:35.368333 17222 raft_consensus.cc:515] T bb55cfe6314c4d27bb86dcaa2bb135a8 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:35.372025 17222 leader_election.cc:290] T bb55cfe6314c4d27bb86dcaa2bb135a8 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [CANDIDATE]: Term 1 election: Requested vote from peers a14159c3f4f3468eb16708bfb6c72677 (127.16.126.2:38731), 25102c72ce134bd5a7369eda67c041d2 (127.16.126.3:46201)
I20251023 07:57:35.372545 17097 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bb55cfe6314c4d27bb86dcaa2bb135a8" candidate_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a14159c3f4f3468eb16708bfb6c72677"
I20251023 07:57:35.373303 17097 raft_consensus.cc:2393] T bb55cfe6314c4d27bb86dcaa2bb135a8 P a14159c3f4f3468eb16708bfb6c72677 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1eca84c8bc4e4fd48a9ec0b5146ea641 in current term 1: Already voted for candidate a14159c3f4f3468eb16708bfb6c72677 in this term.
I20251023 07:57:35.373632 17243 leader_election.cc:290] T bb55cfe6314c4d27bb86dcaa2bb135a8 P a14159c3f4f3468eb16708bfb6c72677 [CANDIDATE]: Term 1 election: Requested vote from peers 1eca84c8bc4e4fd48a9ec0b5146ea641 (127.16.126.1:45063), 25102c72ce134bd5a7369eda67c041d2 (127.16.126.3:46201)
I20251023 07:57:35.373800 17172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bb55cfe6314c4d27bb86dcaa2bb135a8" candidate_uuid: "a14159c3f4f3468eb16708bfb6c72677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25102c72ce134bd5a7369eda67c041d2"
I20251023 07:57:35.374392 17172 raft_consensus.cc:3060] T bb55cfe6314c4d27bb86dcaa2bb135a8 P 25102c72ce134bd5a7369eda67c041d2 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:57:35.375164 17171 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bb55cfe6314c4d27bb86dcaa2bb135a8" candidate_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25102c72ce134bd5a7369eda67c041d2"
I20251023 07:57:35.377424 16986 leader_election.cc:304] T bb55cfe6314c4d27bb86dcaa2bb135a8 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1eca84c8bc4e4fd48a9ec0b5146ea641; no voters: 25102c72ce134bd5a7369eda67c041d2, a14159c3f4f3468eb16708bfb6c72677
I20251023 07:57:35.377496 17023 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bb55cfe6314c4d27bb86dcaa2bb135a8" candidate_uuid: "a14159c3f4f3468eb16708bfb6c72677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641"
I20251023 07:57:35.382117 17023 raft_consensus.cc:2393] T bb55cfe6314c4d27bb86dcaa2bb135a8 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a14159c3f4f3468eb16708bfb6c72677 in current term 1: Already voted for candidate 1eca84c8bc4e4fd48a9ec0b5146ea641 in this term.
I20251023 07:57:35.383116 17222 raft_consensus.cc:2749] T bb55cfe6314c4d27bb86dcaa2bb135a8 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20251023 07:57:35.383168 17172 raft_consensus.cc:2468] T bb55cfe6314c4d27bb86dcaa2bb135a8 P 25102c72ce134bd5a7369eda67c041d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a14159c3f4f3468eb16708bfb6c72677 in term 1.
I20251023 07:57:35.384305 17061 leader_election.cc:304] T bb55cfe6314c4d27bb86dcaa2bb135a8 P a14159c3f4f3468eb16708bfb6c72677 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25102c72ce134bd5a7369eda67c041d2, a14159c3f4f3468eb16708bfb6c72677; no voters: 1eca84c8bc4e4fd48a9ec0b5146ea641
I20251023 07:57:35.385833 17243 raft_consensus.cc:2804] T bb55cfe6314c4d27bb86dcaa2bb135a8 P a14159c3f4f3468eb16708bfb6c72677 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:57:35.389709 17242 consensus_queue.cc:1048] T 621b0ed837604654a4fa0c14a0ca9c60 P a14159c3f4f3468eb16708bfb6c72677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:57:35.393865 17243 raft_consensus.cc:697] T bb55cfe6314c4d27bb86dcaa2bb135a8 P a14159c3f4f3468eb16708bfb6c72677 [term 1 LEADER]: Becoming Leader. State: Replica: a14159c3f4f3468eb16708bfb6c72677, State: Running, Role: LEADER
I20251023 07:57:35.395476 17243 consensus_queue.cc:237] T bb55cfe6314c4d27bb86dcaa2bb135a8 P a14159c3f4f3468eb16708bfb6c72677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:35.396857 17170 raft_consensus.cc:3060] T 30d4cc48296446b49a4e32822c8be1bf P 25102c72ce134bd5a7369eda67c041d2 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:57:35.421943 17275 consensus_queue.cc:1048] T 30d4cc48296446b49a4e32822c8be1bf P a14159c3f4f3468eb16708bfb6c72677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:57:35.428095 17244 consensus_queue.cc:1048] T 6bc67d2b65d64a338ebcfd3326790173 P 25102c72ce134bd5a7369eda67c041d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:57:35.431666 16919 catalog_manager.cc:5649] T bb55cfe6314c4d27bb86dcaa2bb135a8 P a14159c3f4f3468eb16708bfb6c72677 reported cstate change: term changed from 0 to 1, leader changed from <none> to a14159c3f4f3468eb16708bfb6c72677 (127.16.126.2). New cstate: current_term: 1 leader_uuid: "a14159c3f4f3468eb16708bfb6c72677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } health_report { overall_health: UNKNOWN } } }
I20251023 07:57:35.442018 17275 consensus_queue.cc:1048] T 30d4cc48296446b49a4e32822c8be1bf P a14159c3f4f3468eb16708bfb6c72677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:57:35.448871 17097 raft_consensus.cc:3060] T 6bc67d2b65d64a338ebcfd3326790173 P a14159c3f4f3468eb16708bfb6c72677 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:57:35.459249 17220 consensus_queue.cc:1048] T 6bc67d2b65d64a338ebcfd3326790173 P 25102c72ce134bd5a7369eda67c041d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:57:35.473152 17243 raft_consensus.cc:493] T 734cd185b3ff45c59fa612ff8f546f6a P a14159c3f4f3468eb16708bfb6c72677 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:57:35.473888 17243 raft_consensus.cc:515] T 734cd185b3ff45c59fa612ff8f546f6a P a14159c3f4f3468eb16708bfb6c72677 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } } peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } }
I20251023 07:57:35.475893 17243 leader_election.cc:290] T 734cd185b3ff45c59fa612ff8f546f6a P a14159c3f4f3468eb16708bfb6c72677 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25102c72ce134bd5a7369eda67c041d2 (127.16.126.3:46201), 1eca84c8bc4e4fd48a9ec0b5146ea641 (127.16.126.1:45063)
I20251023 07:57:35.476931 17170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "734cd185b3ff45c59fa612ff8f546f6a" candidate_uuid: "a14159c3f4f3468eb16708bfb6c72677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25102c72ce134bd5a7369eda67c041d2" is_pre_election: true
I20251023 07:57:35.477136 17022 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "734cd185b3ff45c59fa612ff8f546f6a" candidate_uuid: "a14159c3f4f3468eb16708bfb6c72677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" is_pre_election: true
I20251023 07:57:35.477938 17022 raft_consensus.cc:2393] T 734cd185b3ff45c59fa612ff8f546f6a P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a14159c3f4f3468eb16708bfb6c72677 in current term 1: Already voted for candidate 25102c72ce134bd5a7369eda67c041d2 in this term.
I20251023 07:57:35.478852 17061 leader_election.cc:304] T 734cd185b3ff45c59fa612ff8f546f6a P a14159c3f4f3468eb16708bfb6c72677 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a14159c3f4f3468eb16708bfb6c72677; no voters: 1eca84c8bc4e4fd48a9ec0b5146ea641, 25102c72ce134bd5a7369eda67c041d2
I20251023 07:57:35.479678 17243 raft_consensus.cc:3060] T 734cd185b3ff45c59fa612ff8f546f6a P a14159c3f4f3468eb16708bfb6c72677 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:57:35.486274 17243 raft_consensus.cc:2749] T 734cd185b3ff45c59fa612ff8f546f6a P a14159c3f4f3468eb16708bfb6c72677 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:57:35.533243 17220 consensus_queue.cc:1048] T 734cd185b3ff45c59fa612ff8f546f6a P 25102c72ce134bd5a7369eda67c041d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:57:35.546909 17285 consensus_queue.cc:1048] T 734cd185b3ff45c59fa612ff8f546f6a P 25102c72ce134bd5a7369eda67c041d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:57:35.573767 17285 raft_consensus.cc:493] T 01f422ecb29f444098d80a283dd67a53 P 25102c72ce134bd5a7369eda67c041d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:57:35.574352 17285 raft_consensus.cc:515] T 01f422ecb29f444098d80a283dd67a53 P 25102c72ce134bd5a7369eda67c041d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:35.576568 17285 leader_election.cc:290] T 01f422ecb29f444098d80a283dd67a53 P 25102c72ce134bd5a7369eda67c041d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1eca84c8bc4e4fd48a9ec0b5146ea641 (127.16.126.1:45063), a14159c3f4f3468eb16708bfb6c72677 (127.16.126.2:38731)
I20251023 07:57:35.577389 17022 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01f422ecb29f444098d80a283dd67a53" candidate_uuid: "25102c72ce134bd5a7369eda67c041d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" is_pre_election: true
I20251023 07:57:35.577558 17097 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01f422ecb29f444098d80a283dd67a53" candidate_uuid: "25102c72ce134bd5a7369eda67c041d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a14159c3f4f3468eb16708bfb6c72677" is_pre_election: true
I20251023 07:57:35.577972 17022 raft_consensus.cc:2468] T 01f422ecb29f444098d80a283dd67a53 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25102c72ce134bd5a7369eda67c041d2 in term 0.
I20251023 07:57:35.578200 17097 raft_consensus.cc:2468] T 01f422ecb29f444098d80a283dd67a53 P a14159c3f4f3468eb16708bfb6c72677 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25102c72ce134bd5a7369eda67c041d2 in term 0.
I20251023 07:57:35.578930 17135 leader_election.cc:304] T 01f422ecb29f444098d80a283dd67a53 P 25102c72ce134bd5a7369eda67c041d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1eca84c8bc4e4fd48a9ec0b5146ea641, 25102c72ce134bd5a7369eda67c041d2; no voters:
I20251023 07:57:35.579618 17285 raft_consensus.cc:2804] T 01f422ecb29f444098d80a283dd67a53 P 25102c72ce134bd5a7369eda67c041d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:57:35.579974 17285 raft_consensus.cc:493] T 01f422ecb29f444098d80a283dd67a53 P 25102c72ce134bd5a7369eda67c041d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:57:35.580308 17285 raft_consensus.cc:3060] T 01f422ecb29f444098d80a283dd67a53 P 25102c72ce134bd5a7369eda67c041d2 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:57:35.587288 17285 raft_consensus.cc:515] T 01f422ecb29f444098d80a283dd67a53 P 25102c72ce134bd5a7369eda67c041d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:35.589278 17285 leader_election.cc:290] T 01f422ecb29f444098d80a283dd67a53 P 25102c72ce134bd5a7369eda67c041d2 [CANDIDATE]: Term 1 election: Requested vote from peers 1eca84c8bc4e4fd48a9ec0b5146ea641 (127.16.126.1:45063), a14159c3f4f3468eb16708bfb6c72677 (127.16.126.2:38731)
I20251023 07:57:35.590226 17022 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01f422ecb29f444098d80a283dd67a53" candidate_uuid: "25102c72ce134bd5a7369eda67c041d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641"
I20251023 07:57:35.590353 17097 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01f422ecb29f444098d80a283dd67a53" candidate_uuid: "25102c72ce134bd5a7369eda67c041d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a14159c3f4f3468eb16708bfb6c72677"
I20251023 07:57:35.590767 17022 raft_consensus.cc:3060] T 01f422ecb29f444098d80a283dd67a53 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:57:35.590960 17097 raft_consensus.cc:3060] T 01f422ecb29f444098d80a283dd67a53 P a14159c3f4f3468eb16708bfb6c72677 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:57:35.595496 17022 raft_consensus.cc:2468] T 01f422ecb29f444098d80a283dd67a53 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25102c72ce134bd5a7369eda67c041d2 in term 1.
I20251023 07:57:35.596503 17135 leader_election.cc:304] T 01f422ecb29f444098d80a283dd67a53 P 25102c72ce134bd5a7369eda67c041d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1eca84c8bc4e4fd48a9ec0b5146ea641, 25102c72ce134bd5a7369eda67c041d2; no voters:
I20251023 07:57:35.597170 17285 raft_consensus.cc:2804] T 01f422ecb29f444098d80a283dd67a53 P 25102c72ce134bd5a7369eda67c041d2 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:57:35.597591 17285 raft_consensus.cc:697] T 01f422ecb29f444098d80a283dd67a53 P 25102c72ce134bd5a7369eda67c041d2 [term 1 LEADER]: Becoming Leader. State: Replica: 25102c72ce134bd5a7369eda67c041d2, State: Running, Role: LEADER
I20251023 07:57:35.597707 17097 raft_consensus.cc:2468] T 01f422ecb29f444098d80a283dd67a53 P a14159c3f4f3468eb16708bfb6c72677 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25102c72ce134bd5a7369eda67c041d2 in term 1.
I20251023 07:57:35.598462 17285 consensus_queue.cc:237] T 01f422ecb29f444098d80a283dd67a53 P 25102c72ce134bd5a7369eda67c041d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:35.607002 16917 catalog_manager.cc:5649] T 01f422ecb29f444098d80a283dd67a53 P 25102c72ce134bd5a7369eda67c041d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25102c72ce134bd5a7369eda67c041d2 (127.16.126.3). New cstate: current_term: 1 leader_uuid: "25102c72ce134bd5a7369eda67c041d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } health_report { overall_health: HEALTHY } } }
I20251023 07:57:35.722270 17221 consensus_queue.cc:1048] T 76bacff5c098439cb18968ff9dee3875 P a14159c3f4f3468eb16708bfb6c72677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:57:35.723133 17243 consensus_queue.cc:1048] T 76bacff5c098439cb18968ff9dee3875 P a14159c3f4f3468eb16708bfb6c72677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:57:35.776929 17170 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "734cd185b3ff45c59fa612ff8f546f6a"
dest_uuid: "25102c72ce134bd5a7369eda67c041d2"
mode: GRACEFUL
new_leader_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641"
from {username='slave'} at 127.0.0.1:56684
I20251023 07:57:35.777532 17170 raft_consensus.cc:606] T 734cd185b3ff45c59fa612ff8f546f6a P 25102c72ce134bd5a7369eda67c041d2 [term 1 LEADER]: Received request to transfer leadership to TS 1eca84c8bc4e4fd48a9ec0b5146ea641
I20251023 07:57:35.789990 17242 consensus_queue.cc:1048] T 8f48d577e386480a905dc2367cf209ab P a14159c3f4f3468eb16708bfb6c72677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:57:35.792196 17097 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "76bacff5c098439cb18968ff9dee3875"
dest_uuid: "a14159c3f4f3468eb16708bfb6c72677"
mode: GRACEFUL
new_leader_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641"
from {username='slave'} at 127.0.0.1:35402
I20251023 07:57:35.792683 17097 raft_consensus.cc:606] T 76bacff5c098439cb18968ff9dee3875 P a14159c3f4f3468eb16708bfb6c72677 [term 1 LEADER]: Received request to transfer leadership to TS 1eca84c8bc4e4fd48a9ec0b5146ea641
I20251023 07:57:35.802790 17170 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "6bc67d2b65d64a338ebcfd3326790173"
dest_uuid: "25102c72ce134bd5a7369eda67c041d2"
mode: GRACEFUL
new_leader_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641"
from {username='slave'} at 127.0.0.1:56684
I20251023 07:57:35.803386 17170 raft_consensus.cc:606] T 6bc67d2b65d64a338ebcfd3326790173 P 25102c72ce134bd5a7369eda67c041d2 [term 1 LEADER]: Received request to transfer leadership to TS 1eca84c8bc4e4fd48a9ec0b5146ea641
I20251023 07:57:35.809077 17275 consensus_queue.cc:1048] T 8f48d577e386480a905dc2367cf209ab P a14159c3f4f3468eb16708bfb6c72677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:57:35.821110 17172 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "01f422ecb29f444098d80a283dd67a53"
dest_uuid: "25102c72ce134bd5a7369eda67c041d2"
mode: GRACEFUL
new_leader_uuid: "a14159c3f4f3468eb16708bfb6c72677"
from {username='slave'} at 127.0.0.1:56684
I20251023 07:57:35.821795 17172 raft_consensus.cc:606] T 01f422ecb29f444098d80a283dd67a53 P 25102c72ce134bd5a7369eda67c041d2 [term 1 LEADER]: Received request to transfer leadership to TS a14159c3f4f3468eb16708bfb6c72677
I20251023 07:57:35.832557 17097 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "30d4cc48296446b49a4e32822c8be1bf"
dest_uuid: "a14159c3f4f3468eb16708bfb6c72677"
mode: GRACEFUL
new_leader_uuid: "25102c72ce134bd5a7369eda67c041d2"
from {username='slave'} at 127.0.0.1:35402
I20251023 07:57:35.833159 17097 raft_consensus.cc:606] T 30d4cc48296446b49a4e32822c8be1bf P a14159c3f4f3468eb16708bfb6c72677 [term 1 LEADER]: Received request to transfer leadership to TS 25102c72ce134bd5a7369eda67c041d2
I20251023 07:57:35.835557 17222 consensus_queue.cc:1048] T 08671d08202b46c6b16e0271769eb119 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:57:35.848371 17245 consensus_queue.cc:1048] T 08671d08202b46c6b16e0271769eb119 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:57:35.887665 17275 consensus_queue.cc:1048] T bb55cfe6314c4d27bb86dcaa2bb135a8 P a14159c3f4f3468eb16708bfb6c72677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:57:35.893177 17242 consensus_queue.cc:1048] T bb55cfe6314c4d27bb86dcaa2bb135a8 P a14159c3f4f3468eb16708bfb6c72677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:57:35.962916 17244 raft_consensus.cc:993] T 6bc67d2b65d64a338ebcfd3326790173 P 25102c72ce134bd5a7369eda67c041d2: : Instructing follower 1eca84c8bc4e4fd48a9ec0b5146ea641 to start an election
I20251023 07:57:35.963361 17285 raft_consensus.cc:1081] T 6bc67d2b65d64a338ebcfd3326790173 P 25102c72ce134bd5a7369eda67c041d2 [term 1 LEADER]: Signalling peer 1eca84c8bc4e4fd48a9ec0b5146ea641 to start an election
I20251023 07:57:35.964866 17023 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "6bc67d2b65d64a338ebcfd3326790173"
dest_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641"
from {username='slave'} at 127.0.0.1:38430
I20251023 07:57:35.965374 17023 raft_consensus.cc:493] T 6bc67d2b65d64a338ebcfd3326790173 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:57:35.965689 17023 raft_consensus.cc:3060] T 6bc67d2b65d64a338ebcfd3326790173 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:57:35.971657 17023 raft_consensus.cc:515] T 6bc67d2b65d64a338ebcfd3326790173 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:35.973249 17023 leader_election.cc:290] T 6bc67d2b65d64a338ebcfd3326790173 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [CANDIDATE]: Term 2 election: Requested vote from peers a14159c3f4f3468eb16708bfb6c72677 (127.16.126.2:38731), 25102c72ce134bd5a7369eda67c041d2 (127.16.126.3:46201)
I20251023 07:57:35.974913 17097 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6bc67d2b65d64a338ebcfd3326790173" candidate_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a14159c3f4f3468eb16708bfb6c72677"
I20251023 07:57:35.974455 17170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6bc67d2b65d64a338ebcfd3326790173" candidate_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "25102c72ce134bd5a7369eda67c041d2"
I20251023 07:57:35.975466 17097 raft_consensus.cc:3060] T 6bc67d2b65d64a338ebcfd3326790173 P a14159c3f4f3468eb16708bfb6c72677 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:57:35.975803 17170 raft_consensus.cc:3055] T 6bc67d2b65d64a338ebcfd3326790173 P 25102c72ce134bd5a7369eda67c041d2 [term 1 LEADER]: Stepping down as leader of term 1
I20251023 07:57:35.976171 17170 raft_consensus.cc:740] T 6bc67d2b65d64a338ebcfd3326790173 P 25102c72ce134bd5a7369eda67c041d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 25102c72ce134bd5a7369eda67c041d2, State: Running, Role: LEADER
I20251023 07:57:35.976910 17170 consensus_queue.cc:260] T 6bc67d2b65d64a338ebcfd3326790173 P 25102c72ce134bd5a7369eda67c041d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:35.978248 17170 raft_consensus.cc:3060] T 6bc67d2b65d64a338ebcfd3326790173 P 25102c72ce134bd5a7369eda67c041d2 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:57:35.981998 17097 raft_consensus.cc:2468] T 6bc67d2b65d64a338ebcfd3326790173 P a14159c3f4f3468eb16708bfb6c72677 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1eca84c8bc4e4fd48a9ec0b5146ea641 in term 2.
I20251023 07:57:35.982890 17170 raft_consensus.cc:2468] T 6bc67d2b65d64a338ebcfd3326790173 P 25102c72ce134bd5a7369eda67c041d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1eca84c8bc4e4fd48a9ec0b5146ea641 in term 2.
I20251023 07:57:35.983227 16986 leader_election.cc:304] T 6bc67d2b65d64a338ebcfd3326790173 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1eca84c8bc4e4fd48a9ec0b5146ea641, a14159c3f4f3468eb16708bfb6c72677; no voters:
I20251023 07:57:35.983992 17245 raft_consensus.cc:2804] T 6bc67d2b65d64a338ebcfd3326790173 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:57:35.984436 17245 raft_consensus.cc:697] T 6bc67d2b65d64a338ebcfd3326790173 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 2 LEADER]: Becoming Leader. State: Replica: 1eca84c8bc4e4fd48a9ec0b5146ea641, State: Running, Role: LEADER
I20251023 07:57:35.984771 17242 raft_consensus.cc:993] T 30d4cc48296446b49a4e32822c8be1bf P a14159c3f4f3468eb16708bfb6c72677: : Instructing follower 25102c72ce134bd5a7369eda67c041d2 to start an election
I20251023 07:57:35.985170 17242 raft_consensus.cc:1081] T 30d4cc48296446b49a4e32822c8be1bf P a14159c3f4f3468eb16708bfb6c72677 [term 1 LEADER]: Signalling peer 25102c72ce134bd5a7369eda67c041d2 to start an election
I20251023 07:57:35.985180 17245 consensus_queue.cc:237] T 6bc67d2b65d64a338ebcfd3326790173 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:35.986723 17172 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "30d4cc48296446b49a4e32822c8be1bf"
dest_uuid: "25102c72ce134bd5a7369eda67c041d2"
from {username='slave'} at 127.0.0.1:48644
I20251023 07:57:35.987206 17172 raft_consensus.cc:493] T 30d4cc48296446b49a4e32822c8be1bf P 25102c72ce134bd5a7369eda67c041d2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:57:35.987497 17172 raft_consensus.cc:3060] T 30d4cc48296446b49a4e32822c8be1bf P 25102c72ce134bd5a7369eda67c041d2 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:57:35.993207 17172 raft_consensus.cc:515] T 30d4cc48296446b49a4e32822c8be1bf P 25102c72ce134bd5a7369eda67c041d2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:35.992786 16917 catalog_manager.cc:5649] T 6bc67d2b65d64a338ebcfd3326790173 P 1eca84c8bc4e4fd48a9ec0b5146ea641 reported cstate change: term changed from 1 to 2, leader changed from 25102c72ce134bd5a7369eda67c041d2 (127.16.126.3) to 1eca84c8bc4e4fd48a9ec0b5146ea641 (127.16.126.1). New cstate: current_term: 2 leader_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } health_report { overall_health: UNKNOWN } } }
I20251023 07:57:35.995043 17172 leader_election.cc:290] T 30d4cc48296446b49a4e32822c8be1bf P 25102c72ce134bd5a7369eda67c041d2 [CANDIDATE]: Term 2 election: Requested vote from peers 1eca84c8bc4e4fd48a9ec0b5146ea641 (127.16.126.1:45063), a14159c3f4f3468eb16708bfb6c72677 (127.16.126.2:38731)
I20251023 07:57:35.996690 17023 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "30d4cc48296446b49a4e32822c8be1bf" candidate_uuid: "25102c72ce134bd5a7369eda67c041d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641"
I20251023 07:57:35.996702 17097 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "30d4cc48296446b49a4e32822c8be1bf" candidate_uuid: "25102c72ce134bd5a7369eda67c041d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a14159c3f4f3468eb16708bfb6c72677"
I20251023 07:57:35.997485 17097 raft_consensus.cc:3055] T 30d4cc48296446b49a4e32822c8be1bf P a14159c3f4f3468eb16708bfb6c72677 [term 1 LEADER]: Stepping down as leader of term 1
I20251023 07:57:35.997820 17097 raft_consensus.cc:740] T 30d4cc48296446b49a4e32822c8be1bf P a14159c3f4f3468eb16708bfb6c72677 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a14159c3f4f3468eb16708bfb6c72677, State: Running, Role: LEADER
I20251023 07:57:35.998534 17097 consensus_queue.cc:260] T 30d4cc48296446b49a4e32822c8be1bf P a14159c3f4f3468eb16708bfb6c72677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:35.999408 17097 raft_consensus.cc:3060] T 30d4cc48296446b49a4e32822c8be1bf P a14159c3f4f3468eb16708bfb6c72677 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:57:35.999961 17023 raft_consensus.cc:3060] T 30d4cc48296446b49a4e32822c8be1bf P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:57:36.004499 17097 raft_consensus.cc:2468] T 30d4cc48296446b49a4e32822c8be1bf P a14159c3f4f3468eb16708bfb6c72677 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25102c72ce134bd5a7369eda67c041d2 in term 2.
I20251023 07:57:36.005684 17135 leader_election.cc:304] T 30d4cc48296446b49a4e32822c8be1bf P 25102c72ce134bd5a7369eda67c041d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25102c72ce134bd5a7369eda67c041d2, a14159c3f4f3468eb16708bfb6c72677; no voters:
I20251023 07:57:36.006551 17285 raft_consensus.cc:2804] T 30d4cc48296446b49a4e32822c8be1bf P 25102c72ce134bd5a7369eda67c041d2 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:57:36.007040 17285 raft_consensus.cc:697] T 30d4cc48296446b49a4e32822c8be1bf P 25102c72ce134bd5a7369eda67c041d2 [term 2 LEADER]: Becoming Leader. State: Replica: 25102c72ce134bd5a7369eda67c041d2, State: Running, Role: LEADER
I20251023 07:57:36.007620 17023 raft_consensus.cc:2468] T 30d4cc48296446b49a4e32822c8be1bf P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25102c72ce134bd5a7369eda67c041d2 in term 2.
I20251023 07:57:36.007894 17285 consensus_queue.cc:237] T 30d4cc48296446b49a4e32822c8be1bf P 25102c72ce134bd5a7369eda67c041d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:36.014065 16917 catalog_manager.cc:5649] T 30d4cc48296446b49a4e32822c8be1bf P 25102c72ce134bd5a7369eda67c041d2 reported cstate change: term changed from 1 to 2, leader changed from a14159c3f4f3468eb16708bfb6c72677 (127.16.126.2) to 25102c72ce134bd5a7369eda67c041d2 (127.16.126.3). New cstate: current_term: 2 leader_uuid: "25102c72ce134bd5a7369eda67c041d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } health_report { overall_health: HEALTHY } } }
I20251023 07:57:36.056887 17285 consensus_queue.cc:1048] T 01f422ecb29f444098d80a283dd67a53 P 25102c72ce134bd5a7369eda67c041d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:57:36.069269 17285 consensus_queue.cc:1048] T 01f422ecb29f444098d80a283dd67a53 P 25102c72ce134bd5a7369eda67c041d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:57:36.079823 17244 raft_consensus.cc:993] T 01f422ecb29f444098d80a283dd67a53 P 25102c72ce134bd5a7369eda67c041d2: : Instructing follower a14159c3f4f3468eb16708bfb6c72677 to start an election
I20251023 07:57:36.080400 17285 raft_consensus.cc:1081] T 01f422ecb29f444098d80a283dd67a53 P 25102c72ce134bd5a7369eda67c041d2 [term 1 LEADER]: Signalling peer a14159c3f4f3468eb16708bfb6c72677 to start an election
I20251023 07:57:36.082152 17098 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "01f422ecb29f444098d80a283dd67a53"
dest_uuid: "a14159c3f4f3468eb16708bfb6c72677"
from {username='slave'} at 127.0.0.1:43520
I20251023 07:57:36.082741 17098 raft_consensus.cc:493] T 01f422ecb29f444098d80a283dd67a53 P a14159c3f4f3468eb16708bfb6c72677 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:57:36.083101 17098 raft_consensus.cc:3060] T 01f422ecb29f444098d80a283dd67a53 P a14159c3f4f3468eb16708bfb6c72677 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:57:36.087917 17098 raft_consensus.cc:515] T 01f422ecb29f444098d80a283dd67a53 P a14159c3f4f3468eb16708bfb6c72677 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:36.089679 17098 leader_election.cc:290] T 01f422ecb29f444098d80a283dd67a53 P a14159c3f4f3468eb16708bfb6c72677 [CANDIDATE]: Term 2 election: Requested vote from peers 1eca84c8bc4e4fd48a9ec0b5146ea641 (127.16.126.1:45063), 25102c72ce134bd5a7369eda67c041d2 (127.16.126.3:46201)
I20251023 07:57:36.090838 17023 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01f422ecb29f444098d80a283dd67a53" candidate_uuid: "a14159c3f4f3468eb16708bfb6c72677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641"
I20251023 07:57:36.091204 17172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01f422ecb29f444098d80a283dd67a53" candidate_uuid: "a14159c3f4f3468eb16708bfb6c72677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "25102c72ce134bd5a7369eda67c041d2"
I20251023 07:57:36.091462 17023 raft_consensus.cc:3060] T 01f422ecb29f444098d80a283dd67a53 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:57:36.091833 17172 raft_consensus.cc:3055] T 01f422ecb29f444098d80a283dd67a53 P 25102c72ce134bd5a7369eda67c041d2 [term 1 LEADER]: Stepping down as leader of term 1
I20251023 07:57:36.092520 17172 raft_consensus.cc:740] T 01f422ecb29f444098d80a283dd67a53 P 25102c72ce134bd5a7369eda67c041d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 25102c72ce134bd5a7369eda67c041d2, State: Running, Role: LEADER
I20251023 07:57:36.098578 17023 raft_consensus.cc:2468] T 01f422ecb29f444098d80a283dd67a53 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a14159c3f4f3468eb16708bfb6c72677 in term 2.
I20251023 07:57:36.099740 17061 leader_election.cc:304] T 01f422ecb29f444098d80a283dd67a53 P a14159c3f4f3468eb16708bfb6c72677 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1eca84c8bc4e4fd48a9ec0b5146ea641, a14159c3f4f3468eb16708bfb6c72677; no voters:
I20251023 07:57:36.100554 17242 raft_consensus.cc:2804] T 01f422ecb29f444098d80a283dd67a53 P a14159c3f4f3468eb16708bfb6c72677 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:57:36.101240 17242 raft_consensus.cc:697] T 01f422ecb29f444098d80a283dd67a53 P a14159c3f4f3468eb16708bfb6c72677 [term 2 LEADER]: Becoming Leader. State: Replica: a14159c3f4f3468eb16708bfb6c72677, State: Running, Role: LEADER
I20251023 07:57:36.102357 17242 consensus_queue.cc:237] T 01f422ecb29f444098d80a283dd67a53 P a14159c3f4f3468eb16708bfb6c72677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:36.104614 17220 raft_consensus.cc:993] T 734cd185b3ff45c59fa612ff8f546f6a P 25102c72ce134bd5a7369eda67c041d2: : Instructing follower 1eca84c8bc4e4fd48a9ec0b5146ea641 to start an election
I20251023 07:57:36.105065 17244 raft_consensus.cc:1081] T 734cd185b3ff45c59fa612ff8f546f6a P 25102c72ce134bd5a7369eda67c041d2 [term 1 LEADER]: Signalling peer 1eca84c8bc4e4fd48a9ec0b5146ea641 to start an election
I20251023 07:57:36.097563 17172 consensus_queue.cc:260] T 01f422ecb29f444098d80a283dd67a53 P 25102c72ce134bd5a7369eda67c041d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:36.105988 17172 raft_consensus.cc:3060] T 01f422ecb29f444098d80a283dd67a53 P 25102c72ce134bd5a7369eda67c041d2 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:57:36.106717 17023 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "734cd185b3ff45c59fa612ff8f546f6a"
dest_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641"
from {username='slave'} at 127.0.0.1:38430
I20251023 07:57:36.107395 17023 raft_consensus.cc:493] T 734cd185b3ff45c59fa612ff8f546f6a P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:57:36.107815 17023 raft_consensus.cc:3060] T 734cd185b3ff45c59fa612ff8f546f6a P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:57:36.112445 17172 raft_consensus.cc:2468] T 01f422ecb29f444098d80a283dd67a53 P 25102c72ce134bd5a7369eda67c041d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a14159c3f4f3468eb16708bfb6c72677 in term 2.
I20251023 07:57:36.112061 16919 catalog_manager.cc:5649] T 01f422ecb29f444098d80a283dd67a53 P a14159c3f4f3468eb16708bfb6c72677 reported cstate change: term changed from 1 to 2, leader changed from 25102c72ce134bd5a7369eda67c041d2 (127.16.126.3) to a14159c3f4f3468eb16708bfb6c72677 (127.16.126.2). New cstate: current_term: 2 leader_uuid: "a14159c3f4f3468eb16708bfb6c72677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } health_report { overall_health: UNKNOWN } } }
I20251023 07:57:36.114490 17023 raft_consensus.cc:515] T 734cd185b3ff45c59fa612ff8f546f6a P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } } peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } }
I20251023 07:57:36.116219 17023 leader_election.cc:290] T 734cd185b3ff45c59fa612ff8f546f6a P 1eca84c8bc4e4fd48a9ec0b5146ea641 [CANDIDATE]: Term 2 election: Requested vote from peers 25102c72ce134bd5a7369eda67c041d2 (127.16.126.3:46201), a14159c3f4f3468eb16708bfb6c72677 (127.16.126.2:38731)
I20251023 07:57:36.117775 17172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "734cd185b3ff45c59fa612ff8f546f6a" candidate_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "25102c72ce134bd5a7369eda67c041d2"
I20251023 07:57:36.118707 17172 raft_consensus.cc:3055] T 734cd185b3ff45c59fa612ff8f546f6a P 25102c72ce134bd5a7369eda67c041d2 [term 1 LEADER]: Stepping down as leader of term 1
I20251023 07:57:36.119099 17172 raft_consensus.cc:740] T 734cd185b3ff45c59fa612ff8f546f6a P 25102c72ce134bd5a7369eda67c041d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 25102c72ce134bd5a7369eda67c041d2, State: Running, Role: LEADER
I20251023 07:57:36.120009 17172 consensus_queue.cc:260] T 734cd185b3ff45c59fa612ff8f546f6a P 25102c72ce134bd5a7369eda67c041d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } } peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } }
I20251023 07:57:36.117775 17098 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "734cd185b3ff45c59fa612ff8f546f6a" candidate_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a14159c3f4f3468eb16708bfb6c72677"
I20251023 07:57:36.121376 17172 raft_consensus.cc:3060] T 734cd185b3ff45c59fa612ff8f546f6a P 25102c72ce134bd5a7369eda67c041d2 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:57:36.121753 17098 raft_consensus.cc:3060] T 734cd185b3ff45c59fa612ff8f546f6a P a14159c3f4f3468eb16708bfb6c72677 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:57:36.129017 17172 raft_consensus.cc:2468] T 734cd185b3ff45c59fa612ff8f546f6a P 25102c72ce134bd5a7369eda67c041d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1eca84c8bc4e4fd48a9ec0b5146ea641 in term 2.
I20251023 07:57:36.129017 17098 raft_consensus.cc:2468] T 734cd185b3ff45c59fa612ff8f546f6a P a14159c3f4f3468eb16708bfb6c72677 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1eca84c8bc4e4fd48a9ec0b5146ea641 in term 2.
I20251023 07:57:36.130645 16986 leader_election.cc:304] T 734cd185b3ff45c59fa612ff8f546f6a P 1eca84c8bc4e4fd48a9ec0b5146ea641 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1eca84c8bc4e4fd48a9ec0b5146ea641, a14159c3f4f3468eb16708bfb6c72677; no voters:
I20251023 07:57:36.131578 17245 raft_consensus.cc:2804] T 734cd185b3ff45c59fa612ff8f546f6a P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:57:36.132059 17245 raft_consensus.cc:697] T 734cd185b3ff45c59fa612ff8f546f6a P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 2 LEADER]: Becoming Leader. State: Replica: 1eca84c8bc4e4fd48a9ec0b5146ea641, State: Running, Role: LEADER
I20251023 07:57:36.132897 17245 consensus_queue.cc:237] T 734cd185b3ff45c59fa612ff8f546f6a P 1eca84c8bc4e4fd48a9ec0b5146ea641 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } } peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } }
I20251023 07:57:36.139317 16919 catalog_manager.cc:5649] T 734cd185b3ff45c59fa612ff8f546f6a P 1eca84c8bc4e4fd48a9ec0b5146ea641 reported cstate change: term changed from 1 to 2, leader changed from 25102c72ce134bd5a7369eda67c041d2 (127.16.126.3) to 1eca84c8bc4e4fd48a9ec0b5146ea641 (127.16.126.1). New cstate: current_term: 2 leader_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } health_report { overall_health: UNKNOWN } } }
I20251023 07:57:36.235045 17275 raft_consensus.cc:993] T 76bacff5c098439cb18968ff9dee3875 P a14159c3f4f3468eb16708bfb6c72677: : Instructing follower 1eca84c8bc4e4fd48a9ec0b5146ea641 to start an election
I20251023 07:57:36.235459 17242 raft_consensus.cc:1081] T 76bacff5c098439cb18968ff9dee3875 P a14159c3f4f3468eb16708bfb6c72677 [term 1 LEADER]: Signalling peer 1eca84c8bc4e4fd48a9ec0b5146ea641 to start an election
I20251023 07:57:36.237164 17023 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "76bacff5c098439cb18968ff9dee3875"
dest_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641"
from {username='slave'} at 127.0.0.1:38428
I20251023 07:57:36.237694 17023 raft_consensus.cc:493] T 76bacff5c098439cb18968ff9dee3875 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:57:36.237983 17023 raft_consensus.cc:3060] T 76bacff5c098439cb18968ff9dee3875 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:57:36.242825 17023 raft_consensus.cc:515] T 76bacff5c098439cb18968ff9dee3875 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:36.244356 17023 leader_election.cc:290] T 76bacff5c098439cb18968ff9dee3875 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [CANDIDATE]: Term 2 election: Requested vote from peers a14159c3f4f3468eb16708bfb6c72677 (127.16.126.2:38731), 25102c72ce134bd5a7369eda67c041d2 (127.16.126.3:46201)
I20251023 07:57:36.245288 17098 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "76bacff5c098439cb18968ff9dee3875" candidate_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a14159c3f4f3468eb16708bfb6c72677"
I20251023 07:57:36.245534 17172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "76bacff5c098439cb18968ff9dee3875" candidate_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "25102c72ce134bd5a7369eda67c041d2"
I20251023 07:57:36.245947 17098 raft_consensus.cc:3055] T 76bacff5c098439cb18968ff9dee3875 P a14159c3f4f3468eb16708bfb6c72677 [term 1 LEADER]: Stepping down as leader of term 1
I20251023 07:57:36.246138 17172 raft_consensus.cc:3060] T 76bacff5c098439cb18968ff9dee3875 P 25102c72ce134bd5a7369eda67c041d2 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:57:36.246333 17098 raft_consensus.cc:740] T 76bacff5c098439cb18968ff9dee3875 P a14159c3f4f3468eb16708bfb6c72677 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a14159c3f4f3468eb16708bfb6c72677, State: Running, Role: LEADER
I20251023 07:57:36.247164 17098 consensus_queue.cc:260] T 76bacff5c098439cb18968ff9dee3875 P a14159c3f4f3468eb16708bfb6c72677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:36.248387 17098 raft_consensus.cc:3060] T 76bacff5c098439cb18968ff9dee3875 P a14159c3f4f3468eb16708bfb6c72677 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:57:36.253412 17172 raft_consensus.cc:2468] T 76bacff5c098439cb18968ff9dee3875 P 25102c72ce134bd5a7369eda67c041d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1eca84c8bc4e4fd48a9ec0b5146ea641 in term 2.
I20251023 07:57:36.254498 16986 leader_election.cc:304] T 76bacff5c098439cb18968ff9dee3875 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1eca84c8bc4e4fd48a9ec0b5146ea641, 25102c72ce134bd5a7369eda67c041d2; no voters:
I20251023 07:57:36.255112 17098 raft_consensus.cc:2468] T 76bacff5c098439cb18968ff9dee3875 P a14159c3f4f3468eb16708bfb6c72677 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1eca84c8bc4e4fd48a9ec0b5146ea641 in term 2.
I20251023 07:57:36.255314 17245 raft_consensus.cc:2804] T 76bacff5c098439cb18968ff9dee3875 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:57:36.255798 17245 raft_consensus.cc:697] T 76bacff5c098439cb18968ff9dee3875 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 2 LEADER]: Becoming Leader. State: Replica: 1eca84c8bc4e4fd48a9ec0b5146ea641, State: Running, Role: LEADER
I20251023 07:57:36.256538 17245 consensus_queue.cc:237] T 76bacff5c098439cb18968ff9dee3875 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:36.263114 16919 catalog_manager.cc:5649] T 76bacff5c098439cb18968ff9dee3875 P 1eca84c8bc4e4fd48a9ec0b5146ea641 reported cstate change: term changed from 1 to 2, leader changed from a14159c3f4f3468eb16708bfb6c72677 (127.16.126.2) to 1eca84c8bc4e4fd48a9ec0b5146ea641 (127.16.126.1). New cstate: current_term: 2 leader_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } health_report { overall_health: UNKNOWN } } }
I20251023 07:57:36.423593 17098 raft_consensus.cc:1275] T 30d4cc48296446b49a4e32822c8be1bf P a14159c3f4f3468eb16708bfb6c72677 [term 2 FOLLOWER]: Refusing update from remote peer 25102c72ce134bd5a7369eda67c041d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:57:36.424919 17285 consensus_queue.cc:1048] T 30d4cc48296446b49a4e32822c8be1bf P 25102c72ce134bd5a7369eda67c041d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:57:36.432487 17023 raft_consensus.cc:1275] T 30d4cc48296446b49a4e32822c8be1bf P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 2 FOLLOWER]: Refusing update from remote peer 25102c72ce134bd5a7369eda67c041d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:57:36.434350 17220 consensus_queue.cc:1048] T 30d4cc48296446b49a4e32822c8be1bf P 25102c72ce134bd5a7369eda67c041d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:57:36.475932 17098 raft_consensus.cc:1275] T 6bc67d2b65d64a338ebcfd3326790173 P a14159c3f4f3468eb16708bfb6c72677 [term 2 FOLLOWER]: Refusing update from remote peer 1eca84c8bc4e4fd48a9ec0b5146ea641: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:57:36.477165 17301 consensus_queue.cc:1048] T 6bc67d2b65d64a338ebcfd3326790173 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:57:36.485209 17172 raft_consensus.cc:1275] T 6bc67d2b65d64a338ebcfd3326790173 P 25102c72ce134bd5a7369eda67c041d2 [term 2 FOLLOWER]: Refusing update from remote peer 1eca84c8bc4e4fd48a9ec0b5146ea641: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:57:36.487877 17301 consensus_queue.cc:1048] T 6bc67d2b65d64a338ebcfd3326790173 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:57:36.536427 17023 raft_consensus.cc:1275] T 01f422ecb29f444098d80a283dd67a53 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 2 FOLLOWER]: Refusing update from remote peer a14159c3f4f3468eb16708bfb6c72677: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:57:36.537628 17242 consensus_queue.cc:1048] T 01f422ecb29f444098d80a283dd67a53 P a14159c3f4f3468eb16708bfb6c72677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:57:36.545739 17172 raft_consensus.cc:1275] T 01f422ecb29f444098d80a283dd67a53 P 25102c72ce134bd5a7369eda67c041d2 [term 2 FOLLOWER]: Refusing update from remote peer a14159c3f4f3468eb16708bfb6c72677: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:57:36.547119 17305 consensus_queue.cc:1048] T 01f422ecb29f444098d80a283dd67a53 P a14159c3f4f3468eb16708bfb6c72677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20251023 07:57:36.649531 17172 raft_consensus.cc:1275] T 76bacff5c098439cb18968ff9dee3875 P 25102c72ce134bd5a7369eda67c041d2 [term 2 FOLLOWER]: Refusing update from remote peer 1eca84c8bc4e4fd48a9ec0b5146ea641: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:57:36.650701 17301 consensus_queue.cc:1048] T 76bacff5c098439cb18968ff9dee3875 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:57:36.653052 17098 raft_consensus.cc:1275] T 76bacff5c098439cb18968ff9dee3875 P a14159c3f4f3468eb16708bfb6c72677 [term 2 FOLLOWER]: Refusing update from remote peer 1eca84c8bc4e4fd48a9ec0b5146ea641: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:57:36.654233 17301 consensus_queue.cc:1048] T 76bacff5c098439cb18968ff9dee3875 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:57:36.725930 17172 raft_consensus.cc:1275] T 734cd185b3ff45c59fa612ff8f546f6a P 25102c72ce134bd5a7369eda67c041d2 [term 2 FOLLOWER]: Refusing update from remote peer 1eca84c8bc4e4fd48a9ec0b5146ea641: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:57:36.727171 17303 consensus_queue.cc:1048] T 734cd185b3ff45c59fa612ff8f546f6a P 1eca84c8bc4e4fd48a9ec0b5146ea641 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:57:36.736240 17098 raft_consensus.cc:1275] T 734cd185b3ff45c59fa612ff8f546f6a P a14159c3f4f3468eb16708bfb6c72677 [term 2 FOLLOWER]: Refusing update from remote peer 1eca84c8bc4e4fd48a9ec0b5146ea641: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:57:36.737818 17303 consensus_queue.cc:1048] T 734cd185b3ff45c59fa612ff8f546f6a P 1eca84c8bc4e4fd48a9ec0b5146ea641 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:57:38.861768 16888 auto_leader_rebalancer-test.cc:272] The leader distribution is
I20251023 07:57:38.862536 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:57:38.881160 17098 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "621b0ed837604654a4fa0c14a0ca9c60"
dest_uuid: "a14159c3f4f3468eb16708bfb6c72677"
mode: GRACEFUL
new_leader_uuid: "25102c72ce134bd5a7369eda67c041d2"
from {username='slave'} at 127.0.0.1:35406
I20251023 07:57:38.881669 17098 raft_consensus.cc:606] T 621b0ed837604654a4fa0c14a0ca9c60 P a14159c3f4f3468eb16708bfb6c72677 [term 1 LEADER]: Received request to transfer leadership to TS 25102c72ce134bd5a7369eda67c041d2
I20251023 07:57:38.891654 17023 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "76bacff5c098439cb18968ff9dee3875"
dest_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641"
mode: GRACEFUL
new_leader_uuid: "25102c72ce134bd5a7369eda67c041d2"
from {username='slave'} at 127.0.0.1:36628
I20251023 07:57:38.892100 17023 raft_consensus.cc:606] T 76bacff5c098439cb18968ff9dee3875 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 2 LEADER]: Received request to transfer leadership to TS 25102c72ce134bd5a7369eda67c041d2
I20251023 07:57:38.893035 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20251023 07:57:38.893450 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 07:57:39.075783 17301 raft_consensus.cc:993] T 76bacff5c098439cb18968ff9dee3875 P 1eca84c8bc4e4fd48a9ec0b5146ea641: : Instructing follower 25102c72ce134bd5a7369eda67c041d2 to start an election
I20251023 07:57:39.076246 17311 raft_consensus.cc:1081] T 76bacff5c098439cb18968ff9dee3875 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 2 LEADER]: Signalling peer 25102c72ce134bd5a7369eda67c041d2 to start an election
I20251023 07:57:39.077729 17172 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "76bacff5c098439cb18968ff9dee3875"
dest_uuid: "25102c72ce134bd5a7369eda67c041d2"
from {username='slave'} at 127.0.0.1:48646
I20251023 07:57:39.078311 17172 raft_consensus.cc:493] T 76bacff5c098439cb18968ff9dee3875 P 25102c72ce134bd5a7369eda67c041d2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:57:39.078595 17172 raft_consensus.cc:3060] T 76bacff5c098439cb18968ff9dee3875 P 25102c72ce134bd5a7369eda67c041d2 [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:57:39.083070 17172 raft_consensus.cc:515] T 76bacff5c098439cb18968ff9dee3875 P 25102c72ce134bd5a7369eda67c041d2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:39.084517 17172 leader_election.cc:290] T 76bacff5c098439cb18968ff9dee3875 P 25102c72ce134bd5a7369eda67c041d2 [CANDIDATE]: Term 3 election: Requested vote from peers 1eca84c8bc4e4fd48a9ec0b5146ea641 (127.16.126.1:45063), a14159c3f4f3468eb16708bfb6c72677 (127.16.126.2:38731)
I20251023 07:57:39.085467 17023 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "76bacff5c098439cb18968ff9dee3875" candidate_uuid: "25102c72ce134bd5a7369eda67c041d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641"
I20251023 07:57:39.085620 17098 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "76bacff5c098439cb18968ff9dee3875" candidate_uuid: "25102c72ce134bd5a7369eda67c041d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a14159c3f4f3468eb16708bfb6c72677"
I20251023 07:57:39.086110 17023 raft_consensus.cc:3055] T 76bacff5c098439cb18968ff9dee3875 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 2 LEADER]: Stepping down as leader of term 2
I20251023 07:57:39.086124 17098 raft_consensus.cc:3060] T 76bacff5c098439cb18968ff9dee3875 P a14159c3f4f3468eb16708bfb6c72677 [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:57:39.086581 17023 raft_consensus.cc:740] T 76bacff5c098439cb18968ff9dee3875 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1eca84c8bc4e4fd48a9ec0b5146ea641, State: Running, Role: LEADER
I20251023 07:57:39.087374 17023 consensus_queue.cc:260] T 76bacff5c098439cb18968ff9dee3875 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:39.088606 17023 raft_consensus.cc:3060] T 76bacff5c098439cb18968ff9dee3875 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:57:39.093075 17098 raft_consensus.cc:2468] T 76bacff5c098439cb18968ff9dee3875 P a14159c3f4f3468eb16708bfb6c72677 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25102c72ce134bd5a7369eda67c041d2 in term 3.
I20251023 07:57:39.094374 17135 leader_election.cc:304] T 76bacff5c098439cb18968ff9dee3875 P 25102c72ce134bd5a7369eda67c041d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25102c72ce134bd5a7369eda67c041d2, a14159c3f4f3468eb16708bfb6c72677; no voters:
I20251023 07:57:39.094833 17023 raft_consensus.cc:2468] T 76bacff5c098439cb18968ff9dee3875 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25102c72ce134bd5a7369eda67c041d2 in term 3.
I20251023 07:57:39.095052 17285 raft_consensus.cc:2804] T 76bacff5c098439cb18968ff9dee3875 P 25102c72ce134bd5a7369eda67c041d2 [term 3 FOLLOWER]: Leader election won for term 3
I20251023 07:57:39.096215 17285 raft_consensus.cc:697] T 76bacff5c098439cb18968ff9dee3875 P 25102c72ce134bd5a7369eda67c041d2 [term 3 LEADER]: Becoming Leader. State: Replica: 25102c72ce134bd5a7369eda67c041d2, State: Running, Role: LEADER
I20251023 07:57:39.096880 17285 consensus_queue.cc:237] T 76bacff5c098439cb18968ff9dee3875 P 25102c72ce134bd5a7369eda67c041d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:39.106304 16917 catalog_manager.cc:5649] T 76bacff5c098439cb18968ff9dee3875 P 25102c72ce134bd5a7369eda67c041d2 reported cstate change: term changed from 2 to 3, leader changed from 1eca84c8bc4e4fd48a9ec0b5146ea641 (127.16.126.1) to 25102c72ce134bd5a7369eda67c041d2 (127.16.126.3). New cstate: current_term: 3 leader_uuid: "25102c72ce134bd5a7369eda67c041d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } health_report { overall_health: HEALTHY } } }
I20251023 07:57:39.196564 17275 raft_consensus.cc:993] T 621b0ed837604654a4fa0c14a0ca9c60 P a14159c3f4f3468eb16708bfb6c72677: : Instructing follower 25102c72ce134bd5a7369eda67c041d2 to start an election
I20251023 07:57:39.197002 17275 raft_consensus.cc:1081] T 621b0ed837604654a4fa0c14a0ca9c60 P a14159c3f4f3468eb16708bfb6c72677 [term 1 LEADER]: Signalling peer 25102c72ce134bd5a7369eda67c041d2 to start an election
I20251023 07:57:39.198426 17172 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "621b0ed837604654a4fa0c14a0ca9c60"
dest_uuid: "25102c72ce134bd5a7369eda67c041d2"
from {username='slave'} at 127.0.0.1:48644
I20251023 07:57:39.198946 17172 raft_consensus.cc:493] T 621b0ed837604654a4fa0c14a0ca9c60 P 25102c72ce134bd5a7369eda67c041d2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:57:39.199190 17172 raft_consensus.cc:3060] T 621b0ed837604654a4fa0c14a0ca9c60 P 25102c72ce134bd5a7369eda67c041d2 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:57:39.203691 17172 raft_consensus.cc:515] T 621b0ed837604654a4fa0c14a0ca9c60 P 25102c72ce134bd5a7369eda67c041d2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:39.205196 17172 leader_election.cc:290] T 621b0ed837604654a4fa0c14a0ca9c60 P 25102c72ce134bd5a7369eda67c041d2 [CANDIDATE]: Term 2 election: Requested vote from peers 1eca84c8bc4e4fd48a9ec0b5146ea641 (127.16.126.1:45063), a14159c3f4f3468eb16708bfb6c72677 (127.16.126.2:38731)
I20251023 07:57:39.206061 17023 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "621b0ed837604654a4fa0c14a0ca9c60" candidate_uuid: "25102c72ce134bd5a7369eda67c041d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641"
I20251023 07:57:39.206300 17098 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "621b0ed837604654a4fa0c14a0ca9c60" candidate_uuid: "25102c72ce134bd5a7369eda67c041d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a14159c3f4f3468eb16708bfb6c72677"
I20251023 07:57:39.206558 17023 raft_consensus.cc:3060] T 621b0ed837604654a4fa0c14a0ca9c60 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:57:39.206821 17098 raft_consensus.cc:3055] T 621b0ed837604654a4fa0c14a0ca9c60 P a14159c3f4f3468eb16708bfb6c72677 [term 1 LEADER]: Stepping down as leader of term 1
I20251023 07:57:39.207134 17098 raft_consensus.cc:740] T 621b0ed837604654a4fa0c14a0ca9c60 P a14159c3f4f3468eb16708bfb6c72677 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a14159c3f4f3468eb16708bfb6c72677, State: Running, Role: LEADER
I20251023 07:57:39.207763 17098 consensus_queue.cc:260] T 621b0ed837604654a4fa0c14a0ca9c60 P a14159c3f4f3468eb16708bfb6c72677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:39.208596 17098 raft_consensus.cc:3060] T 621b0ed837604654a4fa0c14a0ca9c60 P a14159c3f4f3468eb16708bfb6c72677 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:57:39.210750 17023 raft_consensus.cc:2468] T 621b0ed837604654a4fa0c14a0ca9c60 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25102c72ce134bd5a7369eda67c041d2 in term 2.
I20251023 07:57:39.211798 17135 leader_election.cc:304] T 621b0ed837604654a4fa0c14a0ca9c60 P 25102c72ce134bd5a7369eda67c041d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1eca84c8bc4e4fd48a9ec0b5146ea641, 25102c72ce134bd5a7369eda67c041d2; no voters:
I20251023 07:57:39.212500 17285 raft_consensus.cc:2804] T 621b0ed837604654a4fa0c14a0ca9c60 P 25102c72ce134bd5a7369eda67c041d2 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:57:39.212973 17285 raft_consensus.cc:697] T 621b0ed837604654a4fa0c14a0ca9c60 P 25102c72ce134bd5a7369eda67c041d2 [term 2 LEADER]: Becoming Leader. State: Replica: 25102c72ce134bd5a7369eda67c041d2, State: Running, Role: LEADER
I20251023 07:57:39.213523 17098 raft_consensus.cc:2468] T 621b0ed837604654a4fa0c14a0ca9c60 P a14159c3f4f3468eb16708bfb6c72677 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25102c72ce134bd5a7369eda67c041d2 in term 2.
I20251023 07:57:39.213842 17285 consensus_queue.cc:237] T 621b0ed837604654a4fa0c14a0ca9c60 P 25102c72ce134bd5a7369eda67c041d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:39.220229 16917 catalog_manager.cc:5649] T 621b0ed837604654a4fa0c14a0ca9c60 P 25102c72ce134bd5a7369eda67c041d2 reported cstate change: term changed from 1 to 2, leader changed from a14159c3f4f3468eb16708bfb6c72677 (127.16.126.2) to 25102c72ce134bd5a7369eda67c041d2 (127.16.126.3). New cstate: current_term: 2 leader_uuid: "25102c72ce134bd5a7369eda67c041d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } health_report { overall_health: HEALTHY } } }
I20251023 07:57:39.585641 17023 raft_consensus.cc:1275] T 76bacff5c098439cb18968ff9dee3875 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 3 FOLLOWER]: Refusing update from remote peer 25102c72ce134bd5a7369eda67c041d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251023 07:57:39.586750 17285 consensus_queue.cc:1048] T 76bacff5c098439cb18968ff9dee3875 P 25102c72ce134bd5a7369eda67c041d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:57:39.597608 17098 raft_consensus.cc:1275] T 76bacff5c098439cb18968ff9dee3875 P a14159c3f4f3468eb16708bfb6c72677 [term 3 FOLLOWER]: Refusing update from remote peer 25102c72ce134bd5a7369eda67c041d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251023 07:57:39.598870 17285 consensus_queue.cc:1048] T 76bacff5c098439cb18968ff9dee3875 P 25102c72ce134bd5a7369eda67c041d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20251023 07:57:39.611212 17023 raft_consensus.cc:1275] T 621b0ed837604654a4fa0c14a0ca9c60 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 2 FOLLOWER]: Refusing update from remote peer 25102c72ce134bd5a7369eda67c041d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:57:39.612342 17285 consensus_queue.cc:1048] T 621b0ed837604654a4fa0c14a0ca9c60 P 25102c72ce134bd5a7369eda67c041d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:57:39.622020 17098 raft_consensus.cc:1275] T 621b0ed837604654a4fa0c14a0ca9c60 P a14159c3f4f3468eb16708bfb6c72677 [term 2 FOLLOWER]: Refusing update from remote peer 25102c72ce134bd5a7369eda67c041d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:57:39.623431 17312 consensus_queue.cc:1048] T 621b0ed837604654a4fa0c14a0ca9c60 P 25102c72ce134bd5a7369eda67c041d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:57:39.894351 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:57:39.899917 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251023 07:57:39.900295 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 07:57:40.901181 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:57:40.906355 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251023 07:57:40.906786 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 07:57:41.908365 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:57:41.914572 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251023 07:57:41.914961 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 07:57:42.915843 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:57:42.920809 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251023 07:57:42.921173 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 07:57:43.922127 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:57:43.927277 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251023 07:57:43.927692 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 07:57:44.928610 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:57:44.933471 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251023 07:57:44.933898 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 07:57:45.934800 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:57:45.939731 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251023 07:57:45.940147 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 07:57:46.941030 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:57:46.945958 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251023 07:57:46.946425 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 07:57:47.980087 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:57:47.985091 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251023 07:57:47.985569 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
W20251023 07:57:48.395979 17044 debug-util.cc:398] Leaking SignalData structure 0x7b08000e6060 after lost signal to thread 16891
W20251023 07:57:48.396772 17044 debug-util.cc:398] Leaking SignalData structure 0x7b08000e6740 after lost signal to thread 16954
W20251023 07:57:48.397601 17044 debug-util.cc:398] Leaking SignalData structure 0x7b08001f1b60 after lost signal to thread 17047
W20251023 07:57:48.398281 17044 debug-util.cc:398] Leaking SignalData structure 0x7b08001f12a0 after lost signal to thread 17122
W20251023 07:57:48.398948 17044 debug-util.cc:398] Leaking SignalData structure 0x7b08001d3140 after lost signal to thread 17196
I20251023 07:57:49.016571 16888 auto_leader_rebalancer-test.cc:291] The leader distribution is
I20251023 07:57:49.037555 17022 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "734cd185b3ff45c59fa612ff8f546f6a"
dest_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641"
mode: GRACEFUL
new_leader_uuid: "a14159c3f4f3468eb16708bfb6c72677"
from {username='slave'} at 127.0.0.1:44972
I20251023 07:57:49.038564 17022 raft_consensus.cc:606] T 734cd185b3ff45c59fa612ff8f546f6a P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 2 LEADER]: Received request to transfer leadership to TS a14159c3f4f3468eb16708bfb6c72677
I20251023 07:57:49.044517 17172 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "76bacff5c098439cb18968ff9dee3875"
dest_uuid: "25102c72ce134bd5a7369eda67c041d2"
mode: GRACEFUL
new_leader_uuid: "a14159c3f4f3468eb16708bfb6c72677"
from {username='slave'} at 127.0.0.1:56684
I20251023 07:57:49.044999 17172 raft_consensus.cc:606] T 76bacff5c098439cb18968ff9dee3875 P 25102c72ce134bd5a7369eda67c041d2 [term 3 LEADER]: Received request to transfer leadership to TS a14159c3f4f3468eb16708bfb6c72677
I20251023 07:57:49.050459 17022 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "6bc67d2b65d64a338ebcfd3326790173"
dest_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641"
mode: GRACEFUL
new_leader_uuid: "a14159c3f4f3468eb16708bfb6c72677"
from {username='slave'} at 127.0.0.1:44972
I20251023 07:57:49.051213 17022 raft_consensus.cc:606] T 6bc67d2b65d64a338ebcfd3326790173 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 2 LEADER]: Received request to transfer leadership to TS a14159c3f4f3468eb16708bfb6c72677
I20251023 07:57:49.056169 17022 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "08671d08202b46c6b16e0271769eb119"
dest_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641"
mode: GRACEFUL
new_leader_uuid: "a14159c3f4f3468eb16708bfb6c72677"
from {username='slave'} at 127.0.0.1:44972
I20251023 07:57:49.056659 17022 raft_consensus.cc:606] T 08671d08202b46c6b16e0271769eb119 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 1 LEADER]: Received request to transfer leadership to TS a14159c3f4f3468eb16708bfb6c72677
I20251023 07:57:49.070232 17172 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "621b0ed837604654a4fa0c14a0ca9c60"
dest_uuid: "25102c72ce134bd5a7369eda67c041d2"
mode: GRACEFUL
new_leader_uuid: "a14159c3f4f3468eb16708bfb6c72677"
from {username='slave'} at 127.0.0.1:56684
I20251023 07:57:49.070717 17172 raft_consensus.cc:606] T 621b0ed837604654a4fa0c14a0ca9c60 P 25102c72ce134bd5a7369eda67c041d2 [term 2 LEADER]: Received request to transfer leadership to TS a14159c3f4f3468eb16708bfb6c72677
I20251023 07:57:49.233889 17348 raft_consensus.cc:993] T 6bc67d2b65d64a338ebcfd3326790173 P 1eca84c8bc4e4fd48a9ec0b5146ea641: : Instructing follower a14159c3f4f3468eb16708bfb6c72677 to start an election
I20251023 07:57:49.234483 17334 raft_consensus.cc:1081] T 6bc67d2b65d64a338ebcfd3326790173 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 2 LEADER]: Signalling peer a14159c3f4f3468eb16708bfb6c72677 to start an election
I20251023 07:57:49.236310 17098 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "6bc67d2b65d64a338ebcfd3326790173"
dest_uuid: "a14159c3f4f3468eb16708bfb6c72677"
from {username='slave'} at 127.0.0.1:43536
I20251023 07:57:49.236951 17098 raft_consensus.cc:493] T 6bc67d2b65d64a338ebcfd3326790173 P a14159c3f4f3468eb16708bfb6c72677 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:57:49.237380 17098 raft_consensus.cc:3060] T 6bc67d2b65d64a338ebcfd3326790173 P a14159c3f4f3468eb16708bfb6c72677 [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:57:49.245466 17098 raft_consensus.cc:515] T 6bc67d2b65d64a338ebcfd3326790173 P a14159c3f4f3468eb16708bfb6c72677 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:49.247675 17098 leader_election.cc:290] T 6bc67d2b65d64a338ebcfd3326790173 P a14159c3f4f3468eb16708bfb6c72677 [CANDIDATE]: Term 3 election: Requested vote from peers 1eca84c8bc4e4fd48a9ec0b5146ea641 (127.16.126.1:45063), 25102c72ce134bd5a7369eda67c041d2 (127.16.126.3:46201)
I20251023 07:57:49.248739 17172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6bc67d2b65d64a338ebcfd3326790173" candidate_uuid: "a14159c3f4f3468eb16708bfb6c72677" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "25102c72ce134bd5a7369eda67c041d2"
I20251023 07:57:49.248828 17022 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6bc67d2b65d64a338ebcfd3326790173" candidate_uuid: "a14159c3f4f3468eb16708bfb6c72677" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641"
I20251023 07:57:49.249598 17172 raft_consensus.cc:3060] T 6bc67d2b65d64a338ebcfd3326790173 P 25102c72ce134bd5a7369eda67c041d2 [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:57:49.249905 17022 raft_consensus.cc:3055] T 6bc67d2b65d64a338ebcfd3326790173 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 2 LEADER]: Stepping down as leader of term 2
I20251023 07:57:49.250286 17022 raft_consensus.cc:740] T 6bc67d2b65d64a338ebcfd3326790173 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1eca84c8bc4e4fd48a9ec0b5146ea641, State: Running, Role: LEADER
I20251023 07:57:49.251084 17022 consensus_queue.cc:260] T 6bc67d2b65d64a338ebcfd3326790173 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:49.252374 17022 raft_consensus.cc:3060] T 6bc67d2b65d64a338ebcfd3326790173 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:57:49.257037 17022 raft_consensus.cc:2468] T 6bc67d2b65d64a338ebcfd3326790173 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a14159c3f4f3468eb16708bfb6c72677 in term 3.
I20251023 07:57:49.257169 17172 raft_consensus.cc:2468] T 6bc67d2b65d64a338ebcfd3326790173 P 25102c72ce134bd5a7369eda67c041d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a14159c3f4f3468eb16708bfb6c72677 in term 3.
I20251023 07:57:49.258078 17170 raft_consensus.cc:1240] T 6bc67d2b65d64a338ebcfd3326790173 P 25102c72ce134bd5a7369eda67c041d2 [term 3 FOLLOWER]: Rejecting Update request from peer 1eca84c8bc4e4fd48a9ec0b5146ea641 for earlier term 2. Current term is 3. Ops: []
I20251023 07:57:49.258438 17061 leader_election.cc:304] T 6bc67d2b65d64a338ebcfd3326790173 P a14159c3f4f3468eb16708bfb6c72677 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1eca84c8bc4e4fd48a9ec0b5146ea641, a14159c3f4f3468eb16708bfb6c72677; no voters:
I20251023 07:57:49.259454 17333 raft_consensus.cc:2804] T 6bc67d2b65d64a338ebcfd3326790173 P a14159c3f4f3468eb16708bfb6c72677 [term 3 FOLLOWER]: Leader election won for term 3
I20251023 07:57:49.262938 17333 raft_consensus.cc:697] T 6bc67d2b65d64a338ebcfd3326790173 P a14159c3f4f3468eb16708bfb6c72677 [term 3 LEADER]: Becoming Leader. State: Replica: a14159c3f4f3468eb16708bfb6c72677, State: Running, Role: LEADER
I20251023 07:57:49.264039 17333 consensus_queue.cc:237] T 6bc67d2b65d64a338ebcfd3326790173 P a14159c3f4f3468eb16708bfb6c72677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:49.266988 17348 raft_consensus.cc:993] T 08671d08202b46c6b16e0271769eb119 P 1eca84c8bc4e4fd48a9ec0b5146ea641: : Instructing follower a14159c3f4f3468eb16708bfb6c72677 to start an election
I20251023 07:57:49.267421 17334 raft_consensus.cc:1081] T 08671d08202b46c6b16e0271769eb119 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 1 LEADER]: Signalling peer a14159c3f4f3468eb16708bfb6c72677 to start an election
I20251023 07:57:49.269261 17098 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "08671d08202b46c6b16e0271769eb119"
dest_uuid: "a14159c3f4f3468eb16708bfb6c72677"
from {username='slave'} at 127.0.0.1:43536
I20251023 07:57:49.269843 17098 raft_consensus.cc:493] T 08671d08202b46c6b16e0271769eb119 P a14159c3f4f3468eb16708bfb6c72677 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:57:49.270179 17098 raft_consensus.cc:3060] T 08671d08202b46c6b16e0271769eb119 P a14159c3f4f3468eb16708bfb6c72677 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:57:49.275704 17098 raft_consensus.cc:515] T 08671d08202b46c6b16e0271769eb119 P a14159c3f4f3468eb16708bfb6c72677 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:49.276729 16917 catalog_manager.cc:5649] T 6bc67d2b65d64a338ebcfd3326790173 P a14159c3f4f3468eb16708bfb6c72677 reported cstate change: term changed from 2 to 3, leader changed from 1eca84c8bc4e4fd48a9ec0b5146ea641 (127.16.126.1) to a14159c3f4f3468eb16708bfb6c72677 (127.16.126.2). New cstate: current_term: 3 leader_uuid: "a14159c3f4f3468eb16708bfb6c72677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } health_report { overall_health: UNKNOWN } } }
I20251023 07:57:49.277544 17098 leader_election.cc:290] T 08671d08202b46c6b16e0271769eb119 P a14159c3f4f3468eb16708bfb6c72677 [CANDIDATE]: Term 2 election: Requested vote from peers 1eca84c8bc4e4fd48a9ec0b5146ea641 (127.16.126.1:45063), 25102c72ce134bd5a7369eda67c041d2 (127.16.126.3:46201)
I20251023 07:57:49.278687 17170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08671d08202b46c6b16e0271769eb119" candidate_uuid: "a14159c3f4f3468eb16708bfb6c72677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "25102c72ce134bd5a7369eda67c041d2"
I20251023 07:57:49.279116 17170 raft_consensus.cc:3060] T 08671d08202b46c6b16e0271769eb119 P 25102c72ce134bd5a7369eda67c041d2 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:57:49.279467 17022 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08671d08202b46c6b16e0271769eb119" candidate_uuid: "a14159c3f4f3468eb16708bfb6c72677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641"
I20251023 07:57:49.280022 17022 raft_consensus.cc:3055] T 08671d08202b46c6b16e0271769eb119 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 1 LEADER]: Stepping down as leader of term 1
I20251023 07:57:49.280340 17022 raft_consensus.cc:740] T 08671d08202b46c6b16e0271769eb119 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1eca84c8bc4e4fd48a9ec0b5146ea641, State: Running, Role: LEADER
I20251023 07:57:49.281178 17022 consensus_queue.cc:260] T 08671d08202b46c6b16e0271769eb119 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:49.282418 17022 raft_consensus.cc:3060] T 08671d08202b46c6b16e0271769eb119 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:57:49.286196 17170 raft_consensus.cc:2468] T 08671d08202b46c6b16e0271769eb119 P 25102c72ce134bd5a7369eda67c041d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a14159c3f4f3468eb16708bfb6c72677 in term 2.
I20251023 07:57:49.287396 17061 leader_election.cc:304] T 08671d08202b46c6b16e0271769eb119 P a14159c3f4f3468eb16708bfb6c72677 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25102c72ce134bd5a7369eda67c041d2, a14159c3f4f3468eb16708bfb6c72677; no voters:
I20251023 07:57:49.288416 17333 raft_consensus.cc:2804] T 08671d08202b46c6b16e0271769eb119 P a14159c3f4f3468eb16708bfb6c72677 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:57:49.289223 17022 raft_consensus.cc:2468] T 08671d08202b46c6b16e0271769eb119 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a14159c3f4f3468eb16708bfb6c72677 in term 2.
I20251023 07:57:49.289366 17333 raft_consensus.cc:697] T 08671d08202b46c6b16e0271769eb119 P a14159c3f4f3468eb16708bfb6c72677 [term 2 LEADER]: Becoming Leader. State: Replica: a14159c3f4f3468eb16708bfb6c72677, State: Running, Role: LEADER
I20251023 07:57:49.290550 17333 consensus_queue.cc:237] T 08671d08202b46c6b16e0271769eb119 P a14159c3f4f3468eb16708bfb6c72677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:49.315346 16917 catalog_manager.cc:5649] T 08671d08202b46c6b16e0271769eb119 P a14159c3f4f3468eb16708bfb6c72677 reported cstate change: term changed from 1 to 2, leader changed from 1eca84c8bc4e4fd48a9ec0b5146ea641 (127.16.126.1) to a14159c3f4f3468eb16708bfb6c72677 (127.16.126.2). New cstate: current_term: 2 leader_uuid: "a14159c3f4f3468eb16708bfb6c72677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } health_report { overall_health: UNKNOWN } } }
I20251023 07:57:49.325834 17337 raft_consensus.cc:993] T 76bacff5c098439cb18968ff9dee3875 P 25102c72ce134bd5a7369eda67c041d2: : Instructing follower a14159c3f4f3468eb16708bfb6c72677 to start an election
I20251023 07:57:49.326582 17356 raft_consensus.cc:1081] T 76bacff5c098439cb18968ff9dee3875 P 25102c72ce134bd5a7369eda67c041d2 [term 3 LEADER]: Signalling peer a14159c3f4f3468eb16708bfb6c72677 to start an election
I20251023 07:57:49.328925 17098 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "76bacff5c098439cb18968ff9dee3875"
dest_uuid: "a14159c3f4f3468eb16708bfb6c72677"
from {username='slave'} at 127.0.0.1:43520
I20251023 07:57:49.329530 17098 raft_consensus.cc:493] T 76bacff5c098439cb18968ff9dee3875 P a14159c3f4f3468eb16708bfb6c72677 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:57:49.329882 17098 raft_consensus.cc:3060] T 76bacff5c098439cb18968ff9dee3875 P a14159c3f4f3468eb16708bfb6c72677 [term 3 FOLLOWER]: Advancing to term 4
I20251023 07:57:49.336648 17098 raft_consensus.cc:515] T 76bacff5c098439cb18968ff9dee3875 P a14159c3f4f3468eb16708bfb6c72677 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:49.338497 17098 leader_election.cc:290] T 76bacff5c098439cb18968ff9dee3875 P a14159c3f4f3468eb16708bfb6c72677 [CANDIDATE]: Term 4 election: Requested vote from peers 1eca84c8bc4e4fd48a9ec0b5146ea641 (127.16.126.1:45063), 25102c72ce134bd5a7369eda67c041d2 (127.16.126.3:46201)
I20251023 07:57:49.339385 17022 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "76bacff5c098439cb18968ff9dee3875" candidate_uuid: "a14159c3f4f3468eb16708bfb6c72677" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641"
I20251023 07:57:49.339476 17170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "76bacff5c098439cb18968ff9dee3875" candidate_uuid: "a14159c3f4f3468eb16708bfb6c72677" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "25102c72ce134bd5a7369eda67c041d2"
I20251023 07:57:49.340068 17022 raft_consensus.cc:3060] T 76bacff5c098439cb18968ff9dee3875 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 3 FOLLOWER]: Advancing to term 4
I20251023 07:57:49.340128 17170 raft_consensus.cc:3055] T 76bacff5c098439cb18968ff9dee3875 P 25102c72ce134bd5a7369eda67c041d2 [term 3 LEADER]: Stepping down as leader of term 3
I20251023 07:57:49.340500 17170 raft_consensus.cc:740] T 76bacff5c098439cb18968ff9dee3875 P 25102c72ce134bd5a7369eda67c041d2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 25102c72ce134bd5a7369eda67c041d2, State: Running, Role: LEADER
I20251023 07:57:49.341264 17170 consensus_queue.cc:260] T 76bacff5c098439cb18968ff9dee3875 P 25102c72ce134bd5a7369eda67c041d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:49.342550 17170 raft_consensus.cc:3060] T 76bacff5c098439cb18968ff9dee3875 P 25102c72ce134bd5a7369eda67c041d2 [term 3 FOLLOWER]: Advancing to term 4
I20251023 07:57:49.345072 17022 raft_consensus.cc:2468] T 76bacff5c098439cb18968ff9dee3875 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a14159c3f4f3468eb16708bfb6c72677 in term 4.
I20251023 07:57:49.346099 17061 leader_election.cc:304] T 76bacff5c098439cb18968ff9dee3875 P a14159c3f4f3468eb16708bfb6c72677 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1eca84c8bc4e4fd48a9ec0b5146ea641, a14159c3f4f3468eb16708bfb6c72677; no voters:
I20251023 07:57:49.346985 17349 raft_consensus.cc:2804] T 76bacff5c098439cb18968ff9dee3875 P a14159c3f4f3468eb16708bfb6c72677 [term 4 FOLLOWER]: Leader election won for term 4
I20251023 07:57:49.347429 17349 raft_consensus.cc:697] T 76bacff5c098439cb18968ff9dee3875 P a14159c3f4f3468eb16708bfb6c72677 [term 4 LEADER]: Becoming Leader. State: Replica: a14159c3f4f3468eb16708bfb6c72677, State: Running, Role: LEADER
I20251023 07:57:49.348006 17334 raft_consensus.cc:993] T 734cd185b3ff45c59fa612ff8f546f6a P 1eca84c8bc4e4fd48a9ec0b5146ea641: : Instructing follower a14159c3f4f3468eb16708bfb6c72677 to start an election
I20251023 07:57:49.348454 17334 raft_consensus.cc:1081] T 734cd185b3ff45c59fa612ff8f546f6a P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 2 LEADER]: Signalling peer a14159c3f4f3468eb16708bfb6c72677 to start an election
I20251023 07:57:49.348277 17349 consensus_queue.cc:237] T 76bacff5c098439cb18968ff9dee3875 P a14159c3f4f3468eb16708bfb6c72677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:49.350421 17096 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "734cd185b3ff45c59fa612ff8f546f6a"
dest_uuid: "a14159c3f4f3468eb16708bfb6c72677"
from {username='slave'} at 127.0.0.1:43536
I20251023 07:57:49.351027 17096 raft_consensus.cc:493] T 734cd185b3ff45c59fa612ff8f546f6a P a14159c3f4f3468eb16708bfb6c72677 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:57:49.351449 17096 raft_consensus.cc:3060] T 734cd185b3ff45c59fa612ff8f546f6a P a14159c3f4f3468eb16708bfb6c72677 [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:57:49.351413 17170 raft_consensus.cc:2468] T 76bacff5c098439cb18968ff9dee3875 P 25102c72ce134bd5a7369eda67c041d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a14159c3f4f3468eb16708bfb6c72677 in term 4.
I20251023 07:57:49.357623 16917 catalog_manager.cc:5649] T 76bacff5c098439cb18968ff9dee3875 P a14159c3f4f3468eb16708bfb6c72677 reported cstate change: term changed from 3 to 4, leader changed from 25102c72ce134bd5a7369eda67c041d2 (127.16.126.3) to a14159c3f4f3468eb16708bfb6c72677 (127.16.126.2). New cstate: current_term: 4 leader_uuid: "a14159c3f4f3468eb16708bfb6c72677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } health_report { overall_health: UNKNOWN } } }
I20251023 07:57:49.359515 17096 raft_consensus.cc:515] T 734cd185b3ff45c59fa612ff8f546f6a P a14159c3f4f3468eb16708bfb6c72677 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } } peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } }
I20251023 07:57:49.361163 17096 leader_election.cc:290] T 734cd185b3ff45c59fa612ff8f546f6a P a14159c3f4f3468eb16708bfb6c72677 [CANDIDATE]: Term 3 election: Requested vote from peers 25102c72ce134bd5a7369eda67c041d2 (127.16.126.3:46201), 1eca84c8bc4e4fd48a9ec0b5146ea641 (127.16.126.1:45063)
I20251023 07:57:49.362784 17022 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "734cd185b3ff45c59fa612ff8f546f6a" candidate_uuid: "a14159c3f4f3468eb16708bfb6c72677" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641"
I20251023 07:57:49.363348 17022 raft_consensus.cc:3055] T 734cd185b3ff45c59fa612ff8f546f6a P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 2 LEADER]: Stepping down as leader of term 2
I20251023 07:57:49.363674 17022 raft_consensus.cc:740] T 734cd185b3ff45c59fa612ff8f546f6a P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1eca84c8bc4e4fd48a9ec0b5146ea641, State: Running, Role: LEADER
I20251023 07:57:49.362442 17170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "734cd185b3ff45c59fa612ff8f546f6a" candidate_uuid: "a14159c3f4f3468eb16708bfb6c72677" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "25102c72ce134bd5a7369eda67c041d2"
I20251023 07:57:49.364357 17170 raft_consensus.cc:3060] T 734cd185b3ff45c59fa612ff8f546f6a P 25102c72ce134bd5a7369eda67c041d2 [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:57:49.364537 17022 consensus_queue.cc:260] T 734cd185b3ff45c59fa612ff8f546f6a P 1eca84c8bc4e4fd48a9ec0b5146ea641 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } } peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } }
I20251023 07:57:49.365875 17022 raft_consensus.cc:3060] T 734cd185b3ff45c59fa612ff8f546f6a P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:57:49.371766 17170 raft_consensus.cc:2468] T 734cd185b3ff45c59fa612ff8f546f6a P 25102c72ce134bd5a7369eda67c041d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a14159c3f4f3468eb16708bfb6c72677 in term 3.
I20251023 07:57:49.372087 17022 raft_consensus.cc:2468] T 734cd185b3ff45c59fa612ff8f546f6a P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a14159c3f4f3468eb16708bfb6c72677 in term 3.
I20251023 07:57:49.372882 17061 leader_election.cc:304] T 734cd185b3ff45c59fa612ff8f546f6a P a14159c3f4f3468eb16708bfb6c72677 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25102c72ce134bd5a7369eda67c041d2, a14159c3f4f3468eb16708bfb6c72677; no voters:
I20251023 07:57:49.373553 17349 raft_consensus.cc:2804] T 734cd185b3ff45c59fa612ff8f546f6a P a14159c3f4f3468eb16708bfb6c72677 [term 3 FOLLOWER]: Leader election won for term 3
I20251023 07:57:49.373996 17349 raft_consensus.cc:697] T 734cd185b3ff45c59fa612ff8f546f6a P a14159c3f4f3468eb16708bfb6c72677 [term 3 LEADER]: Becoming Leader. State: Replica: a14159c3f4f3468eb16708bfb6c72677, State: Running, Role: LEADER
I20251023 07:57:49.374737 17349 consensus_queue.cc:237] T 734cd185b3ff45c59fa612ff8f546f6a P a14159c3f4f3468eb16708bfb6c72677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } } peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } }
I20251023 07:57:49.382593 16917 catalog_manager.cc:5649] T 734cd185b3ff45c59fa612ff8f546f6a P a14159c3f4f3468eb16708bfb6c72677 reported cstate change: term changed from 2 to 3, leader changed from 1eca84c8bc4e4fd48a9ec0b5146ea641 (127.16.126.1) to a14159c3f4f3468eb16708bfb6c72677 (127.16.126.2). New cstate: current_term: 3 leader_uuid: "a14159c3f4f3468eb16708bfb6c72677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } health_report { overall_health: HEALTHY } } }
I20251023 07:57:49.438184 17337 raft_consensus.cc:993] T 621b0ed837604654a4fa0c14a0ca9c60 P 25102c72ce134bd5a7369eda67c041d2: : Instructing follower a14159c3f4f3468eb16708bfb6c72677 to start an election
I20251023 07:57:49.438695 17356 raft_consensus.cc:1081] T 621b0ed837604654a4fa0c14a0ca9c60 P 25102c72ce134bd5a7369eda67c041d2 [term 2 LEADER]: Signalling peer a14159c3f4f3468eb16708bfb6c72677 to start an election
I20251023 07:57:49.440160 17096 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "621b0ed837604654a4fa0c14a0ca9c60"
dest_uuid: "a14159c3f4f3468eb16708bfb6c72677"
from {username='slave'} at 127.0.0.1:43520
I20251023 07:57:49.440634 17096 raft_consensus.cc:493] T 621b0ed837604654a4fa0c14a0ca9c60 P a14159c3f4f3468eb16708bfb6c72677 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:57:49.440925 17096 raft_consensus.cc:3060] T 621b0ed837604654a4fa0c14a0ca9c60 P a14159c3f4f3468eb16708bfb6c72677 [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:57:49.446112 17096 raft_consensus.cc:515] T 621b0ed837604654a4fa0c14a0ca9c60 P a14159c3f4f3468eb16708bfb6c72677 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:49.447741 17096 leader_election.cc:290] T 621b0ed837604654a4fa0c14a0ca9c60 P a14159c3f4f3468eb16708bfb6c72677 [CANDIDATE]: Term 3 election: Requested vote from peers 1eca84c8bc4e4fd48a9ec0b5146ea641 (127.16.126.1:45063), 25102c72ce134bd5a7369eda67c041d2 (127.16.126.3:46201)
I20251023 07:57:49.448803 17170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "621b0ed837604654a4fa0c14a0ca9c60" candidate_uuid: "a14159c3f4f3468eb16708bfb6c72677" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "25102c72ce134bd5a7369eda67c041d2"
I20251023 07:57:49.448803 17022 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "621b0ed837604654a4fa0c14a0ca9c60" candidate_uuid: "a14159c3f4f3468eb16708bfb6c72677" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641"
I20251023 07:57:49.449587 17170 raft_consensus.cc:3055] T 621b0ed837604654a4fa0c14a0ca9c60 P 25102c72ce134bd5a7369eda67c041d2 [term 2 LEADER]: Stepping down as leader of term 2
I20251023 07:57:49.449717 17022 raft_consensus.cc:3060] T 621b0ed837604654a4fa0c14a0ca9c60 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:57:49.449932 17170 raft_consensus.cc:740] T 621b0ed837604654a4fa0c14a0ca9c60 P 25102c72ce134bd5a7369eda67c041d2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 25102c72ce134bd5a7369eda67c041d2, State: Running, Role: LEADER
I20251023 07:57:49.450673 17170 consensus_queue.cc:260] T 621b0ed837604654a4fa0c14a0ca9c60 P 25102c72ce134bd5a7369eda67c041d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:49.451831 17170 raft_consensus.cc:3060] T 621b0ed837604654a4fa0c14a0ca9c60 P 25102c72ce134bd5a7369eda67c041d2 [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:57:49.456393 17022 raft_consensus.cc:2468] T 621b0ed837604654a4fa0c14a0ca9c60 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a14159c3f4f3468eb16708bfb6c72677 in term 3.
I20251023 07:57:49.457551 17061 leader_election.cc:304] T 621b0ed837604654a4fa0c14a0ca9c60 P a14159c3f4f3468eb16708bfb6c72677 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1eca84c8bc4e4fd48a9ec0b5146ea641, a14159c3f4f3468eb16708bfb6c72677; no voters:
I20251023 07:57:49.458096 17170 raft_consensus.cc:2468] T 621b0ed837604654a4fa0c14a0ca9c60 P 25102c72ce134bd5a7369eda67c041d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a14159c3f4f3468eb16708bfb6c72677 in term 3.
I20251023 07:57:49.458433 17349 raft_consensus.cc:2804] T 621b0ed837604654a4fa0c14a0ca9c60 P a14159c3f4f3468eb16708bfb6c72677 [term 3 FOLLOWER]: Leader election won for term 3
I20251023 07:57:49.458976 17349 raft_consensus.cc:697] T 621b0ed837604654a4fa0c14a0ca9c60 P a14159c3f4f3468eb16708bfb6c72677 [term 3 LEADER]: Becoming Leader. State: Replica: a14159c3f4f3468eb16708bfb6c72677, State: Running, Role: LEADER
I20251023 07:57:49.459852 17349 consensus_queue.cc:237] T 621b0ed837604654a4fa0c14a0ca9c60 P a14159c3f4f3468eb16708bfb6c72677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:49.468403 16917 catalog_manager.cc:5649] T 621b0ed837604654a4fa0c14a0ca9c60 P a14159c3f4f3468eb16708bfb6c72677 reported cstate change: term changed from 2 to 3, leader changed from 25102c72ce134bd5a7369eda67c041d2 (127.16.126.3) to a14159c3f4f3468eb16708bfb6c72677 (127.16.126.2). New cstate: current_term: 3 leader_uuid: "a14159c3f4f3468eb16708bfb6c72677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } health_report { overall_health: UNKNOWN } } }
I20251023 07:57:49.646064 17170 raft_consensus.cc:1275] T 6bc67d2b65d64a338ebcfd3326790173 P 25102c72ce134bd5a7369eda67c041d2 [term 3 FOLLOWER]: Refusing update from remote peer a14159c3f4f3468eb16708bfb6c72677: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251023 07:57:49.647275 17349 consensus_queue.cc:1048] T 6bc67d2b65d64a338ebcfd3326790173 P a14159c3f4f3468eb16708bfb6c72677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:57:49.661751 17022 raft_consensus.cc:1275] T 6bc67d2b65d64a338ebcfd3326790173 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 3 FOLLOWER]: Refusing update from remote peer a14159c3f4f3468eb16708bfb6c72677: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251023 07:57:49.663203 17349 consensus_queue.cc:1048] T 6bc67d2b65d64a338ebcfd3326790173 P a14159c3f4f3468eb16708bfb6c72677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:57:49.777650 17170 raft_consensus.cc:1275] T 08671d08202b46c6b16e0271769eb119 P 25102c72ce134bd5a7369eda67c041d2 [term 2 FOLLOWER]: Refusing update from remote peer a14159c3f4f3468eb16708bfb6c72677: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:57:49.779003 17349 consensus_queue.cc:1048] T 08671d08202b46c6b16e0271769eb119 P a14159c3f4f3468eb16708bfb6c72677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:57:49.790535 17172 raft_consensus.cc:1275] T 76bacff5c098439cb18968ff9dee3875 P 25102c72ce134bd5a7369eda67c041d2 [term 4 FOLLOWER]: Refusing update from remote peer a14159c3f4f3468eb16708bfb6c72677: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20251023 07:57:49.792469 17349 consensus_queue.cc:1048] T 76bacff5c098439cb18968ff9dee3875 P a14159c3f4f3468eb16708bfb6c72677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:57:49.800675 17022 raft_consensus.cc:1275] T 08671d08202b46c6b16e0271769eb119 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 2 FOLLOWER]: Refusing update from remote peer a14159c3f4f3468eb16708bfb6c72677: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:57:49.803201 17349 consensus_queue.cc:1048] T 08671d08202b46c6b16e0271769eb119 P a14159c3f4f3468eb16708bfb6c72677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20251023 07:57:49.811926 17023 raft_consensus.cc:1275] T 76bacff5c098439cb18968ff9dee3875 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 4 FOLLOWER]: Refusing update from remote peer a14159c3f4f3468eb16708bfb6c72677: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20251023 07:57:49.813700 17366 consensus_queue.cc:1048] T 76bacff5c098439cb18968ff9dee3875 P a14159c3f4f3468eb16708bfb6c72677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20251023 07:57:49.839155 17170 raft_consensus.cc:1275] T 734cd185b3ff45c59fa612ff8f546f6a P 25102c72ce134bd5a7369eda67c041d2 [term 3 FOLLOWER]: Refusing update from remote peer a14159c3f4f3468eb16708bfb6c72677: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251023 07:57:49.840451 17349 consensus_queue.cc:1048] T 734cd185b3ff45c59fa612ff8f546f6a P a14159c3f4f3468eb16708bfb6c72677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:57:49.851648 17023 raft_consensus.cc:1275] T 734cd185b3ff45c59fa612ff8f546f6a P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 3 FOLLOWER]: Refusing update from remote peer a14159c3f4f3468eb16708bfb6c72677: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251023 07:57:49.856056 17349 consensus_queue.cc:1048] T 734cd185b3ff45c59fa612ff8f546f6a P a14159c3f4f3468eb16708bfb6c72677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:57:49.897184 17022 raft_consensus.cc:1275] T 621b0ed837604654a4fa0c14a0ca9c60 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 3 FOLLOWER]: Refusing update from remote peer a14159c3f4f3468eb16708bfb6c72677: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251023 07:57:49.898718 17349 consensus_queue.cc:1048] T 621b0ed837604654a4fa0c14a0ca9c60 P a14159c3f4f3468eb16708bfb6c72677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:57:49.908309 17170 raft_consensus.cc:1275] T 621b0ed837604654a4fa0c14a0ca9c60 P 25102c72ce134bd5a7369eda67c041d2 [term 3 FOLLOWER]: Refusing update from remote peer a14159c3f4f3468eb16708bfb6c72677: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251023 07:57:49.909834 17366 consensus_queue.cc:1048] T 621b0ed837604654a4fa0c14a0ca9c60 P a14159c3f4f3468eb16708bfb6c72677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:57:52.103564 16888 auto_leader_rebalancer-test.cc:306] The leader distribution is
I20251023 07:57:52.104359 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:57:52.111236 17096 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "01f422ecb29f444098d80a283dd67a53"
dest_uuid: "a14159c3f4f3468eb16708bfb6c72677"
mode: GRACEFUL
new_leader_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641"
from {username='slave'} at 127.0.0.1:35406
I20251023 07:57:52.111907 17096 raft_consensus.cc:606] T 01f422ecb29f444098d80a283dd67a53 P a14159c3f4f3468eb16708bfb6c72677 [term 2 LEADER]: Received request to transfer leadership to TS 1eca84c8bc4e4fd48a9ec0b5146ea641
I20251023 07:57:52.114434 17096 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "08671d08202b46c6b16e0271769eb119"
dest_uuid: "a14159c3f4f3468eb16708bfb6c72677"
mode: GRACEFUL
new_leader_uuid: "25102c72ce134bd5a7369eda67c041d2"
from {username='slave'} at 127.0.0.1:35406
I20251023 07:57:52.114902 17096 raft_consensus.cc:606] T 08671d08202b46c6b16e0271769eb119 P a14159c3f4f3468eb16708bfb6c72677 [term 2 LEADER]: Received request to transfer leadership to TS 25102c72ce134bd5a7369eda67c041d2
I20251023 07:57:52.116997 17096 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "621b0ed837604654a4fa0c14a0ca9c60"
dest_uuid: "a14159c3f4f3468eb16708bfb6c72677"
mode: GRACEFUL
new_leader_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641"
from {username='slave'} at 127.0.0.1:35406
I20251023 07:57:52.117533 17096 raft_consensus.cc:606] T 621b0ed837604654a4fa0c14a0ca9c60 P a14159c3f4f3468eb16708bfb6c72677 [term 3 LEADER]: Received request to transfer leadership to TS 1eca84c8bc4e4fd48a9ec0b5146ea641
I20251023 07:57:52.119571 17096 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "76bacff5c098439cb18968ff9dee3875"
dest_uuid: "a14159c3f4f3468eb16708bfb6c72677"
mode: GRACEFUL
new_leader_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641"
from {username='slave'} at 127.0.0.1:35406
I20251023 07:57:52.120007 17096 raft_consensus.cc:606] T 76bacff5c098439cb18968ff9dee3875 P a14159c3f4f3468eb16708bfb6c72677 [term 4 LEADER]: Received request to transfer leadership to TS 1eca84c8bc4e4fd48a9ec0b5146ea641
I20251023 07:57:52.121979 17096 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "bb55cfe6314c4d27bb86dcaa2bb135a8"
dest_uuid: "a14159c3f4f3468eb16708bfb6c72677"
mode: GRACEFUL
new_leader_uuid: "25102c72ce134bd5a7369eda67c041d2"
from {username='slave'} at 127.0.0.1:35406
I20251023 07:57:52.122403 17096 raft_consensus.cc:606] T bb55cfe6314c4d27bb86dcaa2bb135a8 P a14159c3f4f3468eb16708bfb6c72677 [term 1 LEADER]: Received request to transfer leadership to TS 25102c72ce134bd5a7369eda67c041d2
I20251023 07:57:52.123284 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20251023 07:57:52.123713 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 07:57:52.226891 17333 raft_consensus.cc:993] T 01f422ecb29f444098d80a283dd67a53 P a14159c3f4f3468eb16708bfb6c72677: : Instructing follower 1eca84c8bc4e4fd48a9ec0b5146ea641 to start an election
I20251023 07:57:52.227270 17333 raft_consensus.cc:1081] T 01f422ecb29f444098d80a283dd67a53 P a14159c3f4f3468eb16708bfb6c72677 [term 2 LEADER]: Signalling peer 1eca84c8bc4e4fd48a9ec0b5146ea641 to start an election
I20251023 07:57:52.228665 17022 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "01f422ecb29f444098d80a283dd67a53"
dest_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641"
from {username='slave'} at 127.0.0.1:38428
I20251023 07:57:52.229089 17022 raft_consensus.cc:493] T 01f422ecb29f444098d80a283dd67a53 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:57:52.229367 17022 raft_consensus.cc:3060] T 01f422ecb29f444098d80a283dd67a53 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:57:52.234421 17022 raft_consensus.cc:515] T 01f422ecb29f444098d80a283dd67a53 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:52.236420 17022 leader_election.cc:290] T 01f422ecb29f444098d80a283dd67a53 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [CANDIDATE]: Term 3 election: Requested vote from peers a14159c3f4f3468eb16708bfb6c72677 (127.16.126.2:38731), 25102c72ce134bd5a7369eda67c041d2 (127.16.126.3:46201)
I20251023 07:57:52.237612 17096 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01f422ecb29f444098d80a283dd67a53" candidate_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a14159c3f4f3468eb16708bfb6c72677"
I20251023 07:57:52.238011 17170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01f422ecb29f444098d80a283dd67a53" candidate_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "25102c72ce134bd5a7369eda67c041d2"
I20251023 07:57:52.238476 17096 raft_consensus.cc:3055] T 01f422ecb29f444098d80a283dd67a53 P a14159c3f4f3468eb16708bfb6c72677 [term 2 LEADER]: Stepping down as leader of term 2
I20251023 07:57:52.238523 17170 raft_consensus.cc:3060] T 01f422ecb29f444098d80a283dd67a53 P 25102c72ce134bd5a7369eda67c041d2 [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:57:52.238919 17096 raft_consensus.cc:740] T 01f422ecb29f444098d80a283dd67a53 P a14159c3f4f3468eb16708bfb6c72677 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a14159c3f4f3468eb16708bfb6c72677, State: Running, Role: LEADER
I20251023 07:57:52.239778 17096 consensus_queue.cc:260] T 01f422ecb29f444098d80a283dd67a53 P a14159c3f4f3468eb16708bfb6c72677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:52.241263 17096 raft_consensus.cc:3060] T 01f422ecb29f444098d80a283dd67a53 P a14159c3f4f3468eb16708bfb6c72677 [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:57:52.246114 17170 raft_consensus.cc:2468] T 01f422ecb29f444098d80a283dd67a53 P 25102c72ce134bd5a7369eda67c041d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1eca84c8bc4e4fd48a9ec0b5146ea641 in term 3.
I20251023 07:57:52.247555 16986 leader_election.cc:304] T 01f422ecb29f444098d80a283dd67a53 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1eca84c8bc4e4fd48a9ec0b5146ea641, 25102c72ce134bd5a7369eda67c041d2; no voters:
I20251023 07:57:52.248270 17096 raft_consensus.cc:2468] T 01f422ecb29f444098d80a283dd67a53 P a14159c3f4f3468eb16708bfb6c72677 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1eca84c8bc4e4fd48a9ec0b5146ea641 in term 3.
I20251023 07:57:52.249215 17377 raft_consensus.cc:2804] T 01f422ecb29f444098d80a283dd67a53 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 3 FOLLOWER]: Leader election won for term 3
I20251023 07:57:52.250197 17377 raft_consensus.cc:697] T 01f422ecb29f444098d80a283dd67a53 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 3 LEADER]: Becoming Leader. State: Replica: 1eca84c8bc4e4fd48a9ec0b5146ea641, State: Running, Role: LEADER
I20251023 07:57:52.250978 17377 consensus_queue.cc:237] T 01f422ecb29f444098d80a283dd67a53 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:52.257653 16919 catalog_manager.cc:5649] T 01f422ecb29f444098d80a283dd67a53 P 1eca84c8bc4e4fd48a9ec0b5146ea641 reported cstate change: term changed from 2 to 3, leader changed from a14159c3f4f3468eb16708bfb6c72677 (127.16.126.2) to 1eca84c8bc4e4fd48a9ec0b5146ea641 (127.16.126.1). New cstate: current_term: 3 leader_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } health_report { overall_health: UNKNOWN } } }
I20251023 07:57:52.293242 17376 raft_consensus.cc:993] T 76bacff5c098439cb18968ff9dee3875 P a14159c3f4f3468eb16708bfb6c72677: : Instructing follower 1eca84c8bc4e4fd48a9ec0b5146ea641 to start an election
I20251023 07:57:52.293691 17333 raft_consensus.cc:1081] T 76bacff5c098439cb18968ff9dee3875 P a14159c3f4f3468eb16708bfb6c72677 [term 4 LEADER]: Signalling peer 1eca84c8bc4e4fd48a9ec0b5146ea641 to start an election
I20251023 07:57:52.294986 17022 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "76bacff5c098439cb18968ff9dee3875"
dest_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641"
from {username='slave'} at 127.0.0.1:38428
I20251023 07:57:52.295384 17022 raft_consensus.cc:493] T 76bacff5c098439cb18968ff9dee3875 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:57:52.295600 17022 raft_consensus.cc:3060] T 76bacff5c098439cb18968ff9dee3875 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 4 FOLLOWER]: Advancing to term 5
I20251023 07:57:52.299625 17022 raft_consensus.cc:515] T 76bacff5c098439cb18968ff9dee3875 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:52.300906 17022 leader_election.cc:290] T 76bacff5c098439cb18968ff9dee3875 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [CANDIDATE]: Term 5 election: Requested vote from peers a14159c3f4f3468eb16708bfb6c72677 (127.16.126.2:38731), 25102c72ce134bd5a7369eda67c041d2 (127.16.126.3:46201)
I20251023 07:57:52.301923 17096 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "76bacff5c098439cb18968ff9dee3875" candidate_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "a14159c3f4f3468eb16708bfb6c72677"
I20251023 07:57:52.302012 17170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "76bacff5c098439cb18968ff9dee3875" candidate_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "25102c72ce134bd5a7369eda67c041d2"
I20251023 07:57:52.302407 17096 raft_consensus.cc:3055] T 76bacff5c098439cb18968ff9dee3875 P a14159c3f4f3468eb16708bfb6c72677 [term 4 LEADER]: Stepping down as leader of term 4
I20251023 07:57:52.302482 17170 raft_consensus.cc:3060] T 76bacff5c098439cb18968ff9dee3875 P 25102c72ce134bd5a7369eda67c041d2 [term 4 FOLLOWER]: Advancing to term 5
I20251023 07:57:52.302688 17096 raft_consensus.cc:740] T 76bacff5c098439cb18968ff9dee3875 P a14159c3f4f3468eb16708bfb6c72677 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a14159c3f4f3468eb16708bfb6c72677, State: Running, Role: LEADER
I20251023 07:57:52.303392 17096 consensus_queue.cc:260] T 76bacff5c098439cb18968ff9dee3875 P a14159c3f4f3468eb16708bfb6c72677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:52.304352 17096 raft_consensus.cc:3060] T 76bacff5c098439cb18968ff9dee3875 P a14159c3f4f3468eb16708bfb6c72677 [term 4 FOLLOWER]: Advancing to term 5
I20251023 07:57:52.307044 17170 raft_consensus.cc:2468] T 76bacff5c098439cb18968ff9dee3875 P 25102c72ce134bd5a7369eda67c041d2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1eca84c8bc4e4fd48a9ec0b5146ea641 in term 5.
I20251023 07:57:52.308079 16986 leader_election.cc:304] T 76bacff5c098439cb18968ff9dee3875 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1eca84c8bc4e4fd48a9ec0b5146ea641, 25102c72ce134bd5a7369eda67c041d2; no voters:
I20251023 07:57:52.308703 17377 raft_consensus.cc:2804] T 76bacff5c098439cb18968ff9dee3875 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 5 FOLLOWER]: Leader election won for term 5
I20251023 07:57:52.309060 17377 raft_consensus.cc:697] T 76bacff5c098439cb18968ff9dee3875 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 5 LEADER]: Becoming Leader. State: Replica: 1eca84c8bc4e4fd48a9ec0b5146ea641, State: Running, Role: LEADER
I20251023 07:57:52.309484 17096 raft_consensus.cc:2468] T 76bacff5c098439cb18968ff9dee3875 P a14159c3f4f3468eb16708bfb6c72677 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1eca84c8bc4e4fd48a9ec0b5146ea641 in term 5.
I20251023 07:57:52.309890 17377 consensus_queue.cc:237] T 76bacff5c098439cb18968ff9dee3875 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:52.316601 16919 catalog_manager.cc:5649] T 76bacff5c098439cb18968ff9dee3875 P 1eca84c8bc4e4fd48a9ec0b5146ea641 reported cstate change: term changed from 4 to 5, leader changed from a14159c3f4f3468eb16708bfb6c72677 (127.16.126.2) to 1eca84c8bc4e4fd48a9ec0b5146ea641 (127.16.126.1). New cstate: current_term: 5 leader_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } health_report { overall_health: UNKNOWN } } }
I20251023 07:57:52.356073 17376 raft_consensus.cc:993] T 08671d08202b46c6b16e0271769eb119 P a14159c3f4f3468eb16708bfb6c72677: : Instructing follower 25102c72ce134bd5a7369eda67c041d2 to start an election
I20251023 07:57:52.356494 17333 raft_consensus.cc:1081] T 08671d08202b46c6b16e0271769eb119 P a14159c3f4f3468eb16708bfb6c72677 [term 2 LEADER]: Signalling peer 25102c72ce134bd5a7369eda67c041d2 to start an election
I20251023 07:57:52.357901 17170 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "08671d08202b46c6b16e0271769eb119"
dest_uuid: "25102c72ce134bd5a7369eda67c041d2"
from {username='slave'} at 127.0.0.1:48644
I20251023 07:57:52.358285 17170 raft_consensus.cc:493] T 08671d08202b46c6b16e0271769eb119 P 25102c72ce134bd5a7369eda67c041d2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:57:52.358517 17170 raft_consensus.cc:3060] T 08671d08202b46c6b16e0271769eb119 P 25102c72ce134bd5a7369eda67c041d2 [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:57:52.362769 17170 raft_consensus.cc:515] T 08671d08202b46c6b16e0271769eb119 P 25102c72ce134bd5a7369eda67c041d2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:52.364513 17170 leader_election.cc:290] T 08671d08202b46c6b16e0271769eb119 P 25102c72ce134bd5a7369eda67c041d2 [CANDIDATE]: Term 3 election: Requested vote from peers 1eca84c8bc4e4fd48a9ec0b5146ea641 (127.16.126.1:45063), a14159c3f4f3468eb16708bfb6c72677 (127.16.126.2:38731)
I20251023 07:57:52.365476 17022 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08671d08202b46c6b16e0271769eb119" candidate_uuid: "25102c72ce134bd5a7369eda67c041d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641"
I20251023 07:57:52.365692 17096 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08671d08202b46c6b16e0271769eb119" candidate_uuid: "25102c72ce134bd5a7369eda67c041d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a14159c3f4f3468eb16708bfb6c72677"
I20251023 07:57:52.366076 17022 raft_consensus.cc:3060] T 08671d08202b46c6b16e0271769eb119 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:57:52.366195 17096 raft_consensus.cc:3055] T 08671d08202b46c6b16e0271769eb119 P a14159c3f4f3468eb16708bfb6c72677 [term 2 LEADER]: Stepping down as leader of term 2
I20251023 07:57:52.366537 17096 raft_consensus.cc:740] T 08671d08202b46c6b16e0271769eb119 P a14159c3f4f3468eb16708bfb6c72677 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a14159c3f4f3468eb16708bfb6c72677, State: Running, Role: LEADER
I20251023 07:57:52.367303 17096 consensus_queue.cc:260] T 08671d08202b46c6b16e0271769eb119 P a14159c3f4f3468eb16708bfb6c72677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:52.368525 17096 raft_consensus.cc:3060] T 08671d08202b46c6b16e0271769eb119 P a14159c3f4f3468eb16708bfb6c72677 [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:57:52.372511 17022 raft_consensus.cc:2468] T 08671d08202b46c6b16e0271769eb119 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25102c72ce134bd5a7369eda67c041d2 in term 3.
I20251023 07:57:52.373886 17135 leader_election.cc:304] T 08671d08202b46c6b16e0271769eb119 P 25102c72ce134bd5a7369eda67c041d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1eca84c8bc4e4fd48a9ec0b5146ea641, 25102c72ce134bd5a7369eda67c041d2; no voters:
I20251023 07:57:52.374814 17356 raft_consensus.cc:2804] T 08671d08202b46c6b16e0271769eb119 P 25102c72ce134bd5a7369eda67c041d2 [term 3 FOLLOWER]: Leader election won for term 3
I20251023 07:57:52.375097 17096 raft_consensus.cc:2468] T 08671d08202b46c6b16e0271769eb119 P a14159c3f4f3468eb16708bfb6c72677 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25102c72ce134bd5a7369eda67c041d2 in term 3.
I20251023 07:57:52.376134 17356 raft_consensus.cc:697] T 08671d08202b46c6b16e0271769eb119 P 25102c72ce134bd5a7369eda67c041d2 [term 3 LEADER]: Becoming Leader. State: Replica: 25102c72ce134bd5a7369eda67c041d2, State: Running, Role: LEADER
I20251023 07:57:52.376942 17356 consensus_queue.cc:237] T 08671d08202b46c6b16e0271769eb119 P 25102c72ce134bd5a7369eda67c041d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:52.384105 16919 catalog_manager.cc:5649] T 08671d08202b46c6b16e0271769eb119 P 25102c72ce134bd5a7369eda67c041d2 reported cstate change: term changed from 2 to 3, leader changed from a14159c3f4f3468eb16708bfb6c72677 (127.16.126.2) to 25102c72ce134bd5a7369eda67c041d2 (127.16.126.3). New cstate: current_term: 3 leader_uuid: "25102c72ce134bd5a7369eda67c041d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } health_report { overall_health: HEALTHY } } }
I20251023 07:57:52.596681 17376 raft_consensus.cc:993] T 621b0ed837604654a4fa0c14a0ca9c60 P a14159c3f4f3468eb16708bfb6c72677: : Instructing follower 1eca84c8bc4e4fd48a9ec0b5146ea641 to start an election
I20251023 07:57:52.597102 17333 raft_consensus.cc:1081] T 621b0ed837604654a4fa0c14a0ca9c60 P a14159c3f4f3468eb16708bfb6c72677 [term 3 LEADER]: Signalling peer 1eca84c8bc4e4fd48a9ec0b5146ea641 to start an election
I20251023 07:57:52.598444 17022 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "621b0ed837604654a4fa0c14a0ca9c60"
dest_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641"
from {username='slave'} at 127.0.0.1:38428
I20251023 07:57:52.598883 17022 raft_consensus.cc:493] T 621b0ed837604654a4fa0c14a0ca9c60 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:57:52.599188 17022 raft_consensus.cc:3060] T 621b0ed837604654a4fa0c14a0ca9c60 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 3 FOLLOWER]: Advancing to term 4
I20251023 07:57:52.603261 17022 raft_consensus.cc:515] T 621b0ed837604654a4fa0c14a0ca9c60 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:52.604534 17022 leader_election.cc:290] T 621b0ed837604654a4fa0c14a0ca9c60 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [CANDIDATE]: Term 4 election: Requested vote from peers a14159c3f4f3468eb16708bfb6c72677 (127.16.126.2:38731), 25102c72ce134bd5a7369eda67c041d2 (127.16.126.3:46201)
I20251023 07:57:52.605494 17096 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "621b0ed837604654a4fa0c14a0ca9c60" candidate_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a14159c3f4f3468eb16708bfb6c72677"
I20251023 07:57:52.605665 17170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "621b0ed837604654a4fa0c14a0ca9c60" candidate_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "25102c72ce134bd5a7369eda67c041d2"
I20251023 07:57:52.605943 17096 raft_consensus.cc:3055] T 621b0ed837604654a4fa0c14a0ca9c60 P a14159c3f4f3468eb16708bfb6c72677 [term 3 LEADER]: Stepping down as leader of term 3
I20251023 07:57:52.606104 17170 raft_consensus.cc:3060] T 621b0ed837604654a4fa0c14a0ca9c60 P 25102c72ce134bd5a7369eda67c041d2 [term 3 FOLLOWER]: Advancing to term 4
I20251023 07:57:52.606233 17096 raft_consensus.cc:740] T 621b0ed837604654a4fa0c14a0ca9c60 P a14159c3f4f3468eb16708bfb6c72677 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a14159c3f4f3468eb16708bfb6c72677, State: Running, Role: LEADER
I20251023 07:57:52.606986 17096 consensus_queue.cc:260] T 621b0ed837604654a4fa0c14a0ca9c60 P a14159c3f4f3468eb16708bfb6c72677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:52.608033 17096 raft_consensus.cc:3060] T 621b0ed837604654a4fa0c14a0ca9c60 P a14159c3f4f3468eb16708bfb6c72677 [term 3 FOLLOWER]: Advancing to term 4
I20251023 07:57:52.610657 17170 raft_consensus.cc:2468] T 621b0ed837604654a4fa0c14a0ca9c60 P 25102c72ce134bd5a7369eda67c041d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1eca84c8bc4e4fd48a9ec0b5146ea641 in term 4.
I20251023 07:57:52.611614 16986 leader_election.cc:304] T 621b0ed837604654a4fa0c14a0ca9c60 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1eca84c8bc4e4fd48a9ec0b5146ea641, 25102c72ce134bd5a7369eda67c041d2; no voters:
I20251023 07:57:52.612242 17377 raft_consensus.cc:2804] T 621b0ed837604654a4fa0c14a0ca9c60 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 4 FOLLOWER]: Leader election won for term 4
I20251023 07:57:52.612723 17377 raft_consensus.cc:697] T 621b0ed837604654a4fa0c14a0ca9c60 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 4 LEADER]: Becoming Leader. State: Replica: 1eca84c8bc4e4fd48a9ec0b5146ea641, State: Running, Role: LEADER
I20251023 07:57:52.613037 17096 raft_consensus.cc:2468] T 621b0ed837604654a4fa0c14a0ca9c60 P a14159c3f4f3468eb16708bfb6c72677 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1eca84c8bc4e4fd48a9ec0b5146ea641 in term 4.
I20251023 07:57:52.613690 17377 consensus_queue.cc:237] T 621b0ed837604654a4fa0c14a0ca9c60 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:52.620218 16919 catalog_manager.cc:5649] T 621b0ed837604654a4fa0c14a0ca9c60 P 1eca84c8bc4e4fd48a9ec0b5146ea641 reported cstate change: term changed from 3 to 4, leader changed from a14159c3f4f3468eb16708bfb6c72677 (127.16.126.2) to 1eca84c8bc4e4fd48a9ec0b5146ea641 (127.16.126.1). New cstate: current_term: 4 leader_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } health_report { overall_health: UNKNOWN } } }
I20251023 07:57:52.648449 17376 raft_consensus.cc:993] T bb55cfe6314c4d27bb86dcaa2bb135a8 P a14159c3f4f3468eb16708bfb6c72677: : Instructing follower 25102c72ce134bd5a7369eda67c041d2 to start an election
I20251023 07:57:52.648875 17333 raft_consensus.cc:1081] T bb55cfe6314c4d27bb86dcaa2bb135a8 P a14159c3f4f3468eb16708bfb6c72677 [term 1 LEADER]: Signalling peer 25102c72ce134bd5a7369eda67c041d2 to start an election
I20251023 07:57:52.650156 17170 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "bb55cfe6314c4d27bb86dcaa2bb135a8"
dest_uuid: "25102c72ce134bd5a7369eda67c041d2"
from {username='slave'} at 127.0.0.1:48644
I20251023 07:57:52.650583 17170 raft_consensus.cc:493] T bb55cfe6314c4d27bb86dcaa2bb135a8 P 25102c72ce134bd5a7369eda67c041d2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:57:52.650847 17170 raft_consensus.cc:3060] T bb55cfe6314c4d27bb86dcaa2bb135a8 P 25102c72ce134bd5a7369eda67c041d2 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:57:52.654790 17170 raft_consensus.cc:515] T bb55cfe6314c4d27bb86dcaa2bb135a8 P 25102c72ce134bd5a7369eda67c041d2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:52.656149 17170 leader_election.cc:290] T bb55cfe6314c4d27bb86dcaa2bb135a8 P 25102c72ce134bd5a7369eda67c041d2 [CANDIDATE]: Term 2 election: Requested vote from peers 1eca84c8bc4e4fd48a9ec0b5146ea641 (127.16.126.1:45063), a14159c3f4f3468eb16708bfb6c72677 (127.16.126.2:38731)
I20251023 07:57:52.656946 17022 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bb55cfe6314c4d27bb86dcaa2bb135a8" candidate_uuid: "25102c72ce134bd5a7369eda67c041d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641"
I20251023 07:57:52.657212 17096 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bb55cfe6314c4d27bb86dcaa2bb135a8" candidate_uuid: "25102c72ce134bd5a7369eda67c041d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a14159c3f4f3468eb16708bfb6c72677"
I20251023 07:57:52.657485 17022 raft_consensus.cc:3060] T bb55cfe6314c4d27bb86dcaa2bb135a8 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:57:52.657773 17096 raft_consensus.cc:3055] T bb55cfe6314c4d27bb86dcaa2bb135a8 P a14159c3f4f3468eb16708bfb6c72677 [term 1 LEADER]: Stepping down as leader of term 1
I20251023 07:57:52.658057 17096 raft_consensus.cc:740] T bb55cfe6314c4d27bb86dcaa2bb135a8 P a14159c3f4f3468eb16708bfb6c72677 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a14159c3f4f3468eb16708bfb6c72677, State: Running, Role: LEADER
I20251023 07:57:52.658783 17096 consensus_queue.cc:260] T bb55cfe6314c4d27bb86dcaa2bb135a8 P a14159c3f4f3468eb16708bfb6c72677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:52.659708 17096 raft_consensus.cc:3060] T bb55cfe6314c4d27bb86dcaa2bb135a8 P a14159c3f4f3468eb16708bfb6c72677 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:57:52.662056 17022 raft_consensus.cc:2468] T bb55cfe6314c4d27bb86dcaa2bb135a8 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25102c72ce134bd5a7369eda67c041d2 in term 2.
I20251023 07:57:52.663045 17135 leader_election.cc:304] T bb55cfe6314c4d27bb86dcaa2bb135a8 P 25102c72ce134bd5a7369eda67c041d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1eca84c8bc4e4fd48a9ec0b5146ea641, 25102c72ce134bd5a7369eda67c041d2; no voters:
I20251023 07:57:52.663727 17356 raft_consensus.cc:2804] T bb55cfe6314c4d27bb86dcaa2bb135a8 P 25102c72ce134bd5a7369eda67c041d2 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:57:52.663874 17170 raft_consensus.cc:1275] T 01f422ecb29f444098d80a283dd67a53 P 25102c72ce134bd5a7369eda67c041d2 [term 3 FOLLOWER]: Refusing update from remote peer 1eca84c8bc4e4fd48a9ec0b5146ea641: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251023 07:57:52.664124 17356 raft_consensus.cc:697] T bb55cfe6314c4d27bb86dcaa2bb135a8 P 25102c72ce134bd5a7369eda67c041d2 [term 2 LEADER]: Becoming Leader. State: Replica: 25102c72ce134bd5a7369eda67c041d2, State: Running, Role: LEADER
I20251023 07:57:52.665016 17356 consensus_queue.cc:237] T bb55cfe6314c4d27bb86dcaa2bb135a8 P 25102c72ce134bd5a7369eda67c041d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } }
I20251023 07:57:52.665279 17377 consensus_queue.cc:1048] T 01f422ecb29f444098d80a283dd67a53 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:57:52.665973 17096 raft_consensus.cc:2468] T bb55cfe6314c4d27bb86dcaa2bb135a8 P a14159c3f4f3468eb16708bfb6c72677 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25102c72ce134bd5a7369eda67c041d2 in term 2.
I20251023 07:57:52.673398 16919 catalog_manager.cc:5649] T bb55cfe6314c4d27bb86dcaa2bb135a8 P 25102c72ce134bd5a7369eda67c041d2 reported cstate change: term changed from 1 to 2, leader changed from a14159c3f4f3468eb16708bfb6c72677 (127.16.126.2) to 25102c72ce134bd5a7369eda67c041d2 (127.16.126.3). New cstate: current_term: 2 leader_uuid: "25102c72ce134bd5a7369eda67c041d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 } health_report { overall_health: HEALTHY } } }
I20251023 07:57:52.676383 17096 raft_consensus.cc:1275] T 01f422ecb29f444098d80a283dd67a53 P a14159c3f4f3468eb16708bfb6c72677 [term 3 FOLLOWER]: Refusing update from remote peer 1eca84c8bc4e4fd48a9ec0b5146ea641: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251023 07:57:52.679982 17377 consensus_queue.cc:1048] T 01f422ecb29f444098d80a283dd67a53 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20251023 07:57:52.738461 17096 raft_consensus.cc:1275] T 76bacff5c098439cb18968ff9dee3875 P a14159c3f4f3468eb16708bfb6c72677 [term 5 FOLLOWER]: Refusing update from remote peer 1eca84c8bc4e4fd48a9ec0b5146ea641: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20251023 07:57:52.739539 17377 consensus_queue.cc:1048] T 76bacff5c098439cb18968ff9dee3875 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20251023 07:57:52.748451 17171 raft_consensus.cc:1275] T 76bacff5c098439cb18968ff9dee3875 P 25102c72ce134bd5a7369eda67c041d2 [term 5 FOLLOWER]: Refusing update from remote peer 1eca84c8bc4e4fd48a9ec0b5146ea641: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20251023 07:57:52.750034 17377 consensus_queue.cc:1048] T 76bacff5c098439cb18968ff9dee3875 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20251023 07:57:52.774152 17096 raft_consensus.cc:1275] T 08671d08202b46c6b16e0271769eb119 P a14159c3f4f3468eb16708bfb6c72677 [term 3 FOLLOWER]: Refusing update from remote peer 25102c72ce134bd5a7369eda67c041d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251023 07:57:52.775375 17356 consensus_queue.cc:1048] T 08671d08202b46c6b16e0271769eb119 P 25102c72ce134bd5a7369eda67c041d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:57:52.784430 17022 raft_consensus.cc:1275] T 08671d08202b46c6b16e0271769eb119 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 3 FOLLOWER]: Refusing update from remote peer 25102c72ce134bd5a7369eda67c041d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251023 07:57:52.785828 17356 consensus_queue.cc:1048] T 08671d08202b46c6b16e0271769eb119 P 25102c72ce134bd5a7369eda67c041d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:57:53.030452 17096 raft_consensus.cc:1275] T 621b0ed837604654a4fa0c14a0ca9c60 P a14159c3f4f3468eb16708bfb6c72677 [term 4 FOLLOWER]: Refusing update from remote peer 1eca84c8bc4e4fd48a9ec0b5146ea641: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20251023 07:57:53.031592 17377 consensus_queue.cc:1048] T 621b0ed837604654a4fa0c14a0ca9c60 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:57:53.040026 17171 raft_consensus.cc:1275] T 621b0ed837604654a4fa0c14a0ca9c60 P 25102c72ce134bd5a7369eda67c041d2 [term 4 FOLLOWER]: Refusing update from remote peer 1eca84c8bc4e4fd48a9ec0b5146ea641: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20251023 07:57:53.041698 17378 consensus_queue.cc:1048] T 621b0ed837604654a4fa0c14a0ca9c60 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25102c72ce134bd5a7369eda67c041d2" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20251023 07:57:53.124882 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:57:53.129673 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251023 07:57:53.130084 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 07:57:53.136646 17022 raft_consensus.cc:1275] T bb55cfe6314c4d27bb86dcaa2bb135a8 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 2 FOLLOWER]: Refusing update from remote peer 25102c72ce134bd5a7369eda67c041d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:57:53.137945 17356 consensus_queue.cc:1048] T bb55cfe6314c4d27bb86dcaa2bb135a8 P 25102c72ce134bd5a7369eda67c041d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1eca84c8bc4e4fd48a9ec0b5146ea641" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 45063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:57:53.146994 17096 raft_consensus.cc:1275] T bb55cfe6314c4d27bb86dcaa2bb135a8 P a14159c3f4f3468eb16708bfb6c72677 [term 2 FOLLOWER]: Refusing update from remote peer 25102c72ce134bd5a7369eda67c041d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:57:53.149092 17398 consensus_queue.cc:1048] T bb55cfe6314c4d27bb86dcaa2bb135a8 P 25102c72ce134bd5a7369eda67c041d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a14159c3f4f3468eb16708bfb6c72677" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 38731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:57:54.131124 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:57:54.135885 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251023 07:57:54.136328 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 07:57:55.137270 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:57:55.142977 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251023 07:57:55.143405 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 07:57:56.144403 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:57:56.149327 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251023 07:57:56.149864 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 07:57:57.150947 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:57:57.155787 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251023 07:57:57.156211 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 07:57:58.157265 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:57:58.162495 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251023 07:57:58.162931 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 07:57:59.163877 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:57:59.168830 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251023 07:57:59.169462 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 07:58:00.170624 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:58:00.175441 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251023 07:58:00.175817 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 07:58:01.176951 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:58:01.182399 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251023 07:58:01.182811 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 07:58:02.216495 16888 auto_leader_rebalancer-test.cc:318] The leader distribution is
I20251023 07:58:02.217115 16888 tablet_server.cc:178] TabletServer@127.16.126.1:0 shutting down...
I20251023 07:58:02.254882 16888 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251023 07:58:02.255714 16888 tablet_replica.cc:333] T 01f422ecb29f444098d80a283dd67a53 P 1eca84c8bc4e4fd48a9ec0b5146ea641: stopping tablet replica
I20251023 07:58:02.256479 16888 raft_consensus.cc:2243] T 01f422ecb29f444098d80a283dd67a53 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 3 LEADER]: Raft consensus shutting down.
I20251023 07:58:02.257542 16888 raft_consensus.cc:2272] T 01f422ecb29f444098d80a283dd67a53 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:02.260031 16888 tablet_replica.cc:333] T bb55cfe6314c4d27bb86dcaa2bb135a8 P 1eca84c8bc4e4fd48a9ec0b5146ea641: stopping tablet replica
I20251023 07:58:02.260535 16888 raft_consensus.cc:2243] T bb55cfe6314c4d27bb86dcaa2bb135a8 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:58:02.261022 16888 raft_consensus.cc:2272] T bb55cfe6314c4d27bb86dcaa2bb135a8 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:02.262796 16888 tablet_replica.cc:333] T 76bacff5c098439cb18968ff9dee3875 P 1eca84c8bc4e4fd48a9ec0b5146ea641: stopping tablet replica
I20251023 07:58:02.263290 16888 raft_consensus.cc:2243] T 76bacff5c098439cb18968ff9dee3875 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 5 LEADER]: Raft consensus shutting down.
I20251023 07:58:02.264140 16888 raft_consensus.cc:2272] T 76bacff5c098439cb18968ff9dee3875 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 5 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:02.266040 16888 tablet_replica.cc:333] T 08671d08202b46c6b16e0271769eb119 P 1eca84c8bc4e4fd48a9ec0b5146ea641: stopping tablet replica
I20251023 07:58:02.266532 16888 raft_consensus.cc:2243] T 08671d08202b46c6b16e0271769eb119 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251023 07:58:02.266924 16888 raft_consensus.cc:2272] T 08671d08202b46c6b16e0271769eb119 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:02.268633 16888 tablet_replica.cc:333] T 734cd185b3ff45c59fa612ff8f546f6a P 1eca84c8bc4e4fd48a9ec0b5146ea641: stopping tablet replica
I20251023 07:58:02.269061 16888 raft_consensus.cc:2243] T 734cd185b3ff45c59fa612ff8f546f6a P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251023 07:58:02.269515 16888 raft_consensus.cc:2272] T 734cd185b3ff45c59fa612ff8f546f6a P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:02.271164 16888 tablet_replica.cc:333] T 30d4cc48296446b49a4e32822c8be1bf P 1eca84c8bc4e4fd48a9ec0b5146ea641: stopping tablet replica
I20251023 07:58:02.271631 16888 raft_consensus.cc:2243] T 30d4cc48296446b49a4e32822c8be1bf P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:58:02.272060 16888 raft_consensus.cc:2272] T 30d4cc48296446b49a4e32822c8be1bf P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:02.273876 16888 tablet_replica.cc:333] T 8f48d577e386480a905dc2367cf209ab P 1eca84c8bc4e4fd48a9ec0b5146ea641: stopping tablet replica
I20251023 07:58:02.274312 16888 raft_consensus.cc:2243] T 8f48d577e386480a905dc2367cf209ab P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:58:02.274636 16888 raft_consensus.cc:2272] T 8f48d577e386480a905dc2367cf209ab P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:02.276417 16888 tablet_replica.cc:333] T 621b0ed837604654a4fa0c14a0ca9c60 P 1eca84c8bc4e4fd48a9ec0b5146ea641: stopping tablet replica
I20251023 07:58:02.276875 16888 raft_consensus.cc:2243] T 621b0ed837604654a4fa0c14a0ca9c60 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 4 LEADER]: Raft consensus shutting down.
I20251023 07:58:02.277658 16888 raft_consensus.cc:2272] T 621b0ed837604654a4fa0c14a0ca9c60 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 4 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:02.279548 16888 tablet_replica.cc:333] T 6bc67d2b65d64a338ebcfd3326790173 P 1eca84c8bc4e4fd48a9ec0b5146ea641: stopping tablet replica
I20251023 07:58:02.280051 16888 raft_consensus.cc:2243] T 6bc67d2b65d64a338ebcfd3326790173 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251023 07:58:02.280506 16888 raft_consensus.cc:2272] T 6bc67d2b65d64a338ebcfd3326790173 P 1eca84c8bc4e4fd48a9ec0b5146ea641 [term 3 FOLLOWER]: Raft consensus is shut down!
W20251023 07:58:02.356107 17135 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.16.126.1:45063: connect: Connection refused (error 111)
W20251023 07:58:02.370530 17135 consensus_peers.cc:597] T bb55cfe6314c4d27bb86dcaa2bb135a8 P 25102c72ce134bd5a7369eda67c041d2 -> Peer 1eca84c8bc4e4fd48a9ec0b5146ea641 (127.16.126.1:45063): Couldn't send request to peer 1eca84c8bc4e4fd48a9ec0b5146ea641. Status: Network error: Client connection negotiation failed: client connection to 127.16.126.1:45063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251023 07:58:02.388403 16888 tablet_server.cc:195] TabletServer@127.16.126.1:0 shutdown complete.
W20251023 07:58:02.395157 17061 consensus_peers.cc:597] T 8f48d577e386480a905dc2367cf209ab P a14159c3f4f3468eb16708bfb6c72677 -> Peer 1eca84c8bc4e4fd48a9ec0b5146ea641 (127.16.126.1:45063): Couldn't send request to peer 1eca84c8bc4e4fd48a9ec0b5146ea641. Status: Network error: Client connection negotiation failed: client connection to 127.16.126.1:45063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251023 07:58:02.410665 16888 tablet_server.cc:178] TabletServer@127.16.126.2:0 shutting down...
W20251023 07:58:02.416499 17061 consensus_peers.cc:597] T 734cd185b3ff45c59fa612ff8f546f6a P a14159c3f4f3468eb16708bfb6c72677 -> Peer 1eca84c8bc4e4fd48a9ec0b5146ea641 (127.16.126.1:45063): Couldn't send request to peer 1eca84c8bc4e4fd48a9ec0b5146ea641. Status: Network error: Client connection negotiation failed: client connection to 127.16.126.1:45063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251023 07:58:02.437250 16888 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251023 07:58:02.437953 16888 tablet_replica.cc:333] T 01f422ecb29f444098d80a283dd67a53 P a14159c3f4f3468eb16708bfb6c72677: stopping tablet replica
I20251023 07:58:02.438630 16888 raft_consensus.cc:2243] T 01f422ecb29f444098d80a283dd67a53 P a14159c3f4f3468eb16708bfb6c72677 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251023 07:58:02.439141 16888 raft_consensus.cc:2272] T 01f422ecb29f444098d80a283dd67a53 P a14159c3f4f3468eb16708bfb6c72677 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:02.441526 16888 tablet_replica.cc:333] T 8f48d577e386480a905dc2367cf209ab P a14159c3f4f3468eb16708bfb6c72677: stopping tablet replica
I20251023 07:58:02.441996 16888 raft_consensus.cc:2243] T 8f48d577e386480a905dc2367cf209ab P a14159c3f4f3468eb16708bfb6c72677 [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:58:02.442816 16888 raft_consensus.cc:2272] T 8f48d577e386480a905dc2367cf209ab P a14159c3f4f3468eb16708bfb6c72677 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:02.444808 16888 tablet_replica.cc:333] T bb55cfe6314c4d27bb86dcaa2bb135a8 P a14159c3f4f3468eb16708bfb6c72677: stopping tablet replica
I20251023 07:58:02.445317 16888 raft_consensus.cc:2243] T bb55cfe6314c4d27bb86dcaa2bb135a8 P a14159c3f4f3468eb16708bfb6c72677 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:58:02.445924 16888 raft_consensus.cc:2272] T bb55cfe6314c4d27bb86dcaa2bb135a8 P a14159c3f4f3468eb16708bfb6c72677 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:02.447654 16888 tablet_replica.cc:333] T 08671d08202b46c6b16e0271769eb119 P a14159c3f4f3468eb16708bfb6c72677: stopping tablet replica
I20251023 07:58:02.448252 16888 raft_consensus.cc:2243] T 08671d08202b46c6b16e0271769eb119 P a14159c3f4f3468eb16708bfb6c72677 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251023 07:58:02.448642 16888 raft_consensus.cc:2272] T 08671d08202b46c6b16e0271769eb119 P a14159c3f4f3468eb16708bfb6c72677 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:02.450300 16888 tablet_replica.cc:333] T 76bacff5c098439cb18968ff9dee3875 P a14159c3f4f3468eb16708bfb6c72677: stopping tablet replica
I20251023 07:58:02.450848 16888 raft_consensus.cc:2243] T 76bacff5c098439cb18968ff9dee3875 P a14159c3f4f3468eb16708bfb6c72677 [term 5 FOLLOWER]: Raft consensus shutting down.
I20251023 07:58:02.451265 16888 raft_consensus.cc:2272] T 76bacff5c098439cb18968ff9dee3875 P a14159c3f4f3468eb16708bfb6c72677 [term 5 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:02.452896 16888 tablet_replica.cc:333] T 6bc67d2b65d64a338ebcfd3326790173 P a14159c3f4f3468eb16708bfb6c72677: stopping tablet replica
I20251023 07:58:02.453362 16888 raft_consensus.cc:2243] T 6bc67d2b65d64a338ebcfd3326790173 P a14159c3f4f3468eb16708bfb6c72677 [term 3 LEADER]: Raft consensus shutting down.
I20251023 07:58:02.454162 16888 raft_consensus.cc:2272] T 6bc67d2b65d64a338ebcfd3326790173 P a14159c3f4f3468eb16708bfb6c72677 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:02.455855 16888 tablet_replica.cc:333] T 621b0ed837604654a4fa0c14a0ca9c60 P a14159c3f4f3468eb16708bfb6c72677: stopping tablet replica
I20251023 07:58:02.456363 16888 raft_consensus.cc:2243] T 621b0ed837604654a4fa0c14a0ca9c60 P a14159c3f4f3468eb16708bfb6c72677 [term 4 FOLLOWER]: Raft consensus shutting down.
I20251023 07:58:02.456748 16888 raft_consensus.cc:2272] T 621b0ed837604654a4fa0c14a0ca9c60 P a14159c3f4f3468eb16708bfb6c72677 [term 4 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:02.458523 16888 tablet_replica.cc:333] T 734cd185b3ff45c59fa612ff8f546f6a P a14159c3f4f3468eb16708bfb6c72677: stopping tablet replica
I20251023 07:58:02.458961 16888 raft_consensus.cc:2243] T 734cd185b3ff45c59fa612ff8f546f6a P a14159c3f4f3468eb16708bfb6c72677 [term 3 LEADER]: Raft consensus shutting down.
I20251023 07:58:02.459705 16888 raft_consensus.cc:2272] T 734cd185b3ff45c59fa612ff8f546f6a P a14159c3f4f3468eb16708bfb6c72677 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:02.461272 16888 tablet_replica.cc:333] T 30d4cc48296446b49a4e32822c8be1bf P a14159c3f4f3468eb16708bfb6c72677: stopping tablet replica
I20251023 07:58:02.461701 16888 raft_consensus.cc:2243] T 30d4cc48296446b49a4e32822c8be1bf P a14159c3f4f3468eb16708bfb6c72677 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:58:02.462136 16888 raft_consensus.cc:2272] T 30d4cc48296446b49a4e32822c8be1bf P a14159c3f4f3468eb16708bfb6c72677 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:02.491185 16888 tablet_server.cc:195] TabletServer@127.16.126.2:0 shutdown complete.
W20251023 07:58:02.493542 17135 consensus_peers.cc:597] T 08671d08202b46c6b16e0271769eb119 P 25102c72ce134bd5a7369eda67c041d2 -> Peer a14159c3f4f3468eb16708bfb6c72677 (127.16.126.2:38731): Couldn't send request to peer a14159c3f4f3468eb16708bfb6c72677. Status: Network error: Client connection negotiation failed: client connection to 127.16.126.2:38731: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251023 07:58:02.497771 17135 consensus_peers.cc:597] T 30d4cc48296446b49a4e32822c8be1bf P 25102c72ce134bd5a7369eda67c041d2 -> Peer a14159c3f4f3468eb16708bfb6c72677 (127.16.126.2:38731): Couldn't send request to peer a14159c3f4f3468eb16708bfb6c72677. Status: Network error: Client connection negotiation failed: client connection to 127.16.126.2:38731: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251023 07:58:02.511125 16888 tablet_server.cc:178] TabletServer@127.16.126.3:0 shutting down...
I20251023 07:58:02.538762 16888 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251023 07:58:02.539413 16888 tablet_replica.cc:333] T 01f422ecb29f444098d80a283dd67a53 P 25102c72ce134bd5a7369eda67c041d2: stopping tablet replica
I20251023 07:58:02.540060 16888 raft_consensus.cc:2243] T 01f422ecb29f444098d80a283dd67a53 P 25102c72ce134bd5a7369eda67c041d2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251023 07:58:02.540678 16888 raft_consensus.cc:2272] T 01f422ecb29f444098d80a283dd67a53 P 25102c72ce134bd5a7369eda67c041d2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:02.542502 16888 tablet_replica.cc:333] T 08671d08202b46c6b16e0271769eb119 P 25102c72ce134bd5a7369eda67c041d2: stopping tablet replica
I20251023 07:58:02.542986 16888 raft_consensus.cc:2243] T 08671d08202b46c6b16e0271769eb119 P 25102c72ce134bd5a7369eda67c041d2 [term 3 LEADER]: Raft consensus shutting down.
I20251023 07:58:02.543762 16888 raft_consensus.cc:2272] T 08671d08202b46c6b16e0271769eb119 P 25102c72ce134bd5a7369eda67c041d2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:02.545315 16888 tablet_replica.cc:333] T 76bacff5c098439cb18968ff9dee3875 P 25102c72ce134bd5a7369eda67c041d2: stopping tablet replica
I20251023 07:58:02.545806 16888 raft_consensus.cc:2243] T 76bacff5c098439cb18968ff9dee3875 P 25102c72ce134bd5a7369eda67c041d2 [term 5 FOLLOWER]: Raft consensus shutting down.
I20251023 07:58:02.546294 16888 raft_consensus.cc:2272] T 76bacff5c098439cb18968ff9dee3875 P 25102c72ce134bd5a7369eda67c041d2 [term 5 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:02.547946 16888 tablet_replica.cc:333] T bb55cfe6314c4d27bb86dcaa2bb135a8 P 25102c72ce134bd5a7369eda67c041d2: stopping tablet replica
I20251023 07:58:02.548506 16888 raft_consensus.cc:2243] T bb55cfe6314c4d27bb86dcaa2bb135a8 P 25102c72ce134bd5a7369eda67c041d2 [term 2 LEADER]: Raft consensus shutting down.
I20251023 07:58:02.549216 16888 raft_consensus.cc:2272] T bb55cfe6314c4d27bb86dcaa2bb135a8 P 25102c72ce134bd5a7369eda67c041d2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:02.550825 16888 tablet_replica.cc:333] T 8f48d577e386480a905dc2367cf209ab P 25102c72ce134bd5a7369eda67c041d2: stopping tablet replica
I20251023 07:58:02.551278 16888 raft_consensus.cc:2243] T 8f48d577e386480a905dc2367cf209ab P 25102c72ce134bd5a7369eda67c041d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:58:02.551635 16888 raft_consensus.cc:2272] T 8f48d577e386480a905dc2367cf209ab P 25102c72ce134bd5a7369eda67c041d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:02.553202 16888 tablet_replica.cc:333] T 621b0ed837604654a4fa0c14a0ca9c60 P 25102c72ce134bd5a7369eda67c041d2: stopping tablet replica
I20251023 07:58:02.553714 16888 raft_consensus.cc:2243] T 621b0ed837604654a4fa0c14a0ca9c60 P 25102c72ce134bd5a7369eda67c041d2 [term 4 FOLLOWER]: Raft consensus shutting down.
I20251023 07:58:02.554142 16888 raft_consensus.cc:2272] T 621b0ed837604654a4fa0c14a0ca9c60 P 25102c72ce134bd5a7369eda67c041d2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:02.555636 16888 tablet_replica.cc:333] T 6bc67d2b65d64a338ebcfd3326790173 P 25102c72ce134bd5a7369eda67c041d2: stopping tablet replica
I20251023 07:58:02.556079 16888 raft_consensus.cc:2243] T 6bc67d2b65d64a338ebcfd3326790173 P 25102c72ce134bd5a7369eda67c041d2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251023 07:58:02.556473 16888 raft_consensus.cc:2272] T 6bc67d2b65d64a338ebcfd3326790173 P 25102c72ce134bd5a7369eda67c041d2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:02.558140 16888 tablet_replica.cc:333] T 30d4cc48296446b49a4e32822c8be1bf P 25102c72ce134bd5a7369eda67c041d2: stopping tablet replica
I20251023 07:58:02.558553 16888 raft_consensus.cc:2243] T 30d4cc48296446b49a4e32822c8be1bf P 25102c72ce134bd5a7369eda67c041d2 [term 2 LEADER]: Raft consensus shutting down.
I20251023 07:58:02.559249 16888 raft_consensus.cc:2272] T 30d4cc48296446b49a4e32822c8be1bf P 25102c72ce134bd5a7369eda67c041d2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:02.560738 16888 tablet_replica.cc:333] T 734cd185b3ff45c59fa612ff8f546f6a P 25102c72ce134bd5a7369eda67c041d2: stopping tablet replica
I20251023 07:58:02.561168 16888 raft_consensus.cc:2243] T 734cd185b3ff45c59fa612ff8f546f6a P 25102c72ce134bd5a7369eda67c041d2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251023 07:58:02.561635 16888 raft_consensus.cc:2272] T 734cd185b3ff45c59fa612ff8f546f6a P 25102c72ce134bd5a7369eda67c041d2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:02.589586 16888 tablet_server.cc:195] TabletServer@127.16.126.3:0 shutdown complete.
I20251023 07:58:02.607681 16888 master.cc:561] Master@127.16.126.62:34949 shutting down...
I20251023 07:58:02.820163 16888 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 0fcd9e92d65245c888b7c618d66cfd9f [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:58:02.820746 16888 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 0fcd9e92d65245c888b7c618d66cfd9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:02.821034 16888 tablet_replica.cc:333] T 00000000000000000000000000000000 P 0fcd9e92d65245c888b7c618d66cfd9f: stopping tablet replica
I20251023 07:58:02.840623 16888 master.cc:583] Master@127.16.126.62:34949 shutdown complete.
1eca84c8bc4e4fd48a9ec0b5146ea641 4
25102c72ce134bd5a7369eda67c041d2 1
a14159c3f4f3468eb16708bfb6c72677 4
1eca84c8bc4e4fd48a9ec0b5146ea641 3
25102c72ce134bd5a7369eda67c041d2 3
a14159c3f4f3468eb16708bfb6c72677 3
1eca84c8bc4e4fd48a9ec0b5146ea641 0
25102c72ce134bd5a7369eda67c041d2 1
a14159c3f4f3468eb16708bfb6c72677 8
1eca84c8bc4e4fd48a9ec0b5146ea641 3
25102c72ce134bd5a7369eda67c041d2 3
a14159c3f4f3468eb16708bfb6c72677 3
[ OK ] LeaderRebalancerTest.FunctionalTestForDivided (31082 ms)
[ RUN ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20251023 07:58:02.880735 16888 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.16.126.62:45081
I20251023 07:58:02.881966 16888 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251023 07:58:02.887601 17420 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251023 07:58:02.888099 17421 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251023 07:58:02.888957 17423 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251023 07:58:02.889818 16888 server_base.cc:1047] running on GCE node
I20251023 07:58:02.890810 16888 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251023 07:58:02.890996 16888 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251023 07:58:02.891152 16888 hybrid_clock.cc:648] HybridClock initialized: now 1761206282891132 us; error 0 us; skew 500 ppm
I20251023 07:58:02.891682 16888 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20251023 07:58:02.894037 16888 webserver.cc:492] Webserver started at http://127.16.126.62:40009/ using document root <none> and password file <none>
I20251023 07:58:02.894526 16888 fs_manager.cc:362] Metadata directory not provided
I20251023 07:58:02.894704 16888 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251023 07:58:02.894963 16888 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251023 07:58:02.896142 16888 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1761206251627710-16888-0/minicluster-data/master-0-root/instance:
uuid: "75545236f37841709f88cf733d7b543c"
format_stamp: "Formatted at 2025-10-23 07:58:02 on dist-test-slave-m488"
I20251023 07:58:02.900642 16888 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20251023 07:58:02.903911 17428 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251023 07:58:02.904623 16888 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20251023 07:58:02.904889 16888 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1761206251627710-16888-0/minicluster-data/master-0-root
uuid: "75545236f37841709f88cf733d7b543c"
format_stamp: "Formatted at 2025-10-23 07:58:02 on dist-test-slave-m488"
I20251023 07:58:02.905148 16888 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1761206251627710-16888-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1761206251627710-16888-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1761206251627710-16888-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251023 07:58:02.919719 16888 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251023 07:58:02.920941 16888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251023 07:58:02.959798 16888 rpc_server.cc:307] RPC server started. Bound to: 127.16.126.62:45081
I20251023 07:58:02.959882 17479 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.126.62:45081 every 8 connection(s)
I20251023 07:58:02.963711 17480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:02.973501 17480 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75545236f37841709f88cf733d7b543c: Bootstrap starting.
I20251023 07:58:02.978170 17480 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 75545236f37841709f88cf733d7b543c: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:02.982574 17480 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75545236f37841709f88cf733d7b543c: No bootstrap required, opened a new log
I20251023 07:58:02.984683 17480 raft_consensus.cc:359] T 00000000000000000000000000000000 P 75545236f37841709f88cf733d7b543c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75545236f37841709f88cf733d7b543c" member_type: VOTER }
I20251023 07:58:02.985113 17480 raft_consensus.cc:385] T 00000000000000000000000000000000 P 75545236f37841709f88cf733d7b543c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:02.985375 17480 raft_consensus.cc:740] T 00000000000000000000000000000000 P 75545236f37841709f88cf733d7b543c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75545236f37841709f88cf733d7b543c, State: Initialized, Role: FOLLOWER
I20251023 07:58:02.985953 17480 consensus_queue.cc:260] T 00000000000000000000000000000000 P 75545236f37841709f88cf733d7b543c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75545236f37841709f88cf733d7b543c" member_type: VOTER }
I20251023 07:58:02.986409 17480 raft_consensus.cc:399] T 00000000000000000000000000000000 P 75545236f37841709f88cf733d7b543c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251023 07:58:02.986647 17480 raft_consensus.cc:493] T 00000000000000000000000000000000 P 75545236f37841709f88cf733d7b543c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251023 07:58:02.986905 17480 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 75545236f37841709f88cf733d7b543c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:02.991080 17480 raft_consensus.cc:515] T 00000000000000000000000000000000 P 75545236f37841709f88cf733d7b543c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75545236f37841709f88cf733d7b543c" member_type: VOTER }
I20251023 07:58:02.991636 17480 leader_election.cc:304] T 00000000000000000000000000000000 P 75545236f37841709f88cf733d7b543c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 75545236f37841709f88cf733d7b543c; no voters:
I20251023 07:58:02.992790 17480 leader_election.cc:290] T 00000000000000000000000000000000 P 75545236f37841709f88cf733d7b543c [CANDIDATE]: Term 1 election: Requested vote from peers
I20251023 07:58:02.993217 17483 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 75545236f37841709f88cf733d7b543c [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:58:02.994640 17483 raft_consensus.cc:697] T 00000000000000000000000000000000 P 75545236f37841709f88cf733d7b543c [term 1 LEADER]: Becoming Leader. State: Replica: 75545236f37841709f88cf733d7b543c, State: Running, Role: LEADER
I20251023 07:58:02.995333 17483 consensus_queue.cc:237] T 00000000000000000000000000000000 P 75545236f37841709f88cf733d7b543c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75545236f37841709f88cf733d7b543c" member_type: VOTER }
I20251023 07:58:02.995648 17480 sys_catalog.cc:565] T 00000000000000000000000000000000 P 75545236f37841709f88cf733d7b543c [sys.catalog]: configured and running, proceeding with master startup.
I20251023 07:58:03.001119 17485 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75545236f37841709f88cf733d7b543c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 75545236f37841709f88cf733d7b543c. Latest consensus state: current_term: 1 leader_uuid: "75545236f37841709f88cf733d7b543c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75545236f37841709f88cf733d7b543c" member_type: VOTER } }
I20251023 07:58:03.001140 17484 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75545236f37841709f88cf733d7b543c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "75545236f37841709f88cf733d7b543c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75545236f37841709f88cf733d7b543c" member_type: VOTER } }
I20251023 07:58:03.002290 17485 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75545236f37841709f88cf733d7b543c [sys.catalog]: This master's current role is: LEADER
I20251023 07:58:03.002349 17484 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75545236f37841709f88cf733d7b543c [sys.catalog]: This master's current role is: LEADER
I20251023 07:58:03.005870 17491 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251023 07:58:03.013865 17491 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251023 07:58:03.014886 16888 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20251023 07:58:03.022915 17491 catalog_manager.cc:1357] Generated new cluster ID: 98eb120950c0475dbe1fa330d31337a1
I20251023 07:58:03.023232 17491 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251023 07:58:03.061916 17491 catalog_manager.cc:1380] Generated new certificate authority record
I20251023 07:58:03.063139 17491 catalog_manager.cc:1514] Loading token signing keys...
I20251023 07:58:03.082970 17491 catalog_manager.cc:6022] T 00000000000000000000000000000000 P 75545236f37841709f88cf733d7b543c: Generated new TSK 0
I20251023 07:58:03.083542 17491 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251023 07:58:03.146000 16888 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251023 07:58:03.151839 17501 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251023 07:58:03.153224 17502 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251023 07:58:03.154991 17504 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251023 07:58:03.155196 16888 server_base.cc:1047] running on GCE node
I20251023 07:58:03.156129 16888 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251023 07:58:03.156330 16888 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251023 07:58:03.156486 16888 hybrid_clock.cc:648] HybridClock initialized: now 1761206283156467 us; error 0 us; skew 500 ppm
I20251023 07:58:03.156989 16888 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20251023 07:58:03.159229 16888 webserver.cc:492] Webserver started at http://127.16.126.1:46603/ using document root <none> and password file <none>
I20251023 07:58:03.159722 16888 fs_manager.cc:362] Metadata directory not provided
I20251023 07:58:03.159909 16888 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251023 07:58:03.160152 16888 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251023 07:58:03.161227 16888 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1761206251627710-16888-0/minicluster-data/ts-0-root/instance:
uuid: "a2ded24d2e7648649ddbe521d1dbd135"
format_stamp: "Formatted at 2025-10-23 07:58:03 on dist-test-slave-m488"
I20251023 07:58:03.165675 16888 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20251023 07:58:03.168812 17509 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251023 07:58:03.169516 16888 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20251023 07:58:03.169823 16888 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1761206251627710-16888-0/minicluster-data/ts-0-root
uuid: "a2ded24d2e7648649ddbe521d1dbd135"
format_stamp: "Formatted at 2025-10-23 07:58:03 on dist-test-slave-m488"
I20251023 07:58:03.170104 16888 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1761206251627710-16888-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1761206251627710-16888-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1761206251627710-16888-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251023 07:58:03.181576 16888 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251023 07:58:03.182813 16888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251023 07:58:03.184207 16888 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251023 07:58:03.186489 16888 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251023 07:58:03.186686 16888 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251023 07:58:03.186910 16888 ts_tablet_manager.cc:616] Registered 0 tablets
I20251023 07:58:03.187073 16888 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251023 07:58:03.228340 16888 rpc_server.cc:307] RPC server started. Bound to: 127.16.126.1:43887
I20251023 07:58:03.228444 17571 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.126.1:43887 every 8 connection(s)
I20251023 07:58:03.232925 16888 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251023 07:58:03.241291 17576 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251023 07:58:03.241717 17577 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251023 07:58:03.244556 16888 server_base.cc:1047] running on GCE node
W20251023 07:58:03.245116 17579 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251023 07:58:03.245966 16888 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251023 07:58:03.246269 16888 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251023 07:58:03.246457 16888 hybrid_clock.cc:648] HybridClock initialized: now 1761206283246438 us; error 0 us; skew 500 ppm
I20251023 07:58:03.246975 16888 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20251023 07:58:03.249511 17572 heartbeater.cc:344] Connected to a master server at 127.16.126.62:45081
I20251023 07:58:03.249804 16888 webserver.cc:492] Webserver started at http://127.16.126.2:42949/ using document root <none> and password file <none>
I20251023 07:58:03.249855 17572 heartbeater.cc:461] Registering TS with master...
I20251023 07:58:03.250422 16888 fs_manager.cc:362] Metadata directory not provided
I20251023 07:58:03.250646 16888 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251023 07:58:03.250741 17572 heartbeater.cc:507] Master 127.16.126.62:45081 requested a full tablet report, sending...
I20251023 07:58:03.250905 16888 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251023 07:58:03.252116 16888 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1761206251627710-16888-0/minicluster-data/ts-1-root/instance:
uuid: "a35e1d7a0f05466db4af95b208209620"
format_stamp: "Formatted at 2025-10-23 07:58:03 on dist-test-slave-m488"
I20251023 07:58:03.252738 17445 ts_manager.cc:194] Registered new tserver with Master: a2ded24d2e7648649ddbe521d1dbd135 (127.16.126.1:43887)
I20251023 07:58:03.254446 17445 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38250
I20251023 07:58:03.256923 16888 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20251023 07:58:03.260268 17584 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251023 07:58:03.261058 16888 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20251023 07:58:03.261320 16888 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1761206251627710-16888-0/minicluster-data/ts-1-root
uuid: "a35e1d7a0f05466db4af95b208209620"
format_stamp: "Formatted at 2025-10-23 07:58:03 on dist-test-slave-m488"
I20251023 07:58:03.261622 16888 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1761206251627710-16888-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1761206251627710-16888-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1761206251627710-16888-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251023 07:58:03.275523 16888 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251023 07:58:03.276773 16888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251023 07:58:03.278254 16888 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251023 07:58:03.280577 16888 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251023 07:58:03.280761 16888 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251023 07:58:03.281008 16888 ts_tablet_manager.cc:616] Registered 0 tablets
I20251023 07:58:03.281206 16888 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251023 07:58:03.321630 16888 rpc_server.cc:307] RPC server started. Bound to: 127.16.126.2:43007
I20251023 07:58:03.321724 17646 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.126.2:43007 every 8 connection(s)
I20251023 07:58:03.326210 16888 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251023 07:58:03.333323 17650 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251023 07:58:03.335125 17651 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251023 07:58:03.338500 17653 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251023 07:58:03.338846 16888 server_base.cc:1047] running on GCE node
I20251023 07:58:03.339401 17647 heartbeater.cc:344] Connected to a master server at 127.16.126.62:45081
I20251023 07:58:03.339746 17647 heartbeater.cc:461] Registering TS with master...
I20251023 07:58:03.339852 16888 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251023 07:58:03.340088 16888 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251023 07:58:03.340240 16888 hybrid_clock.cc:648] HybridClock initialized: now 1761206283340222 us; error 0 us; skew 500 ppm
I20251023 07:58:03.340493 17647 heartbeater.cc:507] Master 127.16.126.62:45081 requested a full tablet report, sending...
I20251023 07:58:03.340804 16888 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20251023 07:58:03.342587 17445 ts_manager.cc:194] Registered new tserver with Master: a35e1d7a0f05466db4af95b208209620 (127.16.126.2:43007)
I20251023 07:58:03.343596 16888 webserver.cc:492] Webserver started at http://127.16.126.3:44903/ using document root <none> and password file <none>
I20251023 07:58:03.344238 16888 fs_manager.cc:362] Metadata directory not provided
I20251023 07:58:03.344491 16888 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251023 07:58:03.344409 17445 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38262
I20251023 07:58:03.344899 16888 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251023 07:58:03.346189 16888 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1761206251627710-16888-0/minicluster-data/ts-2-root/instance:
uuid: "141636b82a7b4949931f25ce0a14addc"
format_stamp: "Formatted at 2025-10-23 07:58:03 on dist-test-slave-m488"
I20251023 07:58:03.350494 16888 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20251023 07:58:03.353744 17658 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251023 07:58:03.354460 16888 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20251023 07:58:03.354732 16888 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1761206251627710-16888-0/minicluster-data/ts-2-root
uuid: "141636b82a7b4949931f25ce0a14addc"
format_stamp: "Formatted at 2025-10-23 07:58:03 on dist-test-slave-m488"
I20251023 07:58:03.354995 16888 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1761206251627710-16888-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1761206251627710-16888-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1761206251627710-16888-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251023 07:58:03.375788 16888 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251023 07:58:03.377005 16888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251023 07:58:03.378494 16888 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251023 07:58:03.380672 16888 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251023 07:58:03.380872 16888 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251023 07:58:03.381106 16888 ts_tablet_manager.cc:616] Registered 0 tablets
I20251023 07:58:03.381268 16888 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251023 07:58:03.420944 16888 rpc_server.cc:307] RPC server started. Bound to: 127.16.126.3:42717
I20251023 07:58:03.421052 17720 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.126.3:42717 every 8 connection(s)
I20251023 07:58:03.435202 17721 heartbeater.cc:344] Connected to a master server at 127.16.126.62:45081
I20251023 07:58:03.435542 17721 heartbeater.cc:461] Registering TS with master...
I20251023 07:58:03.436199 17721 heartbeater.cc:507] Master 127.16.126.62:45081 requested a full tablet report, sending...
I20251023 07:58:03.437981 17445 ts_manager.cc:194] Registered new tserver with Master: 141636b82a7b4949931f25ce0a14addc (127.16.126.3:42717)
I20251023 07:58:03.438338 16888 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014419352s
I20251023 07:58:03.439268 17445 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38266
I20251023 07:58:03.440587 16888 test_util.cc:276] Using random seed: -890859089
I20251023 07:58:03.462579 17445 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38282:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251023 07:58:03.465415 17445 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251023 07:58:03.534232 17686 tablet_service.cc:1505] Processing CreateTablet for tablet f7dc54ff3f724e939f77ddaa796574c8 (DEFAULT_TABLE table=test-workload [id=12821d0c82ab468b97fa5d6131f00d4c]), partition=RANGE (key) PARTITION VALUES < 214748364
I20251023 07:58:03.536044 17686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7dc54ff3f724e939f77ddaa796574c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:03.536772 17684 tablet_service.cc:1505] Processing CreateTablet for tablet fcb0398cbb794ef7856899e143856d9a (DEFAULT_TABLE table=test-workload [id=12821d0c82ab468b97fa5d6131f00d4c]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20251023 07:58:03.538250 17684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcb0398cbb794ef7856899e143856d9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:03.540874 17685 tablet_service.cc:1505] Processing CreateTablet for tablet 65cb88497ea44c4a9ee9cc67ede9d318 (DEFAULT_TABLE table=test-workload [id=12821d0c82ab468b97fa5d6131f00d4c]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20251023 07:58:03.542382 17685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65cb88497ea44c4a9ee9cc67ede9d318. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:03.554721 17682 tablet_service.cc:1505] Processing CreateTablet for tablet 1d80e56f890b4b3f99fdd1940f40e0a0 (DEFAULT_TABLE table=test-workload [id=12821d0c82ab468b97fa5d6131f00d4c]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20251023 07:58:03.553180 17683 tablet_service.cc:1505] Processing CreateTablet for tablet 51aacc3534884c92926b5d632a3e11f7 (DEFAULT_TABLE table=test-workload [id=12821d0c82ab468b97fa5d6131f00d4c]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20251023 07:58:03.556298 17682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d80e56f890b4b3f99fdd1940f40e0a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:03.562662 17678 tablet_service.cc:1505] Processing CreateTablet for tablet 5a8aa3610eeb4df3b88aa6fcb808969f (DEFAULT_TABLE table=test-workload [id=12821d0c82ab468b97fa5d6131f00d4c]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20251023 07:58:03.564077 17678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a8aa3610eeb4df3b88aa6fcb808969f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:03.557698 17680 tablet_service.cc:1505] Processing CreateTablet for tablet 0524c60cf5404f1e99bef45655e8bd77 (DEFAULT_TABLE table=test-workload [id=12821d0c82ab468b97fa5d6131f00d4c]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20251023 07:58:03.567056 17680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0524c60cf5404f1e99bef45655e8bd77. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:03.558691 17681 tablet_service.cc:1505] Processing CreateTablet for tablet b84678e61cb446c3b00429824b024d12 (DEFAULT_TABLE table=test-workload [id=12821d0c82ab468b97fa5d6131f00d4c]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20251023 07:58:03.570928 17681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b84678e61cb446c3b00429824b024d12. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:03.560958 17679 tablet_service.cc:1505] Processing CreateTablet for tablet 1ea153fe03884218bb2cf06c75d029c0 (DEFAULT_TABLE table=test-workload [id=12821d0c82ab468b97fa5d6131f00d4c]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20251023 07:58:03.577419 17679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ea153fe03884218bb2cf06c75d029c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:03.581851 17683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51aacc3534884c92926b5d632a3e11f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:03.583124 17610 tablet_service.cc:1505] Processing CreateTablet for tablet fcb0398cbb794ef7856899e143856d9a (DEFAULT_TABLE table=test-workload [id=12821d0c82ab468b97fa5d6131f00d4c]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20251023 07:58:03.583349 17605 tablet_service.cc:1505] Processing CreateTablet for tablet 1ea153fe03884218bb2cf06c75d029c0 (DEFAULT_TABLE table=test-workload [id=12821d0c82ab468b97fa5d6131f00d4c]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20251023 07:58:03.584550 17610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcb0398cbb794ef7856899e143856d9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:03.585634 17604 tablet_service.cc:1505] Processing CreateTablet for tablet 5a8aa3610eeb4df3b88aa6fcb808969f (DEFAULT_TABLE table=test-workload [id=12821d0c82ab468b97fa5d6131f00d4c]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20251023 07:58:03.586637 17609 tablet_service.cc:1505] Processing CreateTablet for tablet 51aacc3534884c92926b5d632a3e11f7 (DEFAULT_TABLE table=test-workload [id=12821d0c82ab468b97fa5d6131f00d4c]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20251023 07:58:03.587962 17603 tablet_service.cc:1505] Processing CreateTablet for tablet cd34ebe0d6ff472cbfd9a71f16d4aee1 (DEFAULT_TABLE table=test-workload [id=12821d0c82ab468b97fa5d6131f00d4c]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20251023 07:58:03.588608 17608 tablet_service.cc:1505] Processing CreateTablet for tablet 1d80e56f890b4b3f99fdd1940f40e0a0 (DEFAULT_TABLE table=test-workload [id=12821d0c82ab468b97fa5d6131f00d4c]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20251023 07:58:03.590060 17685 tablet_service.cc:1505] Processing CreateTablet for tablet cd34ebe0d6ff472cbfd9a71f16d4aee1 (DEFAULT_TABLE table=test-workload [id=12821d0c82ab468b97fa5d6131f00d4c]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20251023 07:58:03.590466 17607 tablet_service.cc:1505] Processing CreateTablet for tablet b84678e61cb446c3b00429824b024d12 (DEFAULT_TABLE table=test-workload [id=12821d0c82ab468b97fa5d6131f00d4c]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20251023 07:58:03.591343 17685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd34ebe0d6ff472cbfd9a71f16d4aee1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:03.592373 17606 tablet_service.cc:1505] Processing CreateTablet for tablet 0524c60cf5404f1e99bef45655e8bd77 (DEFAULT_TABLE table=test-workload [id=12821d0c82ab468b97fa5d6131f00d4c]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20251023 07:58:03.594662 17611 tablet_service.cc:1505] Processing CreateTablet for tablet 65cb88497ea44c4a9ee9cc67ede9d318 (DEFAULT_TABLE table=test-workload [id=12821d0c82ab468b97fa5d6131f00d4c]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20251023 07:58:03.599179 17604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a8aa3610eeb4df3b88aa6fcb808969f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:03.581025 17612 tablet_service.cc:1505] Processing CreateTablet for tablet f7dc54ff3f724e939f77ddaa796574c8 (DEFAULT_TABLE table=test-workload [id=12821d0c82ab468b97fa5d6131f00d4c]), partition=RANGE (key) PARTITION VALUES < 214748364
I20251023 07:58:03.603201 17612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7dc54ff3f724e939f77ddaa796574c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:03.606138 17609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51aacc3534884c92926b5d632a3e11f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:03.607856 17603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd34ebe0d6ff472cbfd9a71f16d4aee1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:03.609114 17536 tablet_service.cc:1505] Processing CreateTablet for tablet 65cb88497ea44c4a9ee9cc67ede9d318 (DEFAULT_TABLE table=test-workload [id=12821d0c82ab468b97fa5d6131f00d4c]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20251023 07:58:03.610513 17536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65cb88497ea44c4a9ee9cc67ede9d318. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:03.614243 17608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d80e56f890b4b3f99fdd1940f40e0a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:03.614684 17535 tablet_service.cc:1505] Processing CreateTablet for tablet fcb0398cbb794ef7856899e143856d9a (DEFAULT_TABLE table=test-workload [id=12821d0c82ab468b97fa5d6131f00d4c]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20251023 07:58:03.616042 17535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcb0398cbb794ef7856899e143856d9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:03.618142 17607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b84678e61cb446c3b00429824b024d12. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:03.618656 17534 tablet_service.cc:1505] Processing CreateTablet for tablet 51aacc3534884c92926b5d632a3e11f7 (DEFAULT_TABLE table=test-workload [id=12821d0c82ab468b97fa5d6131f00d4c]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20251023 07:58:03.619951 17534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51aacc3534884c92926b5d632a3e11f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:03.622656 17533 tablet_service.cc:1505] Processing CreateTablet for tablet 1d80e56f890b4b3f99fdd1940f40e0a0 (DEFAULT_TABLE table=test-workload [id=12821d0c82ab468b97fa5d6131f00d4c]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20251023 07:58:03.623975 17533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d80e56f890b4b3f99fdd1940f40e0a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:03.624197 17606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0524c60cf5404f1e99bef45655e8bd77. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:03.626650 17532 tablet_service.cc:1505] Processing CreateTablet for tablet b84678e61cb446c3b00429824b024d12 (DEFAULT_TABLE table=test-workload [id=12821d0c82ab468b97fa5d6131f00d4c]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20251023 07:58:03.627928 17532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b84678e61cb446c3b00429824b024d12. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:03.629556 17611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65cb88497ea44c4a9ee9cc67ede9d318. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:03.630200 17530 tablet_service.cc:1505] Processing CreateTablet for tablet 1ea153fe03884218bb2cf06c75d029c0 (DEFAULT_TABLE table=test-workload [id=12821d0c82ab468b97fa5d6131f00d4c]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20251023 07:58:03.631518 17530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ea153fe03884218bb2cf06c75d029c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:03.634223 17605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ea153fe03884218bb2cf06c75d029c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:03.634533 17531 tablet_service.cc:1505] Processing CreateTablet for tablet 0524c60cf5404f1e99bef45655e8bd77 (DEFAULT_TABLE table=test-workload [id=12821d0c82ab468b97fa5d6131f00d4c]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20251023 07:58:03.635788 17531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0524c60cf5404f1e99bef45655e8bd77. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:03.607867 17537 tablet_service.cc:1505] Processing CreateTablet for tablet f7dc54ff3f724e939f77ddaa796574c8 (DEFAULT_TABLE table=test-workload [id=12821d0c82ab468b97fa5d6131f00d4c]), partition=RANGE (key) PARTITION VALUES < 214748364
I20251023 07:58:03.638842 17537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7dc54ff3f724e939f77ddaa796574c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:03.642722 17529 tablet_service.cc:1505] Processing CreateTablet for tablet 5a8aa3610eeb4df3b88aa6fcb808969f (DEFAULT_TABLE table=test-workload [id=12821d0c82ab468b97fa5d6131f00d4c]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20251023 07:58:03.643115 17528 tablet_service.cc:1505] Processing CreateTablet for tablet cd34ebe0d6ff472cbfd9a71f16d4aee1 (DEFAULT_TABLE table=test-workload [id=12821d0c82ab468b97fa5d6131f00d4c]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20251023 07:58:03.644109 17529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a8aa3610eeb4df3b88aa6fcb808969f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:03.649812 17528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd34ebe0d6ff472cbfd9a71f16d4aee1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:03.682199 17737 tablet_bootstrap.cc:492] T b84678e61cb446c3b00429824b024d12 P a2ded24d2e7648649ddbe521d1dbd135: Bootstrap starting.
I20251023 07:58:03.771616 17737 tablet_bootstrap.cc:654] T b84678e61cb446c3b00429824b024d12 P a2ded24d2e7648649ddbe521d1dbd135: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:03.772775 17735 tablet_bootstrap.cc:492] T fcb0398cbb794ef7856899e143856d9a P 141636b82a7b4949931f25ce0a14addc: Bootstrap starting.
I20251023 07:58:03.773613 17736 tablet_bootstrap.cc:492] T fcb0398cbb794ef7856899e143856d9a P a35e1d7a0f05466db4af95b208209620: Bootstrap starting.
I20251023 07:58:03.783555 17735 tablet_bootstrap.cc:654] T fcb0398cbb794ef7856899e143856d9a P 141636b82a7b4949931f25ce0a14addc: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:03.788352 17736 tablet_bootstrap.cc:654] T fcb0398cbb794ef7856899e143856d9a P a35e1d7a0f05466db4af95b208209620: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:03.795943 17735 tablet_bootstrap.cc:492] T fcb0398cbb794ef7856899e143856d9a P 141636b82a7b4949931f25ce0a14addc: No bootstrap required, opened a new log
I20251023 07:58:03.796844 17735 ts_tablet_manager.cc:1403] T fcb0398cbb794ef7856899e143856d9a P 141636b82a7b4949931f25ce0a14addc: Time spent bootstrapping tablet: real 0.024s user 0.016s sys 0.002s
I20251023 07:58:03.798744 17737 tablet_bootstrap.cc:492] T b84678e61cb446c3b00429824b024d12 P a2ded24d2e7648649ddbe521d1dbd135: No bootstrap required, opened a new log
I20251023 07:58:03.799132 17737 ts_tablet_manager.cc:1403] T b84678e61cb446c3b00429824b024d12 P a2ded24d2e7648649ddbe521d1dbd135: Time spent bootstrapping tablet: real 0.141s user 0.010s sys 0.007s
I20251023 07:58:03.799503 17736 tablet_bootstrap.cc:492] T fcb0398cbb794ef7856899e143856d9a P a35e1d7a0f05466db4af95b208209620: No bootstrap required, opened a new log
I20251023 07:58:03.799983 17736 ts_tablet_manager.cc:1403] T fcb0398cbb794ef7856899e143856d9a P a35e1d7a0f05466db4af95b208209620: Time spent bootstrapping tablet: real 0.027s user 0.007s sys 0.010s
I20251023 07:58:03.799783 17735 raft_consensus.cc:359] T fcb0398cbb794ef7856899e143856d9a P 141636b82a7b4949931f25ce0a14addc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:03.800522 17735 raft_consensus.cc:385] T fcb0398cbb794ef7856899e143856d9a P 141636b82a7b4949931f25ce0a14addc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:03.800830 17735 raft_consensus.cc:740] T fcb0398cbb794ef7856899e143856d9a P 141636b82a7b4949931f25ce0a14addc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 141636b82a7b4949931f25ce0a14addc, State: Initialized, Role: FOLLOWER
I20251023 07:58:03.801286 17737 raft_consensus.cc:359] T b84678e61cb446c3b00429824b024d12 P a2ded24d2e7648649ddbe521d1dbd135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:03.801898 17737 raft_consensus.cc:385] T b84678e61cb446c3b00429824b024d12 P a2ded24d2e7648649ddbe521d1dbd135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:03.801600 17735 consensus_queue.cc:260] T fcb0398cbb794ef7856899e143856d9a P 141636b82a7b4949931f25ce0a14addc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:03.802136 17737 raft_consensus.cc:740] T b84678e61cb446c3b00429824b024d12 P a2ded24d2e7648649ddbe521d1dbd135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2ded24d2e7648649ddbe521d1dbd135, State: Initialized, Role: FOLLOWER
I20251023 07:58:03.802826 17737 consensus_queue.cc:260] T b84678e61cb446c3b00429824b024d12 P a2ded24d2e7648649ddbe521d1dbd135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:03.802706 17736 raft_consensus.cc:359] T fcb0398cbb794ef7856899e143856d9a P a35e1d7a0f05466db4af95b208209620 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:03.803676 17736 raft_consensus.cc:385] T fcb0398cbb794ef7856899e143856d9a P a35e1d7a0f05466db4af95b208209620 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:03.804077 17736 raft_consensus.cc:740] T fcb0398cbb794ef7856899e143856d9a P a35e1d7a0f05466db4af95b208209620 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a35e1d7a0f05466db4af95b208209620, State: Initialized, Role: FOLLOWER
I20251023 07:58:03.805146 17736 consensus_queue.cc:260] T fcb0398cbb794ef7856899e143856d9a P a35e1d7a0f05466db4af95b208209620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:03.807543 17721 heartbeater.cc:499] Master 127.16.126.62:45081 was elected leader, sending a full tablet report...
I20251023 07:58:03.807530 17735 ts_tablet_manager.cc:1434] T fcb0398cbb794ef7856899e143856d9a P 141636b82a7b4949931f25ce0a14addc: Time spent starting tablet: real 0.010s user 0.007s sys 0.003s
I20251023 07:58:03.808275 17737 ts_tablet_manager.cc:1434] T b84678e61cb446c3b00429824b024d12 P a2ded24d2e7648649ddbe521d1dbd135: Time spent starting tablet: real 0.009s user 0.010s sys 0.000s
I20251023 07:58:03.809048 17735 tablet_bootstrap.cc:492] T 65cb88497ea44c4a9ee9cc67ede9d318 P 141636b82a7b4949931f25ce0a14addc: Bootstrap starting.
I20251023 07:58:03.815409 17736 ts_tablet_manager.cc:1434] T fcb0398cbb794ef7856899e143856d9a P a35e1d7a0f05466db4af95b208209620: Time spent starting tablet: real 0.015s user 0.009s sys 0.006s
I20251023 07:58:03.816155 17647 heartbeater.cc:499] Master 127.16.126.62:45081 was elected leader, sending a full tablet report...
I20251023 07:58:03.816859 17735 tablet_bootstrap.cc:654] T 65cb88497ea44c4a9ee9cc67ede9d318 P 141636b82a7b4949931f25ce0a14addc: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:03.820446 17736 tablet_bootstrap.cc:492] T b84678e61cb446c3b00429824b024d12 P a35e1d7a0f05466db4af95b208209620: Bootstrap starting.
I20251023 07:58:03.826753 17572 heartbeater.cc:499] Master 127.16.126.62:45081 was elected leader, sending a full tablet report...
I20251023 07:58:03.827276 17736 tablet_bootstrap.cc:654] T b84678e61cb446c3b00429824b024d12 P a35e1d7a0f05466db4af95b208209620: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:03.827993 17735 tablet_bootstrap.cc:492] T 65cb88497ea44c4a9ee9cc67ede9d318 P 141636b82a7b4949931f25ce0a14addc: No bootstrap required, opened a new log
I20251023 07:58:03.828500 17735 ts_tablet_manager.cc:1403] T 65cb88497ea44c4a9ee9cc67ede9d318 P 141636b82a7b4949931f25ce0a14addc: Time spent bootstrapping tablet: real 0.020s user 0.011s sys 0.000s
I20251023 07:58:03.831570 17735 raft_consensus.cc:359] T 65cb88497ea44c4a9ee9cc67ede9d318 P 141636b82a7b4949931f25ce0a14addc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:03.831573 17737 tablet_bootstrap.cc:492] T 5a8aa3610eeb4df3b88aa6fcb808969f P a2ded24d2e7648649ddbe521d1dbd135: Bootstrap starting.
I20251023 07:58:03.832605 17735 raft_consensus.cc:385] T 65cb88497ea44c4a9ee9cc67ede9d318 P 141636b82a7b4949931f25ce0a14addc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:03.835460 17735 raft_consensus.cc:740] T 65cb88497ea44c4a9ee9cc67ede9d318 P 141636b82a7b4949931f25ce0a14addc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 141636b82a7b4949931f25ce0a14addc, State: Initialized, Role: FOLLOWER
I20251023 07:58:03.836465 17735 consensus_queue.cc:260] T 65cb88497ea44c4a9ee9cc67ede9d318 P 141636b82a7b4949931f25ce0a14addc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:03.839046 17735 ts_tablet_manager.cc:1434] T 65cb88497ea44c4a9ee9cc67ede9d318 P 141636b82a7b4949931f25ce0a14addc: Time spent starting tablet: real 0.010s user 0.008s sys 0.003s
I20251023 07:58:03.840247 17735 tablet_bootstrap.cc:492] T b84678e61cb446c3b00429824b024d12 P 141636b82a7b4949931f25ce0a14addc: Bootstrap starting.
I20251023 07:58:03.843950 17737 tablet_bootstrap.cc:654] T 5a8aa3610eeb4df3b88aa6fcb808969f P a2ded24d2e7648649ddbe521d1dbd135: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:03.845252 17736 tablet_bootstrap.cc:492] T b84678e61cb446c3b00429824b024d12 P a35e1d7a0f05466db4af95b208209620: No bootstrap required, opened a new log
I20251023 07:58:03.845770 17736 ts_tablet_manager.cc:1403] T b84678e61cb446c3b00429824b024d12 P a35e1d7a0f05466db4af95b208209620: Time spent bootstrapping tablet: real 0.026s user 0.010s sys 0.012s
I20251023 07:58:03.847856 17735 tablet_bootstrap.cc:654] T b84678e61cb446c3b00429824b024d12 P 141636b82a7b4949931f25ce0a14addc: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:03.849293 17736 raft_consensus.cc:359] T b84678e61cb446c3b00429824b024d12 P a35e1d7a0f05466db4af95b208209620 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:03.850327 17736 raft_consensus.cc:385] T b84678e61cb446c3b00429824b024d12 P a35e1d7a0f05466db4af95b208209620 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:03.851990 17736 raft_consensus.cc:740] T b84678e61cb446c3b00429824b024d12 P a35e1d7a0f05466db4af95b208209620 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a35e1d7a0f05466db4af95b208209620, State: Initialized, Role: FOLLOWER
I20251023 07:58:03.853338 17736 consensus_queue.cc:260] T b84678e61cb446c3b00429824b024d12 P a35e1d7a0f05466db4af95b208209620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:03.855501 17737 tablet_bootstrap.cc:492] T 5a8aa3610eeb4df3b88aa6fcb808969f P a2ded24d2e7648649ddbe521d1dbd135: No bootstrap required, opened a new log
I20251023 07:58:03.855700 17736 ts_tablet_manager.cc:1434] T b84678e61cb446c3b00429824b024d12 P a35e1d7a0f05466db4af95b208209620: Time spent starting tablet: real 0.010s user 0.006s sys 0.000s
I20251023 07:58:03.856129 17737 ts_tablet_manager.cc:1403] T 5a8aa3610eeb4df3b88aa6fcb808969f P a2ded24d2e7648649ddbe521d1dbd135: Time spent bootstrapping tablet: real 0.025s user 0.017s sys 0.002s
I20251023 07:58:03.856745 17736 tablet_bootstrap.cc:492] T 51aacc3534884c92926b5d632a3e11f7 P a35e1d7a0f05466db4af95b208209620: Bootstrap starting.
I20251023 07:58:03.859031 17737 raft_consensus.cc:359] T 5a8aa3610eeb4df3b88aa6fcb808969f P a2ded24d2e7648649ddbe521d1dbd135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:03.859824 17737 raft_consensus.cc:385] T 5a8aa3610eeb4df3b88aa6fcb808969f P a2ded24d2e7648649ddbe521d1dbd135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:03.860196 17735 tablet_bootstrap.cc:492] T b84678e61cb446c3b00429824b024d12 P 141636b82a7b4949931f25ce0a14addc: No bootstrap required, opened a new log
I20251023 07:58:03.860877 17735 ts_tablet_manager.cc:1403] T b84678e61cb446c3b00429824b024d12 P 141636b82a7b4949931f25ce0a14addc: Time spent bootstrapping tablet: real 0.021s user 0.014s sys 0.003s
I20251023 07:58:03.862486 17736 tablet_bootstrap.cc:654] T 51aacc3534884c92926b5d632a3e11f7 P a35e1d7a0f05466db4af95b208209620: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:03.863724 17735 raft_consensus.cc:359] T b84678e61cb446c3b00429824b024d12 P 141636b82a7b4949931f25ce0a14addc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:03.864450 17735 raft_consensus.cc:385] T b84678e61cb446c3b00429824b024d12 P 141636b82a7b4949931f25ce0a14addc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:03.864771 17735 raft_consensus.cc:740] T b84678e61cb446c3b00429824b024d12 P 141636b82a7b4949931f25ce0a14addc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 141636b82a7b4949931f25ce0a14addc, State: Initialized, Role: FOLLOWER
I20251023 07:58:03.865520 17735 consensus_queue.cc:260] T b84678e61cb446c3b00429824b024d12 P 141636b82a7b4949931f25ce0a14addc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:03.867856 17735 ts_tablet_manager.cc:1434] T b84678e61cb446c3b00429824b024d12 P 141636b82a7b4949931f25ce0a14addc: Time spent starting tablet: real 0.007s user 0.002s sys 0.003s
I20251023 07:58:03.860162 17737 raft_consensus.cc:740] T 5a8aa3610eeb4df3b88aa6fcb808969f P a2ded24d2e7648649ddbe521d1dbd135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2ded24d2e7648649ddbe521d1dbd135, State: Initialized, Role: FOLLOWER
I20251023 07:58:03.868731 17737 consensus_queue.cc:260] T 5a8aa3610eeb4df3b88aa6fcb808969f P a2ded24d2e7648649ddbe521d1dbd135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:03.871126 17737 ts_tablet_manager.cc:1434] T 5a8aa3610eeb4df3b88aa6fcb808969f P a2ded24d2e7648649ddbe521d1dbd135: Time spent starting tablet: real 0.015s user 0.005s sys 0.000s
I20251023 07:58:03.872115 17737 tablet_bootstrap.cc:492] T f7dc54ff3f724e939f77ddaa796574c8 P a2ded24d2e7648649ddbe521d1dbd135: Bootstrap starting.
I20251023 07:58:03.875540 17735 tablet_bootstrap.cc:492] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P 141636b82a7b4949931f25ce0a14addc: Bootstrap starting.
I20251023 07:58:03.878243 17737 tablet_bootstrap.cc:654] T f7dc54ff3f724e939f77ddaa796574c8 P a2ded24d2e7648649ddbe521d1dbd135: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:03.879386 17736 tablet_bootstrap.cc:492] T 51aacc3534884c92926b5d632a3e11f7 P a35e1d7a0f05466db4af95b208209620: No bootstrap required, opened a new log
I20251023 07:58:03.879849 17736 ts_tablet_manager.cc:1403] T 51aacc3534884c92926b5d632a3e11f7 P a35e1d7a0f05466db4af95b208209620: Time spent bootstrapping tablet: real 0.023s user 0.015s sys 0.003s
I20251023 07:58:03.882040 17735 tablet_bootstrap.cc:654] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P 141636b82a7b4949931f25ce0a14addc: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:03.882700 17736 raft_consensus.cc:359] T 51aacc3534884c92926b5d632a3e11f7 P a35e1d7a0f05466db4af95b208209620 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:03.883473 17736 raft_consensus.cc:385] T 51aacc3534884c92926b5d632a3e11f7 P a35e1d7a0f05466db4af95b208209620 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:03.883828 17736 raft_consensus.cc:740] T 51aacc3534884c92926b5d632a3e11f7 P a35e1d7a0f05466db4af95b208209620 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a35e1d7a0f05466db4af95b208209620, State: Initialized, Role: FOLLOWER
I20251023 07:58:03.884586 17736 consensus_queue.cc:260] T 51aacc3534884c92926b5d632a3e11f7 P a35e1d7a0f05466db4af95b208209620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:03.887702 17736 ts_tablet_manager.cc:1434] T 51aacc3534884c92926b5d632a3e11f7 P a35e1d7a0f05466db4af95b208209620: Time spent starting tablet: real 0.008s user 0.004s sys 0.004s
I20251023 07:58:03.889063 17736 tablet_bootstrap.cc:492] T 5a8aa3610eeb4df3b88aa6fcb808969f P a35e1d7a0f05466db4af95b208209620: Bootstrap starting.
I20251023 07:58:03.890498 17737 tablet_bootstrap.cc:492] T f7dc54ff3f724e939f77ddaa796574c8 P a2ded24d2e7648649ddbe521d1dbd135: No bootstrap required, opened a new log
I20251023 07:58:03.891081 17737 ts_tablet_manager.cc:1403] T f7dc54ff3f724e939f77ddaa796574c8 P a2ded24d2e7648649ddbe521d1dbd135: Time spent bootstrapping tablet: real 0.019s user 0.013s sys 0.004s
I20251023 07:58:03.894033 17737 raft_consensus.cc:359] T f7dc54ff3f724e939f77ddaa796574c8 P a2ded24d2e7648649ddbe521d1dbd135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } }
I20251023 07:58:03.894841 17737 raft_consensus.cc:385] T f7dc54ff3f724e939f77ddaa796574c8 P a2ded24d2e7648649ddbe521d1dbd135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:03.895228 17737 raft_consensus.cc:740] T f7dc54ff3f724e939f77ddaa796574c8 P a2ded24d2e7648649ddbe521d1dbd135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2ded24d2e7648649ddbe521d1dbd135, State: Initialized, Role: FOLLOWER
I20251023 07:58:03.897382 17736 tablet_bootstrap.cc:654] T 5a8aa3610eeb4df3b88aa6fcb808969f P a35e1d7a0f05466db4af95b208209620: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:03.899438 17735 tablet_bootstrap.cc:492] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P 141636b82a7b4949931f25ce0a14addc: No bootstrap required, opened a new log
I20251023 07:58:03.899945 17735 ts_tablet_manager.cc:1403] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P 141636b82a7b4949931f25ce0a14addc: Time spent bootstrapping tablet: real 0.025s user 0.018s sys 0.005s
I20251023 07:58:03.896900 17737 consensus_queue.cc:260] T f7dc54ff3f724e939f77ddaa796574c8 P a2ded24d2e7648649ddbe521d1dbd135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } }
I20251023 07:58:03.902793 17735 raft_consensus.cc:359] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P 141636b82a7b4949931f25ce0a14addc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:03.903544 17735 raft_consensus.cc:385] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P 141636b82a7b4949931f25ce0a14addc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:03.903873 17735 raft_consensus.cc:740] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P 141636b82a7b4949931f25ce0a14addc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 141636b82a7b4949931f25ce0a14addc, State: Initialized, Role: FOLLOWER
I20251023 07:58:03.904719 17735 consensus_queue.cc:260] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P 141636b82a7b4949931f25ce0a14addc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:03.906833 17737 ts_tablet_manager.cc:1434] T f7dc54ff3f724e939f77ddaa796574c8 P a2ded24d2e7648649ddbe521d1dbd135: Time spent starting tablet: real 0.015s user 0.006s sys 0.000s
I20251023 07:58:03.907546 17735 ts_tablet_manager.cc:1434] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P 141636b82a7b4949931f25ce0a14addc: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20251023 07:58:03.908562 17735 tablet_bootstrap.cc:492] T f7dc54ff3f724e939f77ddaa796574c8 P 141636b82a7b4949931f25ce0a14addc: Bootstrap starting.
I20251023 07:58:03.912218 17737 tablet_bootstrap.cc:492] T 1ea153fe03884218bb2cf06c75d029c0 P a2ded24d2e7648649ddbe521d1dbd135: Bootstrap starting.
I20251023 07:58:03.918730 17737 tablet_bootstrap.cc:654] T 1ea153fe03884218bb2cf06c75d029c0 P a2ded24d2e7648649ddbe521d1dbd135: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:03.918736 17735 tablet_bootstrap.cc:654] T f7dc54ff3f724e939f77ddaa796574c8 P 141636b82a7b4949931f25ce0a14addc: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:03.924312 17736 tablet_bootstrap.cc:492] T 5a8aa3610eeb4df3b88aa6fcb808969f P a35e1d7a0f05466db4af95b208209620: No bootstrap required, opened a new log
I20251023 07:58:03.924432 17737 tablet_bootstrap.cc:492] T 1ea153fe03884218bb2cf06c75d029c0 P a2ded24d2e7648649ddbe521d1dbd135: No bootstrap required, opened a new log
I20251023 07:58:03.924911 17736 ts_tablet_manager.cc:1403] T 5a8aa3610eeb4df3b88aa6fcb808969f P a35e1d7a0f05466db4af95b208209620: Time spent bootstrapping tablet: real 0.036s user 0.030s sys 0.003s
I20251023 07:58:03.924986 17737 ts_tablet_manager.cc:1403] T 1ea153fe03884218bb2cf06c75d029c0 P a2ded24d2e7648649ddbe521d1dbd135: Time spent bootstrapping tablet: real 0.017s user 0.012s sys 0.000s
I20251023 07:58:03.925338 17735 tablet_bootstrap.cc:492] T f7dc54ff3f724e939f77ddaa796574c8 P 141636b82a7b4949931f25ce0a14addc: No bootstrap required, opened a new log
I20251023 07:58:03.925854 17735 ts_tablet_manager.cc:1403] T f7dc54ff3f724e939f77ddaa796574c8 P 141636b82a7b4949931f25ce0a14addc: Time spent bootstrapping tablet: real 0.017s user 0.006s sys 0.007s
I20251023 07:58:03.927978 17737 raft_consensus.cc:359] T 1ea153fe03884218bb2cf06c75d029c0 P a2ded24d2e7648649ddbe521d1dbd135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:03.927975 17736 raft_consensus.cc:359] T 5a8aa3610eeb4df3b88aa6fcb808969f P a35e1d7a0f05466db4af95b208209620 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:03.928437 17735 raft_consensus.cc:359] T f7dc54ff3f724e939f77ddaa796574c8 P 141636b82a7b4949931f25ce0a14addc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } }
I20251023 07:58:03.928956 17737 raft_consensus.cc:385] T 1ea153fe03884218bb2cf06c75d029c0 P a2ded24d2e7648649ddbe521d1dbd135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:03.929080 17736 raft_consensus.cc:385] T 5a8aa3610eeb4df3b88aa6fcb808969f P a35e1d7a0f05466db4af95b208209620 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:03.929157 17735 raft_consensus.cc:385] T f7dc54ff3f724e939f77ddaa796574c8 P 141636b82a7b4949931f25ce0a14addc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:03.929467 17737 raft_consensus.cc:740] T 1ea153fe03884218bb2cf06c75d029c0 P a2ded24d2e7648649ddbe521d1dbd135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2ded24d2e7648649ddbe521d1dbd135, State: Initialized, Role: FOLLOWER
I20251023 07:58:03.929690 17735 raft_consensus.cc:740] T f7dc54ff3f724e939f77ddaa796574c8 P 141636b82a7b4949931f25ce0a14addc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 141636b82a7b4949931f25ce0a14addc, State: Initialized, Role: FOLLOWER
I20251023 07:58:03.929608 17736 raft_consensus.cc:740] T 5a8aa3610eeb4df3b88aa6fcb808969f P a35e1d7a0f05466db4af95b208209620 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a35e1d7a0f05466db4af95b208209620, State: Initialized, Role: FOLLOWER
I20251023 07:58:03.934370 17737 consensus_queue.cc:260] T 1ea153fe03884218bb2cf06c75d029c0 P a2ded24d2e7648649ddbe521d1dbd135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:03.934628 17735 consensus_queue.cc:260] T f7dc54ff3f724e939f77ddaa796574c8 P 141636b82a7b4949931f25ce0a14addc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } }
I20251023 07:58:03.930145 17741 raft_consensus.cc:493] T fcb0398cbb794ef7856899e143856d9a P 141636b82a7b4949931f25ce0a14addc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:03.936570 17741 raft_consensus.cc:515] T fcb0398cbb794ef7856899e143856d9a P 141636b82a7b4949931f25ce0a14addc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:03.937279 17737 ts_tablet_manager.cc:1434] T 1ea153fe03884218bb2cf06c75d029c0 P a2ded24d2e7648649ddbe521d1dbd135: Time spent starting tablet: real 0.012s user 0.007s sys 0.000s
I20251023 07:58:03.934700 17736 consensus_queue.cc:260] T 5a8aa3610eeb4df3b88aa6fcb808969f P a35e1d7a0f05466db4af95b208209620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:03.938490 17737 tablet_bootstrap.cc:492] T fcb0398cbb794ef7856899e143856d9a P a2ded24d2e7648649ddbe521d1dbd135: Bootstrap starting.
I20251023 07:58:03.944526 17741 leader_election.cc:290] T fcb0398cbb794ef7856899e143856d9a P 141636b82a7b4949931f25ce0a14addc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2ded24d2e7648649ddbe521d1dbd135 (127.16.126.1:43887), a35e1d7a0f05466db4af95b208209620 (127.16.126.2:43007)
I20251023 07:58:03.944829 17737 tablet_bootstrap.cc:654] T fcb0398cbb794ef7856899e143856d9a P a2ded24d2e7648649ddbe521d1dbd135: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:03.947371 17741 raft_consensus.cc:493] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P 141636b82a7b4949931f25ce0a14addc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:03.948674 17741 raft_consensus.cc:515] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P 141636b82a7b4949931f25ce0a14addc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:03.949106 17736 ts_tablet_manager.cc:1434] T 5a8aa3610eeb4df3b88aa6fcb808969f P a35e1d7a0f05466db4af95b208209620: Time spent starting tablet: real 0.024s user 0.001s sys 0.009s
I20251023 07:58:03.953047 17741 leader_election.cc:290] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P 141636b82a7b4949931f25ce0a14addc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2ded24d2e7648649ddbe521d1dbd135 (127.16.126.1:43887), a35e1d7a0f05466db4af95b208209620 (127.16.126.2:43007)
I20251023 07:58:03.954281 17736 tablet_bootstrap.cc:492] T f7dc54ff3f724e939f77ddaa796574c8 P a35e1d7a0f05466db4af95b208209620: Bootstrap starting.
I20251023 07:58:03.954406 17737 tablet_bootstrap.cc:492] T fcb0398cbb794ef7856899e143856d9a P a2ded24d2e7648649ddbe521d1dbd135: No bootstrap required, opened a new log
I20251023 07:58:03.955790 17737 ts_tablet_manager.cc:1403] T fcb0398cbb794ef7856899e143856d9a P a2ded24d2e7648649ddbe521d1dbd135: Time spent bootstrapping tablet: real 0.018s user 0.005s sys 0.008s
I20251023 07:58:03.958813 17737 raft_consensus.cc:359] T fcb0398cbb794ef7856899e143856d9a P a2ded24d2e7648649ddbe521d1dbd135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:03.961541 17736 tablet_bootstrap.cc:654] T f7dc54ff3f724e939f77ddaa796574c8 P a35e1d7a0f05466db4af95b208209620: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:03.961823 17737 raft_consensus.cc:385] T fcb0398cbb794ef7856899e143856d9a P a2ded24d2e7648649ddbe521d1dbd135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:03.962141 17737 raft_consensus.cc:740] T fcb0398cbb794ef7856899e143856d9a P a2ded24d2e7648649ddbe521d1dbd135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2ded24d2e7648649ddbe521d1dbd135, State: Initialized, Role: FOLLOWER
I20251023 07:58:03.962877 17737 consensus_queue.cc:260] T fcb0398cbb794ef7856899e143856d9a P a2ded24d2e7648649ddbe521d1dbd135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:03.965291 17737 ts_tablet_manager.cc:1434] T fcb0398cbb794ef7856899e143856d9a P a2ded24d2e7648649ddbe521d1dbd135: Time spent starting tablet: real 0.009s user 0.003s sys 0.000s
I20251023 07:58:03.972085 17737 tablet_bootstrap.cc:492] T 65cb88497ea44c4a9ee9cc67ede9d318 P a2ded24d2e7648649ddbe521d1dbd135: Bootstrap starting.
I20251023 07:58:03.978653 17547 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fcb0398cbb794ef7856899e143856d9a" candidate_uuid: "141636b82a7b4949931f25ce0a14addc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2ded24d2e7648649ddbe521d1dbd135" is_pre_election: true
I20251023 07:58:03.979455 17547 raft_consensus.cc:2468] T fcb0398cbb794ef7856899e143856d9a P a2ded24d2e7648649ddbe521d1dbd135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 141636b82a7b4949931f25ce0a14addc in term 0.
I20251023 07:58:03.979915 17735 ts_tablet_manager.cc:1434] T f7dc54ff3f724e939f77ddaa796574c8 P 141636b82a7b4949931f25ce0a14addc: Time spent starting tablet: real 0.054s user 0.015s sys 0.012s
I20251023 07:58:03.980332 17742 raft_consensus.cc:493] T b84678e61cb446c3b00429824b024d12 P a2ded24d2e7648649ddbe521d1dbd135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:03.981035 17735 tablet_bootstrap.cc:492] T 1d80e56f890b4b3f99fdd1940f40e0a0 P 141636b82a7b4949931f25ce0a14addc: Bootstrap starting.
I20251023 07:58:03.980787 17742 raft_consensus.cc:515] T b84678e61cb446c3b00429824b024d12 P a2ded24d2e7648649ddbe521d1dbd135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:03.981205 17547 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cd34ebe0d6ff472cbfd9a71f16d4aee1" candidate_uuid: "141636b82a7b4949931f25ce0a14addc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2ded24d2e7648649ddbe521d1dbd135" is_pre_election: true
I20251023 07:58:03.983402 17742 leader_election.cc:290] T b84678e61cb446c3b00429824b024d12 P a2ded24d2e7648649ddbe521d1dbd135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a35e1d7a0f05466db4af95b208209620 (127.16.126.2:43007), 141636b82a7b4949931f25ce0a14addc (127.16.126.3:42717)
I20251023 07:58:03.979945 17736 tablet_bootstrap.cc:492] T f7dc54ff3f724e939f77ddaa796574c8 P a35e1d7a0f05466db4af95b208209620: No bootstrap required, opened a new log
I20251023 07:58:03.985057 17736 ts_tablet_manager.cc:1403] T f7dc54ff3f724e939f77ddaa796574c8 P a35e1d7a0f05466db4af95b208209620: Time spent bootstrapping tablet: real 0.031s user 0.007s sys 0.005s
I20251023 07:58:03.988257 17659 leader_election.cc:304] T fcb0398cbb794ef7856899e143856d9a P 141636b82a7b4949931f25ce0a14addc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 141636b82a7b4949931f25ce0a14addc, a2ded24d2e7648649ddbe521d1dbd135; no voters:
W20251023 07:58:03.990638 17659 leader_election.cc:343] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P 141636b82a7b4949931f25ce0a14addc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a2ded24d2e7648649ddbe521d1dbd135 (127.16.126.1:43887): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:03.991935 17756 raft_consensus.cc:2804] T fcb0398cbb794ef7856899e143856d9a P 141636b82a7b4949931f25ce0a14addc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:58:03.994251 17756 raft_consensus.cc:493] T fcb0398cbb794ef7856899e143856d9a P 141636b82a7b4949931f25ce0a14addc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:03.994869 17735 tablet_bootstrap.cc:654] T 1d80e56f890b4b3f99fdd1940f40e0a0 P 141636b82a7b4949931f25ce0a14addc: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:03.995231 17756 raft_consensus.cc:3060] T fcb0398cbb794ef7856899e143856d9a P 141636b82a7b4949931f25ce0a14addc [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:03.999969 17737 tablet_bootstrap.cc:654] T 65cb88497ea44c4a9ee9cc67ede9d318 P a2ded24d2e7648649ddbe521d1dbd135: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:04.003724 17743 raft_consensus.cc:493] T fcb0398cbb794ef7856899e143856d9a P a35e1d7a0f05466db4af95b208209620 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:04.004245 17743 raft_consensus.cc:515] T fcb0398cbb794ef7856899e143856d9a P a35e1d7a0f05466db4af95b208209620 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:03.988389 17736 raft_consensus.cc:359] T f7dc54ff3f724e939f77ddaa796574c8 P a35e1d7a0f05466db4af95b208209620 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } }
I20251023 07:58:04.006500 17736 raft_consensus.cc:385] T f7dc54ff3f724e939f77ddaa796574c8 P a35e1d7a0f05466db4af95b208209620 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:04.006824 17736 raft_consensus.cc:740] T f7dc54ff3f724e939f77ddaa796574c8 P a35e1d7a0f05466db4af95b208209620 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a35e1d7a0f05466db4af95b208209620, State: Initialized, Role: FOLLOWER
I20251023 07:58:04.008294 17735 tablet_bootstrap.cc:492] T 1d80e56f890b4b3f99fdd1940f40e0a0 P 141636b82a7b4949931f25ce0a14addc: No bootstrap required, opened a new log
I20251023 07:58:04.008920 17735 ts_tablet_manager.cc:1403] T 1d80e56f890b4b3f99fdd1940f40e0a0 P 141636b82a7b4949931f25ce0a14addc: Time spent bootstrapping tablet: real 0.028s user 0.018s sys 0.000s
W20251023 07:58:04.010375 17493 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20251023 07:58:04.011349 17743 leader_election.cc:290] T fcb0398cbb794ef7856899e143856d9a P a35e1d7a0f05466db4af95b208209620 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2ded24d2e7648649ddbe521d1dbd135 (127.16.126.1:43887), 141636b82a7b4949931f25ce0a14addc (127.16.126.3:42717)
I20251023 07:58:04.013053 17735 raft_consensus.cc:359] T 1d80e56f890b4b3f99fdd1940f40e0a0 P 141636b82a7b4949931f25ce0a14addc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:04.015331 17735 raft_consensus.cc:385] T 1d80e56f890b4b3f99fdd1940f40e0a0 P 141636b82a7b4949931f25ce0a14addc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:04.015694 17735 raft_consensus.cc:740] T 1d80e56f890b4b3f99fdd1940f40e0a0 P 141636b82a7b4949931f25ce0a14addc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 141636b82a7b4949931f25ce0a14addc, State: Initialized, Role: FOLLOWER
I20251023 07:58:04.016785 17737 tablet_bootstrap.cc:492] T 65cb88497ea44c4a9ee9cc67ede9d318 P a2ded24d2e7648649ddbe521d1dbd135: No bootstrap required, opened a new log
I20251023 07:58:04.016533 17735 consensus_queue.cc:260] T 1d80e56f890b4b3f99fdd1940f40e0a0 P 141636b82a7b4949931f25ce0a14addc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:04.018765 17737 ts_tablet_manager.cc:1403] T 65cb88497ea44c4a9ee9cc67ede9d318 P a2ded24d2e7648649ddbe521d1dbd135: Time spent bootstrapping tablet: real 0.047s user 0.007s sys 0.009s
I20251023 07:58:04.022042 17737 raft_consensus.cc:359] T 65cb88497ea44c4a9ee9cc67ede9d318 P a2ded24d2e7648649ddbe521d1dbd135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:04.022902 17735 ts_tablet_manager.cc:1434] T 1d80e56f890b4b3f99fdd1940f40e0a0 P 141636b82a7b4949931f25ce0a14addc: Time spent starting tablet: real 0.014s user 0.005s sys 0.003s
I20251023 07:58:04.023481 17743 raft_consensus.cc:493] T 51aacc3534884c92926b5d632a3e11f7 P a35e1d7a0f05466db4af95b208209620 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:04.026078 17743 raft_consensus.cc:515] T 51aacc3534884c92926b5d632a3e11f7 P a35e1d7a0f05466db4af95b208209620 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:04.026659 17735 tablet_bootstrap.cc:492] T 0524c60cf5404f1e99bef45655e8bd77 P 141636b82a7b4949931f25ce0a14addc: Bootstrap starting.
I20251023 07:58:04.027360 17736 consensus_queue.cc:260] T f7dc54ff3f724e939f77ddaa796574c8 P a35e1d7a0f05466db4af95b208209620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } }
I20251023 07:58:04.028045 17743 leader_election.cc:290] T 51aacc3534884c92926b5d632a3e11f7 P a35e1d7a0f05466db4af95b208209620 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2ded24d2e7648649ddbe521d1dbd135 (127.16.126.1:43887), 141636b82a7b4949931f25ce0a14addc (127.16.126.3:42717)
I20251023 07:58:04.025548 17737 raft_consensus.cc:385] T 65cb88497ea44c4a9ee9cc67ede9d318 P a2ded24d2e7648649ddbe521d1dbd135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:04.030989 17737 raft_consensus.cc:740] T 65cb88497ea44c4a9ee9cc67ede9d318 P a2ded24d2e7648649ddbe521d1dbd135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2ded24d2e7648649ddbe521d1dbd135, State: Initialized, Role: FOLLOWER
I20251023 07:58:04.032416 17622 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fcb0398cbb794ef7856899e143856d9a" candidate_uuid: "141636b82a7b4949931f25ce0a14addc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a35e1d7a0f05466db4af95b208209620" is_pre_election: true
I20251023 07:58:04.033953 17621 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cd34ebe0d6ff472cbfd9a71f16d4aee1" candidate_uuid: "141636b82a7b4949931f25ce0a14addc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a35e1d7a0f05466db4af95b208209620" is_pre_election: true
I20251023 07:58:04.033097 17622 raft_consensus.cc:2468] T fcb0398cbb794ef7856899e143856d9a P a35e1d7a0f05466db4af95b208209620 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 141636b82a7b4949931f25ce0a14addc in term 0.
I20251023 07:58:04.031805 17737 consensus_queue.cc:260] T 65cb88497ea44c4a9ee9cc67ede9d318 P a2ded24d2e7648649ddbe521d1dbd135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
W20251023 07:58:04.038070 17659 leader_election.cc:343] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P 141636b82a7b4949931f25ce0a14addc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a35e1d7a0f05466db4af95b208209620 (127.16.126.2:43007): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:04.038589 17659 leader_election.cc:304] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P 141636b82a7b4949931f25ce0a14addc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 141636b82a7b4949931f25ce0a14addc; no voters: a2ded24d2e7648649ddbe521d1dbd135, a35e1d7a0f05466db4af95b208209620
I20251023 07:58:04.039513 17754 raft_consensus.cc:2749] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P 141636b82a7b4949931f25ce0a14addc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:58:04.040452 17756 raft_consensus.cc:515] T fcb0398cbb794ef7856899e143856d9a P 141636b82a7b4949931f25ce0a14addc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:04.042529 17756 leader_election.cc:290] T fcb0398cbb794ef7856899e143856d9a P 141636b82a7b4949931f25ce0a14addc [CANDIDATE]: Term 1 election: Requested vote from peers a2ded24d2e7648649ddbe521d1dbd135 (127.16.126.1:43887), a35e1d7a0f05466db4af95b208209620 (127.16.126.2:43007)
I20251023 07:58:04.044133 17547 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fcb0398cbb794ef7856899e143856d9a" candidate_uuid: "141636b82a7b4949931f25ce0a14addc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2ded24d2e7648649ddbe521d1dbd135"
I20251023 07:58:04.044708 17547 raft_consensus.cc:3060] T fcb0398cbb794ef7856899e143856d9a P a2ded24d2e7648649ddbe521d1dbd135 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:04.045058 17737 ts_tablet_manager.cc:1434] T 65cb88497ea44c4a9ee9cc67ede9d318 P a2ded24d2e7648649ddbe521d1dbd135: Time spent starting tablet: real 0.026s user 0.006s sys 0.000s
I20251023 07:58:04.048236 17736 ts_tablet_manager.cc:1434] T f7dc54ff3f724e939f77ddaa796574c8 P a35e1d7a0f05466db4af95b208209620: Time spent starting tablet: real 0.063s user 0.006s sys 0.001s
I20251023 07:58:04.051079 17736 tablet_bootstrap.cc:492] T 65cb88497ea44c4a9ee9cc67ede9d318 P a35e1d7a0f05466db4af95b208209620: Bootstrap starting.
I20251023 07:58:04.052028 17547 raft_consensus.cc:2468] T fcb0398cbb794ef7856899e143856d9a P a2ded24d2e7648649ddbe521d1dbd135 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 141636b82a7b4949931f25ce0a14addc in term 1.
I20251023 07:58:04.052599 17735 tablet_bootstrap.cc:654] T 0524c60cf5404f1e99bef45655e8bd77 P 141636b82a7b4949931f25ce0a14addc: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:04.052670 17737 tablet_bootstrap.cc:492] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P a2ded24d2e7648649ddbe521d1dbd135: Bootstrap starting.
I20251023 07:58:04.054250 17622 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fcb0398cbb794ef7856899e143856d9a" candidate_uuid: "141636b82a7b4949931f25ce0a14addc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a35e1d7a0f05466db4af95b208209620"
I20251023 07:58:04.055576 17695 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "51aacc3534884c92926b5d632a3e11f7" candidate_uuid: "a35e1d7a0f05466db4af95b208209620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141636b82a7b4949931f25ce0a14addc" is_pre_election: true
I20251023 07:58:04.056090 17622 raft_consensus.cc:3060] T fcb0398cbb794ef7856899e143856d9a P a35e1d7a0f05466db4af95b208209620 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:04.056926 17659 leader_election.cc:304] T fcb0398cbb794ef7856899e143856d9a P 141636b82a7b4949931f25ce0a14addc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 141636b82a7b4949931f25ce0a14addc, a2ded24d2e7648649ddbe521d1dbd135; no voters:
I20251023 07:58:04.055253 17696 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fcb0398cbb794ef7856899e143856d9a" candidate_uuid: "a35e1d7a0f05466db4af95b208209620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141636b82a7b4949931f25ce0a14addc" is_pre_election: true
I20251023 07:58:04.057883 17696 raft_consensus.cc:2393] T fcb0398cbb794ef7856899e143856d9a P 141636b82a7b4949931f25ce0a14addc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a35e1d7a0f05466db4af95b208209620 in current term 1: Already voted for candidate 141636b82a7b4949931f25ce0a14addc in this term.
W20251023 07:58:04.057066 17587 leader_election.cc:343] T 51aacc3534884c92926b5d632a3e11f7 P a35e1d7a0f05466db4af95b208209620 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 141636b82a7b4949931f25ce0a14addc (127.16.126.3:42717): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:04.060272 17546 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "51aacc3534884c92926b5d632a3e11f7" candidate_uuid: "a35e1d7a0f05466db4af95b208209620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2ded24d2e7648649ddbe521d1dbd135" is_pre_election: true
W20251023 07:58:04.062738 17585 leader_election.cc:343] T 51aacc3534884c92926b5d632a3e11f7 P a35e1d7a0f05466db4af95b208209620 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a2ded24d2e7648649ddbe521d1dbd135 (127.16.126.1:43887): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:04.066193 17736 tablet_bootstrap.cc:654] T 65cb88497ea44c4a9ee9cc67ede9d318 P a35e1d7a0f05466db4af95b208209620: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:04.067817 17696 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b84678e61cb446c3b00429824b024d12" candidate_uuid: "a2ded24d2e7648649ddbe521d1dbd135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141636b82a7b4949931f25ce0a14addc" is_pre_election: true
I20251023 07:58:04.068554 17696 raft_consensus.cc:2468] T b84678e61cb446c3b00429824b024d12 P 141636b82a7b4949931f25ce0a14addc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2ded24d2e7648649ddbe521d1dbd135 in term 0.
I20251023 07:58:04.069322 17735 tablet_bootstrap.cc:492] T 0524c60cf5404f1e99bef45655e8bd77 P 141636b82a7b4949931f25ce0a14addc: No bootstrap required, opened a new log
I20251023 07:58:04.066001 17622 raft_consensus.cc:2468] T fcb0398cbb794ef7856899e143856d9a P a35e1d7a0f05466db4af95b208209620 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 141636b82a7b4949931f25ce0a14addc in term 1.
I20251023 07:58:04.066874 17756 raft_consensus.cc:2804] T fcb0398cbb794ef7856899e143856d9a P 141636b82a7b4949931f25ce0a14addc [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:58:04.070088 17512 leader_election.cc:304] T b84678e61cb446c3b00429824b024d12 P a2ded24d2e7648649ddbe521d1dbd135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 141636b82a7b4949931f25ce0a14addc, a2ded24d2e7648649ddbe521d1dbd135; no voters:
I20251023 07:58:04.054847 17547 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fcb0398cbb794ef7856899e143856d9a" candidate_uuid: "a35e1d7a0f05466db4af95b208209620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2ded24d2e7648649ddbe521d1dbd135" is_pre_election: true
I20251023 07:58:04.071074 17742 raft_consensus.cc:2804] T b84678e61cb446c3b00429824b024d12 P a2ded24d2e7648649ddbe521d1dbd135 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:58:04.071056 17756 raft_consensus.cc:697] T fcb0398cbb794ef7856899e143856d9a P 141636b82a7b4949931f25ce0a14addc [term 1 LEADER]: Becoming Leader. State: Replica: 141636b82a7b4949931f25ce0a14addc, State: Running, Role: LEADER
I20251023 07:58:04.071710 17742 raft_consensus.cc:493] T b84678e61cb446c3b00429824b024d12 P a2ded24d2e7648649ddbe521d1dbd135 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:04.063211 17585 leader_election.cc:304] T 51aacc3534884c92926b5d632a3e11f7 P a35e1d7a0f05466db4af95b208209620 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a35e1d7a0f05466db4af95b208209620; no voters: 141636b82a7b4949931f25ce0a14addc, a2ded24d2e7648649ddbe521d1dbd135
I20251023 07:58:04.072057 17742 raft_consensus.cc:3060] T b84678e61cb446c3b00429824b024d12 P a2ded24d2e7648649ddbe521d1dbd135 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:04.072328 17756 consensus_queue.cc:237] T fcb0398cbb794ef7856899e143856d9a P 141636b82a7b4949931f25ce0a14addc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:04.072785 17768 raft_consensus.cc:2749] T 51aacc3534884c92926b5d632a3e11f7 P a35e1d7a0f05466db4af95b208209620 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:58:04.071283 17735 ts_tablet_manager.cc:1403] T 0524c60cf5404f1e99bef45655e8bd77 P 141636b82a7b4949931f25ce0a14addc: Time spent bootstrapping tablet: real 0.045s user 0.016s sys 0.002s
I20251023 07:58:04.076150 17622 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b84678e61cb446c3b00429824b024d12" candidate_uuid: "a2ded24d2e7648649ddbe521d1dbd135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a35e1d7a0f05466db4af95b208209620" is_pre_election: true
I20251023 07:58:04.076802 17622 raft_consensus.cc:2468] T b84678e61cb446c3b00429824b024d12 P a35e1d7a0f05466db4af95b208209620 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2ded24d2e7648649ddbe521d1dbd135 in term 0.
I20251023 07:58:04.078516 17735 raft_consensus.cc:359] T 0524c60cf5404f1e99bef45655e8bd77 P 141636b82a7b4949931f25ce0a14addc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:04.079310 17735 raft_consensus.cc:385] T 0524c60cf5404f1e99bef45655e8bd77 P 141636b82a7b4949931f25ce0a14addc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:04.079690 17735 raft_consensus.cc:740] T 0524c60cf5404f1e99bef45655e8bd77 P 141636b82a7b4949931f25ce0a14addc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 141636b82a7b4949931f25ce0a14addc, State: Initialized, Role: FOLLOWER
I20251023 07:58:04.079592 17742 raft_consensus.cc:515] T b84678e61cb446c3b00429824b024d12 P a2ded24d2e7648649ddbe521d1dbd135 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:04.080720 17735 consensus_queue.cc:260] T 0524c60cf5404f1e99bef45655e8bd77 P 141636b82a7b4949931f25ce0a14addc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:04.082335 17622 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b84678e61cb446c3b00429824b024d12" candidate_uuid: "a2ded24d2e7648649ddbe521d1dbd135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a35e1d7a0f05466db4af95b208209620"
I20251023 07:58:04.082820 17754 raft_consensus.cc:493] T 65cb88497ea44c4a9ee9cc67ede9d318 P 141636b82a7b4949931f25ce0a14addc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:04.083600 17547 raft_consensus.cc:2393] T fcb0398cbb794ef7856899e143856d9a P a2ded24d2e7648649ddbe521d1dbd135 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a35e1d7a0f05466db4af95b208209620 in current term 1: Already voted for candidate 141636b82a7b4949931f25ce0a14addc in this term.
I20251023 07:58:04.083348 17754 raft_consensus.cc:515] T 65cb88497ea44c4a9ee9cc67ede9d318 P 141636b82a7b4949931f25ce0a14addc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:04.084715 17585 leader_election.cc:304] T fcb0398cbb794ef7856899e143856d9a P a35e1d7a0f05466db4af95b208209620 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a35e1d7a0f05466db4af95b208209620; no voters: 141636b82a7b4949931f25ce0a14addc, a2ded24d2e7648649ddbe521d1dbd135
I20251023 07:58:04.085249 17754 leader_election.cc:290] T 65cb88497ea44c4a9ee9cc67ede9d318 P 141636b82a7b4949931f25ce0a14addc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2ded24d2e7648649ddbe521d1dbd135 (127.16.126.1:43887), a35e1d7a0f05466db4af95b208209620 (127.16.126.2:43007)
I20251023 07:58:04.085472 17768 raft_consensus.cc:2749] T fcb0398cbb794ef7856899e143856d9a P a35e1d7a0f05466db4af95b208209620 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:58:04.087095 17621 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "65cb88497ea44c4a9ee9cc67ede9d318" candidate_uuid: "141636b82a7b4949931f25ce0a14addc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a35e1d7a0f05466db4af95b208209620" is_pre_election: true
I20251023 07:58:04.087236 17546 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "65cb88497ea44c4a9ee9cc67ede9d318" candidate_uuid: "141636b82a7b4949931f25ce0a14addc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2ded24d2e7648649ddbe521d1dbd135" is_pre_election: true
I20251023 07:58:04.087759 17546 raft_consensus.cc:2468] T 65cb88497ea44c4a9ee9cc67ede9d318 P a2ded24d2e7648649ddbe521d1dbd135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 141636b82a7b4949931f25ce0a14addc in term 0.
W20251023 07:58:04.088336 17659 leader_election.cc:343] T 65cb88497ea44c4a9ee9cc67ede9d318 P 141636b82a7b4949931f25ce0a14addc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a35e1d7a0f05466db4af95b208209620 (127.16.126.2:43007): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:04.082875 17622 raft_consensus.cc:3060] T b84678e61cb446c3b00429824b024d12 P a35e1d7a0f05466db4af95b208209620 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:04.089051 17659 leader_election.cc:304] T 65cb88497ea44c4a9ee9cc67ede9d318 P 141636b82a7b4949931f25ce0a14addc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 141636b82a7b4949931f25ce0a14addc, a2ded24d2e7648649ddbe521d1dbd135; no voters: a35e1d7a0f05466db4af95b208209620
I20251023 07:58:04.090674 17742 leader_election.cc:290] T b84678e61cb446c3b00429824b024d12 P a2ded24d2e7648649ddbe521d1dbd135 [CANDIDATE]: Term 1 election: Requested vote from peers a35e1d7a0f05466db4af95b208209620 (127.16.126.2:43007), 141636b82a7b4949931f25ce0a14addc (127.16.126.3:42717)
I20251023 07:58:04.091714 17696 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b84678e61cb446c3b00429824b024d12" candidate_uuid: "a2ded24d2e7648649ddbe521d1dbd135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141636b82a7b4949931f25ce0a14addc"
I20251023 07:58:04.092307 17696 raft_consensus.cc:3060] T b84678e61cb446c3b00429824b024d12 P 141636b82a7b4949931f25ce0a14addc [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:04.095547 17737 tablet_bootstrap.cc:654] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P a2ded24d2e7648649ddbe521d1dbd135: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:04.095733 17754 raft_consensus.cc:2804] T 65cb88497ea44c4a9ee9cc67ede9d318 P 141636b82a7b4949931f25ce0a14addc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:58:04.096050 17754 raft_consensus.cc:493] T 65cb88497ea44c4a9ee9cc67ede9d318 P 141636b82a7b4949931f25ce0a14addc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:04.096395 17754 raft_consensus.cc:3060] T 65cb88497ea44c4a9ee9cc67ede9d318 P 141636b82a7b4949931f25ce0a14addc [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:04.101764 17736 tablet_bootstrap.cc:492] T 65cb88497ea44c4a9ee9cc67ede9d318 P a35e1d7a0f05466db4af95b208209620: No bootstrap required, opened a new log
I20251023 07:58:04.102324 17736 ts_tablet_manager.cc:1403] T 65cb88497ea44c4a9ee9cc67ede9d318 P a35e1d7a0f05466db4af95b208209620: Time spent bootstrapping tablet: real 0.051s user 0.024s sys 0.014s
I20251023 07:58:04.104116 17443 catalog_manager.cc:5649] T fcb0398cbb794ef7856899e143856d9a P 141636b82a7b4949931f25ce0a14addc reported cstate change: term changed from 0 to 1, leader changed from <none> to 141636b82a7b4949931f25ce0a14addc (127.16.126.3). New cstate: current_term: 1 leader_uuid: "141636b82a7b4949931f25ce0a14addc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } health_report { overall_health: HEALTHY } } }
I20251023 07:58:04.105055 17736 raft_consensus.cc:359] T 65cb88497ea44c4a9ee9cc67ede9d318 P a35e1d7a0f05466db4af95b208209620 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:04.106031 17736 raft_consensus.cc:385] T 65cb88497ea44c4a9ee9cc67ede9d318 P a35e1d7a0f05466db4af95b208209620 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:04.106403 17736 raft_consensus.cc:740] T 65cb88497ea44c4a9ee9cc67ede9d318 P a35e1d7a0f05466db4af95b208209620 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a35e1d7a0f05466db4af95b208209620, State: Initialized, Role: FOLLOWER
I20251023 07:58:04.107372 17736 consensus_queue.cc:260] T 65cb88497ea44c4a9ee9cc67ede9d318 P a35e1d7a0f05466db4af95b208209620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:04.111370 17622 raft_consensus.cc:2468] T b84678e61cb446c3b00429824b024d12 P a35e1d7a0f05466db4af95b208209620 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2ded24d2e7648649ddbe521d1dbd135 in term 1.
I20251023 07:58:04.112461 17736 ts_tablet_manager.cc:1434] T 65cb88497ea44c4a9ee9cc67ede9d318 P a35e1d7a0f05466db4af95b208209620: Time spent starting tablet: real 0.010s user 0.004s sys 0.001s
I20251023 07:58:04.116376 17736 tablet_bootstrap.cc:492] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P a35e1d7a0f05466db4af95b208209620: Bootstrap starting.
I20251023 07:58:04.116643 17510 leader_election.cc:304] T b84678e61cb446c3b00429824b024d12 P a2ded24d2e7648649ddbe521d1dbd135 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2ded24d2e7648649ddbe521d1dbd135, a35e1d7a0f05466db4af95b208209620; no voters:
I20251023 07:58:04.119758 17742 raft_consensus.cc:2804] T b84678e61cb446c3b00429824b024d12 P a2ded24d2e7648649ddbe521d1dbd135 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:58:04.122479 17742 raft_consensus.cc:697] T b84678e61cb446c3b00429824b024d12 P a2ded24d2e7648649ddbe521d1dbd135 [term 1 LEADER]: Becoming Leader. State: Replica: a2ded24d2e7648649ddbe521d1dbd135, State: Running, Role: LEADER
I20251023 07:58:04.122926 17736 tablet_bootstrap.cc:654] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P a35e1d7a0f05466db4af95b208209620: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:04.123369 17742 consensus_queue.cc:237] T b84678e61cb446c3b00429824b024d12 P a2ded24d2e7648649ddbe521d1dbd135 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:04.115226 17735 ts_tablet_manager.cc:1434] T 0524c60cf5404f1e99bef45655e8bd77 P 141636b82a7b4949931f25ce0a14addc: Time spent starting tablet: real 0.039s user 0.001s sys 0.005s
I20251023 07:58:04.126040 17737 tablet_bootstrap.cc:492] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P a2ded24d2e7648649ddbe521d1dbd135: No bootstrap required, opened a new log
I20251023 07:58:04.126297 17735 tablet_bootstrap.cc:492] T 1ea153fe03884218bb2cf06c75d029c0 P 141636b82a7b4949931f25ce0a14addc: Bootstrap starting.
I20251023 07:58:04.126789 17737 ts_tablet_manager.cc:1403] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P a2ded24d2e7648649ddbe521d1dbd135: Time spent bootstrapping tablet: real 0.074s user 0.024s sys 0.011s
I20251023 07:58:04.130404 17737 raft_consensus.cc:359] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P a2ded24d2e7648649ddbe521d1dbd135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:04.131224 17737 raft_consensus.cc:385] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P a2ded24d2e7648649ddbe521d1dbd135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:04.131557 17737 raft_consensus.cc:740] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P a2ded24d2e7648649ddbe521d1dbd135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2ded24d2e7648649ddbe521d1dbd135, State: Initialized, Role: FOLLOWER
I20251023 07:58:04.132405 17737 consensus_queue.cc:260] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P a2ded24d2e7648649ddbe521d1dbd135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:04.114842 17754 raft_consensus.cc:515] T 65cb88497ea44c4a9ee9cc67ede9d318 P 141636b82a7b4949931f25ce0a14addc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:04.135515 17754 leader_election.cc:290] T 65cb88497ea44c4a9ee9cc67ede9d318 P 141636b82a7b4949931f25ce0a14addc [CANDIDATE]: Term 1 election: Requested vote from peers a2ded24d2e7648649ddbe521d1dbd135 (127.16.126.1:43887), a35e1d7a0f05466db4af95b208209620 (127.16.126.2:43007)
I20251023 07:58:04.113775 17696 raft_consensus.cc:2468] T b84678e61cb446c3b00429824b024d12 P 141636b82a7b4949931f25ce0a14addc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2ded24d2e7648649ddbe521d1dbd135 in term 1.
I20251023 07:58:04.136309 17547 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "65cb88497ea44c4a9ee9cc67ede9d318" candidate_uuid: "141636b82a7b4949931f25ce0a14addc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2ded24d2e7648649ddbe521d1dbd135"
I20251023 07:58:04.136678 17737 ts_tablet_manager.cc:1434] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P a2ded24d2e7648649ddbe521d1dbd135: Time spent starting tablet: real 0.009s user 0.003s sys 0.005s
I20251023 07:58:04.136909 17547 raft_consensus.cc:3060] T 65cb88497ea44c4a9ee9cc67ede9d318 P a2ded24d2e7648649ddbe521d1dbd135 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:04.137992 17737 tablet_bootstrap.cc:492] T 1d80e56f890b4b3f99fdd1940f40e0a0 P a2ded24d2e7648649ddbe521d1dbd135: Bootstrap starting.
I20251023 07:58:04.138959 17735 tablet_bootstrap.cc:654] T 1ea153fe03884218bb2cf06c75d029c0 P 141636b82a7b4949931f25ce0a14addc: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:04.142035 17622 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "65cb88497ea44c4a9ee9cc67ede9d318" candidate_uuid: "141636b82a7b4949931f25ce0a14addc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a35e1d7a0f05466db4af95b208209620"
I20251023 07:58:04.143133 17622 raft_consensus.cc:3060] T 65cb88497ea44c4a9ee9cc67ede9d318 P a35e1d7a0f05466db4af95b208209620 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:04.145669 17737 tablet_bootstrap.cc:654] T 1d80e56f890b4b3f99fdd1940f40e0a0 P a2ded24d2e7648649ddbe521d1dbd135: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:04.150887 17735 tablet_bootstrap.cc:492] T 1ea153fe03884218bb2cf06c75d029c0 P 141636b82a7b4949931f25ce0a14addc: No bootstrap required, opened a new log
I20251023 07:58:04.152076 17735 ts_tablet_manager.cc:1403] T 1ea153fe03884218bb2cf06c75d029c0 P 141636b82a7b4949931f25ce0a14addc: Time spent bootstrapping tablet: real 0.026s user 0.012s sys 0.005s
I20251023 07:58:04.147243 17547 raft_consensus.cc:2468] T 65cb88497ea44c4a9ee9cc67ede9d318 P a2ded24d2e7648649ddbe521d1dbd135 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 141636b82a7b4949931f25ce0a14addc in term 1.
I20251023 07:58:04.153695 17659 leader_election.cc:304] T 65cb88497ea44c4a9ee9cc67ede9d318 P 141636b82a7b4949931f25ce0a14addc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 141636b82a7b4949931f25ce0a14addc, a2ded24d2e7648649ddbe521d1dbd135; no voters:
I20251023 07:58:04.154636 17754 raft_consensus.cc:2804] T 65cb88497ea44c4a9ee9cc67ede9d318 P 141636b82a7b4949931f25ce0a14addc [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:58:04.155171 17754 raft_consensus.cc:697] T 65cb88497ea44c4a9ee9cc67ede9d318 P 141636b82a7b4949931f25ce0a14addc [term 1 LEADER]: Becoming Leader. State: Replica: 141636b82a7b4949931f25ce0a14addc, State: Running, Role: LEADER
I20251023 07:58:04.155432 17736 tablet_bootstrap.cc:492] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P a35e1d7a0f05466db4af95b208209620: No bootstrap required, opened a new log
I20251023 07:58:04.154686 17443 catalog_manager.cc:5649] T b84678e61cb446c3b00429824b024d12 P a2ded24d2e7648649ddbe521d1dbd135 reported cstate change: term changed from 0 to 1, leader changed from <none> to a2ded24d2e7648649ddbe521d1dbd135 (127.16.126.1). New cstate: current_term: 1 leader_uuid: "a2ded24d2e7648649ddbe521d1dbd135" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } health_report { overall_health: UNKNOWN } } }
I20251023 07:58:04.155717 17737 tablet_bootstrap.cc:492] T 1d80e56f890b4b3f99fdd1940f40e0a0 P a2ded24d2e7648649ddbe521d1dbd135: No bootstrap required, opened a new log
I20251023 07:58:04.155889 17736 ts_tablet_manager.cc:1403] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P a35e1d7a0f05466db4af95b208209620: Time spent bootstrapping tablet: real 0.040s user 0.013s sys 0.002s
I20251023 07:58:04.156172 17737 ts_tablet_manager.cc:1403] T 1d80e56f890b4b3f99fdd1940f40e0a0 P a2ded24d2e7648649ddbe521d1dbd135: Time spent bootstrapping tablet: real 0.018s user 0.005s sys 0.007s
I20251023 07:58:04.155987 17754 consensus_queue.cc:237] T 65cb88497ea44c4a9ee9cc67ede9d318 P 141636b82a7b4949931f25ce0a14addc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:04.158706 17737 raft_consensus.cc:359] T 1d80e56f890b4b3f99fdd1940f40e0a0 P a2ded24d2e7648649ddbe521d1dbd135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:04.159436 17737 raft_consensus.cc:385] T 1d80e56f890b4b3f99fdd1940f40e0a0 P a2ded24d2e7648649ddbe521d1dbd135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:04.159756 17737 raft_consensus.cc:740] T 1d80e56f890b4b3f99fdd1940f40e0a0 P a2ded24d2e7648649ddbe521d1dbd135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2ded24d2e7648649ddbe521d1dbd135, State: Initialized, Role: FOLLOWER
I20251023 07:58:04.160671 17737 consensus_queue.cc:260] T 1d80e56f890b4b3f99fdd1940f40e0a0 P a2ded24d2e7648649ddbe521d1dbd135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:04.163581 17737 ts_tablet_manager.cc:1434] T 1d80e56f890b4b3f99fdd1940f40e0a0 P a2ded24d2e7648649ddbe521d1dbd135: Time spent starting tablet: real 0.007s user 0.007s sys 0.001s
I20251023 07:58:04.163710 17736 raft_consensus.cc:359] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P a35e1d7a0f05466db4af95b208209620 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:04.164443 17736 raft_consensus.cc:385] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P a35e1d7a0f05466db4af95b208209620 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:04.164621 17737 tablet_bootstrap.cc:492] T 0524c60cf5404f1e99bef45655e8bd77 P a2ded24d2e7648649ddbe521d1dbd135: Bootstrap starting.
I20251023 07:58:04.164762 17736 raft_consensus.cc:740] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P a35e1d7a0f05466db4af95b208209620 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a35e1d7a0f05466db4af95b208209620, State: Initialized, Role: FOLLOWER
I20251023 07:58:04.165661 17736 consensus_queue.cc:260] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P a35e1d7a0f05466db4af95b208209620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:04.168026 17736 ts_tablet_manager.cc:1434] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P a35e1d7a0f05466db4af95b208209620: Time spent starting tablet: real 0.012s user 0.004s sys 0.000s
I20251023 07:58:04.168998 17736 tablet_bootstrap.cc:492] T 1ea153fe03884218bb2cf06c75d029c0 P a35e1d7a0f05466db4af95b208209620: Bootstrap starting.
I20251023 07:58:04.170087 17735 raft_consensus.cc:359] T 1ea153fe03884218bb2cf06c75d029c0 P 141636b82a7b4949931f25ce0a14addc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:04.170746 17735 raft_consensus.cc:385] T 1ea153fe03884218bb2cf06c75d029c0 P 141636b82a7b4949931f25ce0a14addc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:04.170995 17735 raft_consensus.cc:740] T 1ea153fe03884218bb2cf06c75d029c0 P 141636b82a7b4949931f25ce0a14addc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 141636b82a7b4949931f25ce0a14addc, State: Initialized, Role: FOLLOWER
I20251023 07:58:04.174448 17735 consensus_queue.cc:260] T 1ea153fe03884218bb2cf06c75d029c0 P 141636b82a7b4949931f25ce0a14addc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:04.175426 17736 tablet_bootstrap.cc:654] T 1ea153fe03884218bb2cf06c75d029c0 P a35e1d7a0f05466db4af95b208209620: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:04.178714 17622 raft_consensus.cc:2468] T 65cb88497ea44c4a9ee9cc67ede9d318 P a35e1d7a0f05466db4af95b208209620 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 141636b82a7b4949931f25ce0a14addc in term 1.
I20251023 07:58:04.180948 17735 ts_tablet_manager.cc:1434] T 1ea153fe03884218bb2cf06c75d029c0 P 141636b82a7b4949931f25ce0a14addc: Time spent starting tablet: real 0.029s user 0.006s sys 0.000s
I20251023 07:58:04.181996 17768 raft_consensus.cc:493] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P a35e1d7a0f05466db4af95b208209620 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:04.182698 17768 raft_consensus.cc:515] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P a35e1d7a0f05466db4af95b208209620 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:04.186332 17737 tablet_bootstrap.cc:654] T 0524c60cf5404f1e99bef45655e8bd77 P a2ded24d2e7648649ddbe521d1dbd135: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:04.186825 17696 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cd34ebe0d6ff472cbfd9a71f16d4aee1" candidate_uuid: "a35e1d7a0f05466db4af95b208209620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141636b82a7b4949931f25ce0a14addc" is_pre_election: true
I20251023 07:58:04.187655 17696 raft_consensus.cc:2468] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P 141636b82a7b4949931f25ce0a14addc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a35e1d7a0f05466db4af95b208209620 in term 0.
I20251023 07:58:04.187786 17445 catalog_manager.cc:5649] T 65cb88497ea44c4a9ee9cc67ede9d318 P 141636b82a7b4949931f25ce0a14addc reported cstate change: term changed from 0 to 1, leader changed from <none> to 141636b82a7b4949931f25ce0a14addc (127.16.126.3). New cstate: current_term: 1 leader_uuid: "141636b82a7b4949931f25ce0a14addc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } health_report { overall_health: HEALTHY } } }
I20251023 07:58:04.189249 17587 leader_election.cc:304] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P a35e1d7a0f05466db4af95b208209620 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 141636b82a7b4949931f25ce0a14addc, a35e1d7a0f05466db4af95b208209620; no voters:
I20251023 07:58:04.190456 17743 raft_consensus.cc:2804] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P a35e1d7a0f05466db4af95b208209620 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:58:04.190936 17743 raft_consensus.cc:493] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P a35e1d7a0f05466db4af95b208209620 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:04.181990 17735 tablet_bootstrap.cc:492] T 51aacc3534884c92926b5d632a3e11f7 P 141636b82a7b4949931f25ce0a14addc: Bootstrap starting.
I20251023 07:58:04.191355 17743 raft_consensus.cc:3060] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P a35e1d7a0f05466db4af95b208209620 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:04.194903 17547 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cd34ebe0d6ff472cbfd9a71f16d4aee1" candidate_uuid: "a35e1d7a0f05466db4af95b208209620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2ded24d2e7648649ddbe521d1dbd135" is_pre_election: true
I20251023 07:58:04.195662 17547 raft_consensus.cc:2468] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P a2ded24d2e7648649ddbe521d1dbd135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a35e1d7a0f05466db4af95b208209620 in term 0.
I20251023 07:58:04.197878 17784 raft_consensus.cc:493] T f7dc54ff3f724e939f77ddaa796574c8 P a35e1d7a0f05466db4af95b208209620 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:04.200764 17784 raft_consensus.cc:515] T f7dc54ff3f724e939f77ddaa796574c8 P a35e1d7a0f05466db4af95b208209620 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } }
I20251023 07:58:04.201592 17736 tablet_bootstrap.cc:492] T 1ea153fe03884218bb2cf06c75d029c0 P a35e1d7a0f05466db4af95b208209620: No bootstrap required, opened a new log
I20251023 07:58:04.201527 17768 leader_election.cc:290] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P a35e1d7a0f05466db4af95b208209620 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2ded24d2e7648649ddbe521d1dbd135 (127.16.126.1:43887), 141636b82a7b4949931f25ce0a14addc (127.16.126.3:42717)
I20251023 07:58:04.202143 17736 ts_tablet_manager.cc:1403] T 1ea153fe03884218bb2cf06c75d029c0 P a35e1d7a0f05466db4af95b208209620: Time spent bootstrapping tablet: real 0.033s user 0.007s sys 0.018s
I20251023 07:58:04.203473 17784 leader_election.cc:290] T f7dc54ff3f724e939f77ddaa796574c8 P a35e1d7a0f05466db4af95b208209620 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 141636b82a7b4949931f25ce0a14addc (127.16.126.3:42717), a2ded24d2e7648649ddbe521d1dbd135 (127.16.126.1:43887)
I20251023 07:58:04.200330 17737 tablet_bootstrap.cc:492] T 0524c60cf5404f1e99bef45655e8bd77 P a2ded24d2e7648649ddbe521d1dbd135: No bootstrap required, opened a new log
I20251023 07:58:04.204142 17737 ts_tablet_manager.cc:1403] T 0524c60cf5404f1e99bef45655e8bd77 P a2ded24d2e7648649ddbe521d1dbd135: Time spent bootstrapping tablet: real 0.040s user 0.013s sys 0.004s
I20251023 07:58:04.204272 17696 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f7dc54ff3f724e939f77ddaa796574c8" candidate_uuid: "a35e1d7a0f05466db4af95b208209620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141636b82a7b4949931f25ce0a14addc" is_pre_election: true
I20251023 07:58:04.204897 17696 raft_consensus.cc:2468] T f7dc54ff3f724e939f77ddaa796574c8 P 141636b82a7b4949931f25ce0a14addc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a35e1d7a0f05466db4af95b208209620 in term 0.
I20251023 07:58:04.204752 17736 raft_consensus.cc:359] T 1ea153fe03884218bb2cf06c75d029c0 P a35e1d7a0f05466db4af95b208209620 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:04.205482 17736 raft_consensus.cc:385] T 1ea153fe03884218bb2cf06c75d029c0 P a35e1d7a0f05466db4af95b208209620 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:04.205754 17736 raft_consensus.cc:740] T 1ea153fe03884218bb2cf06c75d029c0 P a35e1d7a0f05466db4af95b208209620 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a35e1d7a0f05466db4af95b208209620, State: Initialized, Role: FOLLOWER
I20251023 07:58:04.206197 17587 leader_election.cc:304] T f7dc54ff3f724e939f77ddaa796574c8 P a35e1d7a0f05466db4af95b208209620 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 141636b82a7b4949931f25ce0a14addc, a35e1d7a0f05466db4af95b208209620; no voters:
I20251023 07:58:04.206328 17736 consensus_queue.cc:260] T 1ea153fe03884218bb2cf06c75d029c0 P a35e1d7a0f05466db4af95b208209620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:04.206815 17737 raft_consensus.cc:359] T 0524c60cf5404f1e99bef45655e8bd77 P a2ded24d2e7648649ddbe521d1dbd135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:04.207644 17737 raft_consensus.cc:385] T 0524c60cf5404f1e99bef45655e8bd77 P a2ded24d2e7648649ddbe521d1dbd135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:04.207952 17737 raft_consensus.cc:740] T 0524c60cf5404f1e99bef45655e8bd77 P a2ded24d2e7648649ddbe521d1dbd135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2ded24d2e7648649ddbe521d1dbd135, State: Initialized, Role: FOLLOWER
I20251023 07:58:04.207993 17547 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f7dc54ff3f724e939f77ddaa796574c8" candidate_uuid: "a35e1d7a0f05466db4af95b208209620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2ded24d2e7648649ddbe521d1dbd135" is_pre_election: true
I20251023 07:58:04.208513 17736 ts_tablet_manager.cc:1434] T 1ea153fe03884218bb2cf06c75d029c0 P a35e1d7a0f05466db4af95b208209620: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20251023 07:58:04.208698 17547 raft_consensus.cc:2468] T f7dc54ff3f724e939f77ddaa796574c8 P a2ded24d2e7648649ddbe521d1dbd135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a35e1d7a0f05466db4af95b208209620 in term 0.
I20251023 07:58:04.209381 17736 tablet_bootstrap.cc:492] T 1d80e56f890b4b3f99fdd1940f40e0a0 P a35e1d7a0f05466db4af95b208209620: Bootstrap starting.
I20251023 07:58:04.208877 17737 consensus_queue.cc:260] T 0524c60cf5404f1e99bef45655e8bd77 P a2ded24d2e7648649ddbe521d1dbd135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:04.199548 17735 tablet_bootstrap.cc:654] T 51aacc3534884c92926b5d632a3e11f7 P 141636b82a7b4949931f25ce0a14addc: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:04.211220 17737 ts_tablet_manager.cc:1434] T 0524c60cf5404f1e99bef45655e8bd77 P a2ded24d2e7648649ddbe521d1dbd135: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20251023 07:58:04.211875 17784 raft_consensus.cc:2804] T f7dc54ff3f724e939f77ddaa796574c8 P a35e1d7a0f05466db4af95b208209620 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:58:04.214154 17784 raft_consensus.cc:493] T f7dc54ff3f724e939f77ddaa796574c8 P a35e1d7a0f05466db4af95b208209620 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:04.214617 17784 raft_consensus.cc:3060] T f7dc54ff3f724e939f77ddaa796574c8 P a35e1d7a0f05466db4af95b208209620 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:04.205034 17743 raft_consensus.cc:515] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P a35e1d7a0f05466db4af95b208209620 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:04.212118 17737 tablet_bootstrap.cc:492] T 51aacc3534884c92926b5d632a3e11f7 P a2ded24d2e7648649ddbe521d1dbd135: Bootstrap starting.
I20251023 07:58:04.218406 17736 tablet_bootstrap.cc:654] T 1d80e56f890b4b3f99fdd1940f40e0a0 P a35e1d7a0f05466db4af95b208209620: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:04.221544 17743 leader_election.cc:290] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P a35e1d7a0f05466db4af95b208209620 [CANDIDATE]: Term 1 election: Requested vote from peers a2ded24d2e7648649ddbe521d1dbd135 (127.16.126.1:43887), 141636b82a7b4949931f25ce0a14addc (127.16.126.3:42717)
I20251023 07:58:04.223848 17742 raft_consensus.cc:493] T 1ea153fe03884218bb2cf06c75d029c0 P a2ded24d2e7648649ddbe521d1dbd135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:04.224136 17547 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cd34ebe0d6ff472cbfd9a71f16d4aee1" candidate_uuid: "a35e1d7a0f05466db4af95b208209620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2ded24d2e7648649ddbe521d1dbd135"
I20251023 07:58:04.224339 17742 raft_consensus.cc:515] T 1ea153fe03884218bb2cf06c75d029c0 P a2ded24d2e7648649ddbe521d1dbd135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:04.224965 17547 raft_consensus.cc:3060] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P a2ded24d2e7648649ddbe521d1dbd135 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:04.225690 17737 tablet_bootstrap.cc:654] T 51aacc3534884c92926b5d632a3e11f7 P a2ded24d2e7648649ddbe521d1dbd135: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:04.226408 17742 leader_election.cc:290] T 1ea153fe03884218bb2cf06c75d029c0 P a2ded24d2e7648649ddbe521d1dbd135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a35e1d7a0f05466db4af95b208209620 (127.16.126.2:43007), 141636b82a7b4949931f25ce0a14addc (127.16.126.3:42717)
I20251023 07:58:04.229959 17696 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1ea153fe03884218bb2cf06c75d029c0" candidate_uuid: "a2ded24d2e7648649ddbe521d1dbd135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141636b82a7b4949931f25ce0a14addc" is_pre_election: true
I20251023 07:58:04.230973 17696 raft_consensus.cc:2468] T 1ea153fe03884218bb2cf06c75d029c0 P 141636b82a7b4949931f25ce0a14addc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2ded24d2e7648649ddbe521d1dbd135 in term 0.
I20251023 07:58:04.232558 17512 leader_election.cc:304] T 1ea153fe03884218bb2cf06c75d029c0 P a2ded24d2e7648649ddbe521d1dbd135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 141636b82a7b4949931f25ce0a14addc, a2ded24d2e7648649ddbe521d1dbd135; no voters:
I20251023 07:58:04.233923 17742 raft_consensus.cc:2804] T 1ea153fe03884218bb2cf06c75d029c0 P a2ded24d2e7648649ddbe521d1dbd135 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:58:04.234402 17742 raft_consensus.cc:493] T 1ea153fe03884218bb2cf06c75d029c0 P a2ded24d2e7648649ddbe521d1dbd135 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:04.234845 17742 raft_consensus.cc:3060] T 1ea153fe03884218bb2cf06c75d029c0 P a2ded24d2e7648649ddbe521d1dbd135 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:04.237795 17784 raft_consensus.cc:515] T f7dc54ff3f724e939f77ddaa796574c8 P a35e1d7a0f05466db4af95b208209620 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } }
I20251023 07:58:04.239041 17736 tablet_bootstrap.cc:492] T 1d80e56f890b4b3f99fdd1940f40e0a0 P a35e1d7a0f05466db4af95b208209620: No bootstrap required, opened a new log
I20251023 07:58:04.242027 17736 ts_tablet_manager.cc:1403] T 1d80e56f890b4b3f99fdd1940f40e0a0 P a35e1d7a0f05466db4af95b208209620: Time spent bootstrapping tablet: real 0.033s user 0.011s sys 0.006s
I20251023 07:58:04.242501 17622 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1ea153fe03884218bb2cf06c75d029c0" candidate_uuid: "a2ded24d2e7648649ddbe521d1dbd135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a35e1d7a0f05466db4af95b208209620" is_pre_election: true
I20251023 07:58:04.243197 17622 raft_consensus.cc:2468] T 1ea153fe03884218bb2cf06c75d029c0 P a35e1d7a0f05466db4af95b208209620 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2ded24d2e7648649ddbe521d1dbd135 in term 0.
I20251023 07:58:04.244531 17736 raft_consensus.cc:359] T 1d80e56f890b4b3f99fdd1940f40e0a0 P a35e1d7a0f05466db4af95b208209620 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:04.245188 17736 raft_consensus.cc:385] T 1d80e56f890b4b3f99fdd1940f40e0a0 P a35e1d7a0f05466db4af95b208209620 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:04.245464 17736 raft_consensus.cc:740] T 1d80e56f890b4b3f99fdd1940f40e0a0 P a35e1d7a0f05466db4af95b208209620 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a35e1d7a0f05466db4af95b208209620, State: Initialized, Role: FOLLOWER
I20251023 07:58:04.246093 17736 consensus_queue.cc:260] T 1d80e56f890b4b3f99fdd1940f40e0a0 P a35e1d7a0f05466db4af95b208209620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:04.242440 17737 tablet_bootstrap.cc:492] T 51aacc3534884c92926b5d632a3e11f7 P a2ded24d2e7648649ddbe521d1dbd135: No bootstrap required, opened a new log
I20251023 07:58:04.247850 17737 ts_tablet_manager.cc:1403] T 51aacc3534884c92926b5d632a3e11f7 P a2ded24d2e7648649ddbe521d1dbd135: Time spent bootstrapping tablet: real 0.036s user 0.005s sys 0.007s
I20251023 07:58:04.248131 17736 ts_tablet_manager.cc:1434] T 1d80e56f890b4b3f99fdd1940f40e0a0 P a35e1d7a0f05466db4af95b208209620: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20251023 07:58:04.248849 17743 raft_consensus.cc:493] T 5a8aa3610eeb4df3b88aa6fcb808969f P a35e1d7a0f05466db4af95b208209620 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:04.249321 17743 raft_consensus.cc:515] T 5a8aa3610eeb4df3b88aa6fcb808969f P a35e1d7a0f05466db4af95b208209620 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:04.250442 17784 leader_election.cc:290] T f7dc54ff3f724e939f77ddaa796574c8 P a35e1d7a0f05466db4af95b208209620 [CANDIDATE]: Term 1 election: Requested vote from peers 141636b82a7b4949931f25ce0a14addc (127.16.126.3:42717), a2ded24d2e7648649ddbe521d1dbd135 (127.16.126.1:43887)
I20251023 07:58:04.251158 17743 leader_election.cc:290] T 5a8aa3610eeb4df3b88aa6fcb808969f P a35e1d7a0f05466db4af95b208209620 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2ded24d2e7648649ddbe521d1dbd135 (127.16.126.1:43887), 141636b82a7b4949931f25ce0a14addc (127.16.126.3:42717)
I20251023 07:58:04.251750 17546 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f7dc54ff3f724e939f77ddaa796574c8" candidate_uuid: "a35e1d7a0f05466db4af95b208209620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2ded24d2e7648649ddbe521d1dbd135"
I20251023 07:58:04.252506 17546 raft_consensus.cc:3060] T f7dc54ff3f724e939f77ddaa796574c8 P a2ded24d2e7648649ddbe521d1dbd135 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:04.248978 17736 tablet_bootstrap.cc:492] T 0524c60cf5404f1e99bef45655e8bd77 P a35e1d7a0f05466db4af95b208209620: Bootstrap starting.
I20251023 07:58:04.260892 17774 raft_consensus.cc:493] T 5a8aa3610eeb4df3b88aa6fcb808969f P a2ded24d2e7648649ddbe521d1dbd135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:04.261574 17774 raft_consensus.cc:515] T 5a8aa3610eeb4df3b88aa6fcb808969f P a2ded24d2e7648649ddbe521d1dbd135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:04.268863 17696 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a8aa3610eeb4df3b88aa6fcb808969f" candidate_uuid: "a2ded24d2e7648649ddbe521d1dbd135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141636b82a7b4949931f25ce0a14addc" is_pre_election: true
I20251023 07:58:04.270054 17774 leader_election.cc:290] T 5a8aa3610eeb4df3b88aa6fcb808969f P a2ded24d2e7648649ddbe521d1dbd135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a35e1d7a0f05466db4af95b208209620 (127.16.126.2:43007), 141636b82a7b4949931f25ce0a14addc (127.16.126.3:42717)
W20251023 07:58:04.271353 17512 leader_election.cc:343] T 5a8aa3610eeb4df3b88aa6fcb808969f P a2ded24d2e7648649ddbe521d1dbd135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 141636b82a7b4949931f25ce0a14addc (127.16.126.3:42717): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:04.272254 17742 raft_consensus.cc:515] T 1ea153fe03884218bb2cf06c75d029c0 P a2ded24d2e7648649ddbe521d1dbd135 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:04.276261 17696 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1ea153fe03884218bb2cf06c75d029c0" candidate_uuid: "a2ded24d2e7648649ddbe521d1dbd135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141636b82a7b4949931f25ce0a14addc"
I20251023 07:58:04.276990 17696 raft_consensus.cc:3060] T 1ea153fe03884218bb2cf06c75d029c0 P 141636b82a7b4949931f25ce0a14addc [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:04.282258 17546 raft_consensus.cc:2468] T f7dc54ff3f724e939f77ddaa796574c8 P a2ded24d2e7648649ddbe521d1dbd135 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a35e1d7a0f05466db4af95b208209620 in term 1.
I20251023 07:58:04.284072 17545 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a8aa3610eeb4df3b88aa6fcb808969f" candidate_uuid: "a35e1d7a0f05466db4af95b208209620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2ded24d2e7648649ddbe521d1dbd135" is_pre_election: true
I20251023 07:58:04.284466 17585 leader_election.cc:304] T f7dc54ff3f724e939f77ddaa796574c8 P a35e1d7a0f05466db4af95b208209620 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2ded24d2e7648649ddbe521d1dbd135, a35e1d7a0f05466db4af95b208209620; no voters:
I20251023 07:58:04.284763 17545 raft_consensus.cc:2468] T 5a8aa3610eeb4df3b88aa6fcb808969f P a2ded24d2e7648649ddbe521d1dbd135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a35e1d7a0f05466db4af95b208209620 in term 0.
W20251023 07:58:04.285445 17587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.126.3:42717, user_credentials={real_user=slave}} blocked reactor thread for 79319.9us
I20251023 07:58:04.285504 17737 raft_consensus.cc:359] T 51aacc3534884c92926b5d632a3e11f7 P a2ded24d2e7648649ddbe521d1dbd135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:04.286710 17737 raft_consensus.cc:385] T 51aacc3534884c92926b5d632a3e11f7 P a2ded24d2e7648649ddbe521d1dbd135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:04.287134 17737 raft_consensus.cc:740] T 51aacc3534884c92926b5d632a3e11f7 P a2ded24d2e7648649ddbe521d1dbd135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2ded24d2e7648649ddbe521d1dbd135, State: Initialized, Role: FOLLOWER
I20251023 07:58:04.287159 17695 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cd34ebe0d6ff472cbfd9a71f16d4aee1" candidate_uuid: "a35e1d7a0f05466db4af95b208209620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141636b82a7b4949931f25ce0a14addc"
I20251023 07:58:04.288239 17695 raft_consensus.cc:3060] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P 141636b82a7b4949931f25ce0a14addc [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:04.288265 17737 consensus_queue.cc:260] T 51aacc3534884c92926b5d632a3e11f7 P a2ded24d2e7648649ddbe521d1dbd135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:04.288247 17743 raft_consensus.cc:2804] T f7dc54ff3f724e939f77ddaa796574c8 P a35e1d7a0f05466db4af95b208209620 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:58:04.290999 17743 raft_consensus.cc:697] T f7dc54ff3f724e939f77ddaa796574c8 P a35e1d7a0f05466db4af95b208209620 [term 1 LEADER]: Becoming Leader. State: Replica: a35e1d7a0f05466db4af95b208209620, State: Running, Role: LEADER
I20251023 07:58:04.291841 17743 consensus_queue.cc:237] T f7dc54ff3f724e939f77ddaa796574c8 P a35e1d7a0f05466db4af95b208209620 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } }
I20251023 07:58:04.293109 17696 raft_consensus.cc:2468] T 1ea153fe03884218bb2cf06c75d029c0 P 141636b82a7b4949931f25ce0a14addc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2ded24d2e7648649ddbe521d1dbd135 in term 1.
I20251023 07:58:04.294229 17512 leader_election.cc:304] T 1ea153fe03884218bb2cf06c75d029c0 P a2ded24d2e7648649ddbe521d1dbd135 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 141636b82a7b4949931f25ce0a14addc, a2ded24d2e7648649ddbe521d1dbd135; no voters:
I20251023 07:58:04.282171 17742 leader_election.cc:290] T 1ea153fe03884218bb2cf06c75d029c0 P a2ded24d2e7648649ddbe521d1dbd135 [CANDIDATE]: Term 1 election: Requested vote from peers a35e1d7a0f05466db4af95b208209620 (127.16.126.2:43007), 141636b82a7b4949931f25ce0a14addc (127.16.126.3:42717)
I20251023 07:58:04.296350 17547 raft_consensus.cc:2468] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P a2ded24d2e7648649ddbe521d1dbd135 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a35e1d7a0f05466db4af95b208209620 in term 1.
I20251023 07:58:04.297641 17696 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f7dc54ff3f724e939f77ddaa796574c8" candidate_uuid: "a35e1d7a0f05466db4af95b208209620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141636b82a7b4949931f25ce0a14addc"
I20251023 07:58:04.298341 17696 raft_consensus.cc:3060] T f7dc54ff3f724e939f77ddaa796574c8 P 141636b82a7b4949931f25ce0a14addc [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:04.299649 17695 raft_consensus.cc:2468] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P 141636b82a7b4949931f25ce0a14addc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a35e1d7a0f05466db4af95b208209620 in term 1.
I20251023 07:58:04.301190 17622 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a8aa3610eeb4df3b88aa6fcb808969f" candidate_uuid: "a2ded24d2e7648649ddbe521d1dbd135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a35e1d7a0f05466db4af95b208209620" is_pre_election: true
I20251023 07:58:04.302034 17622 raft_consensus.cc:2468] T 5a8aa3610eeb4df3b88aa6fcb808969f P a35e1d7a0f05466db4af95b208209620 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2ded24d2e7648649ddbe521d1dbd135 in term 0.
I20251023 07:58:04.302117 17585 leader_election.cc:304] T 5a8aa3610eeb4df3b88aa6fcb808969f P a35e1d7a0f05466db4af95b208209620 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2ded24d2e7648649ddbe521d1dbd135, a35e1d7a0f05466db4af95b208209620; no voters:
I20251023 07:58:04.302999 17784 raft_consensus.cc:2804] T 5a8aa3610eeb4df3b88aa6fcb808969f P a35e1d7a0f05466db4af95b208209620 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:58:04.303395 17784 raft_consensus.cc:493] T 5a8aa3610eeb4df3b88aa6fcb808969f P a35e1d7a0f05466db4af95b208209620 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:04.303828 17784 raft_consensus.cc:3060] T 5a8aa3610eeb4df3b88aa6fcb808969f P a35e1d7a0f05466db4af95b208209620 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:04.303207 17621 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1ea153fe03884218bb2cf06c75d029c0" candidate_uuid: "a2ded24d2e7648649ddbe521d1dbd135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a35e1d7a0f05466db4af95b208209620"
I20251023 07:58:04.311745 17735 tablet_bootstrap.cc:492] T 51aacc3534884c92926b5d632a3e11f7 P 141636b82a7b4949931f25ce0a14addc: No bootstrap required, opened a new log
I20251023 07:58:04.312188 17735 ts_tablet_manager.cc:1403] T 51aacc3534884c92926b5d632a3e11f7 P 141636b82a7b4949931f25ce0a14addc: Time spent bootstrapping tablet: real 0.130s user 0.045s sys 0.023s
I20251023 07:58:04.314790 17735 raft_consensus.cc:359] T 51aacc3534884c92926b5d632a3e11f7 P 141636b82a7b4949931f25ce0a14addc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:04.315440 17735 raft_consensus.cc:385] T 51aacc3534884c92926b5d632a3e11f7 P 141636b82a7b4949931f25ce0a14addc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:04.315698 17735 raft_consensus.cc:740] T 51aacc3534884c92926b5d632a3e11f7 P 141636b82a7b4949931f25ce0a14addc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 141636b82a7b4949931f25ce0a14addc, State: Initialized, Role: FOLLOWER
I20251023 07:58:04.316279 17735 consensus_queue.cc:260] T 51aacc3534884c92926b5d632a3e11f7 P 141636b82a7b4949931f25ce0a14addc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:04.309123 17621 raft_consensus.cc:3060] T 1ea153fe03884218bb2cf06c75d029c0 P a35e1d7a0f05466db4af95b208209620 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:04.318426 17737 ts_tablet_manager.cc:1434] T 51aacc3534884c92926b5d632a3e11f7 P a2ded24d2e7648649ddbe521d1dbd135: Time spent starting tablet: real 0.070s user 0.008s sys 0.001s
I20251023 07:58:04.303138 17585 leader_election.cc:304] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P a35e1d7a0f05466db4af95b208209620 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2ded24d2e7648649ddbe521d1dbd135, a35e1d7a0f05466db4af95b208209620; no voters:
I20251023 07:58:04.317508 17695 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a8aa3610eeb4df3b88aa6fcb808969f" candidate_uuid: "a35e1d7a0f05466db4af95b208209620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141636b82a7b4949931f25ce0a14addc" is_pre_election: true
I20251023 07:58:04.320255 17735 ts_tablet_manager.cc:1434] T 51aacc3534884c92926b5d632a3e11f7 P 141636b82a7b4949931f25ce0a14addc: Time spent starting tablet: real 0.008s user 0.006s sys 0.001s
I20251023 07:58:04.306386 17774 raft_consensus.cc:2804] T 1ea153fe03884218bb2cf06c75d029c0 P a2ded24d2e7648649ddbe521d1dbd135 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:58:04.323017 17735 tablet_bootstrap.cc:492] T 5a8aa3610eeb4df3b88aa6fcb808969f P 141636b82a7b4949931f25ce0a14addc: Bootstrap starting.
I20251023 07:58:04.325450 17785 raft_consensus.cc:2804] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P a35e1d7a0f05466db4af95b208209620 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:58:04.326160 17785 raft_consensus.cc:697] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P a35e1d7a0f05466db4af95b208209620 [term 1 LEADER]: Becoming Leader. State: Replica: a35e1d7a0f05466db4af95b208209620, State: Running, Role: LEADER
I20251023 07:58:04.326409 17696 raft_consensus.cc:2468] T f7dc54ff3f724e939f77ddaa796574c8 P 141636b82a7b4949931f25ce0a14addc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a35e1d7a0f05466db4af95b208209620 in term 1.
I20251023 07:58:04.328401 17510 leader_election.cc:304] T 5a8aa3610eeb4df3b88aa6fcb808969f P a2ded24d2e7648649ddbe521d1dbd135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2ded24d2e7648649ddbe521d1dbd135, a35e1d7a0f05466db4af95b208209620; no voters: 141636b82a7b4949931f25ce0a14addc
I20251023 07:58:04.333015 17742 raft_consensus.cc:2804] T 5a8aa3610eeb4df3b88aa6fcb808969f P a2ded24d2e7648649ddbe521d1dbd135 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:58:04.333573 17742 raft_consensus.cc:493] T 5a8aa3610eeb4df3b88aa6fcb808969f P a2ded24d2e7648649ddbe521d1dbd135 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:04.334004 17742 raft_consensus.cc:3060] T 5a8aa3610eeb4df3b88aa6fcb808969f P a2ded24d2e7648649ddbe521d1dbd135 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:04.335534 17784 raft_consensus.cc:515] T 5a8aa3610eeb4df3b88aa6fcb808969f P a35e1d7a0f05466db4af95b208209620 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:04.338789 17547 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a8aa3610eeb4df3b88aa6fcb808969f" candidate_uuid: "a35e1d7a0f05466db4af95b208209620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2ded24d2e7648649ddbe521d1dbd135"
I20251023 07:58:04.344532 17784 leader_election.cc:290] T 5a8aa3610eeb4df3b88aa6fcb808969f P a35e1d7a0f05466db4af95b208209620 [CANDIDATE]: Term 1 election: Requested vote from peers a2ded24d2e7648649ddbe521d1dbd135 (127.16.126.1:43887), 141636b82a7b4949931f25ce0a14addc (127.16.126.3:42717)
I20251023 07:58:04.327590 17774 raft_consensus.cc:697] T 1ea153fe03884218bb2cf06c75d029c0 P a2ded24d2e7648649ddbe521d1dbd135 [term 1 LEADER]: Becoming Leader. State: Replica: a2ded24d2e7648649ddbe521d1dbd135, State: Running, Role: LEADER
I20251023 07:58:04.346901 17774 consensus_queue.cc:237] T 1ea153fe03884218bb2cf06c75d029c0 P a2ded24d2e7648649ddbe521d1dbd135 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
W20251023 07:58:04.347514 17587 leader_election.cc:343] T 5a8aa3610eeb4df3b88aa6fcb808969f P a35e1d7a0f05466db4af95b208209620 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 141636b82a7b4949931f25ce0a14addc (127.16.126.3:42717): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:04.339843 17785 consensus_queue.cc:237] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P a35e1d7a0f05466db4af95b208209620 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:04.350276 17696 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a8aa3610eeb4df3b88aa6fcb808969f" candidate_uuid: "a35e1d7a0f05466db4af95b208209620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141636b82a7b4949931f25ce0a14addc"
W20251023 07:58:04.351434 17587 leader_election.cc:343] T 5a8aa3610eeb4df3b88aa6fcb808969f P a35e1d7a0f05466db4af95b208209620 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 141636b82a7b4949931f25ce0a14addc (127.16.126.3:42717): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:04.352123 17742 raft_consensus.cc:515] T 5a8aa3610eeb4df3b88aa6fcb808969f P a2ded24d2e7648649ddbe521d1dbd135 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:04.353590 17754 raft_consensus.cc:493] T 0524c60cf5404f1e99bef45655e8bd77 P 141636b82a7b4949931f25ce0a14addc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:04.354858 17754 raft_consensus.cc:515] T 0524c60cf5404f1e99bef45655e8bd77 P 141636b82a7b4949931f25ce0a14addc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:04.355861 17547 raft_consensus.cc:2393] T 5a8aa3610eeb4df3b88aa6fcb808969f P a2ded24d2e7648649ddbe521d1dbd135 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a35e1d7a0f05466db4af95b208209620 in current term 1: Already voted for candidate a2ded24d2e7648649ddbe521d1dbd135 in this term.
I20251023 07:58:04.357705 17754 leader_election.cc:290] T 0524c60cf5404f1e99bef45655e8bd77 P 141636b82a7b4949931f25ce0a14addc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2ded24d2e7648649ddbe521d1dbd135 (127.16.126.1:43887), a35e1d7a0f05466db4af95b208209620 (127.16.126.2:43007)
I20251023 07:58:04.359529 17696 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a8aa3610eeb4df3b88aa6fcb808969f" candidate_uuid: "a2ded24d2e7648649ddbe521d1dbd135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141636b82a7b4949931f25ce0a14addc"
I20251023 07:58:04.359529 17545 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0524c60cf5404f1e99bef45655e8bd77" candidate_uuid: "141636b82a7b4949931f25ce0a14addc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2ded24d2e7648649ddbe521d1dbd135" is_pre_election: true
I20251023 07:58:04.360204 17622 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0524c60cf5404f1e99bef45655e8bd77" candidate_uuid: "141636b82a7b4949931f25ce0a14addc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a35e1d7a0f05466db4af95b208209620" is_pre_election: true
W20251023 07:58:04.360630 17512 leader_election.cc:343] T 5a8aa3610eeb4df3b88aa6fcb808969f P a2ded24d2e7648649ddbe521d1dbd135 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 141636b82a7b4949931f25ce0a14addc (127.16.126.3:42717): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:04.361019 17545 raft_consensus.cc:2468] T 0524c60cf5404f1e99bef45655e8bd77 P a2ded24d2e7648649ddbe521d1dbd135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 141636b82a7b4949931f25ce0a14addc in term 0.
I20251023 07:58:04.361460 17742 leader_election.cc:290] T 5a8aa3610eeb4df3b88aa6fcb808969f P a2ded24d2e7648649ddbe521d1dbd135 [CANDIDATE]: Term 1 election: Requested vote from peers a35e1d7a0f05466db4af95b208209620 (127.16.126.2:43007), 141636b82a7b4949931f25ce0a14addc (127.16.126.3:42717)
I20251023 07:58:04.352852 17621 raft_consensus.cc:2468] T 1ea153fe03884218bb2cf06c75d029c0 P a35e1d7a0f05466db4af95b208209620 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2ded24d2e7648649ddbe521d1dbd135 in term 1.
I20251023 07:58:04.364226 17659 leader_election.cc:304] T 0524c60cf5404f1e99bef45655e8bd77 P 141636b82a7b4949931f25ce0a14addc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 141636b82a7b4949931f25ce0a14addc, a2ded24d2e7648649ddbe521d1dbd135; no voters:
I20251023 07:58:04.365641 17754 raft_consensus.cc:2804] T 0524c60cf5404f1e99bef45655e8bd77 P 141636b82a7b4949931f25ce0a14addc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:58:04.366117 17754 raft_consensus.cc:493] T 0524c60cf5404f1e99bef45655e8bd77 P 141636b82a7b4949931f25ce0a14addc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20251023 07:58:04.367579 17659 leader_election.cc:343] T 0524c60cf5404f1e99bef45655e8bd77 P 141636b82a7b4949931f25ce0a14addc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a35e1d7a0f05466db4af95b208209620 (127.16.126.2:43007): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:04.367632 17622 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a8aa3610eeb4df3b88aa6fcb808969f" candidate_uuid: "a2ded24d2e7648649ddbe521d1dbd135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a35e1d7a0f05466db4af95b208209620"
I20251023 07:58:04.367254 17735 tablet_bootstrap.cc:654] T 5a8aa3610eeb4df3b88aa6fcb808969f P 141636b82a7b4949931f25ce0a14addc: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:04.366523 17754 raft_consensus.cc:3060] T 0524c60cf5404f1e99bef45655e8bd77 P 141636b82a7b4949931f25ce0a14addc [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:04.371415 17622 raft_consensus.cc:2393] T 5a8aa3610eeb4df3b88aa6fcb808969f P a35e1d7a0f05466db4af95b208209620 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a2ded24d2e7648649ddbe521d1dbd135 in current term 1: Already voted for candidate a35e1d7a0f05466db4af95b208209620 in this term.
I20251023 07:58:04.367815 17585 leader_election.cc:304] T 5a8aa3610eeb4df3b88aa6fcb808969f P a35e1d7a0f05466db4af95b208209620 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a35e1d7a0f05466db4af95b208209620; no voters: 141636b82a7b4949931f25ce0a14addc, a2ded24d2e7648649ddbe521d1dbd135
I20251023 07:58:04.372841 17743 raft_consensus.cc:2749] T 5a8aa3610eeb4df3b88aa6fcb808969f P a35e1d7a0f05466db4af95b208209620 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20251023 07:58:04.374109 17736 tablet_bootstrap.cc:654] T 0524c60cf5404f1e99bef45655e8bd77 P a35e1d7a0f05466db4af95b208209620: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:04.375902 17510 leader_election.cc:304] T 5a8aa3610eeb4df3b88aa6fcb808969f P a2ded24d2e7648649ddbe521d1dbd135 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2ded24d2e7648649ddbe521d1dbd135; no voters: 141636b82a7b4949931f25ce0a14addc, a35e1d7a0f05466db4af95b208209620
I20251023 07:58:04.377494 17742 raft_consensus.cc:2749] T 5a8aa3610eeb4df3b88aa6fcb808969f P a2ded24d2e7648649ddbe521d1dbd135 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20251023 07:58:04.386905 17736 tablet_bootstrap.cc:492] T 0524c60cf5404f1e99bef45655e8bd77 P a35e1d7a0f05466db4af95b208209620: No bootstrap required, opened a new log
I20251023 07:58:04.387521 17736 ts_tablet_manager.cc:1403] T 0524c60cf5404f1e99bef45655e8bd77 P a35e1d7a0f05466db4af95b208209620: Time spent bootstrapping tablet: real 0.139s user 0.014s sys 0.005s
I20251023 07:58:04.384721 17754 raft_consensus.cc:515] T 0524c60cf5404f1e99bef45655e8bd77 P 141636b82a7b4949931f25ce0a14addc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:04.390974 17736 raft_consensus.cc:359] T 0524c60cf5404f1e99bef45655e8bd77 P a35e1d7a0f05466db4af95b208209620 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:04.391851 17736 raft_consensus.cc:385] T 0524c60cf5404f1e99bef45655e8bd77 P a35e1d7a0f05466db4af95b208209620 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:04.392196 17736 raft_consensus.cc:740] T 0524c60cf5404f1e99bef45655e8bd77 P a35e1d7a0f05466db4af95b208209620 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a35e1d7a0f05466db4af95b208209620, State: Initialized, Role: FOLLOWER
I20251023 07:58:04.393185 17736 consensus_queue.cc:260] T 0524c60cf5404f1e99bef45655e8bd77 P a35e1d7a0f05466db4af95b208209620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:04.396284 17736 ts_tablet_manager.cc:1434] T 0524c60cf5404f1e99bef45655e8bd77 P a35e1d7a0f05466db4af95b208209620: Time spent starting tablet: real 0.008s user 0.009s sys 0.000s
I20251023 07:58:04.399622 17441 catalog_manager.cc:5649] T f7dc54ff3f724e939f77ddaa796574c8 P a35e1d7a0f05466db4af95b208209620 reported cstate change: term changed from 0 to 1, leader changed from <none> to a35e1d7a0f05466db4af95b208209620 (127.16.126.2). New cstate: current_term: 1 leader_uuid: "a35e1d7a0f05466db4af95b208209620" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } health_report { overall_health: UNKNOWN } } }
I20251023 07:58:04.401551 17547 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0524c60cf5404f1e99bef45655e8bd77" candidate_uuid: "141636b82a7b4949931f25ce0a14addc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2ded24d2e7648649ddbe521d1dbd135"
I20251023 07:58:04.401981 17622 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0524c60cf5404f1e99bef45655e8bd77" candidate_uuid: "141636b82a7b4949931f25ce0a14addc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a35e1d7a0f05466db4af95b208209620"
I20251023 07:58:04.402256 17547 raft_consensus.cc:3060] T 0524c60cf5404f1e99bef45655e8bd77 P a2ded24d2e7648649ddbe521d1dbd135 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:04.403034 17756 raft_consensus.cc:493] T 1d80e56f890b4b3f99fdd1940f40e0a0 P 141636b82a7b4949931f25ce0a14addc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:04.403470 17756 raft_consensus.cc:515] T 1d80e56f890b4b3f99fdd1940f40e0a0 P 141636b82a7b4949931f25ce0a14addc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:04.404753 17735 tablet_bootstrap.cc:492] T 5a8aa3610eeb4df3b88aa6fcb808969f P 141636b82a7b4949931f25ce0a14addc: No bootstrap required, opened a new log
I20251023 07:58:04.400892 17754 leader_election.cc:290] T 0524c60cf5404f1e99bef45655e8bd77 P 141636b82a7b4949931f25ce0a14addc [CANDIDATE]: Term 1 election: Requested vote from peers a2ded24d2e7648649ddbe521d1dbd135 (127.16.126.1:43887), a35e1d7a0f05466db4af95b208209620 (127.16.126.2:43007)
I20251023 07:58:04.402673 17441 catalog_manager.cc:5649] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P a35e1d7a0f05466db4af95b208209620 reported cstate change: term changed from 0 to 1, leader changed from <none> to a35e1d7a0f05466db4af95b208209620 (127.16.126.2). New cstate: current_term: 1 leader_uuid: "a35e1d7a0f05466db4af95b208209620" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } health_report { overall_health: UNKNOWN } } }
I20251023 07:58:04.405931 17735 ts_tablet_manager.cc:1403] T 5a8aa3610eeb4df3b88aa6fcb808969f P 141636b82a7b4949931f25ce0a14addc: Time spent bootstrapping tablet: real 0.083s user 0.021s sys 0.017s
I20251023 07:58:04.402647 17622 raft_consensus.cc:3060] T 0524c60cf5404f1e99bef45655e8bd77 P a35e1d7a0f05466db4af95b208209620 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:04.406122 17756 leader_election.cc:290] T 1d80e56f890b4b3f99fdd1940f40e0a0 P 141636b82a7b4949931f25ce0a14addc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2ded24d2e7648649ddbe521d1dbd135 (127.16.126.1:43887), a35e1d7a0f05466db4af95b208209620 (127.16.126.2:43007)
I20251023 07:58:04.410341 17621 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1d80e56f890b4b3f99fdd1940f40e0a0" candidate_uuid: "141636b82a7b4949931f25ce0a14addc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a35e1d7a0f05466db4af95b208209620" is_pre_election: true
I20251023 07:58:04.438133 17621 raft_consensus.cc:2468] T 1d80e56f890b4b3f99fdd1940f40e0a0 P a35e1d7a0f05466db4af95b208209620 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 141636b82a7b4949931f25ce0a14addc in term 0.
I20251023 07:58:04.416800 17547 raft_consensus.cc:2468] T 0524c60cf5404f1e99bef45655e8bd77 P a2ded24d2e7648649ddbe521d1dbd135 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 141636b82a7b4949931f25ce0a14addc in term 1.
I20251023 07:58:04.438966 17735 raft_consensus.cc:359] T 5a8aa3610eeb4df3b88aa6fcb808969f P 141636b82a7b4949931f25ce0a14addc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:04.439663 17735 raft_consensus.cc:385] T 5a8aa3610eeb4df3b88aa6fcb808969f P 141636b82a7b4949931f25ce0a14addc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:04.439924 17735 raft_consensus.cc:740] T 5a8aa3610eeb4df3b88aa6fcb808969f P 141636b82a7b4949931f25ce0a14addc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 141636b82a7b4949931f25ce0a14addc, State: Initialized, Role: FOLLOWER
I20251023 07:58:04.439875 17659 leader_election.cc:304] T 0524c60cf5404f1e99bef45655e8bd77 P 141636b82a7b4949931f25ce0a14addc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 141636b82a7b4949931f25ce0a14addc, a2ded24d2e7648649ddbe521d1dbd135; no voters:
I20251023 07:58:04.409883 17545 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1d80e56f890b4b3f99fdd1940f40e0a0" candidate_uuid: "141636b82a7b4949931f25ce0a14addc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2ded24d2e7648649ddbe521d1dbd135" is_pre_election: true
I20251023 07:58:04.440728 17735 consensus_queue.cc:260] T 5a8aa3610eeb4df3b88aa6fcb808969f P 141636b82a7b4949931f25ce0a14addc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:04.409396 17444 catalog_manager.cc:5649] T 1ea153fe03884218bb2cf06c75d029c0 P a2ded24d2e7648649ddbe521d1dbd135 reported cstate change: term changed from 0 to 1, leader changed from <none> to a2ded24d2e7648649ddbe521d1dbd135 (127.16.126.1). New cstate: current_term: 1 leader_uuid: "a2ded24d2e7648649ddbe521d1dbd135" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } health_report { overall_health: UNKNOWN } } }
I20251023 07:58:04.441761 17754 raft_consensus.cc:2804] T 0524c60cf5404f1e99bef45655e8bd77 P 141636b82a7b4949931f25ce0a14addc [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:58:04.442607 17754 raft_consensus.cc:697] T 0524c60cf5404f1e99bef45655e8bd77 P 141636b82a7b4949931f25ce0a14addc [term 1 LEADER]: Becoming Leader. State: Replica: 141636b82a7b4949931f25ce0a14addc, State: Running, Role: LEADER
I20251023 07:58:04.443336 17735 ts_tablet_manager.cc:1434] T 5a8aa3610eeb4df3b88aa6fcb808969f P 141636b82a7b4949931f25ce0a14addc: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20251023 07:58:04.441248 17545 raft_consensus.cc:2468] T 1d80e56f890b4b3f99fdd1940f40e0a0 P a2ded24d2e7648649ddbe521d1dbd135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 141636b82a7b4949931f25ce0a14addc in term 0.
I20251023 07:58:04.443452 17754 consensus_queue.cc:237] T 0524c60cf5404f1e99bef45655e8bd77 P 141636b82a7b4949931f25ce0a14addc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:04.445761 17659 leader_election.cc:304] T 1d80e56f890b4b3f99fdd1940f40e0a0 P 141636b82a7b4949931f25ce0a14addc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 141636b82a7b4949931f25ce0a14addc, a2ded24d2e7648649ddbe521d1dbd135; no voters:
I20251023 07:58:04.446542 17741 raft_consensus.cc:2804] T 1d80e56f890b4b3f99fdd1940f40e0a0 P 141636b82a7b4949931f25ce0a14addc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:58:04.446928 17741 raft_consensus.cc:493] T 1d80e56f890b4b3f99fdd1940f40e0a0 P 141636b82a7b4949931f25ce0a14addc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:04.447268 17741 raft_consensus.cc:3060] T 1d80e56f890b4b3f99fdd1940f40e0a0 P 141636b82a7b4949931f25ce0a14addc [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:04.453576 17741 raft_consensus.cc:515] T 1d80e56f890b4b3f99fdd1940f40e0a0 P 141636b82a7b4949931f25ce0a14addc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:04.455263 17741 leader_election.cc:290] T 1d80e56f890b4b3f99fdd1940f40e0a0 P 141636b82a7b4949931f25ce0a14addc [CANDIDATE]: Term 1 election: Requested vote from peers a2ded24d2e7648649ddbe521d1dbd135 (127.16.126.1:43887), a35e1d7a0f05466db4af95b208209620 (127.16.126.2:43007)
I20251023 07:58:04.456322 17547 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1d80e56f890b4b3f99fdd1940f40e0a0" candidate_uuid: "141636b82a7b4949931f25ce0a14addc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2ded24d2e7648649ddbe521d1dbd135"
I20251023 07:58:04.456790 17622 raft_consensus.cc:2468] T 0524c60cf5404f1e99bef45655e8bd77 P a35e1d7a0f05466db4af95b208209620 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 141636b82a7b4949931f25ce0a14addc in term 1.
I20251023 07:58:04.456840 17621 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1d80e56f890b4b3f99fdd1940f40e0a0" candidate_uuid: "141636b82a7b4949931f25ce0a14addc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a35e1d7a0f05466db4af95b208209620"
I20251023 07:58:04.457420 17547 raft_consensus.cc:3060] T 1d80e56f890b4b3f99fdd1940f40e0a0 P a2ded24d2e7648649ddbe521d1dbd135 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:04.457852 17621 raft_consensus.cc:3060] T 1d80e56f890b4b3f99fdd1940f40e0a0 P a35e1d7a0f05466db4af95b208209620 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:04.462400 17441 catalog_manager.cc:5649] T 0524c60cf5404f1e99bef45655e8bd77 P 141636b82a7b4949931f25ce0a14addc reported cstate change: term changed from 0 to 1, leader changed from <none> to 141636b82a7b4949931f25ce0a14addc (127.16.126.3). New cstate: current_term: 1 leader_uuid: "141636b82a7b4949931f25ce0a14addc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } health_report { overall_health: HEALTHY } } }
I20251023 07:58:04.463934 17547 raft_consensus.cc:2468] T 1d80e56f890b4b3f99fdd1940f40e0a0 P a2ded24d2e7648649ddbe521d1dbd135 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 141636b82a7b4949931f25ce0a14addc in term 1.
I20251023 07:58:04.464826 17659 leader_election.cc:304] T 1d80e56f890b4b3f99fdd1940f40e0a0 P 141636b82a7b4949931f25ce0a14addc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 141636b82a7b4949931f25ce0a14addc, a2ded24d2e7648649ddbe521d1dbd135; no voters:
I20251023 07:58:04.465500 17741 raft_consensus.cc:2804] T 1d80e56f890b4b3f99fdd1940f40e0a0 P 141636b82a7b4949931f25ce0a14addc [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:58:04.465898 17741 raft_consensus.cc:697] T 1d80e56f890b4b3f99fdd1940f40e0a0 P 141636b82a7b4949931f25ce0a14addc [term 1 LEADER]: Becoming Leader. State: Replica: 141636b82a7b4949931f25ce0a14addc, State: Running, Role: LEADER
I20251023 07:58:04.465175 17621 raft_consensus.cc:2468] T 1d80e56f890b4b3f99fdd1940f40e0a0 P a35e1d7a0f05466db4af95b208209620 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 141636b82a7b4949931f25ce0a14addc in term 1.
I20251023 07:58:04.466898 17741 consensus_queue.cc:237] T 1d80e56f890b4b3f99fdd1940f40e0a0 P 141636b82a7b4949931f25ce0a14addc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:04.477294 17443 catalog_manager.cc:5649] T 1d80e56f890b4b3f99fdd1940f40e0a0 P 141636b82a7b4949931f25ce0a14addc reported cstate change: term changed from 0 to 1, leader changed from <none> to 141636b82a7b4949931f25ce0a14addc (127.16.126.3). New cstate: current_term: 1 leader_uuid: "141636b82a7b4949931f25ce0a14addc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } health_report { overall_health: HEALTHY } } }
I20251023 07:58:04.504963 17774 consensus_queue.cc:1048] T b84678e61cb446c3b00429824b024d12 P a2ded24d2e7648649ddbe521d1dbd135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:04.515873 17774 consensus_queue.cc:1048] T b84678e61cb446c3b00429824b024d12 P a2ded24d2e7648649ddbe521d1dbd135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:04.521744 17754 consensus_queue.cc:1048] T fcb0398cbb794ef7856899e143856d9a P 141636b82a7b4949931f25ce0a14addc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:04.534502 17741 raft_consensus.cc:493] T 5a8aa3610eeb4df3b88aa6fcb808969f P 141636b82a7b4949931f25ce0a14addc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:04.535029 17741 raft_consensus.cc:515] T 5a8aa3610eeb4df3b88aa6fcb808969f P 141636b82a7b4949931f25ce0a14addc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:04.535187 17756 consensus_queue.cc:1048] T fcb0398cbb794ef7856899e143856d9a P 141636b82a7b4949931f25ce0a14addc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:04.536935 17741 leader_election.cc:290] T 5a8aa3610eeb4df3b88aa6fcb808969f P 141636b82a7b4949931f25ce0a14addc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2ded24d2e7648649ddbe521d1dbd135 (127.16.126.1:43887), a35e1d7a0f05466db4af95b208209620 (127.16.126.2:43007)
I20251023 07:58:04.539458 17621 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a8aa3610eeb4df3b88aa6fcb808969f" candidate_uuid: "141636b82a7b4949931f25ce0a14addc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a35e1d7a0f05466db4af95b208209620" is_pre_election: true
I20251023 07:58:04.539595 17547 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a8aa3610eeb4df3b88aa6fcb808969f" candidate_uuid: "141636b82a7b4949931f25ce0a14addc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2ded24d2e7648649ddbe521d1dbd135" is_pre_election: true
I20251023 07:58:04.540311 17621 raft_consensus.cc:2393] T 5a8aa3610eeb4df3b88aa6fcb808969f P a35e1d7a0f05466db4af95b208209620 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 141636b82a7b4949931f25ce0a14addc in current term 1: Already voted for candidate a35e1d7a0f05466db4af95b208209620 in this term.
I20251023 07:58:04.540438 17547 raft_consensus.cc:2393] T 5a8aa3610eeb4df3b88aa6fcb808969f P a2ded24d2e7648649ddbe521d1dbd135 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 141636b82a7b4949931f25ce0a14addc in current term 1: Already voted for candidate a2ded24d2e7648649ddbe521d1dbd135 in this term.
I20251023 07:58:04.543296 17659 leader_election.cc:304] T 5a8aa3610eeb4df3b88aa6fcb808969f P 141636b82a7b4949931f25ce0a14addc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 141636b82a7b4949931f25ce0a14addc; no voters: a2ded24d2e7648649ddbe521d1dbd135, a35e1d7a0f05466db4af95b208209620
I20251023 07:58:04.544464 17741 raft_consensus.cc:3060] T 5a8aa3610eeb4df3b88aa6fcb808969f P 141636b82a7b4949931f25ce0a14addc [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:04.550172 17741 raft_consensus.cc:2749] T 5a8aa3610eeb4df3b88aa6fcb808969f P 141636b82a7b4949931f25ce0a14addc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:58:04.583758 17741 consensus_queue.cc:1048] T 65cb88497ea44c4a9ee9cc67ede9d318 P 141636b82a7b4949931f25ce0a14addc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:04.593693 17741 consensus_queue.cc:1048] T 65cb88497ea44c4a9ee9cc67ede9d318 P 141636b82a7b4949931f25ce0a14addc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251023 07:58:04.615267 17648 tablet.cc:2378] T 0524c60cf5404f1e99bef45655e8bd77 P a35e1d7a0f05466db4af95b208209620: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251023 07:58:04.684854 17774 raft_consensus.cc:493] T 51aacc3534884c92926b5d632a3e11f7 P a2ded24d2e7648649ddbe521d1dbd135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:04.685504 17774 raft_consensus.cc:515] T 51aacc3534884c92926b5d632a3e11f7 P a2ded24d2e7648649ddbe521d1dbd135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:04.687608 17774 leader_election.cc:290] T 51aacc3534884c92926b5d632a3e11f7 P a2ded24d2e7648649ddbe521d1dbd135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a35e1d7a0f05466db4af95b208209620 (127.16.126.2:43007), 141636b82a7b4949931f25ce0a14addc (127.16.126.3:42717)
I20251023 07:58:04.688400 17621 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "51aacc3534884c92926b5d632a3e11f7" candidate_uuid: "a2ded24d2e7648649ddbe521d1dbd135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a35e1d7a0f05466db4af95b208209620" is_pre_election: true
I20251023 07:58:04.688585 17696 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "51aacc3534884c92926b5d632a3e11f7" candidate_uuid: "a2ded24d2e7648649ddbe521d1dbd135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141636b82a7b4949931f25ce0a14addc" is_pre_election: true
I20251023 07:58:04.688944 17621 raft_consensus.cc:2468] T 51aacc3534884c92926b5d632a3e11f7 P a35e1d7a0f05466db4af95b208209620 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2ded24d2e7648649ddbe521d1dbd135 in term 0.
I20251023 07:58:04.689122 17696 raft_consensus.cc:2468] T 51aacc3534884c92926b5d632a3e11f7 P 141636b82a7b4949931f25ce0a14addc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2ded24d2e7648649ddbe521d1dbd135 in term 0.
I20251023 07:58:04.689915 17510 leader_election.cc:304] T 51aacc3534884c92926b5d632a3e11f7 P a2ded24d2e7648649ddbe521d1dbd135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2ded24d2e7648649ddbe521d1dbd135, a35e1d7a0f05466db4af95b208209620; no voters:
I20251023 07:58:04.690595 17774 raft_consensus.cc:2804] T 51aacc3534884c92926b5d632a3e11f7 P a2ded24d2e7648649ddbe521d1dbd135 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:58:04.690884 17774 raft_consensus.cc:493] T 51aacc3534884c92926b5d632a3e11f7 P a2ded24d2e7648649ddbe521d1dbd135 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:04.691140 17774 raft_consensus.cc:3060] T 51aacc3534884c92926b5d632a3e11f7 P a2ded24d2e7648649ddbe521d1dbd135 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:04.695890 17774 raft_consensus.cc:515] T 51aacc3534884c92926b5d632a3e11f7 P a2ded24d2e7648649ddbe521d1dbd135 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:04.697511 17774 leader_election.cc:290] T 51aacc3534884c92926b5d632a3e11f7 P a2ded24d2e7648649ddbe521d1dbd135 [CANDIDATE]: Term 1 election: Requested vote from peers a35e1d7a0f05466db4af95b208209620 (127.16.126.2:43007), 141636b82a7b4949931f25ce0a14addc (127.16.126.3:42717)
I20251023 07:58:04.698423 17621 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "51aacc3534884c92926b5d632a3e11f7" candidate_uuid: "a2ded24d2e7648649ddbe521d1dbd135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a35e1d7a0f05466db4af95b208209620"
I20251023 07:58:04.698477 17696 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "51aacc3534884c92926b5d632a3e11f7" candidate_uuid: "a2ded24d2e7648649ddbe521d1dbd135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141636b82a7b4949931f25ce0a14addc"
I20251023 07:58:04.699123 17621 raft_consensus.cc:3060] T 51aacc3534884c92926b5d632a3e11f7 P a35e1d7a0f05466db4af95b208209620 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:04.699167 17696 raft_consensus.cc:3060] T 51aacc3534884c92926b5d632a3e11f7 P 141636b82a7b4949931f25ce0a14addc [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:04.706195 17696 raft_consensus.cc:2468] T 51aacc3534884c92926b5d632a3e11f7 P 141636b82a7b4949931f25ce0a14addc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2ded24d2e7648649ddbe521d1dbd135 in term 1.
I20251023 07:58:04.706195 17621 raft_consensus.cc:2468] T 51aacc3534884c92926b5d632a3e11f7 P a35e1d7a0f05466db4af95b208209620 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2ded24d2e7648649ddbe521d1dbd135 in term 1.
I20251023 07:58:04.707654 17512 leader_election.cc:304] T 51aacc3534884c92926b5d632a3e11f7 P a2ded24d2e7648649ddbe521d1dbd135 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 141636b82a7b4949931f25ce0a14addc, a2ded24d2e7648649ddbe521d1dbd135; no voters:
I20251023 07:58:04.708314 17774 raft_consensus.cc:2804] T 51aacc3534884c92926b5d632a3e11f7 P a2ded24d2e7648649ddbe521d1dbd135 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:58:04.708752 17774 raft_consensus.cc:697] T 51aacc3534884c92926b5d632a3e11f7 P a2ded24d2e7648649ddbe521d1dbd135 [term 1 LEADER]: Becoming Leader. State: Replica: a2ded24d2e7648649ddbe521d1dbd135, State: Running, Role: LEADER
I20251023 07:58:04.709460 17774 consensus_queue.cc:237] T 51aacc3534884c92926b5d632a3e11f7 P a2ded24d2e7648649ddbe521d1dbd135 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:04.716882 17441 catalog_manager.cc:5649] T 51aacc3534884c92926b5d632a3e11f7 P a2ded24d2e7648649ddbe521d1dbd135 reported cstate change: term changed from 0 to 1, leader changed from <none> to a2ded24d2e7648649ddbe521d1dbd135 (127.16.126.1). New cstate: current_term: 1 leader_uuid: "a2ded24d2e7648649ddbe521d1dbd135" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } health_report { overall_health: UNKNOWN } } }
I20251023 07:58:04.758626 17785 consensus_queue.cc:1048] T f7dc54ff3f724e939f77ddaa796574c8 P a35e1d7a0f05466db4af95b208209620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:04.769691 17785 consensus_queue.cc:1048] T f7dc54ff3f724e939f77ddaa796574c8 P a35e1d7a0f05466db4af95b208209620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:04.797680 17785 consensus_queue.cc:1048] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P a35e1d7a0f05466db4af95b208209620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:04.807767 17785 consensus_queue.cc:1048] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P a35e1d7a0f05466db4af95b208209620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:04.940481 17774 consensus_queue.cc:1048] T 1ea153fe03884218bb2cf06c75d029c0 P a2ded24d2e7648649ddbe521d1dbd135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:04.952180 17812 consensus_queue.cc:1048] T 1ea153fe03884218bb2cf06c75d029c0 P a2ded24d2e7648649ddbe521d1dbd135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:04.966980 17741 consensus_queue.cc:1048] T 0524c60cf5404f1e99bef45655e8bd77 P 141636b82a7b4949931f25ce0a14addc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:04.976207 17754 consensus_queue.cc:1048] T 0524c60cf5404f1e99bef45655e8bd77 P 141636b82a7b4949931f25ce0a14addc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:05.000227 17756 consensus_queue.cc:1048] T 1d80e56f890b4b3f99fdd1940f40e0a0 P 141636b82a7b4949931f25ce0a14addc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:05.010553 17756 consensus_queue.cc:1048] T 1d80e56f890b4b3f99fdd1940f40e0a0 P 141636b82a7b4949931f25ce0a14addc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251023 07:58:05.023844 17493 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20251023 07:58:05.173316 17742 consensus_queue.cc:1048] T 51aacc3534884c92926b5d632a3e11f7 P a2ded24d2e7648649ddbe521d1dbd135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:05.182672 17774 consensus_queue.cc:1048] T 51aacc3534884c92926b5d632a3e11f7 P a2ded24d2e7648649ddbe521d1dbd135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:05.951853 17785 raft_consensus.cc:493] T 5a8aa3610eeb4df3b88aa6fcb808969f P a35e1d7a0f05466db4af95b208209620 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:05.952294 17785 raft_consensus.cc:515] T 5a8aa3610eeb4df3b88aa6fcb808969f P a35e1d7a0f05466db4af95b208209620 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:05.953822 17785 leader_election.cc:290] T 5a8aa3610eeb4df3b88aa6fcb808969f P a35e1d7a0f05466db4af95b208209620 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a2ded24d2e7648649ddbe521d1dbd135 (127.16.126.1:43887), 141636b82a7b4949931f25ce0a14addc (127.16.126.3:42717)
I20251023 07:58:05.954818 17545 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a8aa3610eeb4df3b88aa6fcb808969f" candidate_uuid: "a35e1d7a0f05466db4af95b208209620" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2ded24d2e7648649ddbe521d1dbd135" is_pre_election: true
I20251023 07:58:05.954934 17696 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a8aa3610eeb4df3b88aa6fcb808969f" candidate_uuid: "a35e1d7a0f05466db4af95b208209620" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141636b82a7b4949931f25ce0a14addc" is_pre_election: true
I20251023 07:58:05.955514 17545 raft_consensus.cc:2468] T 5a8aa3610eeb4df3b88aa6fcb808969f P a2ded24d2e7648649ddbe521d1dbd135 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a35e1d7a0f05466db4af95b208209620 in term 1.
I20251023 07:58:05.955569 17696 raft_consensus.cc:2468] T 5a8aa3610eeb4df3b88aa6fcb808969f P 141636b82a7b4949931f25ce0a14addc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a35e1d7a0f05466db4af95b208209620 in term 1.
I20251023 07:58:05.956784 17587 leader_election.cc:304] T 5a8aa3610eeb4df3b88aa6fcb808969f P a35e1d7a0f05466db4af95b208209620 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 141636b82a7b4949931f25ce0a14addc, a35e1d7a0f05466db4af95b208209620; no voters:
I20251023 07:58:05.957415 17785 raft_consensus.cc:2804] T 5a8aa3610eeb4df3b88aa6fcb808969f P a35e1d7a0f05466db4af95b208209620 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251023 07:58:05.957756 17785 raft_consensus.cc:493] T 5a8aa3610eeb4df3b88aa6fcb808969f P a35e1d7a0f05466db4af95b208209620 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:05.958005 17785 raft_consensus.cc:3060] T 5a8aa3610eeb4df3b88aa6fcb808969f P a35e1d7a0f05466db4af95b208209620 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:58:05.962800 17785 raft_consensus.cc:515] T 5a8aa3610eeb4df3b88aa6fcb808969f P a35e1d7a0f05466db4af95b208209620 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:05.964268 17785 leader_election.cc:290] T 5a8aa3610eeb4df3b88aa6fcb808969f P a35e1d7a0f05466db4af95b208209620 [CANDIDATE]: Term 2 election: Requested vote from peers a2ded24d2e7648649ddbe521d1dbd135 (127.16.126.1:43887), 141636b82a7b4949931f25ce0a14addc (127.16.126.3:42717)
I20251023 07:58:05.965368 17696 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a8aa3610eeb4df3b88aa6fcb808969f" candidate_uuid: "a35e1d7a0f05466db4af95b208209620" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141636b82a7b4949931f25ce0a14addc"
I20251023 07:58:05.965497 17545 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a8aa3610eeb4df3b88aa6fcb808969f" candidate_uuid: "a35e1d7a0f05466db4af95b208209620" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2ded24d2e7648649ddbe521d1dbd135"
I20251023 07:58:05.966005 17696 raft_consensus.cc:3060] T 5a8aa3610eeb4df3b88aa6fcb808969f P 141636b82a7b4949931f25ce0a14addc [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:58:05.966076 17545 raft_consensus.cc:3060] T 5a8aa3610eeb4df3b88aa6fcb808969f P a2ded24d2e7648649ddbe521d1dbd135 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:58:05.970928 17696 raft_consensus.cc:2468] T 5a8aa3610eeb4df3b88aa6fcb808969f P 141636b82a7b4949931f25ce0a14addc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a35e1d7a0f05466db4af95b208209620 in term 2.
I20251023 07:58:05.971002 17545 raft_consensus.cc:2468] T 5a8aa3610eeb4df3b88aa6fcb808969f P a2ded24d2e7648649ddbe521d1dbd135 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a35e1d7a0f05466db4af95b208209620 in term 2.
I20251023 07:58:05.971845 17587 leader_election.cc:304] T 5a8aa3610eeb4df3b88aa6fcb808969f P a35e1d7a0f05466db4af95b208209620 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 141636b82a7b4949931f25ce0a14addc, a35e1d7a0f05466db4af95b208209620; no voters:
I20251023 07:58:05.972581 17821 raft_consensus.cc:2804] T 5a8aa3610eeb4df3b88aa6fcb808969f P a35e1d7a0f05466db4af95b208209620 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:58:05.972965 17821 raft_consensus.cc:697] T 5a8aa3610eeb4df3b88aa6fcb808969f P a35e1d7a0f05466db4af95b208209620 [term 2 LEADER]: Becoming Leader. State: Replica: a35e1d7a0f05466db4af95b208209620, State: Running, Role: LEADER
I20251023 07:58:05.973861 17821 consensus_queue.cc:237] T 5a8aa3610eeb4df3b88aa6fcb808969f P a35e1d7a0f05466db4af95b208209620 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:05.981920 17441 catalog_manager.cc:5649] T 5a8aa3610eeb4df3b88aa6fcb808969f P a35e1d7a0f05466db4af95b208209620 reported cstate change: term changed from 0 to 2, leader changed from <none> to a35e1d7a0f05466db4af95b208209620 (127.16.126.2). New cstate: current_term: 2 leader_uuid: "a35e1d7a0f05466db4af95b208209620" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } health_report { overall_health: UNKNOWN } } }
I20251023 07:58:06.308305 17621 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "f7dc54ff3f724e939f77ddaa796574c8"
dest_uuid: "a35e1d7a0f05466db4af95b208209620"
mode: GRACEFUL
new_leader_uuid: "a2ded24d2e7648649ddbe521d1dbd135"
from {username='slave'} at 127.0.0.1:49160
I20251023 07:58:06.308947 17621 raft_consensus.cc:606] T f7dc54ff3f724e939f77ddaa796574c8 P a35e1d7a0f05466db4af95b208209620 [term 1 LEADER]: Received request to transfer leadership to TS a2ded24d2e7648649ddbe521d1dbd135
I20251023 07:58:06.321269 17696 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "65cb88497ea44c4a9ee9cc67ede9d318"
dest_uuid: "141636b82a7b4949931f25ce0a14addc"
mode: GRACEFUL
new_leader_uuid: "a2ded24d2e7648649ddbe521d1dbd135"
from {username='slave'} at 127.0.0.1:51000
I20251023 07:58:06.321806 17696 raft_consensus.cc:606] T 65cb88497ea44c4a9ee9cc67ede9d318 P 141636b82a7b4949931f25ce0a14addc [term 1 LEADER]: Received request to transfer leadership to TS a2ded24d2e7648649ddbe521d1dbd135
I20251023 07:58:06.326354 17696 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "fcb0398cbb794ef7856899e143856d9a"
dest_uuid: "141636b82a7b4949931f25ce0a14addc"
mode: GRACEFUL
new_leader_uuid: "a2ded24d2e7648649ddbe521d1dbd135"
from {username='slave'} at 127.0.0.1:51000
I20251023 07:58:06.326856 17696 raft_consensus.cc:606] T fcb0398cbb794ef7856899e143856d9a P 141636b82a7b4949931f25ce0a14addc [term 1 LEADER]: Received request to transfer leadership to TS a2ded24d2e7648649ddbe521d1dbd135
I20251023 07:58:06.333673 17696 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "1d80e56f890b4b3f99fdd1940f40e0a0"
dest_uuid: "141636b82a7b4949931f25ce0a14addc"
mode: GRACEFUL
new_leader_uuid: "a2ded24d2e7648649ddbe521d1dbd135"
from {username='slave'} at 127.0.0.1:51000
I20251023 07:58:06.334158 17696 raft_consensus.cc:606] T 1d80e56f890b4b3f99fdd1940f40e0a0 P 141636b82a7b4949931f25ce0a14addc [term 1 LEADER]: Received request to transfer leadership to TS a2ded24d2e7648649ddbe521d1dbd135
I20251023 07:58:06.351476 17545 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "b84678e61cb446c3b00429824b024d12"
dest_uuid: "a2ded24d2e7648649ddbe521d1dbd135"
mode: GRACEFUL
new_leader_uuid: "a35e1d7a0f05466db4af95b208209620"
from {username='slave'} at 127.0.0.1:41702
I20251023 07:58:06.352104 17545 raft_consensus.cc:606] T b84678e61cb446c3b00429824b024d12 P a2ded24d2e7648649ddbe521d1dbd135 [term 1 LEADER]: Received request to transfer leadership to TS a35e1d7a0f05466db4af95b208209620
I20251023 07:58:06.357374 17696 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "0524c60cf5404f1e99bef45655e8bd77"
dest_uuid: "141636b82a7b4949931f25ce0a14addc"
mode: GRACEFUL
new_leader_uuid: "a35e1d7a0f05466db4af95b208209620"
from {username='slave'} at 127.0.0.1:51000
I20251023 07:58:06.357998 17696 raft_consensus.cc:606] T 0524c60cf5404f1e99bef45655e8bd77 P 141636b82a7b4949931f25ce0a14addc [term 1 LEADER]: Received request to transfer leadership to TS a35e1d7a0f05466db4af95b208209620
I20251023 07:58:06.363410 17545 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "1ea153fe03884218bb2cf06c75d029c0"
dest_uuid: "a2ded24d2e7648649ddbe521d1dbd135"
mode: GRACEFUL
new_leader_uuid: "a35e1d7a0f05466db4af95b208209620"
from {username='slave'} at 127.0.0.1:41702
I20251023 07:58:06.363947 17545 raft_consensus.cc:606] T 1ea153fe03884218bb2cf06c75d029c0 P a2ded24d2e7648649ddbe521d1dbd135 [term 1 LEADER]: Received request to transfer leadership to TS a35e1d7a0f05466db4af95b208209620
I20251023 07:58:06.372632 17621 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "cd34ebe0d6ff472cbfd9a71f16d4aee1"
dest_uuid: "a35e1d7a0f05466db4af95b208209620"
mode: GRACEFUL
new_leader_uuid: "141636b82a7b4949931f25ce0a14addc"
from {username='slave'} at 127.0.0.1:49160
I20251023 07:58:06.373106 17621 raft_consensus.cc:606] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P a35e1d7a0f05466db4af95b208209620 [term 1 LEADER]: Received request to transfer leadership to TS 141636b82a7b4949931f25ce0a14addc
I20251023 07:58:06.377991 17754 raft_consensus.cc:993] T 0524c60cf5404f1e99bef45655e8bd77 P 141636b82a7b4949931f25ce0a14addc: : Instructing follower a35e1d7a0f05466db4af95b208209620 to start an election
I20251023 07:58:06.378439 17831 raft_consensus.cc:1081] T 0524c60cf5404f1e99bef45655e8bd77 P 141636b82a7b4949931f25ce0a14addc [term 1 LEADER]: Signalling peer a35e1d7a0f05466db4af95b208209620 to start an election
I20251023 07:58:06.380158 17621 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "0524c60cf5404f1e99bef45655e8bd77"
dest_uuid: "a35e1d7a0f05466db4af95b208209620"
from {username='slave'} at 127.0.0.1:60816
I20251023 07:58:06.380607 17621 raft_consensus.cc:493] T 0524c60cf5404f1e99bef45655e8bd77 P a35e1d7a0f05466db4af95b208209620 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:58:06.380879 17621 raft_consensus.cc:3060] T 0524c60cf5404f1e99bef45655e8bd77 P a35e1d7a0f05466db4af95b208209620 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:58:06.386719 17621 raft_consensus.cc:515] T 0524c60cf5404f1e99bef45655e8bd77 P a35e1d7a0f05466db4af95b208209620 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:06.388417 17621 leader_election.cc:290] T 0524c60cf5404f1e99bef45655e8bd77 P a35e1d7a0f05466db4af95b208209620 [CANDIDATE]: Term 2 election: Requested vote from peers a2ded24d2e7648649ddbe521d1dbd135 (127.16.126.1:43887), 141636b82a7b4949931f25ce0a14addc (127.16.126.3:42717)
I20251023 07:58:06.389261 17545 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0524c60cf5404f1e99bef45655e8bd77" candidate_uuid: "a35e1d7a0f05466db4af95b208209620" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a2ded24d2e7648649ddbe521d1dbd135"
I20251023 07:58:06.389479 17696 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0524c60cf5404f1e99bef45655e8bd77" candidate_uuid: "a35e1d7a0f05466db4af95b208209620" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "141636b82a7b4949931f25ce0a14addc"
I20251023 07:58:06.389832 17545 raft_consensus.cc:3060] T 0524c60cf5404f1e99bef45655e8bd77 P a2ded24d2e7648649ddbe521d1dbd135 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:58:06.390007 17696 raft_consensus.cc:3055] T 0524c60cf5404f1e99bef45655e8bd77 P 141636b82a7b4949931f25ce0a14addc [term 1 LEADER]: Stepping down as leader of term 1
I20251023 07:58:06.390364 17696 raft_consensus.cc:740] T 0524c60cf5404f1e99bef45655e8bd77 P 141636b82a7b4949931f25ce0a14addc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 141636b82a7b4949931f25ce0a14addc, State: Running, Role: LEADER
I20251023 07:58:06.390995 17696 consensus_queue.cc:260] T 0524c60cf5404f1e99bef45655e8bd77 P 141636b82a7b4949931f25ce0a14addc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:06.391907 17696 raft_consensus.cc:3060] T 0524c60cf5404f1e99bef45655e8bd77 P 141636b82a7b4949931f25ce0a14addc [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:58:06.394760 17545 raft_consensus.cc:2468] T 0524c60cf5404f1e99bef45655e8bd77 P a2ded24d2e7648649ddbe521d1dbd135 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a35e1d7a0f05466db4af95b208209620 in term 2.
I20251023 07:58:06.395709 17585 leader_election.cc:304] T 0524c60cf5404f1e99bef45655e8bd77 P a35e1d7a0f05466db4af95b208209620 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2ded24d2e7648649ddbe521d1dbd135, a35e1d7a0f05466db4af95b208209620; no voters:
I20251023 07:58:06.396481 17821 raft_consensus.cc:2804] T 0524c60cf5404f1e99bef45655e8bd77 P a35e1d7a0f05466db4af95b208209620 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:58:06.396728 17696 raft_consensus.cc:2468] T 0524c60cf5404f1e99bef45655e8bd77 P 141636b82a7b4949931f25ce0a14addc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a35e1d7a0f05466db4af95b208209620 in term 2.
I20251023 07:58:06.396858 17821 raft_consensus.cc:697] T 0524c60cf5404f1e99bef45655e8bd77 P a35e1d7a0f05466db4af95b208209620 [term 2 LEADER]: Becoming Leader. State: Replica: a35e1d7a0f05466db4af95b208209620, State: Running, Role: LEADER
I20251023 07:58:06.397771 17821 consensus_queue.cc:237] T 0524c60cf5404f1e99bef45655e8bd77 P a35e1d7a0f05466db4af95b208209620 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:06.404184 17441 catalog_manager.cc:5649] T 0524c60cf5404f1e99bef45655e8bd77 P a35e1d7a0f05466db4af95b208209620 reported cstate change: term changed from 1 to 2, leader changed from 141636b82a7b4949931f25ce0a14addc (127.16.126.3) to a35e1d7a0f05466db4af95b208209620 (127.16.126.2). New cstate: current_term: 2 leader_uuid: "a35e1d7a0f05466db4af95b208209620" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } health_report { overall_health: UNKNOWN } } }
I20251023 07:58:06.420744 17812 raft_consensus.cc:993] T 1ea153fe03884218bb2cf06c75d029c0 P a2ded24d2e7648649ddbe521d1dbd135: : Instructing follower a35e1d7a0f05466db4af95b208209620 to start an election
I20251023 07:58:06.421135 17833 raft_consensus.cc:1081] T 1ea153fe03884218bb2cf06c75d029c0 P a2ded24d2e7648649ddbe521d1dbd135 [term 1 LEADER]: Signalling peer a35e1d7a0f05466db4af95b208209620 to start an election
I20251023 07:58:06.422590 17621 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "1ea153fe03884218bb2cf06c75d029c0"
dest_uuid: "a35e1d7a0f05466db4af95b208209620"
from {username='slave'} at 127.0.0.1:60818
I20251023 07:58:06.423062 17621 raft_consensus.cc:493] T 1ea153fe03884218bb2cf06c75d029c0 P a35e1d7a0f05466db4af95b208209620 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:58:06.423321 17621 raft_consensus.cc:3060] T 1ea153fe03884218bb2cf06c75d029c0 P a35e1d7a0f05466db4af95b208209620 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:58:06.427278 17545 raft_consensus.cc:1275] T 5a8aa3610eeb4df3b88aa6fcb808969f P a2ded24d2e7648649ddbe521d1dbd135 [term 2 FOLLOWER]: Refusing update from remote peer a35e1d7a0f05466db4af95b208209620: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20251023 07:58:06.428658 17821 consensus_queue.cc:1048] T 5a8aa3610eeb4df3b88aa6fcb808969f P a35e1d7a0f05466db4af95b208209620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:06.429095 17621 raft_consensus.cc:515] T 1ea153fe03884218bb2cf06c75d029c0 P a35e1d7a0f05466db4af95b208209620 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:06.431835 17621 leader_election.cc:290] T 1ea153fe03884218bb2cf06c75d029c0 P a35e1d7a0f05466db4af95b208209620 [CANDIDATE]: Term 2 election: Requested vote from peers a2ded24d2e7648649ddbe521d1dbd135 (127.16.126.1:43887), 141636b82a7b4949931f25ce0a14addc (127.16.126.3:42717)
I20251023 07:58:06.431990 17547 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1ea153fe03884218bb2cf06c75d029c0" candidate_uuid: "a35e1d7a0f05466db4af95b208209620" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a2ded24d2e7648649ddbe521d1dbd135"
I20251023 07:58:06.432719 17547 raft_consensus.cc:3055] T 1ea153fe03884218bb2cf06c75d029c0 P a2ded24d2e7648649ddbe521d1dbd135 [term 1 LEADER]: Stepping down as leader of term 1
I20251023 07:58:06.433032 17547 raft_consensus.cc:740] T 1ea153fe03884218bb2cf06c75d029c0 P a2ded24d2e7648649ddbe521d1dbd135 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a2ded24d2e7648649ddbe521d1dbd135, State: Running, Role: LEADER
I20251023 07:58:06.431990 17696 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1ea153fe03884218bb2cf06c75d029c0" candidate_uuid: "a35e1d7a0f05466db4af95b208209620" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "141636b82a7b4949931f25ce0a14addc"
I20251023 07:58:06.433768 17696 raft_consensus.cc:3060] T 1ea153fe03884218bb2cf06c75d029c0 P 141636b82a7b4949931f25ce0a14addc [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:58:06.435353 17547 consensus_queue.cc:260] T 1ea153fe03884218bb2cf06c75d029c0 P a2ded24d2e7648649ddbe521d1dbd135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:06.436692 17547 raft_consensus.cc:3060] T 1ea153fe03884218bb2cf06c75d029c0 P a2ded24d2e7648649ddbe521d1dbd135 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:58:06.440667 17696 raft_consensus.cc:2468] T 1ea153fe03884218bb2cf06c75d029c0 P 141636b82a7b4949931f25ce0a14addc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a35e1d7a0f05466db4af95b208209620 in term 2.
I20251023 07:58:06.441919 17587 leader_election.cc:304] T 1ea153fe03884218bb2cf06c75d029c0 P a35e1d7a0f05466db4af95b208209620 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 141636b82a7b4949931f25ce0a14addc, a35e1d7a0f05466db4af95b208209620; no voters:
I20251023 07:58:06.443133 17821 raft_consensus.cc:2804] T 1ea153fe03884218bb2cf06c75d029c0 P a35e1d7a0f05466db4af95b208209620 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:58:06.445696 17547 raft_consensus.cc:2468] T 1ea153fe03884218bb2cf06c75d029c0 P a2ded24d2e7648649ddbe521d1dbd135 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a35e1d7a0f05466db4af95b208209620 in term 2.
I20251023 07:58:06.448743 17821 raft_consensus.cc:697] T 1ea153fe03884218bb2cf06c75d029c0 P a35e1d7a0f05466db4af95b208209620 [term 2 LEADER]: Becoming Leader. State: Replica: a35e1d7a0f05466db4af95b208209620, State: Running, Role: LEADER
I20251023 07:58:06.449954 17821 consensus_queue.cc:237] T 1ea153fe03884218bb2cf06c75d029c0 P a35e1d7a0f05466db4af95b208209620 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:06.459005 17696 raft_consensus.cc:1275] T 5a8aa3610eeb4df3b88aa6fcb808969f P 141636b82a7b4949931f25ce0a14addc [term 2 FOLLOWER]: Refusing update from remote peer a35e1d7a0f05466db4af95b208209620: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20251023 07:58:06.460323 17821 consensus_queue.cc:1048] T 5a8aa3610eeb4df3b88aa6fcb808969f P a35e1d7a0f05466db4af95b208209620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:06.460073 17444 catalog_manager.cc:5649] T 1ea153fe03884218bb2cf06c75d029c0 P a35e1d7a0f05466db4af95b208209620 reported cstate change: term changed from 1 to 2, leader changed from a2ded24d2e7648649ddbe521d1dbd135 (127.16.126.1) to a35e1d7a0f05466db4af95b208209620 (127.16.126.2). New cstate: current_term: 2 leader_uuid: "a35e1d7a0f05466db4af95b208209620" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } health_report { overall_health: UNKNOWN } } }
I20251023 07:58:06.496519 17785 raft_consensus.cc:993] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P a35e1d7a0f05466db4af95b208209620: : Instructing follower 141636b82a7b4949931f25ce0a14addc to start an election
I20251023 07:58:06.496940 17821 raft_consensus.cc:1081] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P a35e1d7a0f05466db4af95b208209620 [term 1 LEADER]: Signalling peer 141636b82a7b4949931f25ce0a14addc to start an election
I20251023 07:58:06.498392 17696 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "cd34ebe0d6ff472cbfd9a71f16d4aee1"
dest_uuid: "141636b82a7b4949931f25ce0a14addc"
from {username='slave'} at 127.0.0.1:35564
I20251023 07:58:06.498865 17696 raft_consensus.cc:493] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P 141636b82a7b4949931f25ce0a14addc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:58:06.499161 17696 raft_consensus.cc:3060] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P 141636b82a7b4949931f25ce0a14addc [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:58:06.503795 17696 raft_consensus.cc:515] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P 141636b82a7b4949931f25ce0a14addc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:06.505506 17696 leader_election.cc:290] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P 141636b82a7b4949931f25ce0a14addc [CANDIDATE]: Term 2 election: Requested vote from peers a2ded24d2e7648649ddbe521d1dbd135 (127.16.126.1:43887), a35e1d7a0f05466db4af95b208209620 (127.16.126.2:43007)
I20251023 07:58:06.506325 17547 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cd34ebe0d6ff472cbfd9a71f16d4aee1" candidate_uuid: "141636b82a7b4949931f25ce0a14addc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a2ded24d2e7648649ddbe521d1dbd135"
I20251023 07:58:06.506453 17621 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cd34ebe0d6ff472cbfd9a71f16d4aee1" candidate_uuid: "141636b82a7b4949931f25ce0a14addc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a35e1d7a0f05466db4af95b208209620"
I20251023 07:58:06.506968 17621 raft_consensus.cc:3055] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P a35e1d7a0f05466db4af95b208209620 [term 1 LEADER]: Stepping down as leader of term 1
I20251023 07:58:06.507215 17621 raft_consensus.cc:740] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P a35e1d7a0f05466db4af95b208209620 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a35e1d7a0f05466db4af95b208209620, State: Running, Role: LEADER
I20251023 07:58:06.507696 17547 raft_consensus.cc:3060] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P a2ded24d2e7648649ddbe521d1dbd135 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:58:06.507942 17621 consensus_queue.cc:260] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P a35e1d7a0f05466db4af95b208209620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:06.508774 17821 raft_consensus.cc:993] T f7dc54ff3f724e939f77ddaa796574c8 P a35e1d7a0f05466db4af95b208209620: : Instructing follower a2ded24d2e7648649ddbe521d1dbd135 to start an election
I20251023 07:58:06.509171 17821 raft_consensus.cc:1081] T f7dc54ff3f724e939f77ddaa796574c8 P a35e1d7a0f05466db4af95b208209620 [term 1 LEADER]: Signalling peer a2ded24d2e7648649ddbe521d1dbd135 to start an election
I20251023 07:58:06.509225 17621 raft_consensus.cc:3060] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P a35e1d7a0f05466db4af95b208209620 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:58:06.513159 17545 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "f7dc54ff3f724e939f77ddaa796574c8"
dest_uuid: "a2ded24d2e7648649ddbe521d1dbd135"
from {username='slave'} at 127.0.0.1:36638
I20251023 07:58:06.513799 17545 raft_consensus.cc:493] T f7dc54ff3f724e939f77ddaa796574c8 P a2ded24d2e7648649ddbe521d1dbd135 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:58:06.514181 17545 raft_consensus.cc:3060] T f7dc54ff3f724e939f77ddaa796574c8 P a2ded24d2e7648649ddbe521d1dbd135 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:58:06.514361 17621 raft_consensus.cc:2468] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P a35e1d7a0f05466db4af95b208209620 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 141636b82a7b4949931f25ce0a14addc in term 2.
I20251023 07:58:06.514457 17547 raft_consensus.cc:2468] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P a2ded24d2e7648649ddbe521d1dbd135 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 141636b82a7b4949931f25ce0a14addc in term 2.
I20251023 07:58:06.515524 17659 leader_election.cc:304] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P 141636b82a7b4949931f25ce0a14addc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 141636b82a7b4949931f25ce0a14addc, a2ded24d2e7648649ddbe521d1dbd135; no voters:
I20251023 07:58:06.516181 17831 raft_consensus.cc:2804] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P 141636b82a7b4949931f25ce0a14addc [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:58:06.516661 17831 raft_consensus.cc:697] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P 141636b82a7b4949931f25ce0a14addc [term 2 LEADER]: Becoming Leader. State: Replica: 141636b82a7b4949931f25ce0a14addc, State: Running, Role: LEADER
I20251023 07:58:06.517513 17831 consensus_queue.cc:237] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P 141636b82a7b4949931f25ce0a14addc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:06.521181 17545 raft_consensus.cc:515] T f7dc54ff3f724e939f77ddaa796574c8 P a2ded24d2e7648649ddbe521d1dbd135 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } }
I20251023 07:58:06.523168 17545 leader_election.cc:290] T f7dc54ff3f724e939f77ddaa796574c8 P a2ded24d2e7648649ddbe521d1dbd135 [CANDIDATE]: Term 2 election: Requested vote from peers 141636b82a7b4949931f25ce0a14addc (127.16.126.3:42717), a35e1d7a0f05466db4af95b208209620 (127.16.126.2:43007)
I20251023 07:58:06.524336 17696 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f7dc54ff3f724e939f77ddaa796574c8" candidate_uuid: "a2ded24d2e7648649ddbe521d1dbd135" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "141636b82a7b4949931f25ce0a14addc"
I20251023 07:58:06.524572 17621 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f7dc54ff3f724e939f77ddaa796574c8" candidate_uuid: "a2ded24d2e7648649ddbe521d1dbd135" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a35e1d7a0f05466db4af95b208209620"
I20251023 07:58:06.524941 17696 raft_consensus.cc:3060] T f7dc54ff3f724e939f77ddaa796574c8 P 141636b82a7b4949931f25ce0a14addc [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:58:06.525121 17621 raft_consensus.cc:3055] T f7dc54ff3f724e939f77ddaa796574c8 P a35e1d7a0f05466db4af95b208209620 [term 1 LEADER]: Stepping down as leader of term 1
I20251023 07:58:06.525516 17621 raft_consensus.cc:740] T f7dc54ff3f724e939f77ddaa796574c8 P a35e1d7a0f05466db4af95b208209620 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a35e1d7a0f05466db4af95b208209620, State: Running, Role: LEADER
I20251023 07:58:06.526262 17621 consensus_queue.cc:260] T f7dc54ff3f724e939f77ddaa796574c8 P a35e1d7a0f05466db4af95b208209620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } }
I20251023 07:58:06.527570 17621 raft_consensus.cc:3060] T f7dc54ff3f724e939f77ddaa796574c8 P a35e1d7a0f05466db4af95b208209620 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:58:06.527696 17754 raft_consensus.cc:993] T 65cb88497ea44c4a9ee9cc67ede9d318 P 141636b82a7b4949931f25ce0a14addc: : Instructing follower a2ded24d2e7648649ddbe521d1dbd135 to start an election
I20251023 07:58:06.527129 17444 catalog_manager.cc:5649] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P 141636b82a7b4949931f25ce0a14addc reported cstate change: term changed from 1 to 2, leader changed from a35e1d7a0f05466db4af95b208209620 (127.16.126.2) to 141636b82a7b4949931f25ce0a14addc (127.16.126.3). New cstate: current_term: 2 leader_uuid: "141636b82a7b4949931f25ce0a14addc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } health_report { overall_health: HEALTHY } } }
I20251023 07:58:06.533876 17831 raft_consensus.cc:1081] T 65cb88497ea44c4a9ee9cc67ede9d318 P 141636b82a7b4949931f25ce0a14addc [term 1 LEADER]: Signalling peer a2ded24d2e7648649ddbe521d1dbd135 to start an election
I20251023 07:58:06.534698 17621 raft_consensus.cc:2468] T f7dc54ff3f724e939f77ddaa796574c8 P a35e1d7a0f05466db4af95b208209620 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2ded24d2e7648649ddbe521d1dbd135 in term 2.
I20251023 07:58:06.533875 17696 raft_consensus.cc:2468] T f7dc54ff3f724e939f77ddaa796574c8 P 141636b82a7b4949931f25ce0a14addc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2ded24d2e7648649ddbe521d1dbd135 in term 2.
I20251023 07:58:06.536661 17512 leader_election.cc:304] T f7dc54ff3f724e939f77ddaa796574c8 P a2ded24d2e7648649ddbe521d1dbd135 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 141636b82a7b4949931f25ce0a14addc, a2ded24d2e7648649ddbe521d1dbd135; no voters:
I20251023 07:58:06.537591 17833 raft_consensus.cc:2804] T f7dc54ff3f724e939f77ddaa796574c8 P a2ded24d2e7648649ddbe521d1dbd135 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:58:06.537532 17545 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "65cb88497ea44c4a9ee9cc67ede9d318"
dest_uuid: "a2ded24d2e7648649ddbe521d1dbd135"
from {username='slave'} at 127.0.0.1:36630
I20251023 07:58:06.538146 17833 raft_consensus.cc:697] T f7dc54ff3f724e939f77ddaa796574c8 P a2ded24d2e7648649ddbe521d1dbd135 [term 2 LEADER]: Becoming Leader. State: Replica: a2ded24d2e7648649ddbe521d1dbd135, State: Running, Role: LEADER
I20251023 07:58:06.538317 17545 raft_consensus.cc:493] T 65cb88497ea44c4a9ee9cc67ede9d318 P a2ded24d2e7648649ddbe521d1dbd135 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:58:06.538837 17545 raft_consensus.cc:3060] T 65cb88497ea44c4a9ee9cc67ede9d318 P a2ded24d2e7648649ddbe521d1dbd135 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:58:06.539041 17833 consensus_queue.cc:237] T f7dc54ff3f724e939f77ddaa796574c8 P a2ded24d2e7648649ddbe521d1dbd135 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } }
I20251023 07:58:06.546746 17545 raft_consensus.cc:515] T 65cb88497ea44c4a9ee9cc67ede9d318 P a2ded24d2e7648649ddbe521d1dbd135 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:06.548808 17545 leader_election.cc:290] T 65cb88497ea44c4a9ee9cc67ede9d318 P a2ded24d2e7648649ddbe521d1dbd135 [CANDIDATE]: Term 2 election: Requested vote from peers a35e1d7a0f05466db4af95b208209620 (127.16.126.2:43007), 141636b82a7b4949931f25ce0a14addc (127.16.126.3:42717)
I20251023 07:58:06.549556 17621 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "65cb88497ea44c4a9ee9cc67ede9d318" candidate_uuid: "a2ded24d2e7648649ddbe521d1dbd135" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a35e1d7a0f05466db4af95b208209620"
I20251023 07:58:06.549841 17696 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "65cb88497ea44c4a9ee9cc67ede9d318" candidate_uuid: "a2ded24d2e7648649ddbe521d1dbd135" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "141636b82a7b4949931f25ce0a14addc"
I20251023 07:58:06.550096 17621 raft_consensus.cc:3060] T 65cb88497ea44c4a9ee9cc67ede9d318 P a35e1d7a0f05466db4af95b208209620 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:58:06.550431 17696 raft_consensus.cc:3055] T 65cb88497ea44c4a9ee9cc67ede9d318 P 141636b82a7b4949931f25ce0a14addc [term 1 LEADER]: Stepping down as leader of term 1
I20251023 07:58:06.550782 17696 raft_consensus.cc:740] T 65cb88497ea44c4a9ee9cc67ede9d318 P 141636b82a7b4949931f25ce0a14addc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 141636b82a7b4949931f25ce0a14addc, State: Running, Role: LEADER
I20251023 07:58:06.551548 17696 consensus_queue.cc:260] T 65cb88497ea44c4a9ee9cc67ede9d318 P 141636b82a7b4949931f25ce0a14addc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:06.551995 17444 catalog_manager.cc:5649] T f7dc54ff3f724e939f77ddaa796574c8 P a2ded24d2e7648649ddbe521d1dbd135 reported cstate change: term changed from 1 to 2, leader changed from a35e1d7a0f05466db4af95b208209620 (127.16.126.2) to a2ded24d2e7648649ddbe521d1dbd135 (127.16.126.1). New cstate: current_term: 2 leader_uuid: "a2ded24d2e7648649ddbe521d1dbd135" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } health_report { overall_health: HEALTHY } } }
I20251023 07:58:06.552814 17696 raft_consensus.cc:3060] T 65cb88497ea44c4a9ee9cc67ede9d318 P 141636b82a7b4949931f25ce0a14addc [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:58:06.555509 17621 raft_consensus.cc:2468] T 65cb88497ea44c4a9ee9cc67ede9d318 P a35e1d7a0f05466db4af95b208209620 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2ded24d2e7648649ddbe521d1dbd135 in term 2.
I20251023 07:58:06.556628 17510 leader_election.cc:304] T 65cb88497ea44c4a9ee9cc67ede9d318 P a2ded24d2e7648649ddbe521d1dbd135 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2ded24d2e7648649ddbe521d1dbd135, a35e1d7a0f05466db4af95b208209620; no voters:
I20251023 07:58:06.557459 17833 raft_consensus.cc:2804] T 65cb88497ea44c4a9ee9cc67ede9d318 P a2ded24d2e7648649ddbe521d1dbd135 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:58:06.557924 17833 raft_consensus.cc:697] T 65cb88497ea44c4a9ee9cc67ede9d318 P a2ded24d2e7648649ddbe521d1dbd135 [term 2 LEADER]: Becoming Leader. State: Replica: a2ded24d2e7648649ddbe521d1dbd135, State: Running, Role: LEADER
I20251023 07:58:06.558717 17833 consensus_queue.cc:237] T 65cb88497ea44c4a9ee9cc67ede9d318 P a2ded24d2e7648649ddbe521d1dbd135 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:06.559049 17696 raft_consensus.cc:2468] T 65cb88497ea44c4a9ee9cc67ede9d318 P 141636b82a7b4949931f25ce0a14addc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2ded24d2e7648649ddbe521d1dbd135 in term 2.
I20251023 07:58:06.566097 17444 catalog_manager.cc:5649] T 65cb88497ea44c4a9ee9cc67ede9d318 P a2ded24d2e7648649ddbe521d1dbd135 reported cstate change: term changed from 1 to 2, leader changed from 141636b82a7b4949931f25ce0a14addc (127.16.126.3) to a2ded24d2e7648649ddbe521d1dbd135 (127.16.126.1). New cstate: current_term: 2 leader_uuid: "a2ded24d2e7648649ddbe521d1dbd135" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } health_report { overall_health: UNKNOWN } } }
I20251023 07:58:06.591145 17812 raft_consensus.cc:993] T b84678e61cb446c3b00429824b024d12 P a2ded24d2e7648649ddbe521d1dbd135: : Instructing follower a35e1d7a0f05466db4af95b208209620 to start an election
I20251023 07:58:06.591575 17833 raft_consensus.cc:1081] T b84678e61cb446c3b00429824b024d12 P a2ded24d2e7648649ddbe521d1dbd135 [term 1 LEADER]: Signalling peer a35e1d7a0f05466db4af95b208209620 to start an election
I20251023 07:58:06.592927 17621 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "b84678e61cb446c3b00429824b024d12"
dest_uuid: "a35e1d7a0f05466db4af95b208209620"
from {username='slave'} at 127.0.0.1:60818
I20251023 07:58:06.593397 17621 raft_consensus.cc:493] T b84678e61cb446c3b00429824b024d12 P a35e1d7a0f05466db4af95b208209620 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:58:06.593698 17621 raft_consensus.cc:3060] T b84678e61cb446c3b00429824b024d12 P a35e1d7a0f05466db4af95b208209620 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:58:06.598477 17621 raft_consensus.cc:515] T b84678e61cb446c3b00429824b024d12 P a35e1d7a0f05466db4af95b208209620 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:06.599951 17621 leader_election.cc:290] T b84678e61cb446c3b00429824b024d12 P a35e1d7a0f05466db4af95b208209620 [CANDIDATE]: Term 2 election: Requested vote from peers a2ded24d2e7648649ddbe521d1dbd135 (127.16.126.1:43887), 141636b82a7b4949931f25ce0a14addc (127.16.126.3:42717)
I20251023 07:58:06.600852 17545 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b84678e61cb446c3b00429824b024d12" candidate_uuid: "a35e1d7a0f05466db4af95b208209620" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a2ded24d2e7648649ddbe521d1dbd135"
I20251023 07:58:06.600996 17696 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b84678e61cb446c3b00429824b024d12" candidate_uuid: "a35e1d7a0f05466db4af95b208209620" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "141636b82a7b4949931f25ce0a14addc"
I20251023 07:58:06.601544 17696 raft_consensus.cc:3060] T b84678e61cb446c3b00429824b024d12 P 141636b82a7b4949931f25ce0a14addc [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:58:06.601503 17545 raft_consensus.cc:3055] T b84678e61cb446c3b00429824b024d12 P a2ded24d2e7648649ddbe521d1dbd135 [term 1 LEADER]: Stepping down as leader of term 1
I20251023 07:58:06.602037 17545 raft_consensus.cc:740] T b84678e61cb446c3b00429824b024d12 P a2ded24d2e7648649ddbe521d1dbd135 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a2ded24d2e7648649ddbe521d1dbd135, State: Running, Role: LEADER
I20251023 07:58:06.602838 17545 consensus_queue.cc:260] T b84678e61cb446c3b00429824b024d12 P a2ded24d2e7648649ddbe521d1dbd135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:06.604040 17545 raft_consensus.cc:3060] T b84678e61cb446c3b00429824b024d12 P a2ded24d2e7648649ddbe521d1dbd135 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:58:06.608458 17696 raft_consensus.cc:2468] T b84678e61cb446c3b00429824b024d12 P 141636b82a7b4949931f25ce0a14addc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a35e1d7a0f05466db4af95b208209620 in term 2.
I20251023 07:58:06.609539 17587 leader_election.cc:304] T b84678e61cb446c3b00429824b024d12 P a35e1d7a0f05466db4af95b208209620 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 141636b82a7b4949931f25ce0a14addc, a35e1d7a0f05466db4af95b208209620; no voters:
I20251023 07:58:06.610316 17837 raft_consensus.cc:2804] T b84678e61cb446c3b00429824b024d12 P a35e1d7a0f05466db4af95b208209620 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:58:06.610783 17837 raft_consensus.cc:697] T b84678e61cb446c3b00429824b024d12 P a35e1d7a0f05466db4af95b208209620 [term 2 LEADER]: Becoming Leader. State: Replica: a35e1d7a0f05466db4af95b208209620, State: Running, Role: LEADER
I20251023 07:58:06.611043 17545 raft_consensus.cc:2468] T b84678e61cb446c3b00429824b024d12 P a2ded24d2e7648649ddbe521d1dbd135 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a35e1d7a0f05466db4af95b208209620 in term 2.
I20251023 07:58:06.611581 17837 consensus_queue.cc:237] T b84678e61cb446c3b00429824b024d12 P a35e1d7a0f05466db4af95b208209620 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:06.620625 17444 catalog_manager.cc:5649] T b84678e61cb446c3b00429824b024d12 P a35e1d7a0f05466db4af95b208209620 reported cstate change: term changed from 1 to 2, leader changed from a2ded24d2e7648649ddbe521d1dbd135 (127.16.126.1) to a35e1d7a0f05466db4af95b208209620 (127.16.126.2). New cstate: current_term: 2 leader_uuid: "a35e1d7a0f05466db4af95b208209620" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } health_report { overall_health: UNKNOWN } } }
I20251023 07:58:06.688576 17754 raft_consensus.cc:993] T fcb0398cbb794ef7856899e143856d9a P 141636b82a7b4949931f25ce0a14addc: : Instructing follower a2ded24d2e7648649ddbe521d1dbd135 to start an election
I20251023 07:58:06.688984 17843 raft_consensus.cc:1081] T fcb0398cbb794ef7856899e143856d9a P 141636b82a7b4949931f25ce0a14addc [term 1 LEADER]: Signalling peer a2ded24d2e7648649ddbe521d1dbd135 to start an election
I20251023 07:58:06.690390 17545 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "fcb0398cbb794ef7856899e143856d9a"
dest_uuid: "a2ded24d2e7648649ddbe521d1dbd135"
from {username='slave'} at 127.0.0.1:36630
I20251023 07:58:06.690822 17545 raft_consensus.cc:493] T fcb0398cbb794ef7856899e143856d9a P a2ded24d2e7648649ddbe521d1dbd135 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:58:06.691061 17545 raft_consensus.cc:3060] T fcb0398cbb794ef7856899e143856d9a P a2ded24d2e7648649ddbe521d1dbd135 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:58:06.695789 17545 raft_consensus.cc:515] T fcb0398cbb794ef7856899e143856d9a P a2ded24d2e7648649ddbe521d1dbd135 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:06.697487 17545 leader_election.cc:290] T fcb0398cbb794ef7856899e143856d9a P a2ded24d2e7648649ddbe521d1dbd135 [CANDIDATE]: Term 2 election: Requested vote from peers a35e1d7a0f05466db4af95b208209620 (127.16.126.2:43007), 141636b82a7b4949931f25ce0a14addc (127.16.126.3:42717)
I20251023 07:58:06.698247 17621 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fcb0398cbb794ef7856899e143856d9a" candidate_uuid: "a2ded24d2e7648649ddbe521d1dbd135" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a35e1d7a0f05466db4af95b208209620"
I20251023 07:58:06.698495 17696 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fcb0398cbb794ef7856899e143856d9a" candidate_uuid: "a2ded24d2e7648649ddbe521d1dbd135" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "141636b82a7b4949931f25ce0a14addc"
I20251023 07:58:06.698733 17621 raft_consensus.cc:3060] T fcb0398cbb794ef7856899e143856d9a P a35e1d7a0f05466db4af95b208209620 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:58:06.698975 17696 raft_consensus.cc:3055] T fcb0398cbb794ef7856899e143856d9a P 141636b82a7b4949931f25ce0a14addc [term 1 LEADER]: Stepping down as leader of term 1
I20251023 07:58:06.699254 17696 raft_consensus.cc:740] T fcb0398cbb794ef7856899e143856d9a P 141636b82a7b4949931f25ce0a14addc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 141636b82a7b4949931f25ce0a14addc, State: Running, Role: LEADER
I20251023 07:58:06.699810 17696 consensus_queue.cc:260] T fcb0398cbb794ef7856899e143856d9a P 141636b82a7b4949931f25ce0a14addc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:06.700598 17696 raft_consensus.cc:3060] T fcb0398cbb794ef7856899e143856d9a P 141636b82a7b4949931f25ce0a14addc [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:58:06.704003 17621 raft_consensus.cc:2468] T fcb0398cbb794ef7856899e143856d9a P a35e1d7a0f05466db4af95b208209620 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2ded24d2e7648649ddbe521d1dbd135 in term 2.
I20251023 07:58:06.704720 17754 raft_consensus.cc:993] T 1d80e56f890b4b3f99fdd1940f40e0a0 P 141636b82a7b4949931f25ce0a14addc: : Instructing follower a2ded24d2e7648649ddbe521d1dbd135 to start an election
I20251023 07:58:06.705057 17510 leader_election.cc:304] T fcb0398cbb794ef7856899e143856d9a P a2ded24d2e7648649ddbe521d1dbd135 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2ded24d2e7648649ddbe521d1dbd135, a35e1d7a0f05466db4af95b208209620; no voters:
I20251023 07:58:06.705170 17831 raft_consensus.cc:1081] T 1d80e56f890b4b3f99fdd1940f40e0a0 P 141636b82a7b4949931f25ce0a14addc [term 1 LEADER]: Signalling peer a2ded24d2e7648649ddbe521d1dbd135 to start an election
I20251023 07:58:06.705816 17833 raft_consensus.cc:2804] T fcb0398cbb794ef7856899e143856d9a P a2ded24d2e7648649ddbe521d1dbd135 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:58:06.706199 17833 raft_consensus.cc:697] T fcb0398cbb794ef7856899e143856d9a P a2ded24d2e7648649ddbe521d1dbd135 [term 2 LEADER]: Becoming Leader. State: Replica: a2ded24d2e7648649ddbe521d1dbd135, State: Running, Role: LEADER
I20251023 07:58:06.706149 17696 raft_consensus.cc:2468] T fcb0398cbb794ef7856899e143856d9a P 141636b82a7b4949931f25ce0a14addc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2ded24d2e7648649ddbe521d1dbd135 in term 2.
I20251023 07:58:06.706904 17545 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "1d80e56f890b4b3f99fdd1940f40e0a0"
dest_uuid: "a2ded24d2e7648649ddbe521d1dbd135"
from {username='slave'} at 127.0.0.1:36630
I20251023 07:58:06.707072 17833 consensus_queue.cc:237] T fcb0398cbb794ef7856899e143856d9a P a2ded24d2e7648649ddbe521d1dbd135 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:06.707612 17545 raft_consensus.cc:493] T 1d80e56f890b4b3f99fdd1940f40e0a0 P a2ded24d2e7648649ddbe521d1dbd135 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:58:06.708002 17545 raft_consensus.cc:3060] T 1d80e56f890b4b3f99fdd1940f40e0a0 P a2ded24d2e7648649ddbe521d1dbd135 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:58:06.713876 17545 raft_consensus.cc:515] T 1d80e56f890b4b3f99fdd1940f40e0a0 P a2ded24d2e7648649ddbe521d1dbd135 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:06.715315 17545 leader_election.cc:290] T 1d80e56f890b4b3f99fdd1940f40e0a0 P a2ded24d2e7648649ddbe521d1dbd135 [CANDIDATE]: Term 2 election: Requested vote from peers a35e1d7a0f05466db4af95b208209620 (127.16.126.2:43007), 141636b82a7b4949931f25ce0a14addc (127.16.126.3:42717)
I20251023 07:58:06.714912 17444 catalog_manager.cc:5649] T fcb0398cbb794ef7856899e143856d9a P a2ded24d2e7648649ddbe521d1dbd135 reported cstate change: term changed from 1 to 2, leader changed from 141636b82a7b4949931f25ce0a14addc (127.16.126.3) to a2ded24d2e7648649ddbe521d1dbd135 (127.16.126.1). New cstate: current_term: 2 leader_uuid: "a2ded24d2e7648649ddbe521d1dbd135" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } health_report { overall_health: UNKNOWN } } }
I20251023 07:58:06.716176 17621 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1d80e56f890b4b3f99fdd1940f40e0a0" candidate_uuid: "a2ded24d2e7648649ddbe521d1dbd135" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a35e1d7a0f05466db4af95b208209620"
I20251023 07:58:06.716365 17696 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1d80e56f890b4b3f99fdd1940f40e0a0" candidate_uuid: "a2ded24d2e7648649ddbe521d1dbd135" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "141636b82a7b4949931f25ce0a14addc"
I20251023 07:58:06.716711 17621 raft_consensus.cc:3060] T 1d80e56f890b4b3f99fdd1940f40e0a0 P a35e1d7a0f05466db4af95b208209620 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:58:06.716818 17696 raft_consensus.cc:3055] T 1d80e56f890b4b3f99fdd1940f40e0a0 P 141636b82a7b4949931f25ce0a14addc [term 1 LEADER]: Stepping down as leader of term 1
I20251023 07:58:06.717062 17696 raft_consensus.cc:740] T 1d80e56f890b4b3f99fdd1940f40e0a0 P 141636b82a7b4949931f25ce0a14addc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 141636b82a7b4949931f25ce0a14addc, State: Running, Role: LEADER
I20251023 07:58:06.717617 17696 consensus_queue.cc:260] T 1d80e56f890b4b3f99fdd1940f40e0a0 P 141636b82a7b4949931f25ce0a14addc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:06.718667 17696 raft_consensus.cc:3060] T 1d80e56f890b4b3f99fdd1940f40e0a0 P 141636b82a7b4949931f25ce0a14addc [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:58:06.721596 17621 raft_consensus.cc:2468] T 1d80e56f890b4b3f99fdd1940f40e0a0 P a35e1d7a0f05466db4af95b208209620 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2ded24d2e7648649ddbe521d1dbd135 in term 2.
I20251023 07:58:06.722644 17510 leader_election.cc:304] T 1d80e56f890b4b3f99fdd1940f40e0a0 P a2ded24d2e7648649ddbe521d1dbd135 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2ded24d2e7648649ddbe521d1dbd135, a35e1d7a0f05466db4af95b208209620; no voters:
I20251023 07:58:06.723464 17833 raft_consensus.cc:2804] T 1d80e56f890b4b3f99fdd1940f40e0a0 P a2ded24d2e7648649ddbe521d1dbd135 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:58:06.723932 17833 raft_consensus.cc:697] T 1d80e56f890b4b3f99fdd1940f40e0a0 P a2ded24d2e7648649ddbe521d1dbd135 [term 2 LEADER]: Becoming Leader. State: Replica: a2ded24d2e7648649ddbe521d1dbd135, State: Running, Role: LEADER
I20251023 07:58:06.724023 17696 raft_consensus.cc:2468] T 1d80e56f890b4b3f99fdd1940f40e0a0 P 141636b82a7b4949931f25ce0a14addc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2ded24d2e7648649ddbe521d1dbd135 in term 2.
I20251023 07:58:06.724757 17833 consensus_queue.cc:237] T 1d80e56f890b4b3f99fdd1940f40e0a0 P a2ded24d2e7648649ddbe521d1dbd135 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:06.731928 17444 catalog_manager.cc:5649] T 1d80e56f890b4b3f99fdd1940f40e0a0 P a2ded24d2e7648649ddbe521d1dbd135 reported cstate change: term changed from 1 to 2, leader changed from 141636b82a7b4949931f25ce0a14addc (127.16.126.3) to a2ded24d2e7648649ddbe521d1dbd135 (127.16.126.1). New cstate: current_term: 2 leader_uuid: "a2ded24d2e7648649ddbe521d1dbd135" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } health_report { overall_health: UNKNOWN } } }
I20251023 07:58:06.803355 17545 raft_consensus.cc:1275] T 0524c60cf5404f1e99bef45655e8bd77 P a2ded24d2e7648649ddbe521d1dbd135 [term 2 FOLLOWER]: Refusing update from remote peer a35e1d7a0f05466db4af95b208209620: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:58:06.804458 17837 consensus_queue.cc:1048] T 0524c60cf5404f1e99bef45655e8bd77 P a35e1d7a0f05466db4af95b208209620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:58:06.812840 17696 raft_consensus.cc:1275] T 0524c60cf5404f1e99bef45655e8bd77 P 141636b82a7b4949931f25ce0a14addc [term 2 FOLLOWER]: Refusing update from remote peer a35e1d7a0f05466db4af95b208209620: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:58:06.814280 17821 consensus_queue.cc:1048] T 0524c60cf5404f1e99bef45655e8bd77 P a35e1d7a0f05466db4af95b208209620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:58:06.919553 17545 raft_consensus.cc:1275] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P a2ded24d2e7648649ddbe521d1dbd135 [term 2 FOLLOWER]: Refusing update from remote peer 141636b82a7b4949931f25ce0a14addc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:58:06.920665 17831 consensus_queue.cc:1048] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P 141636b82a7b4949931f25ce0a14addc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:58:06.925016 17621 raft_consensus.cc:1275] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P a35e1d7a0f05466db4af95b208209620 [term 2 FOLLOWER]: Refusing update from remote peer 141636b82a7b4949931f25ce0a14addc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:58:06.926100 17831 consensus_queue.cc:1048] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P 141636b82a7b4949931f25ce0a14addc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:58:06.956936 17545 raft_consensus.cc:1275] T 1ea153fe03884218bb2cf06c75d029c0 P a2ded24d2e7648649ddbe521d1dbd135 [term 2 FOLLOWER]: Refusing update from remote peer a35e1d7a0f05466db4af95b208209620: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:58:06.957001 17621 raft_consensus.cc:1275] T f7dc54ff3f724e939f77ddaa796574c8 P a35e1d7a0f05466db4af95b208209620 [term 2 FOLLOWER]: Refusing update from remote peer a2ded24d2e7648649ddbe521d1dbd135: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:58:06.958472 17821 consensus_queue.cc:1048] T 1ea153fe03884218bb2cf06c75d029c0 P a35e1d7a0f05466db4af95b208209620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20251023 07:58:06.958474 17833 consensus_queue.cc:1048] T f7dc54ff3f724e939f77ddaa796574c8 P a2ded24d2e7648649ddbe521d1dbd135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20251023 07:58:06.971379 17696 raft_consensus.cc:1275] T f7dc54ff3f724e939f77ddaa796574c8 P 141636b82a7b4949931f25ce0a14addc [term 2 FOLLOWER]: Refusing update from remote peer a2ded24d2e7648649ddbe521d1dbd135: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:58:06.972283 17695 raft_consensus.cc:1275] T 1ea153fe03884218bb2cf06c75d029c0 P 141636b82a7b4949931f25ce0a14addc [term 2 FOLLOWER]: Refusing update from remote peer a35e1d7a0f05466db4af95b208209620: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:58:06.973820 17821 consensus_queue.cc:1048] T 1ea153fe03884218bb2cf06c75d029c0 P a35e1d7a0f05466db4af95b208209620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:58:06.974717 17855 consensus_queue.cc:1048] T f7dc54ff3f724e939f77ddaa796574c8 P a2ded24d2e7648649ddbe521d1dbd135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20251023 07:58:06.990470 17695 raft_consensus.cc:1275] T 65cb88497ea44c4a9ee9cc67ede9d318 P 141636b82a7b4949931f25ce0a14addc [term 2 FOLLOWER]: Refusing update from remote peer a2ded24d2e7648649ddbe521d1dbd135: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:58:06.991758 17812 consensus_queue.cc:1048] T 65cb88497ea44c4a9ee9cc67ede9d318 P a2ded24d2e7648649ddbe521d1dbd135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:58:07.002554 17621 raft_consensus.cc:1275] T 65cb88497ea44c4a9ee9cc67ede9d318 P a35e1d7a0f05466db4af95b208209620 [term 2 FOLLOWER]: Refusing update from remote peer a2ded24d2e7648649ddbe521d1dbd135: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:58:07.004089 17833 consensus_queue.cc:1048] T 65cb88497ea44c4a9ee9cc67ede9d318 P a2ded24d2e7648649ddbe521d1dbd135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:58:07.031097 17695 raft_consensus.cc:1275] T b84678e61cb446c3b00429824b024d12 P 141636b82a7b4949931f25ce0a14addc [term 2 FOLLOWER]: Refusing update from remote peer a35e1d7a0f05466db4af95b208209620: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:58:07.032274 17821 consensus_queue.cc:1048] T b84678e61cb446c3b00429824b024d12 P a35e1d7a0f05466db4af95b208209620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:58:07.042239 17545 raft_consensus.cc:1275] T b84678e61cb446c3b00429824b024d12 P a2ded24d2e7648649ddbe521d1dbd135 [term 2 FOLLOWER]: Refusing update from remote peer a35e1d7a0f05466db4af95b208209620: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:58:07.043835 17821 consensus_queue.cc:1048] T b84678e61cb446c3b00429824b024d12 P a35e1d7a0f05466db4af95b208209620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:58:07.120137 17695 raft_consensus.cc:1275] T fcb0398cbb794ef7856899e143856d9a P 141636b82a7b4949931f25ce0a14addc [term 2 FOLLOWER]: Refusing update from remote peer a2ded24d2e7648649ddbe521d1dbd135: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:58:07.121243 17833 consensus_queue.cc:1048] T fcb0398cbb794ef7856899e143856d9a P a2ded24d2e7648649ddbe521d1dbd135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:58:07.129185 17621 raft_consensus.cc:1275] T fcb0398cbb794ef7856899e143856d9a P a35e1d7a0f05466db4af95b208209620 [term 2 FOLLOWER]: Refusing update from remote peer a2ded24d2e7648649ddbe521d1dbd135: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:58:07.130599 17856 consensus_queue.cc:1048] T fcb0398cbb794ef7856899e143856d9a P a2ded24d2e7648649ddbe521d1dbd135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:58:07.133034 17695 raft_consensus.cc:1275] T 1d80e56f890b4b3f99fdd1940f40e0a0 P 141636b82a7b4949931f25ce0a14addc [term 2 FOLLOWER]: Refusing update from remote peer a2ded24d2e7648649ddbe521d1dbd135: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:58:07.133850 17622 raft_consensus.cc:1275] T 1d80e56f890b4b3f99fdd1940f40e0a0 P a35e1d7a0f05466db4af95b208209620 [term 2 FOLLOWER]: Refusing update from remote peer a2ded24d2e7648649ddbe521d1dbd135: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:58:07.135179 17855 consensus_queue.cc:1048] T 1d80e56f890b4b3f99fdd1940f40e0a0 P a2ded24d2e7648649ddbe521d1dbd135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:58:07.136394 17856 consensus_queue.cc:1048] T 1d80e56f890b4b3f99fdd1940f40e0a0 P a2ded24d2e7648649ddbe521d1dbd135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:58:09.403332 16888 auto_leader_rebalancer-test.cc:343] The leader distribution is
I20251023 07:58:09.404019 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:58:09.425733 17547 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "51aacc3534884c92926b5d632a3e11f7"
dest_uuid: "a2ded24d2e7648649ddbe521d1dbd135"
mode: GRACEFUL
new_leader_uuid: "141636b82a7b4949931f25ce0a14addc"
from {username='slave'} at 127.0.0.1:41718
I20251023 07:58:09.426209 17547 raft_consensus.cc:606] T 51aacc3534884c92926b5d632a3e11f7 P a2ded24d2e7648649ddbe521d1dbd135 [term 1 LEADER]: Received request to transfer leadership to TS 141636b82a7b4949931f25ce0a14addc
I20251023 07:58:09.428385 17547 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "f7dc54ff3f724e939f77ddaa796574c8"
dest_uuid: "a2ded24d2e7648649ddbe521d1dbd135"
mode: GRACEFUL
new_leader_uuid: "141636b82a7b4949931f25ce0a14addc"
from {username='slave'} at 127.0.0.1:41718
I20251023 07:58:09.428864 17547 raft_consensus.cc:606] T f7dc54ff3f724e939f77ddaa796574c8 P a2ded24d2e7648649ddbe521d1dbd135 [term 2 LEADER]: Received request to transfer leadership to TS 141636b82a7b4949931f25ce0a14addc
I20251023 07:58:09.429766 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20251023 07:58:09.430183 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 07:58:09.514137 17872 raft_consensus.cc:993] T f7dc54ff3f724e939f77ddaa796574c8 P a2ded24d2e7648649ddbe521d1dbd135: : Instructing follower 141636b82a7b4949931f25ce0a14addc to start an election
I20251023 07:58:09.514659 17872 raft_consensus.cc:1081] T f7dc54ff3f724e939f77ddaa796574c8 P a2ded24d2e7648649ddbe521d1dbd135 [term 2 LEADER]: Signalling peer 141636b82a7b4949931f25ce0a14addc to start an election
I20251023 07:58:09.516134 17695 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "f7dc54ff3f724e939f77ddaa796574c8"
dest_uuid: "141636b82a7b4949931f25ce0a14addc"
from {username='slave'} at 127.0.0.1:35556
I20251023 07:58:09.516598 17695 raft_consensus.cc:493] T f7dc54ff3f724e939f77ddaa796574c8 P 141636b82a7b4949931f25ce0a14addc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:58:09.516887 17695 raft_consensus.cc:3060] T f7dc54ff3f724e939f77ddaa796574c8 P 141636b82a7b4949931f25ce0a14addc [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:58:09.521461 17695 raft_consensus.cc:515] T f7dc54ff3f724e939f77ddaa796574c8 P 141636b82a7b4949931f25ce0a14addc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } }
I20251023 07:58:09.523025 17695 leader_election.cc:290] T f7dc54ff3f724e939f77ddaa796574c8 P 141636b82a7b4949931f25ce0a14addc [CANDIDATE]: Term 3 election: Requested vote from peers a35e1d7a0f05466db4af95b208209620 (127.16.126.2:43007), a2ded24d2e7648649ddbe521d1dbd135 (127.16.126.1:43887)
I20251023 07:58:09.523823 17622 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f7dc54ff3f724e939f77ddaa796574c8" candidate_uuid: "141636b82a7b4949931f25ce0a14addc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a35e1d7a0f05466db4af95b208209620"
I20251023 07:58:09.524120 17547 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f7dc54ff3f724e939f77ddaa796574c8" candidate_uuid: "141636b82a7b4949931f25ce0a14addc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a2ded24d2e7648649ddbe521d1dbd135"
I20251023 07:58:09.524362 17622 raft_consensus.cc:3060] T f7dc54ff3f724e939f77ddaa796574c8 P a35e1d7a0f05466db4af95b208209620 [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:58:09.524636 17547 raft_consensus.cc:3055] T f7dc54ff3f724e939f77ddaa796574c8 P a2ded24d2e7648649ddbe521d1dbd135 [term 2 LEADER]: Stepping down as leader of term 2
I20251023 07:58:09.524897 17547 raft_consensus.cc:740] T f7dc54ff3f724e939f77ddaa796574c8 P a2ded24d2e7648649ddbe521d1dbd135 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a2ded24d2e7648649ddbe521d1dbd135, State: Running, Role: LEADER
I20251023 07:58:09.525529 17547 consensus_queue.cc:260] T f7dc54ff3f724e939f77ddaa796574c8 P a2ded24d2e7648649ddbe521d1dbd135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } }
I20251023 07:58:09.526417 17547 raft_consensus.cc:3060] T f7dc54ff3f724e939f77ddaa796574c8 P a2ded24d2e7648649ddbe521d1dbd135 [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:58:09.529235 17622 raft_consensus.cc:2468] T f7dc54ff3f724e939f77ddaa796574c8 P a35e1d7a0f05466db4af95b208209620 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 141636b82a7b4949931f25ce0a14addc in term 3.
I20251023 07:58:09.530447 17659 leader_election.cc:304] T f7dc54ff3f724e939f77ddaa796574c8 P 141636b82a7b4949931f25ce0a14addc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 141636b82a7b4949931f25ce0a14addc, a35e1d7a0f05466db4af95b208209620; no voters:
I20251023 07:58:09.531258 17869 raft_consensus.cc:2804] T f7dc54ff3f724e939f77ddaa796574c8 P 141636b82a7b4949931f25ce0a14addc [term 3 FOLLOWER]: Leader election won for term 3
I20251023 07:58:09.531435 17547 raft_consensus.cc:2468] T f7dc54ff3f724e939f77ddaa796574c8 P a2ded24d2e7648649ddbe521d1dbd135 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 141636b82a7b4949931f25ce0a14addc in term 3.
I20251023 07:58:09.532390 17869 raft_consensus.cc:697] T f7dc54ff3f724e939f77ddaa796574c8 P 141636b82a7b4949931f25ce0a14addc [term 3 LEADER]: Becoming Leader. State: Replica: 141636b82a7b4949931f25ce0a14addc, State: Running, Role: LEADER
I20251023 07:58:09.533162 17869 consensus_queue.cc:237] T f7dc54ff3f724e939f77ddaa796574c8 P 141636b82a7b4949931f25ce0a14addc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } }
I20251023 07:58:09.539927 17443 catalog_manager.cc:5649] T f7dc54ff3f724e939f77ddaa796574c8 P 141636b82a7b4949931f25ce0a14addc reported cstate change: term changed from 2 to 3, leader changed from a2ded24d2e7648649ddbe521d1dbd135 (127.16.126.1) to 141636b82a7b4949931f25ce0a14addc (127.16.126.3). New cstate: current_term: 3 leader_uuid: "141636b82a7b4949931f25ce0a14addc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } health_report { overall_health: UNKNOWN } } }
I20251023 07:58:09.958135 17622 raft_consensus.cc:1275] T f7dc54ff3f724e939f77ddaa796574c8 P a35e1d7a0f05466db4af95b208209620 [term 3 FOLLOWER]: Refusing update from remote peer 141636b82a7b4949931f25ce0a14addc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251023 07:58:09.959367 17869 consensus_queue.cc:1048] T f7dc54ff3f724e939f77ddaa796574c8 P 141636b82a7b4949931f25ce0a14addc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:58:09.971829 17547 raft_consensus.cc:1275] T f7dc54ff3f724e939f77ddaa796574c8 P a2ded24d2e7648649ddbe521d1dbd135 [term 3 FOLLOWER]: Refusing update from remote peer 141636b82a7b4949931f25ce0a14addc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251023 07:58:09.973412 17869 consensus_queue.cc:1048] T f7dc54ff3f724e939f77ddaa796574c8 P 141636b82a7b4949931f25ce0a14addc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:58:09.980037 17856 raft_consensus.cc:993] T 51aacc3534884c92926b5d632a3e11f7 P a2ded24d2e7648649ddbe521d1dbd135: : Instructing follower 141636b82a7b4949931f25ce0a14addc to start an election
I20251023 07:58:09.980463 17872 raft_consensus.cc:1081] T 51aacc3534884c92926b5d632a3e11f7 P a2ded24d2e7648649ddbe521d1dbd135 [term 1 LEADER]: Signalling peer 141636b82a7b4949931f25ce0a14addc to start an election
I20251023 07:58:09.981855 17695 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "51aacc3534884c92926b5d632a3e11f7"
dest_uuid: "141636b82a7b4949931f25ce0a14addc"
from {username='slave'} at 127.0.0.1:35556
I20251023 07:58:09.982299 17695 raft_consensus.cc:493] T 51aacc3534884c92926b5d632a3e11f7 P 141636b82a7b4949931f25ce0a14addc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:58:09.982575 17695 raft_consensus.cc:3060] T 51aacc3534884c92926b5d632a3e11f7 P 141636b82a7b4949931f25ce0a14addc [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:58:09.987497 17695 raft_consensus.cc:515] T 51aacc3534884c92926b5d632a3e11f7 P 141636b82a7b4949931f25ce0a14addc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:09.988966 17695 leader_election.cc:290] T 51aacc3534884c92926b5d632a3e11f7 P 141636b82a7b4949931f25ce0a14addc [CANDIDATE]: Term 2 election: Requested vote from peers a2ded24d2e7648649ddbe521d1dbd135 (127.16.126.1:43887), a35e1d7a0f05466db4af95b208209620 (127.16.126.2:43007)
I20251023 07:58:09.989815 17547 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "51aacc3534884c92926b5d632a3e11f7" candidate_uuid: "141636b82a7b4949931f25ce0a14addc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a2ded24d2e7648649ddbe521d1dbd135"
I20251023 07:58:09.989986 17622 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "51aacc3534884c92926b5d632a3e11f7" candidate_uuid: "141636b82a7b4949931f25ce0a14addc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a35e1d7a0f05466db4af95b208209620"
I20251023 07:58:09.990311 17547 raft_consensus.cc:3055] T 51aacc3534884c92926b5d632a3e11f7 P a2ded24d2e7648649ddbe521d1dbd135 [term 1 LEADER]: Stepping down as leader of term 1
I20251023 07:58:09.990532 17622 raft_consensus.cc:3060] T 51aacc3534884c92926b5d632a3e11f7 P a35e1d7a0f05466db4af95b208209620 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:58:09.990640 17547 raft_consensus.cc:740] T 51aacc3534884c92926b5d632a3e11f7 P a2ded24d2e7648649ddbe521d1dbd135 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a2ded24d2e7648649ddbe521d1dbd135, State: Running, Role: LEADER
I20251023 07:58:09.991315 17547 consensus_queue.cc:260] T 51aacc3534884c92926b5d632a3e11f7 P a2ded24d2e7648649ddbe521d1dbd135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:09.992187 17547 raft_consensus.cc:3060] T 51aacc3534884c92926b5d632a3e11f7 P a2ded24d2e7648649ddbe521d1dbd135 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:58:09.995368 17622 raft_consensus.cc:2468] T 51aacc3534884c92926b5d632a3e11f7 P a35e1d7a0f05466db4af95b208209620 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 141636b82a7b4949931f25ce0a14addc in term 2.
I20251023 07:58:09.996436 17659 leader_election.cc:304] T 51aacc3534884c92926b5d632a3e11f7 P 141636b82a7b4949931f25ce0a14addc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 141636b82a7b4949931f25ce0a14addc, a35e1d7a0f05466db4af95b208209620; no voters:
I20251023 07:58:09.997267 17869 raft_consensus.cc:2804] T 51aacc3534884c92926b5d632a3e11f7 P 141636b82a7b4949931f25ce0a14addc [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:58:09.997195 17547 raft_consensus.cc:2468] T 51aacc3534884c92926b5d632a3e11f7 P a2ded24d2e7648649ddbe521d1dbd135 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 141636b82a7b4949931f25ce0a14addc in term 2.
I20251023 07:58:09.997884 17869 raft_consensus.cc:697] T 51aacc3534884c92926b5d632a3e11f7 P 141636b82a7b4949931f25ce0a14addc [term 2 LEADER]: Becoming Leader. State: Replica: 141636b82a7b4949931f25ce0a14addc, State: Running, Role: LEADER
I20251023 07:58:09.998653 17869 consensus_queue.cc:237] T 51aacc3534884c92926b5d632a3e11f7 P 141636b82a7b4949931f25ce0a14addc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:10.005131 17443 catalog_manager.cc:5649] T 51aacc3534884c92926b5d632a3e11f7 P 141636b82a7b4949931f25ce0a14addc reported cstate change: term changed from 1 to 2, leader changed from a2ded24d2e7648649ddbe521d1dbd135 (127.16.126.1) to 141636b82a7b4949931f25ce0a14addc (127.16.126.3). New cstate: current_term: 2 leader_uuid: "141636b82a7b4949931f25ce0a14addc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } health_report { overall_health: HEALTHY } } }
I20251023 07:58:10.431080 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:58:10.436733 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251023 07:58:10.437201 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 07:58:10.481252 17547 raft_consensus.cc:1275] T 51aacc3534884c92926b5d632a3e11f7 P a2ded24d2e7648649ddbe521d1dbd135 [term 2 FOLLOWER]: Refusing update from remote peer 141636b82a7b4949931f25ce0a14addc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:58:10.482429 17869 consensus_queue.cc:1048] T 51aacc3534884c92926b5d632a3e11f7 P 141636b82a7b4949931f25ce0a14addc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:58:10.491181 17622 raft_consensus.cc:1275] T 51aacc3534884c92926b5d632a3e11f7 P a35e1d7a0f05466db4af95b208209620 [term 2 FOLLOWER]: Refusing update from remote peer 141636b82a7b4949931f25ce0a14addc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:58:10.492816 17869 consensus_queue.cc:1048] T 51aacc3534884c92926b5d632a3e11f7 P 141636b82a7b4949931f25ce0a14addc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:58:11.438184 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:58:11.443858 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251023 07:58:11.444239 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 07:58:12.445515 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:58:12.451838 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251023 07:58:12.452222 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 07:58:13.453266 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:58:13.458493 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251023 07:58:13.458927 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 07:58:14.459825 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:58:14.465659 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251023 07:58:14.466076 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 07:58:15.467104 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:58:15.472707 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251023 07:58:15.473134 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 07:58:16.474046 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:58:16.479199 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251023 07:58:16.479650 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 07:58:17.480511 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:58:17.485783 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251023 07:58:17.486209 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 07:58:18.487071 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:58:18.492766 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251023 07:58:18.493202 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 07:58:19.523054 16888 auto_leader_rebalancer-test.cc:362] The leader distribution is
I20251023 07:58:19.527675 17696 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "f7dc54ff3f724e939f77ddaa796574c8"
dest_uuid: "141636b82a7b4949931f25ce0a14addc"
mode: GRACEFUL
new_leader_uuid: "a2ded24d2e7648649ddbe521d1dbd135"
from {username='slave'} at 127.0.0.1:51000
I20251023 07:58:19.528409 17696 raft_consensus.cc:606] T f7dc54ff3f724e939f77ddaa796574c8 P 141636b82a7b4949931f25ce0a14addc [term 3 LEADER]: Received request to transfer leadership to TS a2ded24d2e7648649ddbe521d1dbd135
I20251023 07:58:19.539160 17696 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "51aacc3534884c92926b5d632a3e11f7"
dest_uuid: "141636b82a7b4949931f25ce0a14addc"
mode: GRACEFUL
new_leader_uuid: "a2ded24d2e7648649ddbe521d1dbd135"
from {username='slave'} at 127.0.0.1:51000
I20251023 07:58:19.539597 17696 raft_consensus.cc:606] T 51aacc3534884c92926b5d632a3e11f7 P 141636b82a7b4949931f25ce0a14addc [term 2 LEADER]: Received request to transfer leadership to TS a2ded24d2e7648649ddbe521d1dbd135
I20251023 07:58:19.546886 17621 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "b84678e61cb446c3b00429824b024d12"
dest_uuid: "a35e1d7a0f05466db4af95b208209620"
mode: GRACEFUL
new_leader_uuid: "a2ded24d2e7648649ddbe521d1dbd135"
from {username='slave'} at 127.0.0.1:49160
I20251023 07:58:19.547348 17621 raft_consensus.cc:606] T b84678e61cb446c3b00429824b024d12 P a35e1d7a0f05466db4af95b208209620 [term 2 LEADER]: Received request to transfer leadership to TS a2ded24d2e7648649ddbe521d1dbd135
I20251023 07:58:19.551821 17621 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "0524c60cf5404f1e99bef45655e8bd77"
dest_uuid: "a35e1d7a0f05466db4af95b208209620"
mode: GRACEFUL
new_leader_uuid: "a2ded24d2e7648649ddbe521d1dbd135"
from {username='slave'} at 127.0.0.1:49160
I20251023 07:58:19.552256 17621 raft_consensus.cc:606] T 0524c60cf5404f1e99bef45655e8bd77 P a35e1d7a0f05466db4af95b208209620 [term 2 LEADER]: Received request to transfer leadership to TS a2ded24d2e7648649ddbe521d1dbd135
I20251023 07:58:19.556352 17621 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "1ea153fe03884218bb2cf06c75d029c0"
dest_uuid: "a35e1d7a0f05466db4af95b208209620"
mode: GRACEFUL
new_leader_uuid: "a2ded24d2e7648649ddbe521d1dbd135"
from {username='slave'} at 127.0.0.1:49160
I20251023 07:58:19.556792 17621 raft_consensus.cc:606] T 1ea153fe03884218bb2cf06c75d029c0 P a35e1d7a0f05466db4af95b208209620 [term 2 LEADER]: Received request to transfer leadership to TS a2ded24d2e7648649ddbe521d1dbd135
I20251023 07:58:19.642868 17898 raft_consensus.cc:993] T 51aacc3534884c92926b5d632a3e11f7 P 141636b82a7b4949931f25ce0a14addc: : Instructing follower a2ded24d2e7648649ddbe521d1dbd135 to start an election
I20251023 07:58:19.643285 17898 raft_consensus.cc:1081] T 51aacc3534884c92926b5d632a3e11f7 P 141636b82a7b4949931f25ce0a14addc [term 2 LEADER]: Signalling peer a2ded24d2e7648649ddbe521d1dbd135 to start an election
I20251023 07:58:19.644955 17545 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "51aacc3534884c92926b5d632a3e11f7"
dest_uuid: "a2ded24d2e7648649ddbe521d1dbd135"
from {username='slave'} at 127.0.0.1:36630
I20251023 07:58:19.645501 17545 raft_consensus.cc:493] T 51aacc3534884c92926b5d632a3e11f7 P a2ded24d2e7648649ddbe521d1dbd135 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:58:19.645993 17545 raft_consensus.cc:3060] T 51aacc3534884c92926b5d632a3e11f7 P a2ded24d2e7648649ddbe521d1dbd135 [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:58:19.650230 17903 raft_consensus.cc:993] T 1ea153fe03884218bb2cf06c75d029c0 P a35e1d7a0f05466db4af95b208209620: : Instructing follower a2ded24d2e7648649ddbe521d1dbd135 to start an election
I20251023 07:58:19.650750 17900 raft_consensus.cc:1081] T 1ea153fe03884218bb2cf06c75d029c0 P a35e1d7a0f05466db4af95b208209620 [term 2 LEADER]: Signalling peer a2ded24d2e7648649ddbe521d1dbd135 to start an election
I20251023 07:58:19.652252 17547 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "1ea153fe03884218bb2cf06c75d029c0"
dest_uuid: "a2ded24d2e7648649ddbe521d1dbd135"
from {username='slave'} at 127.0.0.1:36638
I20251023 07:58:19.652652 17547 raft_consensus.cc:493] T 1ea153fe03884218bb2cf06c75d029c0 P a2ded24d2e7648649ddbe521d1dbd135 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:58:19.652889 17547 raft_consensus.cc:3060] T 1ea153fe03884218bb2cf06c75d029c0 P a2ded24d2e7648649ddbe521d1dbd135 [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:58:19.652943 17545 raft_consensus.cc:515] T 51aacc3534884c92926b5d632a3e11f7 P a2ded24d2e7648649ddbe521d1dbd135 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:19.655395 17545 leader_election.cc:290] T 51aacc3534884c92926b5d632a3e11f7 P a2ded24d2e7648649ddbe521d1dbd135 [CANDIDATE]: Term 3 election: Requested vote from peers a35e1d7a0f05466db4af95b208209620 (127.16.126.2:43007), 141636b82a7b4949931f25ce0a14addc (127.16.126.3:42717)
I20251023 07:58:19.656118 17621 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "51aacc3534884c92926b5d632a3e11f7" candidate_uuid: "a2ded24d2e7648649ddbe521d1dbd135" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a35e1d7a0f05466db4af95b208209620"
I20251023 07:58:19.656512 17696 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "51aacc3534884c92926b5d632a3e11f7" candidate_uuid: "a2ded24d2e7648649ddbe521d1dbd135" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "141636b82a7b4949931f25ce0a14addc"
I20251023 07:58:19.656827 17621 raft_consensus.cc:3060] T 51aacc3534884c92926b5d632a3e11f7 P a35e1d7a0f05466db4af95b208209620 [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:58:19.657032 17696 raft_consensus.cc:3055] T 51aacc3534884c92926b5d632a3e11f7 P 141636b82a7b4949931f25ce0a14addc [term 2 LEADER]: Stepping down as leader of term 2
I20251023 07:58:19.657346 17696 raft_consensus.cc:740] T 51aacc3534884c92926b5d632a3e11f7 P 141636b82a7b4949931f25ce0a14addc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 141636b82a7b4949931f25ce0a14addc, State: Running, Role: LEADER
I20251023 07:58:19.658564 17547 raft_consensus.cc:515] T 1ea153fe03884218bb2cf06c75d029c0 P a2ded24d2e7648649ddbe521d1dbd135 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:19.658325 17696 consensus_queue.cc:260] T 51aacc3534884c92926b5d632a3e11f7 P 141636b82a7b4949931f25ce0a14addc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:19.659557 17696 raft_consensus.cc:3060] T 51aacc3534884c92926b5d632a3e11f7 P 141636b82a7b4949931f25ce0a14addc [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:58:19.660001 17547 leader_election.cc:290] T 1ea153fe03884218bb2cf06c75d029c0 P a2ded24d2e7648649ddbe521d1dbd135 [CANDIDATE]: Term 3 election: Requested vote from peers a35e1d7a0f05466db4af95b208209620 (127.16.126.2:43007), 141636b82a7b4949931f25ce0a14addc (127.16.126.3:42717)
I20251023 07:58:19.660820 17622 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1ea153fe03884218bb2cf06c75d029c0" candidate_uuid: "a2ded24d2e7648649ddbe521d1dbd135" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a35e1d7a0f05466db4af95b208209620"
I20251023 07:58:19.661089 17695 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1ea153fe03884218bb2cf06c75d029c0" candidate_uuid: "a2ded24d2e7648649ddbe521d1dbd135" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "141636b82a7b4949931f25ce0a14addc"
I20251023 07:58:19.661396 17622 raft_consensus.cc:3055] T 1ea153fe03884218bb2cf06c75d029c0 P a35e1d7a0f05466db4af95b208209620 [term 2 LEADER]: Stepping down as leader of term 2
I20251023 07:58:19.661586 17695 raft_consensus.cc:3060] T 1ea153fe03884218bb2cf06c75d029c0 P 141636b82a7b4949931f25ce0a14addc [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:58:19.661777 17622 raft_consensus.cc:740] T 1ea153fe03884218bb2cf06c75d029c0 P a35e1d7a0f05466db4af95b208209620 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a35e1d7a0f05466db4af95b208209620, State: Running, Role: LEADER
I20251023 07:58:19.662945 17622 consensus_queue.cc:260] T 1ea153fe03884218bb2cf06c75d029c0 P a35e1d7a0f05466db4af95b208209620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:19.664367 17622 raft_consensus.cc:3060] T 1ea153fe03884218bb2cf06c75d029c0 P a35e1d7a0f05466db4af95b208209620 [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:58:19.667551 17695 raft_consensus.cc:2468] T 1ea153fe03884218bb2cf06c75d029c0 P 141636b82a7b4949931f25ce0a14addc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2ded24d2e7648649ddbe521d1dbd135 in term 3.
I20251023 07:58:19.668756 17512 leader_election.cc:304] T 1ea153fe03884218bb2cf06c75d029c0 P a2ded24d2e7648649ddbe521d1dbd135 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 141636b82a7b4949931f25ce0a14addc, a2ded24d2e7648649ddbe521d1dbd135; no voters:
I20251023 07:58:19.671267 17895 raft_consensus.cc:2804] T 1ea153fe03884218bb2cf06c75d029c0 P a2ded24d2e7648649ddbe521d1dbd135 [term 3 FOLLOWER]: Leader election won for term 3
I20251023 07:58:19.671782 17622 raft_consensus.cc:2468] T 1ea153fe03884218bb2cf06c75d029c0 P a35e1d7a0f05466db4af95b208209620 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2ded24d2e7648649ddbe521d1dbd135 in term 3.
I20251023 07:58:19.671794 17895 raft_consensus.cc:697] T 1ea153fe03884218bb2cf06c75d029c0 P a2ded24d2e7648649ddbe521d1dbd135 [term 3 LEADER]: Becoming Leader. State: Replica: a2ded24d2e7648649ddbe521d1dbd135, State: Running, Role: LEADER
I20251023 07:58:19.674319 17895 consensus_queue.cc:237] T 1ea153fe03884218bb2cf06c75d029c0 P a2ded24d2e7648649ddbe521d1dbd135 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:19.674978 17900 raft_consensus.cc:993] T 0524c60cf5404f1e99bef45655e8bd77 P a35e1d7a0f05466db4af95b208209620: : Instructing follower a2ded24d2e7648649ddbe521d1dbd135 to start an election
I20251023 07:58:19.675283 17696 raft_consensus.cc:2468] T 51aacc3534884c92926b5d632a3e11f7 P 141636b82a7b4949931f25ce0a14addc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2ded24d2e7648649ddbe521d1dbd135 in term 3.
I20251023 07:58:19.677273 17621 raft_consensus.cc:2468] T 51aacc3534884c92926b5d632a3e11f7 P a35e1d7a0f05466db4af95b208209620 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2ded24d2e7648649ddbe521d1dbd135 in term 3.
I20251023 07:58:19.678192 17900 raft_consensus.cc:1081] T 0524c60cf5404f1e99bef45655e8bd77 P a35e1d7a0f05466db4af95b208209620 [term 2 LEADER]: Signalling peer a2ded24d2e7648649ddbe521d1dbd135 to start an election
I20251023 07:58:19.681257 17547 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "0524c60cf5404f1e99bef45655e8bd77"
dest_uuid: "a2ded24d2e7648649ddbe521d1dbd135"
from {username='slave'} at 127.0.0.1:36638
I20251023 07:58:19.680857 17512 leader_election.cc:304] T 51aacc3534884c92926b5d632a3e11f7 P a2ded24d2e7648649ddbe521d1dbd135 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 141636b82a7b4949931f25ce0a14addc, a2ded24d2e7648649ddbe521d1dbd135; no voters:
I20251023 07:58:19.681902 17547 raft_consensus.cc:493] T 0524c60cf5404f1e99bef45655e8bd77 P a2ded24d2e7648649ddbe521d1dbd135 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:58:19.682330 17547 raft_consensus.cc:3060] T 0524c60cf5404f1e99bef45655e8bd77 P a2ded24d2e7648649ddbe521d1dbd135 [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:58:19.683019 17904 raft_consensus.cc:2804] T 51aacc3534884c92926b5d632a3e11f7 P a2ded24d2e7648649ddbe521d1dbd135 [term 3 FOLLOWER]: Leader election won for term 3
I20251023 07:58:19.690243 17904 raft_consensus.cc:697] T 51aacc3534884c92926b5d632a3e11f7 P a2ded24d2e7648649ddbe521d1dbd135 [term 3 LEADER]: Becoming Leader. State: Replica: a2ded24d2e7648649ddbe521d1dbd135, State: Running, Role: LEADER
I20251023 07:58:19.691329 17547 raft_consensus.cc:515] T 0524c60cf5404f1e99bef45655e8bd77 P a2ded24d2e7648649ddbe521d1dbd135 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:19.691345 17904 consensus_queue.cc:237] T 51aacc3534884c92926b5d632a3e11f7 P a2ded24d2e7648649ddbe521d1dbd135 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:19.693265 17547 leader_election.cc:290] T 0524c60cf5404f1e99bef45655e8bd77 P a2ded24d2e7648649ddbe521d1dbd135 [CANDIDATE]: Term 3 election: Requested vote from peers a35e1d7a0f05466db4af95b208209620 (127.16.126.2:43007), 141636b82a7b4949931f25ce0a14addc (127.16.126.3:42717)
I20251023 07:58:19.692906 17444 catalog_manager.cc:5649] T 1ea153fe03884218bb2cf06c75d029c0 P a2ded24d2e7648649ddbe521d1dbd135 reported cstate change: term changed from 2 to 3, leader changed from a35e1d7a0f05466db4af95b208209620 (127.16.126.2) to a2ded24d2e7648649ddbe521d1dbd135 (127.16.126.1). New cstate: current_term: 3 leader_uuid: "a2ded24d2e7648649ddbe521d1dbd135" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } health_report { overall_health: UNKNOWN } } }
I20251023 07:58:19.694242 17696 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0524c60cf5404f1e99bef45655e8bd77" candidate_uuid: "a2ded24d2e7648649ddbe521d1dbd135" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "141636b82a7b4949931f25ce0a14addc"
I20251023 07:58:19.694792 17696 raft_consensus.cc:3060] T 0524c60cf5404f1e99bef45655e8bd77 P 141636b82a7b4949931f25ce0a14addc [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:58:19.694242 17621 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0524c60cf5404f1e99bef45655e8bd77" candidate_uuid: "a2ded24d2e7648649ddbe521d1dbd135" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a35e1d7a0f05466db4af95b208209620"
I20251023 07:58:19.698284 17621 raft_consensus.cc:3055] T 0524c60cf5404f1e99bef45655e8bd77 P a35e1d7a0f05466db4af95b208209620 [term 2 LEADER]: Stepping down as leader of term 2
I20251023 07:58:19.698664 17621 raft_consensus.cc:740] T 0524c60cf5404f1e99bef45655e8bd77 P a35e1d7a0f05466db4af95b208209620 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a35e1d7a0f05466db4af95b208209620, State: Running, Role: LEADER
I20251023 07:58:19.699705 17621 consensus_queue.cc:260] T 0524c60cf5404f1e99bef45655e8bd77 P a35e1d7a0f05466db4af95b208209620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:19.701406 17621 raft_consensus.cc:3060] T 0524c60cf5404f1e99bef45655e8bd77 P a35e1d7a0f05466db4af95b208209620 [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:58:19.703869 17696 raft_consensus.cc:2468] T 0524c60cf5404f1e99bef45655e8bd77 P 141636b82a7b4949931f25ce0a14addc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2ded24d2e7648649ddbe521d1dbd135 in term 3.
I20251023 07:58:19.705543 17512 leader_election.cc:304] T 0524c60cf5404f1e99bef45655e8bd77 P a2ded24d2e7648649ddbe521d1dbd135 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 141636b82a7b4949931f25ce0a14addc, a2ded24d2e7648649ddbe521d1dbd135; no voters:
I20251023 07:58:19.707013 17907 raft_consensus.cc:2804] T 0524c60cf5404f1e99bef45655e8bd77 P a2ded24d2e7648649ddbe521d1dbd135 [term 3 FOLLOWER]: Leader election won for term 3
I20251023 07:58:19.707696 17907 raft_consensus.cc:697] T 0524c60cf5404f1e99bef45655e8bd77 P a2ded24d2e7648649ddbe521d1dbd135 [term 3 LEADER]: Becoming Leader. State: Replica: a2ded24d2e7648649ddbe521d1dbd135, State: Running, Role: LEADER
I20251023 07:58:19.708930 17907 consensus_queue.cc:237] T 0524c60cf5404f1e99bef45655e8bd77 P a2ded24d2e7648649ddbe521d1dbd135 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:19.711776 17621 raft_consensus.cc:2468] T 0524c60cf5404f1e99bef45655e8bd77 P a35e1d7a0f05466db4af95b208209620 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2ded24d2e7648649ddbe521d1dbd135 in term 3.
I20251023 07:58:19.729758 17444 catalog_manager.cc:5649] T 51aacc3534884c92926b5d632a3e11f7 P a2ded24d2e7648649ddbe521d1dbd135 reported cstate change: term changed from 2 to 3, leader changed from 141636b82a7b4949931f25ce0a14addc (127.16.126.3) to a2ded24d2e7648649ddbe521d1dbd135 (127.16.126.1). New cstate: current_term: 3 leader_uuid: "a2ded24d2e7648649ddbe521d1dbd135" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } health_report { overall_health: UNKNOWN } } }
I20251023 07:58:19.731060 17444 catalog_manager.cc:5649] T 0524c60cf5404f1e99bef45655e8bd77 P a2ded24d2e7648649ddbe521d1dbd135 reported cstate change: term changed from 2 to 3, leader changed from a35e1d7a0f05466db4af95b208209620 (127.16.126.2) to a2ded24d2e7648649ddbe521d1dbd135 (127.16.126.1). New cstate: current_term: 3 leader_uuid: "a2ded24d2e7648649ddbe521d1dbd135" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } health_report { overall_health: UNKNOWN } } }
I20251023 07:58:19.751099 17902 raft_consensus.cc:993] T f7dc54ff3f724e939f77ddaa796574c8 P 141636b82a7b4949931f25ce0a14addc: : Instructing follower a2ded24d2e7648649ddbe521d1dbd135 to start an election
I20251023 07:58:19.751538 17898 raft_consensus.cc:1081] T f7dc54ff3f724e939f77ddaa796574c8 P 141636b82a7b4949931f25ce0a14addc [term 3 LEADER]: Signalling peer a2ded24d2e7648649ddbe521d1dbd135 to start an election
I20251023 07:58:19.752911 17547 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "f7dc54ff3f724e939f77ddaa796574c8"
dest_uuid: "a2ded24d2e7648649ddbe521d1dbd135"
from {username='slave'} at 127.0.0.1:36630
I20251023 07:58:19.753304 17547 raft_consensus.cc:493] T f7dc54ff3f724e939f77ddaa796574c8 P a2ded24d2e7648649ddbe521d1dbd135 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:58:19.753556 17547 raft_consensus.cc:3060] T f7dc54ff3f724e939f77ddaa796574c8 P a2ded24d2e7648649ddbe521d1dbd135 [term 3 FOLLOWER]: Advancing to term 4
I20251023 07:58:19.758050 17547 raft_consensus.cc:515] T f7dc54ff3f724e939f77ddaa796574c8 P a2ded24d2e7648649ddbe521d1dbd135 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } }
I20251023 07:58:19.759357 17547 leader_election.cc:290] T f7dc54ff3f724e939f77ddaa796574c8 P a2ded24d2e7648649ddbe521d1dbd135 [CANDIDATE]: Term 4 election: Requested vote from peers 141636b82a7b4949931f25ce0a14addc (127.16.126.3:42717), a35e1d7a0f05466db4af95b208209620 (127.16.126.2:43007)
I20251023 07:58:19.760247 17696 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f7dc54ff3f724e939f77ddaa796574c8" candidate_uuid: "a2ded24d2e7648649ddbe521d1dbd135" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "141636b82a7b4949931f25ce0a14addc"
I20251023 07:58:19.760355 17621 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f7dc54ff3f724e939f77ddaa796574c8" candidate_uuid: "a2ded24d2e7648649ddbe521d1dbd135" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a35e1d7a0f05466db4af95b208209620"
I20251023 07:58:19.760716 17696 raft_consensus.cc:3055] T f7dc54ff3f724e939f77ddaa796574c8 P 141636b82a7b4949931f25ce0a14addc [term 3 LEADER]: Stepping down as leader of term 3
I20251023 07:58:19.760836 17621 raft_consensus.cc:3060] T f7dc54ff3f724e939f77ddaa796574c8 P a35e1d7a0f05466db4af95b208209620 [term 3 FOLLOWER]: Advancing to term 4
I20251023 07:58:19.760980 17696 raft_consensus.cc:740] T f7dc54ff3f724e939f77ddaa796574c8 P 141636b82a7b4949931f25ce0a14addc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 141636b82a7b4949931f25ce0a14addc, State: Running, Role: LEADER
I20251023 07:58:19.761667 17696 consensus_queue.cc:260] T f7dc54ff3f724e939f77ddaa796574c8 P 141636b82a7b4949931f25ce0a14addc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } }
I20251023 07:58:19.762518 17696 raft_consensus.cc:3060] T f7dc54ff3f724e939f77ddaa796574c8 P 141636b82a7b4949931f25ce0a14addc [term 3 FOLLOWER]: Advancing to term 4
I20251023 07:58:19.765318 17621 raft_consensus.cc:2468] T f7dc54ff3f724e939f77ddaa796574c8 P a35e1d7a0f05466db4af95b208209620 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2ded24d2e7648649ddbe521d1dbd135 in term 4.
I20251023 07:58:19.766487 17510 leader_election.cc:304] T f7dc54ff3f724e939f77ddaa796574c8 P a2ded24d2e7648649ddbe521d1dbd135 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2ded24d2e7648649ddbe521d1dbd135, a35e1d7a0f05466db4af95b208209620; no voters:
I20251023 07:58:19.766914 17696 raft_consensus.cc:2468] T f7dc54ff3f724e939f77ddaa796574c8 P 141636b82a7b4949931f25ce0a14addc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2ded24d2e7648649ddbe521d1dbd135 in term 4.
I20251023 07:58:19.767150 17907 raft_consensus.cc:2804] T f7dc54ff3f724e939f77ddaa796574c8 P a2ded24d2e7648649ddbe521d1dbd135 [term 4 FOLLOWER]: Leader election won for term 4
I20251023 07:58:19.767647 17907 raft_consensus.cc:697] T f7dc54ff3f724e939f77ddaa796574c8 P a2ded24d2e7648649ddbe521d1dbd135 [term 4 LEADER]: Becoming Leader. State: Replica: a2ded24d2e7648649ddbe521d1dbd135, State: Running, Role: LEADER
I20251023 07:58:19.768491 17907 consensus_queue.cc:237] T f7dc54ff3f724e939f77ddaa796574c8 P a2ded24d2e7648649ddbe521d1dbd135 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } }
I20251023 07:58:19.774785 17444 catalog_manager.cc:5649] T f7dc54ff3f724e939f77ddaa796574c8 P a2ded24d2e7648649ddbe521d1dbd135 reported cstate change: term changed from 3 to 4, leader changed from 141636b82a7b4949931f25ce0a14addc (127.16.126.3) to a2ded24d2e7648649ddbe521d1dbd135 (127.16.126.1). New cstate: current_term: 4 leader_uuid: "a2ded24d2e7648649ddbe521d1dbd135" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } health_report { overall_health: HEALTHY } } }
I20251023 07:58:19.865316 17903 raft_consensus.cc:993] T b84678e61cb446c3b00429824b024d12 P a35e1d7a0f05466db4af95b208209620: : Instructing follower a2ded24d2e7648649ddbe521d1dbd135 to start an election
I20251023 07:58:19.865811 17900 raft_consensus.cc:1081] T b84678e61cb446c3b00429824b024d12 P a35e1d7a0f05466db4af95b208209620 [term 2 LEADER]: Signalling peer a2ded24d2e7648649ddbe521d1dbd135 to start an election
I20251023 07:58:19.867079 17547 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "b84678e61cb446c3b00429824b024d12"
dest_uuid: "a2ded24d2e7648649ddbe521d1dbd135"
from {username='slave'} at 127.0.0.1:36638
I20251023 07:58:19.867509 17547 raft_consensus.cc:493] T b84678e61cb446c3b00429824b024d12 P a2ded24d2e7648649ddbe521d1dbd135 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:58:19.867758 17547 raft_consensus.cc:3060] T b84678e61cb446c3b00429824b024d12 P a2ded24d2e7648649ddbe521d1dbd135 [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:58:19.871924 17547 raft_consensus.cc:515] T b84678e61cb446c3b00429824b024d12 P a2ded24d2e7648649ddbe521d1dbd135 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:19.873246 17547 leader_election.cc:290] T b84678e61cb446c3b00429824b024d12 P a2ded24d2e7648649ddbe521d1dbd135 [CANDIDATE]: Term 3 election: Requested vote from peers a35e1d7a0f05466db4af95b208209620 (127.16.126.2:43007), 141636b82a7b4949931f25ce0a14addc (127.16.126.3:42717)
I20251023 07:58:19.874207 17696 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b84678e61cb446c3b00429824b024d12" candidate_uuid: "a2ded24d2e7648649ddbe521d1dbd135" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "141636b82a7b4949931f25ce0a14addc"
I20251023 07:58:19.874171 17621 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b84678e61cb446c3b00429824b024d12" candidate_uuid: "a2ded24d2e7648649ddbe521d1dbd135" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a35e1d7a0f05466db4af95b208209620"
I20251023 07:58:19.874831 17696 raft_consensus.cc:3060] T b84678e61cb446c3b00429824b024d12 P 141636b82a7b4949931f25ce0a14addc [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:58:19.874883 17621 raft_consensus.cc:3055] T b84678e61cb446c3b00429824b024d12 P a35e1d7a0f05466db4af95b208209620 [term 2 LEADER]: Stepping down as leader of term 2
I20251023 07:58:19.875258 17621 raft_consensus.cc:740] T b84678e61cb446c3b00429824b024d12 P a35e1d7a0f05466db4af95b208209620 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a35e1d7a0f05466db4af95b208209620, State: Running, Role: LEADER
I20251023 07:58:19.876013 17621 consensus_queue.cc:260] T b84678e61cb446c3b00429824b024d12 P a35e1d7a0f05466db4af95b208209620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:19.877219 17621 raft_consensus.cc:3060] T b84678e61cb446c3b00429824b024d12 P a35e1d7a0f05466db4af95b208209620 [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:58:19.881821 17696 raft_consensus.cc:2468] T b84678e61cb446c3b00429824b024d12 P 141636b82a7b4949931f25ce0a14addc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2ded24d2e7648649ddbe521d1dbd135 in term 3.
I20251023 07:58:19.882886 17512 leader_election.cc:304] T b84678e61cb446c3b00429824b024d12 P a2ded24d2e7648649ddbe521d1dbd135 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 141636b82a7b4949931f25ce0a14addc, a2ded24d2e7648649ddbe521d1dbd135; no voters:
I20251023 07:58:19.883258 17621 raft_consensus.cc:2468] T b84678e61cb446c3b00429824b024d12 P a35e1d7a0f05466db4af95b208209620 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2ded24d2e7648649ddbe521d1dbd135 in term 3.
I20251023 07:58:19.883579 17907 raft_consensus.cc:2804] T b84678e61cb446c3b00429824b024d12 P a2ded24d2e7648649ddbe521d1dbd135 [term 3 FOLLOWER]: Leader election won for term 3
I20251023 07:58:19.884044 17907 raft_consensus.cc:697] T b84678e61cb446c3b00429824b024d12 P a2ded24d2e7648649ddbe521d1dbd135 [term 3 LEADER]: Becoming Leader. State: Replica: a2ded24d2e7648649ddbe521d1dbd135, State: Running, Role: LEADER
I20251023 07:58:19.884868 17907 consensus_queue.cc:237] T b84678e61cb446c3b00429824b024d12 P a2ded24d2e7648649ddbe521d1dbd135 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:19.891063 17444 catalog_manager.cc:5649] T b84678e61cb446c3b00429824b024d12 P a2ded24d2e7648649ddbe521d1dbd135 reported cstate change: term changed from 2 to 3, leader changed from a35e1d7a0f05466db4af95b208209620 (127.16.126.2) to a2ded24d2e7648649ddbe521d1dbd135 (127.16.126.1). New cstate: current_term: 3 leader_uuid: "a2ded24d2e7648649ddbe521d1dbd135" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } health_report { overall_health: UNKNOWN } } }
I20251023 07:58:20.168534 17621 raft_consensus.cc:1275] T 51aacc3534884c92926b5d632a3e11f7 P a35e1d7a0f05466db4af95b208209620 [term 3 FOLLOWER]: Refusing update from remote peer a2ded24d2e7648649ddbe521d1dbd135: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251023 07:58:20.169754 17904 consensus_queue.cc:1048] T 51aacc3534884c92926b5d632a3e11f7 P a2ded24d2e7648649ddbe521d1dbd135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:58:20.181499 17696 raft_consensus.cc:1275] T 51aacc3534884c92926b5d632a3e11f7 P 141636b82a7b4949931f25ce0a14addc [term 3 FOLLOWER]: Refusing update from remote peer a2ded24d2e7648649ddbe521d1dbd135: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251023 07:58:20.183058 17904 consensus_queue.cc:1048] T 51aacc3534884c92926b5d632a3e11f7 P a2ded24d2e7648649ddbe521d1dbd135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:58:20.206557 17696 raft_consensus.cc:1275] T 0524c60cf5404f1e99bef45655e8bd77 P 141636b82a7b4949931f25ce0a14addc [term 3 FOLLOWER]: Refusing update from remote peer a2ded24d2e7648649ddbe521d1dbd135: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251023 07:58:20.207720 17904 consensus_queue.cc:1048] T 0524c60cf5404f1e99bef45655e8bd77 P a2ded24d2e7648649ddbe521d1dbd135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:58:20.217150 17621 raft_consensus.cc:1275] T 0524c60cf5404f1e99bef45655e8bd77 P a35e1d7a0f05466db4af95b208209620 [term 3 FOLLOWER]: Refusing update from remote peer a2ded24d2e7648649ddbe521d1dbd135: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251023 07:58:20.218870 17895 consensus_queue.cc:1048] T 0524c60cf5404f1e99bef45655e8bd77 P a2ded24d2e7648649ddbe521d1dbd135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:58:20.250290 17621 raft_consensus.cc:1275] T 1ea153fe03884218bb2cf06c75d029c0 P a35e1d7a0f05466db4af95b208209620 [term 3 FOLLOWER]: Refusing update from remote peer a2ded24d2e7648649ddbe521d1dbd135: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251023 07:58:20.251355 17895 consensus_queue.cc:1048] T 1ea153fe03884218bb2cf06c75d029c0 P a2ded24d2e7648649ddbe521d1dbd135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:58:20.259754 17696 raft_consensus.cc:1275] T 1ea153fe03884218bb2cf06c75d029c0 P 141636b82a7b4949931f25ce0a14addc [term 3 FOLLOWER]: Refusing update from remote peer a2ded24d2e7648649ddbe521d1dbd135: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251023 07:58:20.261473 17904 consensus_queue.cc:1048] T 1ea153fe03884218bb2cf06c75d029c0 P a2ded24d2e7648649ddbe521d1dbd135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:58:20.293047 17621 raft_consensus.cc:1275] T f7dc54ff3f724e939f77ddaa796574c8 P a35e1d7a0f05466db4af95b208209620 [term 4 FOLLOWER]: Refusing update from remote peer a2ded24d2e7648649ddbe521d1dbd135: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20251023 07:58:20.294166 17904 consensus_queue.cc:1048] T f7dc54ff3f724e939f77ddaa796574c8 P a2ded24d2e7648649ddbe521d1dbd135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:58:20.302315 17696 raft_consensus.cc:1275] T f7dc54ff3f724e939f77ddaa796574c8 P 141636b82a7b4949931f25ce0a14addc [term 4 FOLLOWER]: Refusing update from remote peer a2ded24d2e7648649ddbe521d1dbd135: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20251023 07:58:20.303776 17907 consensus_queue.cc:1048] T f7dc54ff3f724e939f77ddaa796574c8 P a2ded24d2e7648649ddbe521d1dbd135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:58:20.407119 17696 raft_consensus.cc:1275] T b84678e61cb446c3b00429824b024d12 P 141636b82a7b4949931f25ce0a14addc [term 3 FOLLOWER]: Refusing update from remote peer a2ded24d2e7648649ddbe521d1dbd135: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251023 07:58:20.408375 17907 consensus_queue.cc:1048] T b84678e61cb446c3b00429824b024d12 P a2ded24d2e7648649ddbe521d1dbd135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:58:20.416095 17621 raft_consensus.cc:1275] T b84678e61cb446c3b00429824b024d12 P a35e1d7a0f05466db4af95b208209620 [term 3 FOLLOWER]: Refusing update from remote peer a2ded24d2e7648649ddbe521d1dbd135: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251023 07:58:20.417477 17922 consensus_queue.cc:1048] T b84678e61cb446c3b00429824b024d12 P a2ded24d2e7648649ddbe521d1dbd135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:58:22.592519 16888 auto_leader_rebalancer-test.cc:377] The leader distribution is
I20251023 07:58:22.593274 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:58:22.601054 17547 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "0524c60cf5404f1e99bef45655e8bd77"
dest_uuid: "a2ded24d2e7648649ddbe521d1dbd135"
mode: GRACEFUL
new_leader_uuid: "a35e1d7a0f05466db4af95b208209620"
from {username='slave'} at 127.0.0.1:41718
I20251023 07:58:22.601843 17547 raft_consensus.cc:606] T 0524c60cf5404f1e99bef45655e8bd77 P a2ded24d2e7648649ddbe521d1dbd135 [term 3 LEADER]: Received request to transfer leadership to TS a35e1d7a0f05466db4af95b208209620
I20251023 07:58:22.604619 17547 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "1d80e56f890b4b3f99fdd1940f40e0a0"
dest_uuid: "a2ded24d2e7648649ddbe521d1dbd135"
mode: GRACEFUL
new_leader_uuid: "141636b82a7b4949931f25ce0a14addc"
from {username='slave'} at 127.0.0.1:41718
I20251023 07:58:22.605055 17547 raft_consensus.cc:606] T 1d80e56f890b4b3f99fdd1940f40e0a0 P a2ded24d2e7648649ddbe521d1dbd135 [term 2 LEADER]: Received request to transfer leadership to TS 141636b82a7b4949931f25ce0a14addc
I20251023 07:58:22.607328 17547 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "65cb88497ea44c4a9ee9cc67ede9d318"
dest_uuid: "a2ded24d2e7648649ddbe521d1dbd135"
mode: GRACEFUL
new_leader_uuid: "a35e1d7a0f05466db4af95b208209620"
from {username='slave'} at 127.0.0.1:41718
I20251023 07:58:22.607874 17547 raft_consensus.cc:606] T 65cb88497ea44c4a9ee9cc67ede9d318 P a2ded24d2e7648649ddbe521d1dbd135 [term 2 LEADER]: Received request to transfer leadership to TS a35e1d7a0f05466db4af95b208209620
I20251023 07:58:22.610066 17547 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "f7dc54ff3f724e939f77ddaa796574c8"
dest_uuid: "a2ded24d2e7648649ddbe521d1dbd135"
mode: GRACEFUL
new_leader_uuid: "141636b82a7b4949931f25ce0a14addc"
from {username='slave'} at 127.0.0.1:41718
I20251023 07:58:22.610487 17547 raft_consensus.cc:606] T f7dc54ff3f724e939f77ddaa796574c8 P a2ded24d2e7648649ddbe521d1dbd135 [term 4 LEADER]: Received request to transfer leadership to TS 141636b82a7b4949931f25ce0a14addc
I20251023 07:58:22.611347 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 4
I20251023 07:58:22.611790 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 07:58:23.032272 17930 raft_consensus.cc:993] T 65cb88497ea44c4a9ee9cc67ede9d318 P a2ded24d2e7648649ddbe521d1dbd135: : Instructing follower a35e1d7a0f05466db4af95b208209620 to start an election
I20251023 07:58:23.032824 17895 raft_consensus.cc:1081] T 65cb88497ea44c4a9ee9cc67ede9d318 P a2ded24d2e7648649ddbe521d1dbd135 [term 2 LEADER]: Signalling peer a35e1d7a0f05466db4af95b208209620 to start an election
I20251023 07:58:23.034173 17621 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "65cb88497ea44c4a9ee9cc67ede9d318"
dest_uuid: "a35e1d7a0f05466db4af95b208209620"
from {username='slave'} at 127.0.0.1:60818
I20251023 07:58:23.034627 17621 raft_consensus.cc:493] T 65cb88497ea44c4a9ee9cc67ede9d318 P a35e1d7a0f05466db4af95b208209620 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:58:23.034933 17621 raft_consensus.cc:3060] T 65cb88497ea44c4a9ee9cc67ede9d318 P a35e1d7a0f05466db4af95b208209620 [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:58:23.040901 17621 raft_consensus.cc:515] T 65cb88497ea44c4a9ee9cc67ede9d318 P a35e1d7a0f05466db4af95b208209620 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:23.042919 17621 leader_election.cc:290] T 65cb88497ea44c4a9ee9cc67ede9d318 P a35e1d7a0f05466db4af95b208209620 [CANDIDATE]: Term 3 election: Requested vote from peers a2ded24d2e7648649ddbe521d1dbd135 (127.16.126.1:43887), 141636b82a7b4949931f25ce0a14addc (127.16.126.3:42717)
I20251023 07:58:23.044162 17696 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "65cb88497ea44c4a9ee9cc67ede9d318" candidate_uuid: "a35e1d7a0f05466db4af95b208209620" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "141636b82a7b4949931f25ce0a14addc"
I20251023 07:58:23.044729 17696 raft_consensus.cc:3060] T 65cb88497ea44c4a9ee9cc67ede9d318 P 141636b82a7b4949931f25ce0a14addc [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:58:23.043771 17547 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "65cb88497ea44c4a9ee9cc67ede9d318" candidate_uuid: "a35e1d7a0f05466db4af95b208209620" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a2ded24d2e7648649ddbe521d1dbd135"
I20251023 07:58:23.045253 17547 raft_consensus.cc:3055] T 65cb88497ea44c4a9ee9cc67ede9d318 P a2ded24d2e7648649ddbe521d1dbd135 [term 2 LEADER]: Stepping down as leader of term 2
I20251023 07:58:23.045648 17547 raft_consensus.cc:740] T 65cb88497ea44c4a9ee9cc67ede9d318 P a2ded24d2e7648649ddbe521d1dbd135 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a2ded24d2e7648649ddbe521d1dbd135, State: Running, Role: LEADER
I20251023 07:58:23.046492 17930 raft_consensus.cc:993] T 1d80e56f890b4b3f99fdd1940f40e0a0 P a2ded24d2e7648649ddbe521d1dbd135: : Instructing follower 141636b82a7b4949931f25ce0a14addc to start an election
I20251023 07:58:23.046464 17547 consensus_queue.cc:260] T 65cb88497ea44c4a9ee9cc67ede9d318 P a2ded24d2e7648649ddbe521d1dbd135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:23.047096 17895 raft_consensus.cc:1081] T 1d80e56f890b4b3f99fdd1940f40e0a0 P a2ded24d2e7648649ddbe521d1dbd135 [term 2 LEADER]: Signalling peer 141636b82a7b4949931f25ce0a14addc to start an election
I20251023 07:58:23.047859 17547 raft_consensus.cc:3060] T 65cb88497ea44c4a9ee9cc67ede9d318 P a2ded24d2e7648649ddbe521d1dbd135 [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:58:23.048803 17695 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "1d80e56f890b4b3f99fdd1940f40e0a0"
dest_uuid: "141636b82a7b4949931f25ce0a14addc"
from {username='slave'} at 127.0.0.1:35556
I20251023 07:58:23.049307 17695 raft_consensus.cc:493] T 1d80e56f890b4b3f99fdd1940f40e0a0 P 141636b82a7b4949931f25ce0a14addc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:58:23.049672 17695 raft_consensus.cc:3060] T 1d80e56f890b4b3f99fdd1940f40e0a0 P 141636b82a7b4949931f25ce0a14addc [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:58:23.052042 17696 raft_consensus.cc:2468] T 65cb88497ea44c4a9ee9cc67ede9d318 P 141636b82a7b4949931f25ce0a14addc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a35e1d7a0f05466db4af95b208209620 in term 3.
I20251023 07:58:23.053483 17587 leader_election.cc:304] T 65cb88497ea44c4a9ee9cc67ede9d318 P a35e1d7a0f05466db4af95b208209620 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 141636b82a7b4949931f25ce0a14addc, a35e1d7a0f05466db4af95b208209620; no voters:
I20251023 07:58:23.053802 17547 raft_consensus.cc:2468] T 65cb88497ea44c4a9ee9cc67ede9d318 P a2ded24d2e7648649ddbe521d1dbd135 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a35e1d7a0f05466db4af95b208209620 in term 3.
I20251023 07:58:23.054509 17900 raft_consensus.cc:2804] T 65cb88497ea44c4a9ee9cc67ede9d318 P a35e1d7a0f05466db4af95b208209620 [term 3 FOLLOWER]: Leader election won for term 3
I20251023 07:58:23.055601 17900 raft_consensus.cc:697] T 65cb88497ea44c4a9ee9cc67ede9d318 P a35e1d7a0f05466db4af95b208209620 [term 3 LEADER]: Becoming Leader. State: Replica: a35e1d7a0f05466db4af95b208209620, State: Running, Role: LEADER
I20251023 07:58:23.056381 17900 consensus_queue.cc:237] T 65cb88497ea44c4a9ee9cc67ede9d318 P a35e1d7a0f05466db4af95b208209620 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:23.056718 17695 raft_consensus.cc:515] T 1d80e56f890b4b3f99fdd1940f40e0a0 P 141636b82a7b4949931f25ce0a14addc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:23.058676 17695 leader_election.cc:290] T 1d80e56f890b4b3f99fdd1940f40e0a0 P 141636b82a7b4949931f25ce0a14addc [CANDIDATE]: Term 3 election: Requested vote from peers a2ded24d2e7648649ddbe521d1dbd135 (127.16.126.1:43887), a35e1d7a0f05466db4af95b208209620 (127.16.126.2:43007)
I20251023 07:58:23.059999 17621 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1d80e56f890b4b3f99fdd1940f40e0a0" candidate_uuid: "141636b82a7b4949931f25ce0a14addc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a35e1d7a0f05466db4af95b208209620"
I20251023 07:58:23.060108 17547 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1d80e56f890b4b3f99fdd1940f40e0a0" candidate_uuid: "141636b82a7b4949931f25ce0a14addc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a2ded24d2e7648649ddbe521d1dbd135"
I20251023 07:58:23.060590 17621 raft_consensus.cc:3060] T 1d80e56f890b4b3f99fdd1940f40e0a0 P a35e1d7a0f05466db4af95b208209620 [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:58:23.060941 17547 raft_consensus.cc:3055] T 1d80e56f890b4b3f99fdd1940f40e0a0 P a2ded24d2e7648649ddbe521d1dbd135 [term 2 LEADER]: Stepping down as leader of term 2
I20251023 07:58:23.061362 17547 raft_consensus.cc:740] T 1d80e56f890b4b3f99fdd1940f40e0a0 P a2ded24d2e7648649ddbe521d1dbd135 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a2ded24d2e7648649ddbe521d1dbd135, State: Running, Role: LEADER
I20251023 07:58:23.062345 17547 consensus_queue.cc:260] T 1d80e56f890b4b3f99fdd1940f40e0a0 P a2ded24d2e7648649ddbe521d1dbd135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:23.064014 17547 raft_consensus.cc:3060] T 1d80e56f890b4b3f99fdd1940f40e0a0 P a2ded24d2e7648649ddbe521d1dbd135 [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:58:23.067190 17621 raft_consensus.cc:2468] T 1d80e56f890b4b3f99fdd1940f40e0a0 P a35e1d7a0f05466db4af95b208209620 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 141636b82a7b4949931f25ce0a14addc in term 3.
I20251023 07:58:23.068363 17659 leader_election.cc:304] T 1d80e56f890b4b3f99fdd1940f40e0a0 P 141636b82a7b4949931f25ce0a14addc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 141636b82a7b4949931f25ce0a14addc, a35e1d7a0f05466db4af95b208209620; no voters:
I20251023 07:58:23.069181 17898 raft_consensus.cc:2804] T 1d80e56f890b4b3f99fdd1940f40e0a0 P 141636b82a7b4949931f25ce0a14addc [term 3 FOLLOWER]: Leader election won for term 3
I20251023 07:58:23.071277 17443 catalog_manager.cc:5649] T 65cb88497ea44c4a9ee9cc67ede9d318 P a35e1d7a0f05466db4af95b208209620 reported cstate change: term changed from 2 to 3, leader changed from a2ded24d2e7648649ddbe521d1dbd135 (127.16.126.1) to a35e1d7a0f05466db4af95b208209620 (127.16.126.2). New cstate: current_term: 3 leader_uuid: "a35e1d7a0f05466db4af95b208209620" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } health_report { overall_health: UNKNOWN } } }
I20251023 07:58:23.072077 17898 raft_consensus.cc:697] T 1d80e56f890b4b3f99fdd1940f40e0a0 P 141636b82a7b4949931f25ce0a14addc [term 3 LEADER]: Becoming Leader. State: Replica: 141636b82a7b4949931f25ce0a14addc, State: Running, Role: LEADER
I20251023 07:58:23.072069 17547 raft_consensus.cc:2468] T 1d80e56f890b4b3f99fdd1940f40e0a0 P a2ded24d2e7648649ddbe521d1dbd135 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 141636b82a7b4949931f25ce0a14addc in term 3.
I20251023 07:58:23.073418 17898 consensus_queue.cc:237] T 1d80e56f890b4b3f99fdd1940f40e0a0 P 141636b82a7b4949931f25ce0a14addc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:23.081634 17444 catalog_manager.cc:5649] T 1d80e56f890b4b3f99fdd1940f40e0a0 P 141636b82a7b4949931f25ce0a14addc reported cstate change: term changed from 2 to 3, leader changed from a2ded24d2e7648649ddbe521d1dbd135 (127.16.126.1) to 141636b82a7b4949931f25ce0a14addc (127.16.126.3). New cstate: current_term: 3 leader_uuid: "141636b82a7b4949931f25ce0a14addc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } health_report { overall_health: HEALTHY } } }
I20251023 07:58:23.090687 17930 raft_consensus.cc:993] T f7dc54ff3f724e939f77ddaa796574c8 P a2ded24d2e7648649ddbe521d1dbd135: : Instructing follower 141636b82a7b4949931f25ce0a14addc to start an election
I20251023 07:58:23.091095 17930 raft_consensus.cc:1081] T f7dc54ff3f724e939f77ddaa796574c8 P a2ded24d2e7648649ddbe521d1dbd135 [term 4 LEADER]: Signalling peer 141636b82a7b4949931f25ce0a14addc to start an election
I20251023 07:58:23.092520 17695 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "f7dc54ff3f724e939f77ddaa796574c8"
dest_uuid: "141636b82a7b4949931f25ce0a14addc"
from {username='slave'} at 127.0.0.1:35556
I20251023 07:58:23.092931 17695 raft_consensus.cc:493] T f7dc54ff3f724e939f77ddaa796574c8 P 141636b82a7b4949931f25ce0a14addc [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:58:23.093182 17695 raft_consensus.cc:3060] T f7dc54ff3f724e939f77ddaa796574c8 P 141636b82a7b4949931f25ce0a14addc [term 4 FOLLOWER]: Advancing to term 5
I20251023 07:58:23.097330 17695 raft_consensus.cc:515] T f7dc54ff3f724e939f77ddaa796574c8 P 141636b82a7b4949931f25ce0a14addc [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } }
I20251023 07:58:23.098587 17695 leader_election.cc:290] T f7dc54ff3f724e939f77ddaa796574c8 P 141636b82a7b4949931f25ce0a14addc [CANDIDATE]: Term 5 election: Requested vote from peers a35e1d7a0f05466db4af95b208209620 (127.16.126.2:43007), a2ded24d2e7648649ddbe521d1dbd135 (127.16.126.1:43887)
I20251023 07:58:23.099404 17621 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f7dc54ff3f724e939f77ddaa796574c8" candidate_uuid: "141636b82a7b4949931f25ce0a14addc" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "a35e1d7a0f05466db4af95b208209620"
I20251023 07:58:23.099587 17547 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f7dc54ff3f724e939f77ddaa796574c8" candidate_uuid: "141636b82a7b4949931f25ce0a14addc" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "a2ded24d2e7648649ddbe521d1dbd135"
I20251023 07:58:23.099838 17621 raft_consensus.cc:3060] T f7dc54ff3f724e939f77ddaa796574c8 P a35e1d7a0f05466db4af95b208209620 [term 4 FOLLOWER]: Advancing to term 5
I20251023 07:58:23.100050 17547 raft_consensus.cc:3055] T f7dc54ff3f724e939f77ddaa796574c8 P a2ded24d2e7648649ddbe521d1dbd135 [term 4 LEADER]: Stepping down as leader of term 4
I20251023 07:58:23.100325 17547 raft_consensus.cc:740] T f7dc54ff3f724e939f77ddaa796574c8 P a2ded24d2e7648649ddbe521d1dbd135 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a2ded24d2e7648649ddbe521d1dbd135, State: Running, Role: LEADER
I20251023 07:58:23.100992 17547 consensus_queue.cc:260] T f7dc54ff3f724e939f77ddaa796574c8 P a2ded24d2e7648649ddbe521d1dbd135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } }
I20251023 07:58:23.101912 17547 raft_consensus.cc:3060] T f7dc54ff3f724e939f77ddaa796574c8 P a2ded24d2e7648649ddbe521d1dbd135 [term 4 FOLLOWER]: Advancing to term 5
I20251023 07:58:23.104794 17621 raft_consensus.cc:2468] T f7dc54ff3f724e939f77ddaa796574c8 P a35e1d7a0f05466db4af95b208209620 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 141636b82a7b4949931f25ce0a14addc in term 5.
I20251023 07:58:23.105640 17659 leader_election.cc:304] T f7dc54ff3f724e939f77ddaa796574c8 P 141636b82a7b4949931f25ce0a14addc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 141636b82a7b4949931f25ce0a14addc, a35e1d7a0f05466db4af95b208209620; no voters:
I20251023 07:58:23.106230 17898 raft_consensus.cc:2804] T f7dc54ff3f724e939f77ddaa796574c8 P 141636b82a7b4949931f25ce0a14addc [term 5 FOLLOWER]: Leader election won for term 5
I20251023 07:58:23.106362 17547 raft_consensus.cc:2468] T f7dc54ff3f724e939f77ddaa796574c8 P a2ded24d2e7648649ddbe521d1dbd135 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 141636b82a7b4949931f25ce0a14addc in term 5.
I20251023 07:58:23.106634 17898 raft_consensus.cc:697] T f7dc54ff3f724e939f77ddaa796574c8 P 141636b82a7b4949931f25ce0a14addc [term 5 LEADER]: Becoming Leader. State: Replica: 141636b82a7b4949931f25ce0a14addc, State: Running, Role: LEADER
I20251023 07:58:23.107586 17898 consensus_queue.cc:237] T f7dc54ff3f724e939f77ddaa796574c8 P 141636b82a7b4949931f25ce0a14addc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } }
I20251023 07:58:23.113855 17444 catalog_manager.cc:5649] T f7dc54ff3f724e939f77ddaa796574c8 P 141636b82a7b4949931f25ce0a14addc reported cstate change: term changed from 4 to 5, leader changed from a2ded24d2e7648649ddbe521d1dbd135 (127.16.126.1) to 141636b82a7b4949931f25ce0a14addc (127.16.126.3). New cstate: current_term: 5 leader_uuid: "141636b82a7b4949931f25ce0a14addc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } health_report { overall_health: UNKNOWN } } }
I20251023 07:58:23.149361 17895 raft_consensus.cc:993] T 0524c60cf5404f1e99bef45655e8bd77 P a2ded24d2e7648649ddbe521d1dbd135: : Instructing follower a35e1d7a0f05466db4af95b208209620 to start an election
I20251023 07:58:23.149785 17930 raft_consensus.cc:1081] T 0524c60cf5404f1e99bef45655e8bd77 P a2ded24d2e7648649ddbe521d1dbd135 [term 3 LEADER]: Signalling peer a35e1d7a0f05466db4af95b208209620 to start an election
I20251023 07:58:23.151160 17621 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "0524c60cf5404f1e99bef45655e8bd77"
dest_uuid: "a35e1d7a0f05466db4af95b208209620"
from {username='slave'} at 127.0.0.1:60818
I20251023 07:58:23.151573 17621 raft_consensus.cc:493] T 0524c60cf5404f1e99bef45655e8bd77 P a35e1d7a0f05466db4af95b208209620 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:58:23.151839 17621 raft_consensus.cc:3060] T 0524c60cf5404f1e99bef45655e8bd77 P a35e1d7a0f05466db4af95b208209620 [term 3 FOLLOWER]: Advancing to term 4
I20251023 07:58:23.156733 17621 raft_consensus.cc:515] T 0524c60cf5404f1e99bef45655e8bd77 P a35e1d7a0f05466db4af95b208209620 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:23.158195 17621 leader_election.cc:290] T 0524c60cf5404f1e99bef45655e8bd77 P a35e1d7a0f05466db4af95b208209620 [CANDIDATE]: Term 4 election: Requested vote from peers a2ded24d2e7648649ddbe521d1dbd135 (127.16.126.1:43887), 141636b82a7b4949931f25ce0a14addc (127.16.126.3:42717)
I20251023 07:58:23.159080 17547 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0524c60cf5404f1e99bef45655e8bd77" candidate_uuid: "a35e1d7a0f05466db4af95b208209620" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a2ded24d2e7648649ddbe521d1dbd135"
I20251023 07:58:23.159230 17695 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0524c60cf5404f1e99bef45655e8bd77" candidate_uuid: "a35e1d7a0f05466db4af95b208209620" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "141636b82a7b4949931f25ce0a14addc"
I20251023 07:58:23.159595 17547 raft_consensus.cc:3055] T 0524c60cf5404f1e99bef45655e8bd77 P a2ded24d2e7648649ddbe521d1dbd135 [term 3 LEADER]: Stepping down as leader of term 3
I20251023 07:58:23.159690 17695 raft_consensus.cc:3060] T 0524c60cf5404f1e99bef45655e8bd77 P 141636b82a7b4949931f25ce0a14addc [term 3 FOLLOWER]: Advancing to term 4
I20251023 07:58:23.159879 17547 raft_consensus.cc:740] T 0524c60cf5404f1e99bef45655e8bd77 P a2ded24d2e7648649ddbe521d1dbd135 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a2ded24d2e7648649ddbe521d1dbd135, State: Running, Role: LEADER
I20251023 07:58:23.160493 17547 consensus_queue.cc:260] T 0524c60cf5404f1e99bef45655e8bd77 P a2ded24d2e7648649ddbe521d1dbd135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:23.161379 17547 raft_consensus.cc:3060] T 0524c60cf5404f1e99bef45655e8bd77 P a2ded24d2e7648649ddbe521d1dbd135 [term 3 FOLLOWER]: Advancing to term 4
I20251023 07:58:23.164284 17695 raft_consensus.cc:2468] T 0524c60cf5404f1e99bef45655e8bd77 P 141636b82a7b4949931f25ce0a14addc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a35e1d7a0f05466db4af95b208209620 in term 4.
I20251023 07:58:23.165213 17587 leader_election.cc:304] T 0524c60cf5404f1e99bef45655e8bd77 P a35e1d7a0f05466db4af95b208209620 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 141636b82a7b4949931f25ce0a14addc, a35e1d7a0f05466db4af95b208209620; no voters:
I20251023 07:58:23.165666 17547 raft_consensus.cc:2468] T 0524c60cf5404f1e99bef45655e8bd77 P a2ded24d2e7648649ddbe521d1dbd135 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a35e1d7a0f05466db4af95b208209620 in term 4.
I20251023 07:58:23.165937 17900 raft_consensus.cc:2804] T 0524c60cf5404f1e99bef45655e8bd77 P a35e1d7a0f05466db4af95b208209620 [term 4 FOLLOWER]: Leader election won for term 4
I20251023 07:58:23.166390 17900 raft_consensus.cc:697] T 0524c60cf5404f1e99bef45655e8bd77 P a35e1d7a0f05466db4af95b208209620 [term 4 LEADER]: Becoming Leader. State: Replica: a35e1d7a0f05466db4af95b208209620, State: Running, Role: LEADER
I20251023 07:58:23.167205 17900 consensus_queue.cc:237] T 0524c60cf5404f1e99bef45655e8bd77 P a35e1d7a0f05466db4af95b208209620 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } }
I20251023 07:58:23.174103 17444 catalog_manager.cc:5649] T 0524c60cf5404f1e99bef45655e8bd77 P a35e1d7a0f05466db4af95b208209620 reported cstate change: term changed from 3 to 4, leader changed from a2ded24d2e7648649ddbe521d1dbd135 (127.16.126.1) to a35e1d7a0f05466db4af95b208209620 (127.16.126.2). New cstate: current_term: 4 leader_uuid: "a35e1d7a0f05466db4af95b208209620" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 } health_report { overall_health: UNKNOWN } } }
I20251023 07:58:23.468243 17547 raft_consensus.cc:1275] T 65cb88497ea44c4a9ee9cc67ede9d318 P a2ded24d2e7648649ddbe521d1dbd135 [term 3 FOLLOWER]: Refusing update from remote peer a35e1d7a0f05466db4af95b208209620: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251023 07:58:23.469251 17900 consensus_queue.cc:1048] T 65cb88497ea44c4a9ee9cc67ede9d318 P a35e1d7a0f05466db4af95b208209620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:58:23.479961 17695 raft_consensus.cc:1275] T 65cb88497ea44c4a9ee9cc67ede9d318 P 141636b82a7b4949931f25ce0a14addc [term 3 FOLLOWER]: Refusing update from remote peer a35e1d7a0f05466db4af95b208209620: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251023 07:58:23.481208 17900 consensus_queue.cc:1048] T 65cb88497ea44c4a9ee9cc67ede9d318 P a35e1d7a0f05466db4af95b208209620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:58:23.510058 17621 raft_consensus.cc:1275] T f7dc54ff3f724e939f77ddaa796574c8 P a35e1d7a0f05466db4af95b208209620 [term 5 FOLLOWER]: Refusing update from remote peer 141636b82a7b4949931f25ce0a14addc: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20251023 07:58:23.511164 17898 consensus_queue.cc:1048] T f7dc54ff3f724e939f77ddaa796574c8 P 141636b82a7b4949931f25ce0a14addc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20251023 07:58:23.519796 17547 raft_consensus.cc:1275] T f7dc54ff3f724e939f77ddaa796574c8 P a2ded24d2e7648649ddbe521d1dbd135 [term 5 FOLLOWER]: Refusing update from remote peer 141636b82a7b4949931f25ce0a14addc: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20251023 07:58:23.521505 17934 consensus_queue.cc:1048] T f7dc54ff3f724e939f77ddaa796574c8 P 141636b82a7b4949931f25ce0a14addc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20251023 07:58:23.535838 17547 raft_consensus.cc:1275] T 1d80e56f890b4b3f99fdd1940f40e0a0 P a2ded24d2e7648649ddbe521d1dbd135 [term 3 FOLLOWER]: Refusing update from remote peer 141636b82a7b4949931f25ce0a14addc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251023 07:58:23.536929 17934 consensus_queue.cc:1048] T 1d80e56f890b4b3f99fdd1940f40e0a0 P 141636b82a7b4949931f25ce0a14addc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:58:23.541069 17621 raft_consensus.cc:1275] T 1d80e56f890b4b3f99fdd1940f40e0a0 P a35e1d7a0f05466db4af95b208209620 [term 3 FOLLOWER]: Refusing update from remote peer 141636b82a7b4949931f25ce0a14addc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251023 07:58:23.542333 17934 consensus_queue.cc:1048] T 1d80e56f890b4b3f99fdd1940f40e0a0 P 141636b82a7b4949931f25ce0a14addc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a35e1d7a0f05466db4af95b208209620" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:58:23.612671 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:58:23.617977 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251023 07:58:23.618430 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 07:58:23.730340 17695 raft_consensus.cc:1275] T 0524c60cf5404f1e99bef45655e8bd77 P 141636b82a7b4949931f25ce0a14addc [term 4 FOLLOWER]: Refusing update from remote peer a35e1d7a0f05466db4af95b208209620: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20251023 07:58:23.731490 17900 consensus_queue.cc:1048] T 0524c60cf5404f1e99bef45655e8bd77 P a35e1d7a0f05466db4af95b208209620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "141636b82a7b4949931f25ce0a14addc" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 42717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:58:23.740715 17547 raft_consensus.cc:1275] T 0524c60cf5404f1e99bef45655e8bd77 P a2ded24d2e7648649ddbe521d1dbd135 [term 4 FOLLOWER]: Refusing update from remote peer a35e1d7a0f05466db4af95b208209620: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20251023 07:58:23.742722 17932 consensus_queue.cc:1048] T 0524c60cf5404f1e99bef45655e8bd77 P a35e1d7a0f05466db4af95b208209620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2ded24d2e7648649ddbe521d1dbd135" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:58:24.619354 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:58:24.626212 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251023 07:58:24.626621 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 07:58:25.627544 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:58:25.632881 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251023 07:58:25.633318 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 07:58:26.634150 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:58:26.639343 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251023 07:58:26.639781 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 07:58:27.640640 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:58:27.645885 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251023 07:58:27.646250 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 07:58:28.647075 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:58:28.652676 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251023 07:58:28.653072 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 07:58:29.654040 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:58:29.659411 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251023 07:58:29.659857 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 07:58:30.693969 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:58:31.060750 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251023 07:58:31.061179 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
W20251023 07:58:31.436439 17476 debug-util.cc:398] Leaking SignalData structure 0x7b0800056520 after lost signal to thread 16891
W20251023 07:58:31.437254 17476 debug-util.cc:398] Leaking SignalData structure 0x7b0800056c00 after lost signal to thread 17479
W20251023 07:58:31.438166 17476 debug-util.cc:398] Leaking SignalData structure 0x7b08001f54a0 after lost signal to thread 17571
W20251023 07:58:31.439132 17476 debug-util.cc:398] Leaking SignalData structure 0x7b0800116980 after lost signal to thread 17646
W20251023 07:58:31.439982 17476 debug-util.cc:398] Leaking SignalData structure 0x7b080005a540 after lost signal to thread 17720
I20251023 07:58:32.063226 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:58:32.074698 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251023 07:58:32.075289 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 07:58:33.108019 16888 auto_leader_rebalancer-test.cc:388] The leader distribution is
I20251023 07:58:33.108668 16888 tablet_server.cc:178] TabletServer@127.16.126.1:0 shutting down...
W20251023 07:58:33.157660 17585 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 4 similar messages]
W20251023 07:58:33.161243 17585 consensus_peers.cc:597] T 65cb88497ea44c4a9ee9cc67ede9d318 P a35e1d7a0f05466db4af95b208209620 -> Peer a2ded24d2e7648649ddbe521d1dbd135 (127.16.126.1:43887): Couldn't send request to peer a2ded24d2e7648649ddbe521d1dbd135. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:58:33.170022 16888 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251023 07:58:33.170946 16888 tablet_replica.cc:333] T 51aacc3534884c92926b5d632a3e11f7 P a2ded24d2e7648649ddbe521d1dbd135: stopping tablet replica
I20251023 07:58:33.172013 16888 raft_consensus.cc:2243] T 51aacc3534884c92926b5d632a3e11f7 P a2ded24d2e7648649ddbe521d1dbd135 [term 3 LEADER]: Raft consensus shutting down.
I20251023 07:58:33.173403 16888 raft_consensus.cc:2272] T 51aacc3534884c92926b5d632a3e11f7 P a2ded24d2e7648649ddbe521d1dbd135 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:33.176357 16888 tablet_replica.cc:333] T 0524c60cf5404f1e99bef45655e8bd77 P a2ded24d2e7648649ddbe521d1dbd135: stopping tablet replica
I20251023 07:58:33.177196 16888 raft_consensus.cc:2243] T 0524c60cf5404f1e99bef45655e8bd77 P a2ded24d2e7648649ddbe521d1dbd135 [term 4 FOLLOWER]: Raft consensus shutting down.
I20251023 07:58:33.177804 16888 raft_consensus.cc:2272] T 0524c60cf5404f1e99bef45655e8bd77 P a2ded24d2e7648649ddbe521d1dbd135 [term 4 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:33.180701 16888 tablet_replica.cc:333] T 1d80e56f890b4b3f99fdd1940f40e0a0 P a2ded24d2e7648649ddbe521d1dbd135: stopping tablet replica
I20251023 07:58:33.181577 16888 raft_consensus.cc:2243] T 1d80e56f890b4b3f99fdd1940f40e0a0 P a2ded24d2e7648649ddbe521d1dbd135 [term 3 FOLLOWER]: Raft consensus shutting down.
W20251023 07:58:33.181860 17585 consensus_peers.cc:597] T 5a8aa3610eeb4df3b88aa6fcb808969f P a35e1d7a0f05466db4af95b208209620 -> Peer a2ded24d2e7648649ddbe521d1dbd135 (127.16.126.1:43887): Couldn't send request to peer a2ded24d2e7648649ddbe521d1dbd135. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:58:33.182261 16888 raft_consensus.cc:2272] T 1d80e56f890b4b3f99fdd1940f40e0a0 P a2ded24d2e7648649ddbe521d1dbd135 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:33.185007 16888 tablet_replica.cc:333] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P a2ded24d2e7648649ddbe521d1dbd135: stopping tablet replica
I20251023 07:58:33.185801 16888 raft_consensus.cc:2243] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P a2ded24d2e7648649ddbe521d1dbd135 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:58:33.186393 16888 raft_consensus.cc:2272] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P a2ded24d2e7648649ddbe521d1dbd135 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:33.189203 16888 tablet_replica.cc:333] T 65cb88497ea44c4a9ee9cc67ede9d318 P a2ded24d2e7648649ddbe521d1dbd135: stopping tablet replica
I20251023 07:58:33.190038 16888 raft_consensus.cc:2243] T 65cb88497ea44c4a9ee9cc67ede9d318 P a2ded24d2e7648649ddbe521d1dbd135 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251023 07:58:33.190666 16888 raft_consensus.cc:2272] T 65cb88497ea44c4a9ee9cc67ede9d318 P a2ded24d2e7648649ddbe521d1dbd135 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:33.193553 16888 tablet_replica.cc:333] T 1ea153fe03884218bb2cf06c75d029c0 P a2ded24d2e7648649ddbe521d1dbd135: stopping tablet replica
I20251023 07:58:33.194303 16888 raft_consensus.cc:2243] T 1ea153fe03884218bb2cf06c75d029c0 P a2ded24d2e7648649ddbe521d1dbd135 [term 3 LEADER]: Raft consensus shutting down.
I20251023 07:58:33.195457 16888 raft_consensus.cc:2272] T 1ea153fe03884218bb2cf06c75d029c0 P a2ded24d2e7648649ddbe521d1dbd135 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:33.198330 16888 tablet_replica.cc:333] T 5a8aa3610eeb4df3b88aa6fcb808969f P a2ded24d2e7648649ddbe521d1dbd135: stopping tablet replica
I20251023 07:58:33.199086 16888 raft_consensus.cc:2243] T 5a8aa3610eeb4df3b88aa6fcb808969f P a2ded24d2e7648649ddbe521d1dbd135 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:58:33.199676 16888 raft_consensus.cc:2272] T 5a8aa3610eeb4df3b88aa6fcb808969f P a2ded24d2e7648649ddbe521d1dbd135 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:33.202370 16888 tablet_replica.cc:333] T fcb0398cbb794ef7856899e143856d9a P a2ded24d2e7648649ddbe521d1dbd135: stopping tablet replica
I20251023 07:58:33.203106 16888 raft_consensus.cc:2243] T fcb0398cbb794ef7856899e143856d9a P a2ded24d2e7648649ddbe521d1dbd135 [term 2 LEADER]: Raft consensus shutting down.
I20251023 07:58:33.204270 16888 raft_consensus.cc:2272] T fcb0398cbb794ef7856899e143856d9a P a2ded24d2e7648649ddbe521d1dbd135 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:33.206743 16888 tablet_replica.cc:333] T f7dc54ff3f724e939f77ddaa796574c8 P a2ded24d2e7648649ddbe521d1dbd135: stopping tablet replica
I20251023 07:58:33.207522 16888 raft_consensus.cc:2243] T f7dc54ff3f724e939f77ddaa796574c8 P a2ded24d2e7648649ddbe521d1dbd135 [term 5 FOLLOWER]: Raft consensus shutting down.
I20251023 07:58:33.208106 16888 raft_consensus.cc:2272] T f7dc54ff3f724e939f77ddaa796574c8 P a2ded24d2e7648649ddbe521d1dbd135 [term 5 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:33.210690 16888 tablet_replica.cc:333] T b84678e61cb446c3b00429824b024d12 P a2ded24d2e7648649ddbe521d1dbd135: stopping tablet replica
I20251023 07:58:33.211342 16888 raft_consensus.cc:2243] T b84678e61cb446c3b00429824b024d12 P a2ded24d2e7648649ddbe521d1dbd135 [term 3 LEADER]: Raft consensus shutting down.
I20251023 07:58:33.212512 16888 raft_consensus.cc:2272] T b84678e61cb446c3b00429824b024d12 P a2ded24d2e7648649ddbe521d1dbd135 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:33.247928 16888 tablet_server.cc:195] TabletServer@127.16.126.1:0 shutdown complete.
W20251023 07:58:33.255436 17659 consensus_peers.cc:597] T 1d80e56f890b4b3f99fdd1940f40e0a0 P 141636b82a7b4949931f25ce0a14addc -> Peer a2ded24d2e7648649ddbe521d1dbd135 (127.16.126.1:43887): Couldn't send request to peer a2ded24d2e7648649ddbe521d1dbd135. Status: Network error: Client connection negotiation failed: client connection to 127.16.126.1:43887: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251023 07:58:33.273859 16888 tablet_server.cc:178] TabletServer@127.16.126.2:0 shutting down...
I20251023 07:58:33.316633 16888 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251023 07:58:33.317648 16888 tablet_replica.cc:333] T 0524c60cf5404f1e99bef45655e8bd77 P a35e1d7a0f05466db4af95b208209620: stopping tablet replica
I20251023 07:58:33.318856 16888 raft_consensus.cc:2243] T 0524c60cf5404f1e99bef45655e8bd77 P a35e1d7a0f05466db4af95b208209620 [term 4 LEADER]: Raft consensus shutting down.
I20251023 07:58:33.320137 16888 raft_consensus.cc:2272] T 0524c60cf5404f1e99bef45655e8bd77 P a35e1d7a0f05466db4af95b208209620 [term 4 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:33.323076 16888 tablet_replica.cc:333] T 1d80e56f890b4b3f99fdd1940f40e0a0 P a35e1d7a0f05466db4af95b208209620: stopping tablet replica
I20251023 07:58:33.323815 16888 raft_consensus.cc:2243] T 1d80e56f890b4b3f99fdd1940f40e0a0 P a35e1d7a0f05466db4af95b208209620 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251023 07:58:33.324434 16888 raft_consensus.cc:2272] T 1d80e56f890b4b3f99fdd1940f40e0a0 P a35e1d7a0f05466db4af95b208209620 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:33.327103 16888 tablet_replica.cc:333] T 1ea153fe03884218bb2cf06c75d029c0 P a35e1d7a0f05466db4af95b208209620: stopping tablet replica
I20251023 07:58:33.327795 16888 raft_consensus.cc:2243] T 1ea153fe03884218bb2cf06c75d029c0 P a35e1d7a0f05466db4af95b208209620 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251023 07:58:33.328336 16888 raft_consensus.cc:2272] T 1ea153fe03884218bb2cf06c75d029c0 P a35e1d7a0f05466db4af95b208209620 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:33.330917 16888 tablet_replica.cc:333] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P a35e1d7a0f05466db4af95b208209620: stopping tablet replica
I20251023 07:58:33.331732 16888 raft_consensus.cc:2243] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P a35e1d7a0f05466db4af95b208209620 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:58:33.332252 16888 raft_consensus.cc:2272] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P a35e1d7a0f05466db4af95b208209620 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:33.334437 16888 tablet_replica.cc:333] T 65cb88497ea44c4a9ee9cc67ede9d318 P a35e1d7a0f05466db4af95b208209620: stopping tablet replica
I20251023 07:58:33.334923 16888 raft_consensus.cc:2243] T 65cb88497ea44c4a9ee9cc67ede9d318 P a35e1d7a0f05466db4af95b208209620 [term 3 LEADER]: Raft consensus shutting down.
I20251023 07:58:33.335708 16888 raft_consensus.cc:2272] T 65cb88497ea44c4a9ee9cc67ede9d318 P a35e1d7a0f05466db4af95b208209620 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:33.337522 16888 tablet_replica.cc:333] T 51aacc3534884c92926b5d632a3e11f7 P a35e1d7a0f05466db4af95b208209620: stopping tablet replica
I20251023 07:58:33.338001 16888 raft_consensus.cc:2243] T 51aacc3534884c92926b5d632a3e11f7 P a35e1d7a0f05466db4af95b208209620 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251023 07:58:33.338407 16888 raft_consensus.cc:2272] T 51aacc3534884c92926b5d632a3e11f7 P a35e1d7a0f05466db4af95b208209620 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:33.340245 16888 tablet_replica.cc:333] T fcb0398cbb794ef7856899e143856d9a P a35e1d7a0f05466db4af95b208209620: stopping tablet replica
I20251023 07:58:33.340721 16888 raft_consensus.cc:2243] T fcb0398cbb794ef7856899e143856d9a P a35e1d7a0f05466db4af95b208209620 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:58:33.341166 16888 raft_consensus.cc:2272] T fcb0398cbb794ef7856899e143856d9a P a35e1d7a0f05466db4af95b208209620 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:33.342999 16888 tablet_replica.cc:333] T 5a8aa3610eeb4df3b88aa6fcb808969f P a35e1d7a0f05466db4af95b208209620: stopping tablet replica
I20251023 07:58:33.343631 16888 raft_consensus.cc:2243] T 5a8aa3610eeb4df3b88aa6fcb808969f P a35e1d7a0f05466db4af95b208209620 [term 2 LEADER]: Raft consensus shutting down.
I20251023 07:58:33.344753 16888 raft_consensus.cc:2272] T 5a8aa3610eeb4df3b88aa6fcb808969f P a35e1d7a0f05466db4af95b208209620 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:33.347118 16888 tablet_replica.cc:333] T b84678e61cb446c3b00429824b024d12 P a35e1d7a0f05466db4af95b208209620: stopping tablet replica
W20251023 07:58:33.347074 17659 consensus_peers.cc:597] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P 141636b82a7b4949931f25ce0a14addc -> Peer a35e1d7a0f05466db4af95b208209620 (127.16.126.2:43007): Couldn't send request to peer a35e1d7a0f05466db4af95b208209620. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:58:33.347800 16888 raft_consensus.cc:2243] T b84678e61cb446c3b00429824b024d12 P a35e1d7a0f05466db4af95b208209620 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251023 07:58:33.348220 16888 raft_consensus.cc:2272] T b84678e61cb446c3b00429824b024d12 P a35e1d7a0f05466db4af95b208209620 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:33.349952 16888 tablet_replica.cc:333] T f7dc54ff3f724e939f77ddaa796574c8 P a35e1d7a0f05466db4af95b208209620: stopping tablet replica
I20251023 07:58:33.350435 16888 raft_consensus.cc:2243] T f7dc54ff3f724e939f77ddaa796574c8 P a35e1d7a0f05466db4af95b208209620 [term 5 FOLLOWER]: Raft consensus shutting down.
I20251023 07:58:33.350951 16888 raft_consensus.cc:2272] T f7dc54ff3f724e939f77ddaa796574c8 P a35e1d7a0f05466db4af95b208209620 [term 5 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:33.381748 16888 tablet_server.cc:195] TabletServer@127.16.126.2:0 shutdown complete.
W20251023 07:58:33.399797 17659 consensus_peers.cc:597] T f7dc54ff3f724e939f77ddaa796574c8 P 141636b82a7b4949931f25ce0a14addc -> Peer a2ded24d2e7648649ddbe521d1dbd135 (127.16.126.1:43887): Couldn't send request to peer a2ded24d2e7648649ddbe521d1dbd135. Status: Network error: Client connection negotiation failed: client connection to 127.16.126.1:43887: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251023 07:58:33.407449 16888 tablet_server.cc:178] TabletServer@127.16.126.3:0 shutting down...
I20251023 07:58:33.442199 16888 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251023 07:58:33.443107 16888 tablet_replica.cc:333] T 51aacc3534884c92926b5d632a3e11f7 P 141636b82a7b4949931f25ce0a14addc: stopping tablet replica
I20251023 07:58:33.444015 16888 raft_consensus.cc:2243] T 51aacc3534884c92926b5d632a3e11f7 P 141636b82a7b4949931f25ce0a14addc [term 3 FOLLOWER]: Raft consensus shutting down.
I20251023 07:58:33.444710 16888 raft_consensus.cc:2272] T 51aacc3534884c92926b5d632a3e11f7 P 141636b82a7b4949931f25ce0a14addc [term 3 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:33.447620 16888 tablet_replica.cc:333] T 1ea153fe03884218bb2cf06c75d029c0 P 141636b82a7b4949931f25ce0a14addc: stopping tablet replica
I20251023 07:58:33.448407 16888 raft_consensus.cc:2243] T 1ea153fe03884218bb2cf06c75d029c0 P 141636b82a7b4949931f25ce0a14addc [term 3 FOLLOWER]: Raft consensus shutting down.
I20251023 07:58:33.449048 16888 raft_consensus.cc:2272] T 1ea153fe03884218bb2cf06c75d029c0 P 141636b82a7b4949931f25ce0a14addc [term 3 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:33.451571 16888 tablet_replica.cc:333] T 0524c60cf5404f1e99bef45655e8bd77 P 141636b82a7b4949931f25ce0a14addc: stopping tablet replica
I20251023 07:58:33.452564 16888 raft_consensus.cc:2243] T 0524c60cf5404f1e99bef45655e8bd77 P 141636b82a7b4949931f25ce0a14addc [term 4 FOLLOWER]: Raft consensus shutting down.
I20251023 07:58:33.453199 16888 raft_consensus.cc:2272] T 0524c60cf5404f1e99bef45655e8bd77 P 141636b82a7b4949931f25ce0a14addc [term 4 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:33.455677 16888 tablet_replica.cc:333] T 1d80e56f890b4b3f99fdd1940f40e0a0 P 141636b82a7b4949931f25ce0a14addc: stopping tablet replica
I20251023 07:58:33.456377 16888 raft_consensus.cc:2243] T 1d80e56f890b4b3f99fdd1940f40e0a0 P 141636b82a7b4949931f25ce0a14addc [term 3 LEADER]: Raft consensus shutting down.
I20251023 07:58:33.457553 16888 raft_consensus.cc:2272] T 1d80e56f890b4b3f99fdd1940f40e0a0 P 141636b82a7b4949931f25ce0a14addc [term 3 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:33.460016 16888 tablet_replica.cc:333] T b84678e61cb446c3b00429824b024d12 P 141636b82a7b4949931f25ce0a14addc: stopping tablet replica
I20251023 07:58:33.460785 16888 raft_consensus.cc:2243] T b84678e61cb446c3b00429824b024d12 P 141636b82a7b4949931f25ce0a14addc [term 3 FOLLOWER]: Raft consensus shutting down.
I20251023 07:58:33.461467 16888 raft_consensus.cc:2272] T b84678e61cb446c3b00429824b024d12 P 141636b82a7b4949931f25ce0a14addc [term 3 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:33.464154 16888 tablet_replica.cc:333] T f7dc54ff3f724e939f77ddaa796574c8 P 141636b82a7b4949931f25ce0a14addc: stopping tablet replica
I20251023 07:58:33.464932 16888 raft_consensus.cc:2243] T f7dc54ff3f724e939f77ddaa796574c8 P 141636b82a7b4949931f25ce0a14addc [term 5 LEADER]: Raft consensus shutting down.
I20251023 07:58:33.466128 16888 raft_consensus.cc:2272] T f7dc54ff3f724e939f77ddaa796574c8 P 141636b82a7b4949931f25ce0a14addc [term 5 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:33.468909 16888 tablet_replica.cc:333] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P 141636b82a7b4949931f25ce0a14addc: stopping tablet replica
I20251023 07:58:33.469714 16888 raft_consensus.cc:2243] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P 141636b82a7b4949931f25ce0a14addc [term 2 LEADER]: Raft consensus shutting down.
I20251023 07:58:33.470727 16888 raft_consensus.cc:2272] T cd34ebe0d6ff472cbfd9a71f16d4aee1 P 141636b82a7b4949931f25ce0a14addc [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:33.473018 16888 tablet_replica.cc:333] T 65cb88497ea44c4a9ee9cc67ede9d318 P 141636b82a7b4949931f25ce0a14addc: stopping tablet replica
I20251023 07:58:33.473758 16888 raft_consensus.cc:2243] T 65cb88497ea44c4a9ee9cc67ede9d318 P 141636b82a7b4949931f25ce0a14addc [term 3 FOLLOWER]: Raft consensus shutting down.
I20251023 07:58:33.474316 16888 raft_consensus.cc:2272] T 65cb88497ea44c4a9ee9cc67ede9d318 P 141636b82a7b4949931f25ce0a14addc [term 3 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:33.476805 16888 tablet_replica.cc:333] T 5a8aa3610eeb4df3b88aa6fcb808969f P 141636b82a7b4949931f25ce0a14addc: stopping tablet replica
I20251023 07:58:33.477485 16888 raft_consensus.cc:2243] T 5a8aa3610eeb4df3b88aa6fcb808969f P 141636b82a7b4949931f25ce0a14addc [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:58:33.478050 16888 raft_consensus.cc:2272] T 5a8aa3610eeb4df3b88aa6fcb808969f P 141636b82a7b4949931f25ce0a14addc [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:33.480538 16888 tablet_replica.cc:333] T fcb0398cbb794ef7856899e143856d9a P 141636b82a7b4949931f25ce0a14addc: stopping tablet replica
I20251023 07:58:33.481127 16888 raft_consensus.cc:2243] T fcb0398cbb794ef7856899e143856d9a P 141636b82a7b4949931f25ce0a14addc [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:58:33.481746 16888 raft_consensus.cc:2272] T fcb0398cbb794ef7856899e143856d9a P 141636b82a7b4949931f25ce0a14addc [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:33.518841 16888 tablet_server.cc:195] TabletServer@127.16.126.3:0 shutdown complete.
I20251023 07:58:33.550629 16888 master.cc:561] Master@127.16.126.62:45081 shutting down...
I20251023 07:58:33.578948 16888 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 75545236f37841709f88cf733d7b543c [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:58:33.579627 16888 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 75545236f37841709f88cf733d7b543c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:33.579963 16888 tablet_replica.cc:333] T 00000000000000000000000000000000 P 75545236f37841709f88cf733d7b543c: stopping tablet replica
I20251023 07:58:33.917868 16888 master.cc:583] Master@127.16.126.62:45081 shutdown complete.
141636b82a7b4949931f25ce0a14addc 1
a2ded24d2e7648649ddbe521d1dbd135 5
a35e1d7a0f05466db4af95b208209620 4
141636b82a7b4949931f25ce0a14addc 3
a2ded24d2e7648649ddbe521d1dbd135 3
a35e1d7a0f05466db4af95b208209620 4
141636b82a7b4949931f25ce0a14addc 1
a2ded24d2e7648649ddbe521d1dbd135 8
a35e1d7a0f05466db4af95b208209620 1
141636b82a7b4949931f25ce0a14addc 3
a2ded24d2e7648649ddbe521d1dbd135 4
a35e1d7a0f05466db4af95b208209620 3
[ OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (31080 ms)
[ RUN ] LeaderRebalancerTest.AddTserver
I20251023 07:58:33.961874 16888 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.16.126.62:34671
I20251023 07:58:33.962987 16888 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251023 07:58:33.968636 17975 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251023 07:58:33.968892 17976 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251023 07:58:33.969954 17978 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251023 07:58:33.970333 16888 server_base.cc:1047] running on GCE node
I20251023 07:58:33.971282 16888 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251023 07:58:33.971462 16888 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251023 07:58:33.971617 16888 hybrid_clock.cc:648] HybridClock initialized: now 1761206313971600 us; error 0 us; skew 500 ppm
I20251023 07:58:33.972114 16888 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20251023 07:58:33.974460 16888 webserver.cc:492] Webserver started at http://127.16.126.62:35433/ using document root <none> and password file <none>
I20251023 07:58:33.974921 16888 fs_manager.cc:362] Metadata directory not provided
I20251023 07:58:33.975091 16888 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251023 07:58:33.975358 16888 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251023 07:58:33.976478 16888 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1761206251627710-16888-0/minicluster-data/master-0-root/instance:
uuid: "16353da55f05411089bb7a6142d6c048"
format_stamp: "Formatted at 2025-10-23 07:58:33 on dist-test-slave-m488"
I20251023 07:58:33.980827 16888 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20251023 07:58:33.984119 17983 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251023 07:58:33.984907 16888 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20251023 07:58:33.985190 16888 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1761206251627710-16888-0/minicluster-data/master-0-root
uuid: "16353da55f05411089bb7a6142d6c048"
format_stamp: "Formatted at 2025-10-23 07:58:33 on dist-test-slave-m488"
I20251023 07:58:33.985481 16888 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1761206251627710-16888-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1761206251627710-16888-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1761206251627710-16888-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251023 07:58:34.008256 16888 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251023 07:58:34.009580 16888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251023 07:58:34.048411 16888 rpc_server.cc:307] RPC server started. Bound to: 127.16.126.62:34671
I20251023 07:58:34.048503 18034 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.126.62:34671 every 8 connection(s)
I20251023 07:58:34.052286 18035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:34.062307 18035 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 16353da55f05411089bb7a6142d6c048: Bootstrap starting.
I20251023 07:58:34.067093 18035 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 16353da55f05411089bb7a6142d6c048: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:34.071233 18035 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 16353da55f05411089bb7a6142d6c048: No bootstrap required, opened a new log
I20251023 07:58:34.073323 18035 raft_consensus.cc:359] T 00000000000000000000000000000000 P 16353da55f05411089bb7a6142d6c048 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16353da55f05411089bb7a6142d6c048" member_type: VOTER }
I20251023 07:58:34.073807 18035 raft_consensus.cc:385] T 00000000000000000000000000000000 P 16353da55f05411089bb7a6142d6c048 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:34.074047 18035 raft_consensus.cc:740] T 00000000000000000000000000000000 P 16353da55f05411089bb7a6142d6c048 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16353da55f05411089bb7a6142d6c048, State: Initialized, Role: FOLLOWER
I20251023 07:58:34.074565 18035 consensus_queue.cc:260] T 00000000000000000000000000000000 P 16353da55f05411089bb7a6142d6c048 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16353da55f05411089bb7a6142d6c048" member_type: VOTER }
I20251023 07:58:34.075006 18035 raft_consensus.cc:399] T 00000000000000000000000000000000 P 16353da55f05411089bb7a6142d6c048 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251023 07:58:34.075228 18035 raft_consensus.cc:493] T 00000000000000000000000000000000 P 16353da55f05411089bb7a6142d6c048 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251023 07:58:34.075488 18035 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 16353da55f05411089bb7a6142d6c048 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:34.079767 18035 raft_consensus.cc:515] T 00000000000000000000000000000000 P 16353da55f05411089bb7a6142d6c048 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16353da55f05411089bb7a6142d6c048" member_type: VOTER }
I20251023 07:58:34.080230 18035 leader_election.cc:304] T 00000000000000000000000000000000 P 16353da55f05411089bb7a6142d6c048 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 16353da55f05411089bb7a6142d6c048; no voters:
I20251023 07:58:34.081452 18035 leader_election.cc:290] T 00000000000000000000000000000000 P 16353da55f05411089bb7a6142d6c048 [CANDIDATE]: Term 1 election: Requested vote from peers
I20251023 07:58:34.081835 18038 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 16353da55f05411089bb7a6142d6c048 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:58:34.083127 18038 raft_consensus.cc:697] T 00000000000000000000000000000000 P 16353da55f05411089bb7a6142d6c048 [term 1 LEADER]: Becoming Leader. State: Replica: 16353da55f05411089bb7a6142d6c048, State: Running, Role: LEADER
I20251023 07:58:34.083767 18038 consensus_queue.cc:237] T 00000000000000000000000000000000 P 16353da55f05411089bb7a6142d6c048 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16353da55f05411089bb7a6142d6c048" member_type: VOTER }
I20251023 07:58:34.084519 18035 sys_catalog.cc:565] T 00000000000000000000000000000000 P 16353da55f05411089bb7a6142d6c048 [sys.catalog]: configured and running, proceeding with master startup.
I20251023 07:58:34.088781 18040 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16353da55f05411089bb7a6142d6c048 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 16353da55f05411089bb7a6142d6c048. Latest consensus state: current_term: 1 leader_uuid: "16353da55f05411089bb7a6142d6c048" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16353da55f05411089bb7a6142d6c048" member_type: VOTER } }
I20251023 07:58:34.088986 18039 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16353da55f05411089bb7a6142d6c048 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "16353da55f05411089bb7a6142d6c048" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16353da55f05411089bb7a6142d6c048" member_type: VOTER } }
I20251023 07:58:34.089563 18040 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16353da55f05411089bb7a6142d6c048 [sys.catalog]: This master's current role is: LEADER
I20251023 07:58:34.089813 18039 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16353da55f05411089bb7a6142d6c048 [sys.catalog]: This master's current role is: LEADER
I20251023 07:58:34.091777 18045 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251023 07:58:34.096752 18045 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251023 07:58:34.100415 16888 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20251023 07:58:34.105647 18045 catalog_manager.cc:1357] Generated new cluster ID: f53bbe8cdd8444fbbb660291b9a29a46
I20251023 07:58:34.105953 18045 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251023 07:58:34.129861 18045 catalog_manager.cc:1380] Generated new certificate authority record
I20251023 07:58:34.131196 18045 catalog_manager.cc:1514] Loading token signing keys...
I20251023 07:58:34.143314 18045 catalog_manager.cc:6022] T 00000000000000000000000000000000 P 16353da55f05411089bb7a6142d6c048: Generated new TSK 0
I20251023 07:58:34.143939 18045 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251023 07:58:34.167210 16888 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251023 07:58:34.173107 18056 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251023 07:58:34.174517 18057 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251023 07:58:34.175696 18059 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251023 07:58:34.176146 16888 server_base.cc:1047] running on GCE node
I20251023 07:58:34.177083 16888 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251023 07:58:34.177264 16888 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251023 07:58:34.177409 16888 hybrid_clock.cc:648] HybridClock initialized: now 1761206314177392 us; error 0 us; skew 500 ppm
I20251023 07:58:34.177973 16888 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20251023 07:58:34.180226 16888 webserver.cc:492] Webserver started at http://127.16.126.1:35799/ using document root <none> and password file <none>
I20251023 07:58:34.180688 16888 fs_manager.cc:362] Metadata directory not provided
I20251023 07:58:34.180863 16888 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251023 07:58:34.181110 16888 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251023 07:58:34.182240 16888 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1761206251627710-16888-0/minicluster-data/ts-0-root/instance:
uuid: "b3a1328f9c8c484fab08292ce2171ec9"
format_stamp: "Formatted at 2025-10-23 07:58:34 on dist-test-slave-m488"
I20251023 07:58:34.186650 16888 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20251023 07:58:34.189936 18064 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251023 07:58:34.190634 16888 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20251023 07:58:34.190917 16888 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1761206251627710-16888-0/minicluster-data/ts-0-root
uuid: "b3a1328f9c8c484fab08292ce2171ec9"
format_stamp: "Formatted at 2025-10-23 07:58:34 on dist-test-slave-m488"
I20251023 07:58:34.191176 16888 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1761206251627710-16888-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1761206251627710-16888-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1761206251627710-16888-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251023 07:58:34.224684 16888 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251023 07:58:34.225966 16888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251023 07:58:34.227442 16888 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251023 07:58:34.229904 16888 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251023 07:58:34.230114 16888 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251023 07:58:34.230348 16888 ts_tablet_manager.cc:616] Registered 0 tablets
I20251023 07:58:34.230521 16888 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251023 07:58:34.272810 16888 rpc_server.cc:307] RPC server started. Bound to: 127.16.126.1:44025
I20251023 07:58:34.272922 18126 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.126.1:44025 every 8 connection(s)
I20251023 07:58:34.277305 16888 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251023 07:58:34.284900 18131 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251023 07:58:34.285547 18132 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251023 07:58:34.288641 18134 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251023 07:58:34.290515 16888 server_base.cc:1047] running on GCE node
I20251023 07:58:34.291531 16888 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251023 07:58:34.291739 16888 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251023 07:58:34.291908 16888 hybrid_clock.cc:648] HybridClock initialized: now 1761206314291890 us; error 0 us; skew 500 ppm
I20251023 07:58:34.292536 16888 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20251023 07:58:34.293411 18127 heartbeater.cc:344] Connected to a master server at 127.16.126.62:34671
I20251023 07:58:34.293857 18127 heartbeater.cc:461] Registering TS with master...
I20251023 07:58:34.294682 18127 heartbeater.cc:507] Master 127.16.126.62:34671 requested a full tablet report, sending...
I20251023 07:58:34.295198 16888 webserver.cc:492] Webserver started at http://127.16.126.2:33215/ using document root <none> and password file <none>
I20251023 07:58:34.295784 16888 fs_manager.cc:362] Metadata directory not provided
I20251023 07:58:34.296018 16888 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251023 07:58:34.296262 16888 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251023 07:58:34.296727 18000 ts_manager.cc:194] Registered new tserver with Master: b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025)
I20251023 07:58:34.297467 16888 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1761206251627710-16888-0/minicluster-data/ts-1-root/instance:
uuid: "10dfae53d0c941f08bded43539841761"
format_stamp: "Formatted at 2025-10-23 07:58:34 on dist-test-slave-m488"
I20251023 07:58:34.298470 18000 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36086
I20251023 07:58:34.302541 16888 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20251023 07:58:34.306067 18139 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251023 07:58:34.306808 16888 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.001s
I20251023 07:58:34.307135 16888 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1761206251627710-16888-0/minicluster-data/ts-1-root
uuid: "10dfae53d0c941f08bded43539841761"
format_stamp: "Formatted at 2025-10-23 07:58:34 on dist-test-slave-m488"
I20251023 07:58:34.307487 16888 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1761206251627710-16888-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1761206251627710-16888-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1761206251627710-16888-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251023 07:58:34.346657 16888 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251023 07:58:34.347946 16888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251023 07:58:34.349458 16888 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251023 07:58:34.351672 16888 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251023 07:58:34.351866 16888 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251023 07:58:34.352092 16888 ts_tablet_manager.cc:616] Registered 0 tablets
I20251023 07:58:34.352247 16888 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251023 07:58:34.392505 16888 rpc_server.cc:307] RPC server started. Bound to: 127.16.126.2:45799
I20251023 07:58:34.392580 18201 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.126.2:45799 every 8 connection(s)
I20251023 07:58:34.397209 16888 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251023 07:58:34.404527 18205 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251023 07:58:34.405671 18206 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251023 07:58:34.409217 18202 heartbeater.cc:344] Connected to a master server at 127.16.126.62:34671
I20251023 07:58:34.409376 16888 server_base.cc:1047] running on GCE node
I20251023 07:58:34.409780 18202 heartbeater.cc:461] Registering TS with master...
W20251023 07:58:34.410101 18208 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251023 07:58:34.410744 18202 heartbeater.cc:507] Master 127.16.126.62:34671 requested a full tablet report, sending...
I20251023 07:58:34.411177 16888 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251023 07:58:34.411437 16888 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251023 07:58:34.411643 16888 hybrid_clock.cc:648] HybridClock initialized: now 1761206314411624 us; error 0 us; skew 500 ppm
I20251023 07:58:34.412235 16888 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20251023 07:58:34.412940 18000 ts_manager.cc:194] Registered new tserver with Master: 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:58:34.414875 18000 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36100
I20251023 07:58:34.415099 16888 webserver.cc:492] Webserver started at http://127.16.126.3:35039/ using document root <none> and password file <none>
I20251023 07:58:34.415776 16888 fs_manager.cc:362] Metadata directory not provided
I20251023 07:58:34.415992 16888 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251023 07:58:34.416296 16888 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251023 07:58:34.417414 16888 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1761206251627710-16888-0/minicluster-data/ts-2-root/instance:
uuid: "982df35c5b554a8fa64807352c4f34ee"
format_stamp: "Formatted at 2025-10-23 07:58:34 on dist-test-slave-m488"
I20251023 07:58:34.421998 16888 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.001s sys 0.002s
I20251023 07:58:34.425135 18213 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251023 07:58:34.425933 16888 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20251023 07:58:34.426211 16888 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1761206251627710-16888-0/minicluster-data/ts-2-root
uuid: "982df35c5b554a8fa64807352c4f34ee"
format_stamp: "Formatted at 2025-10-23 07:58:34 on dist-test-slave-m488"
I20251023 07:58:34.426479 16888 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1761206251627710-16888-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1761206251627710-16888-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1761206251627710-16888-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251023 07:58:34.437834 16888 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251023 07:58:34.439036 16888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251023 07:58:34.440515 16888 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251023 07:58:34.442840 16888 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251023 07:58:34.443042 16888 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251023 07:58:34.443266 16888 ts_tablet_manager.cc:616] Registered 0 tablets
I20251023 07:58:34.443416 16888 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251023 07:58:34.483062 16888 rpc_server.cc:307] RPC server started. Bound to: 127.16.126.3:46061
I20251023 07:58:34.483165 18275 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.126.3:46061 every 8 connection(s)
I20251023 07:58:34.495771 18276 heartbeater.cc:344] Connected to a master server at 127.16.126.62:34671
I20251023 07:58:34.496150 18276 heartbeater.cc:461] Registering TS with master...
I20251023 07:58:34.496845 18276 heartbeater.cc:507] Master 127.16.126.62:34671 requested a full tablet report, sending...
I20251023 07:58:34.498771 18000 ts_manager.cc:194] Registered new tserver with Master: 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:34.499432 16888 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013446004s
I20251023 07:58:34.500535 18000 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36104
I20251023 07:58:34.502487 16888 test_util.cc:276] Using random seed: -859797183
I20251023 07:58:34.526448 18000 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36114:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251023 07:58:34.532627 18000 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251023 07:58:34.740818 18165 tablet_service.cc:1505] Processing CreateTablet for tablet 33c314b036134d929890c744d68bc0cc (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20251023 07:58:34.742400 18165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33c314b036134d929890c744d68bc0cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:34.746743 18164 tablet_service.cc:1505] Processing CreateTablet for tablet 79fcf5e4a38448ba95c62cc1ffe2823a (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20251023 07:58:34.748127 18164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79fcf5e4a38448ba95c62cc1ffe2823a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:34.750324 18241 tablet_service.cc:1505] Processing CreateTablet for tablet 5d4096f60c864412bb51be0c52c22961 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION VALUES < 36398027
I20251023 07:58:34.751688 18241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d4096f60c864412bb51be0c52c22961. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:34.752667 18236 tablet_service.cc:1505] Processing CreateTablet for tablet abefe27ebb4c4179a8620d4e638fe119 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20251023 07:58:34.754053 18236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abefe27ebb4c4179a8620d4e638fe119. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:34.754617 18163 tablet_service.cc:1505] Processing CreateTablet for tablet 1f184d89e4244f12af7afd690bc7027d (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20251023 07:58:34.756057 18163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f184d89e4244f12af7afd690bc7027d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:34.756003 18092 tablet_service.cc:1505] Processing CreateTablet for tablet 5d4096f60c864412bb51be0c52c22961 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION VALUES < 36398027
I20251023 07:58:34.757392 18092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d4096f60c864412bb51be0c52c22961. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:34.767645 18238 tablet_service.cc:1505] Processing CreateTablet for tablet 79fcf5e4a38448ba95c62cc1ffe2823a (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20251023 07:58:34.769098 18238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79fcf5e4a38448ba95c62cc1ffe2823a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:34.769423 18162 tablet_service.cc:1505] Processing CreateTablet for tablet abefe27ebb4c4179a8620d4e638fe119 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20251023 07:58:34.770848 18162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abefe27ebb4c4179a8620d4e638fe119. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:34.758600 18091 tablet_service.cc:1505] Processing CreateTablet for tablet e4884051da6c4cdc9e0811e70667dd19 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20251023 07:58:34.774199 18091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4884051da6c4cdc9e0811e70667dd19. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:34.774659 18161 tablet_service.cc:1505] Processing CreateTablet for tablet 4117fd2188e14b9aacc56f82245a3cc6 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20251023 07:58:34.775964 18161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4117fd2188e14b9aacc56f82245a3cc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:34.758605 18083 tablet_service.cc:1505] Processing CreateTablet for tablet 5585a11a884140c7abc7d5a3b6ab86f3 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20251023 07:58:34.778859 18083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5585a11a884140c7abc7d5a3b6ab86f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:34.778661 18160 tablet_service.cc:1505] Processing CreateTablet for tablet 3d1032da07fd44be9c392e8f4cd2af1f (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20251023 07:58:34.779985 18160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d1032da07fd44be9c392e8f4cd2af1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:34.783133 18159 tablet_service.cc:1505] Processing CreateTablet for tablet 744a3368282b44d9b9618922875d20d3 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20251023 07:58:34.784579 18159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 744a3368282b44d9b9618922875d20d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:34.785504 18233 tablet_service.cc:1505] Processing CreateTablet for tablet 744a3368282b44d9b9618922875d20d3 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20251023 07:58:34.786890 18233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 744a3368282b44d9b9618922875d20d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:34.787027 18158 tablet_service.cc:1505] Processing CreateTablet for tablet 5585a11a884140c7abc7d5a3b6ab86f3 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20251023 07:58:34.788370 18158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5585a11a884140c7abc7d5a3b6ab86f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:34.758621 18166 tablet_service.cc:1505] Processing CreateTablet for tablet e4884051da6c4cdc9e0811e70667dd19 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20251023 07:58:34.756011 18084 tablet_service.cc:1505] Processing CreateTablet for tablet 744a3368282b44d9b9618922875d20d3 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20251023 07:58:34.792781 18084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 744a3368282b44d9b9618922875d20d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:34.759701 18167 tablet_service.cc:1505] Processing CreateTablet for tablet 5d4096f60c864412bb51be0c52c22961 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION VALUES < 36398027
I20251023 07:58:34.783197 18234 tablet_service.cc:1505] Processing CreateTablet for tablet 3d1032da07fd44be9c392e8f4cd2af1f (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20251023 07:58:34.761014 18089 tablet_service.cc:1505] Processing CreateTablet for tablet 79fcf5e4a38448ba95c62cc1ffe2823a (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20251023 07:58:34.763207 18087 tablet_service.cc:1505] Processing CreateTablet for tablet abefe27ebb4c4179a8620d4e638fe119 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20251023 07:58:34.799319 18234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d1032da07fd44be9c392e8f4cd2af1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:34.799939 18089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79fcf5e4a38448ba95c62cc1ffe2823a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:34.765529 18240 tablet_service.cc:1505] Processing CreateTablet for tablet e4884051da6c4cdc9e0811e70667dd19 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20251023 07:58:34.801373 18240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4884051da6c4cdc9e0811e70667dd19. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:34.762018 18086 tablet_service.cc:1505] Processing CreateTablet for tablet 4117fd2188e14b9aacc56f82245a3cc6 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20251023 07:58:34.802840 18086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4117fd2188e14b9aacc56f82245a3cc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:34.766726 18239 tablet_service.cc:1505] Processing CreateTablet for tablet 33c314b036134d929890c744d68bc0cc (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20251023 07:58:34.805650 18167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d4096f60c864412bb51be0c52c22961. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:34.805796 18087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abefe27ebb4c4179a8620d4e638fe119. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:34.806469 18239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33c314b036134d929890c744d68bc0cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:34.807015 18166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4884051da6c4cdc9e0811e70667dd19. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:34.760722 18085 tablet_service.cc:1505] Processing CreateTablet for tablet 3d1032da07fd44be9c392e8f4cd2af1f (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20251023 07:58:34.808573 18085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d1032da07fd44be9c392e8f4cd2af1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:34.759788 18090 tablet_service.cc:1505] Processing CreateTablet for tablet 33c314b036134d929890c744d68bc0cc (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20251023 07:58:34.810577 18090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33c314b036134d929890c744d68bc0cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:34.762259 18088 tablet_service.cc:1505] Processing CreateTablet for tablet 1f184d89e4244f12af7afd690bc7027d (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20251023 07:58:34.811510 18088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f184d89e4244f12af7afd690bc7027d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:34.764344 18235 tablet_service.cc:1505] Processing CreateTablet for tablet 4117fd2188e14b9aacc56f82245a3cc6 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20251023 07:58:34.812662 18235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4117fd2188e14b9aacc56f82245a3cc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:34.791450 18232 tablet_service.cc:1505] Processing CreateTablet for tablet 5585a11a884140c7abc7d5a3b6ab86f3 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20251023 07:58:34.814855 18232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5585a11a884140c7abc7d5a3b6ab86f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:34.766475 18237 tablet_service.cc:1505] Processing CreateTablet for tablet 1f184d89e4244f12af7afd690bc7027d (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20251023 07:58:34.818420 18237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f184d89e4244f12af7afd690bc7027d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:34.890333 18087 tablet_service.cc:1505] Processing CreateTablet for tablet fbc1ceb70a0c42c6871ea24480ee4221 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20251023 07:58:34.891929 18087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbc1ceb70a0c42c6871ea24480ee4221. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:34.899180 18236 tablet_service.cc:1505] Processing CreateTablet for tablet eeadb773c7dc416581b44225256a4c3b (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20251023 07:58:34.900727 18236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eeadb773c7dc416581b44225256a4c3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:34.902051 18083 tablet_service.cc:1505] Processing CreateTablet for tablet eeadb773c7dc416581b44225256a4c3b (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20251023 07:58:34.903375 18083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eeadb773c7dc416581b44225256a4c3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:34.910486 18293 tablet_bootstrap.cc:492] T e4884051da6c4cdc9e0811e70667dd19 P 10dfae53d0c941f08bded43539841761: Bootstrap starting.
I20251023 07:58:34.911266 18166 tablet_service.cc:1505] Processing CreateTablet for tablet fbc1ceb70a0c42c6871ea24480ee4221 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20251023 07:58:34.912572 18166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbc1ceb70a0c42c6871ea24480ee4221. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:34.936300 18164 tablet_service.cc:1505] Processing CreateTablet for tablet eeadb773c7dc416581b44225256a4c3b (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20251023 07:58:34.869033 18235 tablet_service.cc:1505] Processing CreateTablet for tablet fbc1ceb70a0c42c6871ea24480ee4221 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20251023 07:58:34.938344 18235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbc1ceb70a0c42c6871ea24480ee4221. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:34.951658 18086 tablet_service.cc:1505] Processing CreateTablet for tablet b9841e711f8e4a019c2d0dec5409474c (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20251023 07:58:34.955719 18165 tablet_service.cc:1505] Processing CreateTablet for tablet fe0293c22cae49cfa7cd698f17626a35 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20251023 07:58:34.916993 18240 tablet_service.cc:1505] Processing CreateTablet for tablet b9841e711f8e4a019c2d0dec5409474c (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20251023 07:58:34.957471 18164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eeadb773c7dc416581b44225256a4c3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:34.958503 18167 tablet_service.cc:1505] Processing CreateTablet for tablet 1f539da81d60449b9d96866c7ceee1be (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20251023 07:58:34.961871 18293 tablet_bootstrap.cc:654] T e4884051da6c4cdc9e0811e70667dd19 P 10dfae53d0c941f08bded43539841761: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:34.961796 18085 tablet_service.cc:1505] Processing CreateTablet for tablet fe0293c22cae49cfa7cd698f17626a35 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20251023 07:58:34.965574 18163 tablet_service.cc:1505] Processing CreateTablet for tablet 7fe190354178418bae8b7cc5abbb74ef (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20251023 07:58:34.957506 18240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9841e711f8e4a019c2d0dec5409474c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:34.953238 18159 tablet_service.cc:1505] Processing CreateTablet for tablet b9841e711f8e4a019c2d0dec5409474c (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20251023 07:58:34.960279 18086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9841e711f8e4a019c2d0dec5409474c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:34.977027 18085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe0293c22cae49cfa7cd698f17626a35. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:34.982438 18160 tablet_service.cc:1505] Processing CreateTablet for tablet e99e859ac34a47c4b2859ec2638d17e5 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20251023 07:58:34.973589 18089 tablet_service.cc:1505] Processing CreateTablet for tablet 1f539da81d60449b9d96866c7ceee1be (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20251023 07:58:34.945068 18241 tablet_service.cc:1505] Processing CreateTablet for tablet eb40d8c2f73d48868bfc3ef3889bea45 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20251023 07:58:34.975996 18084 tablet_service.cc:1505] Processing CreateTablet for tablet 7fe190354178418bae8b7cc5abbb74ef (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20251023 07:58:34.990305 18241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb40d8c2f73d48868bfc3ef3889bea45. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:34.990604 18237 tablet_service.cc:1505] Processing CreateTablet for tablet fe0293c22cae49cfa7cd698f17626a35 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20251023 07:58:34.991848 18237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe0293c22cae49cfa7cd698f17626a35. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:34.995513 18291 tablet_bootstrap.cc:492] T abefe27ebb4c4179a8620d4e638fe119 P 982df35c5b554a8fa64807352c4f34ee: Bootstrap starting.
I20251023 07:58:34.987097 18165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe0293c22cae49cfa7cd698f17626a35. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.005244 18160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e99e859ac34a47c4b2859ec2638d17e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.006008 18292 tablet_bootstrap.cc:492] T 3d1032da07fd44be9c392e8f4cd2af1f P b3a1328f9c8c484fab08292ce2171ec9: Bootstrap starting.
I20251023 07:58:35.009745 18163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fe190354178418bae8b7cc5abbb74ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.009773 18084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fe190354178418bae8b7cc5abbb74ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.010993 18159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9841e711f8e4a019c2d0dec5409474c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.022581 18158 tablet_service.cc:1505] Processing CreateTablet for tablet a83dfc7a7d784b52b9c74bbc451ad603 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20251023 07:58:35.022907 18088 tablet_service.cc:1505] Processing CreateTablet for tablet e99e859ac34a47c4b2859ec2638d17e5 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20251023 07:58:35.024144 18088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e99e859ac34a47c4b2859ec2638d17e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.025749 18089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f539da81d60449b9d96866c7ceee1be. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.027247 18293 tablet_bootstrap.cc:492] T e4884051da6c4cdc9e0811e70667dd19 P 10dfae53d0c941f08bded43539841761: No bootstrap required, opened a new log
I20251023 07:58:35.037912 18293 ts_tablet_manager.cc:1403] T e4884051da6c4cdc9e0811e70667dd19 P 10dfae53d0c941f08bded43539841761: Time spent bootstrapping tablet: real 0.128s user 0.013s sys 0.002s
I20251023 07:58:35.040316 18087 tablet_service.cc:1505] Processing CreateTablet for tablet a83dfc7a7d784b52b9c74bbc451ad603 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20251023 07:58:35.032166 18234 tablet_service.cc:1505] Processing CreateTablet for tablet 1f539da81d60449b9d96866c7ceee1be (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20251023 07:58:35.041873 18234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f539da81d60449b9d96866c7ceee1be. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.041637 18162 tablet_service.cc:1505] Processing CreateTablet for tablet c63b5a4dc8eb4b6e918608f281183068 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20251023 07:58:35.025460 18161 tablet_service.cc:1505] Processing CreateTablet for tablet 94cd6588f7824a30ba02f891ae089671 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20251023 07:58:35.034518 18238 tablet_service.cc:1505] Processing CreateTablet for tablet 7fe190354178418bae8b7cc5abbb74ef (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20251023 07:58:35.045732 18167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f539da81d60449b9d96866c7ceee1be. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.045782 18238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fe190354178418bae8b7cc5abbb74ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.048167 18161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94cd6588f7824a30ba02f891ae089671. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.048480 18090 tablet_service.cc:1505] Processing CreateTablet for tablet c63b5a4dc8eb4b6e918608f281183068 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20251023 07:58:35.051457 18092 tablet_service.cc:1505] Processing CreateTablet for tablet c6022ad5a70c4b4f8f34339956122cb7 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20251023 07:58:35.054404 18166 tablet_service.cc:1505] Processing CreateTablet for tablet c6022ad5a70c4b4f8f34339956122cb7 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20251023 07:58:35.040773 18293 raft_consensus.cc:359] T e4884051da6c4cdc9e0811e70667dd19 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:35.055672 18166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6022ad5a70c4b4f8f34339956122cb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.055823 18293 raft_consensus.cc:385] T e4884051da6c4cdc9e0811e70667dd19 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:35.056267 18293 raft_consensus.cc:740] T e4884051da6c4cdc9e0811e70667dd19 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Initialized, Role: FOLLOWER
I20251023 07:58:35.057852 18158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a83dfc7a7d784b52b9c74bbc451ad603. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.059610 18233 tablet_service.cc:1505] Processing CreateTablet for tablet a83dfc7a7d784b52b9c74bbc451ad603 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20251023 07:58:35.059904 18232 tablet_service.cc:1505] Processing CreateTablet for tablet 94cd6588f7824a30ba02f891ae089671 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20251023 07:58:35.060823 18233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a83dfc7a7d784b52b9c74bbc451ad603. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.061472 18091 tablet_service.cc:1505] Processing CreateTablet for tablet 94cd6588f7824a30ba02f891ae089671 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20251023 07:58:35.062631 18291 tablet_bootstrap.cc:654] T abefe27ebb4c4179a8620d4e638fe119 P 982df35c5b554a8fa64807352c4f34ee: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:35.063079 18292 tablet_bootstrap.cc:654] T 3d1032da07fd44be9c392e8f4cd2af1f P b3a1328f9c8c484fab08292ce2171ec9: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:35.063694 18293 consensus_queue.cc:260] T e4884051da6c4cdc9e0811e70667dd19 P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:35.068795 18162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c63b5a4dc8eb4b6e918608f281183068. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.058485 18086 tablet_service.cc:1505] Processing CreateTablet for tablet eb40d8c2f73d48868bfc3ef3889bea45 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20251023 07:58:35.072459 18232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94cd6588f7824a30ba02f891ae089671. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.072541 18087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a83dfc7a7d784b52b9c74bbc451ad603. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.076192 18235 tablet_service.cc:1505] Processing CreateTablet for tablet c63b5a4dc8eb4b6e918608f281183068 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20251023 07:58:35.076769 18091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94cd6588f7824a30ba02f891ae089671. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.077698 18090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c63b5a4dc8eb4b6e918608f281183068. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.079741 18086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb40d8c2f73d48868bfc3ef3889bea45. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.087596 18239 tablet_service.cc:1505] Processing CreateTablet for tablet c6022ad5a70c4b4f8f34339956122cb7 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
W20251023 07:58:35.096156 18048 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20251023 07:58:35.108371 18164 tablet_service.cc:1505] Processing CreateTablet for tablet eb40d8c2f73d48868bfc3ef3889bea45 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20251023 07:58:35.110034 18235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c63b5a4dc8eb4b6e918608f281183068. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.045238 18236 tablet_service.cc:1505] Processing CreateTablet for tablet e99e859ac34a47c4b2859ec2638d17e5 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20251023 07:58:35.110793 18092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6022ad5a70c4b4f8f34339956122cb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.119071 18293 ts_tablet_manager.cc:1434] T e4884051da6c4cdc9e0811e70667dd19 P 10dfae53d0c941f08bded43539841761: Time spent starting tablet: real 0.081s user 0.007s sys 0.002s
I20251023 07:58:35.135056 18164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb40d8c2f73d48868bfc3ef3889bea45. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.135370 18202 heartbeater.cc:499] Master 127.16.126.62:34671 was elected leader, sending a full tablet report...
I20251023 07:58:35.130507 18237 tablet_service.cc:1505] Processing CreateTablet for tablet 3e4d005972f44619b0cf23f4978f51c4 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20251023 07:58:35.138028 18293 tablet_bootstrap.cc:492] T 5d4096f60c864412bb51be0c52c22961 P 10dfae53d0c941f08bded43539841761: Bootstrap starting.
I20251023 07:58:35.143675 18083 tablet_service.cc:1505] Processing CreateTablet for tablet ce0069d7c0cf4dee84a85731209358f7 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20251023 07:58:35.122622 18240 tablet_service.cc:1505] Processing CreateTablet for tablet ce0069d7c0cf4dee84a85731209358f7 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
W20251023 07:58:35.148509 18203 tablet.cc:2378] T e4884051da6c4cdc9e0811e70667dd19 P 10dfae53d0c941f08bded43539841761: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251023 07:58:35.153959 18237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e4d005972f44619b0cf23f4978f51c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.157766 18236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e99e859ac34a47c4b2859ec2638d17e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.160152 18293 tablet_bootstrap.cc:654] T 5d4096f60c864412bb51be0c52c22961 P 10dfae53d0c941f08bded43539841761: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:35.162134 18240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce0069d7c0cf4dee84a85731209358f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.165963 18239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6022ad5a70c4b4f8f34339956122cb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.167956 18165 tablet_service.cc:1505] Processing CreateTablet for tablet 290b1b1fd4ef42cf9f0b285d4bf5ed36 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20251023 07:58:35.169210 18165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 290b1b1fd4ef42cf9f0b285d4bf5ed36. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.173760 18159 tablet_service.cc:1505] Processing CreateTablet for tablet 3e4d005972f44619b0cf23f4978f51c4 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20251023 07:58:35.176107 18160 tablet_service.cc:1505] Processing CreateTablet for tablet b19b550093fb4ab181e62957d89460e7 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20251023 07:58:35.184948 18083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce0069d7c0cf4dee84a85731209358f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.161607 18238 tablet_service.cc:1505] Processing CreateTablet for tablet 290b1b1fd4ef42cf9f0b285d4bf5ed36 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20251023 07:58:35.186702 18238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 290b1b1fd4ef42cf9f0b285d4bf5ed36. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.188024 18241 tablet_service.cc:1505] Processing CreateTablet for tablet 5f7e006a09224285b1e5df5694ff72ae (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20251023 07:58:35.189237 18241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f7e006a09224285b1e5df5694ff72ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.185719 18159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e4d005972f44619b0cf23f4978f51c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.191268 18292 tablet_bootstrap.cc:492] T 3d1032da07fd44be9c392e8f4cd2af1f P b3a1328f9c8c484fab08292ce2171ec9: No bootstrap required, opened a new log
I20251023 07:58:35.191746 18292 ts_tablet_manager.cc:1403] T 3d1032da07fd44be9c392e8f4cd2af1f P b3a1328f9c8c484fab08292ce2171ec9: Time spent bootstrapping tablet: real 0.189s user 0.000s sys 0.017s
I20251023 07:58:35.195770 18089 tablet_service.cc:1505] Processing CreateTablet for tablet 3e4d005972f44619b0cf23f4978f51c4 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20251023 07:58:35.197124 18089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e4d005972f44619b0cf23f4978f51c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.199182 18164 tablet_service.cc:1505] Processing CreateTablet for tablet 5f7e006a09224285b1e5df5694ff72ae (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20251023 07:58:35.130167 18163 tablet_service.cc:1505] Processing CreateTablet for tablet ce0069d7c0cf4dee84a85731209358f7 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20251023 07:58:35.210731 18291 tablet_bootstrap.cc:492] T abefe27ebb4c4179a8620d4e638fe119 P 982df35c5b554a8fa64807352c4f34ee: No bootstrap required, opened a new log
I20251023 07:58:35.211261 18291 ts_tablet_manager.cc:1403] T abefe27ebb4c4179a8620d4e638fe119 P 982df35c5b554a8fa64807352c4f34ee: Time spent bootstrapping tablet: real 0.216s user 0.011s sys 0.006s
I20251023 07:58:35.214067 18291 raft_consensus.cc:359] T abefe27ebb4c4179a8620d4e638fe119 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:35.214833 18291 raft_consensus.cc:385] T abefe27ebb4c4179a8620d4e638fe119 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:35.215170 18291 raft_consensus.cc:740] T abefe27ebb4c4179a8620d4e638fe119 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Initialized, Role: FOLLOWER
I20251023 07:58:35.215991 18291 consensus_queue.cc:260] T abefe27ebb4c4179a8620d4e638fe119 P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:35.218428 18235 tablet_service.cc:1505] Processing CreateTablet for tablet b19b550093fb4ab181e62957d89460e7 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20251023 07:58:35.219748 18235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b19b550093fb4ab181e62957d89460e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.208457 18160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b19b550093fb4ab181e62957d89460e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.233646 18276 heartbeater.cc:499] Master 127.16.126.62:34671 was elected leader, sending a full tablet report...
I20251023 07:58:35.194702 18292 raft_consensus.cc:359] T 3d1032da07fd44be9c392e8f4cd2af1f P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:35.241302 18292 raft_consensus.cc:385] T 3d1032da07fd44be9c392e8f4cd2af1f P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:35.241726 18292 raft_consensus.cc:740] T 3d1032da07fd44be9c392e8f4cd2af1f P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Initialized, Role: FOLLOWER
I20251023 07:58:35.242286 18164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f7e006a09224285b1e5df5694ff72ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.242590 18292 consensus_queue.cc:260] T 3d1032da07fd44be9c392e8f4cd2af1f P b3a1328f9c8c484fab08292ce2171ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:35.206632 18158 tablet_service.cc:1505] Processing CreateTablet for tablet 1178e2ed919b40f29672fc6233b71cf3 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20251023 07:58:35.267081 18163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce0069d7c0cf4dee84a85731209358f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.278335 18241 tablet_service.cc:1505] Processing CreateTablet for tablet 25d22e66fcd6444a9b9c469acd781e59 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20251023 07:58:35.279712 18241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25d22e66fcd6444a9b9c469acd781e59. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.279507 18235 tablet_service.cc:1505] Processing CreateTablet for tablet 55de6ceb03f343b09190cb2fb4bbe144 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20251023 07:58:35.289769 18236 tablet_service.cc:1505] Processing CreateTablet for tablet 14e6f2c3d85b437cac3ead436d5494a7 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20251023 07:58:35.280987 18235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55de6ceb03f343b09190cb2fb4bbe144. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.295570 18086 tablet_service.cc:1505] Processing CreateTablet for tablet 25d22e66fcd6444a9b9c469acd781e59 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20251023 07:58:35.241341 18087 tablet_service.cc:1505] Processing CreateTablet for tablet 5f7e006a09224285b1e5df5694ff72ae (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20251023 07:58:35.301023 18241 tablet_service.cc:1505] Processing CreateTablet for tablet c6c529d344cc483a96dbb509ca4c5890 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20251023 07:58:35.301522 18127 heartbeater.cc:499] Master 127.16.126.62:34671 was elected leader, sending a full tablet report...
I20251023 07:58:35.229490 18234 tablet_service.cc:1505] Processing CreateTablet for tablet 1178e2ed919b40f29672fc6233b71cf3 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20251023 07:58:35.297379 18086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25d22e66fcd6444a9b9c469acd781e59. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.313674 18236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14e6f2c3d85b437cac3ead436d5494a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.328995 18166 tablet_service.cc:1505] Processing CreateTablet for tablet 55de6ceb03f343b09190cb2fb4bbe144 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20251023 07:58:35.314385 18295 raft_consensus.cc:493] T e4884051da6c4cdc9e0811e70667dd19 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:35.330289 18166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55de6ceb03f343b09190cb2fb4bbe144. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.314841 18293 tablet_bootstrap.cc:492] T 5d4096f60c864412bb51be0c52c22961 P 10dfae53d0c941f08bded43539841761: No bootstrap required, opened a new log
I20251023 07:58:35.330986 18293 ts_tablet_manager.cc:1403] T 5d4096f60c864412bb51be0c52c22961 P 10dfae53d0c941f08bded43539841761: Time spent bootstrapping tablet: real 0.193s user 0.007s sys 0.006s
I20251023 07:58:35.333797 18234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1178e2ed919b40f29672fc6233b71cf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.337906 18293 raft_consensus.cc:359] T 5d4096f60c864412bb51be0c52c22961 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } }
I20251023 07:58:35.338814 18293 raft_consensus.cc:385] T 5d4096f60c864412bb51be0c52c22961 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:35.339151 18293 raft_consensus.cc:740] T 5d4096f60c864412bb51be0c52c22961 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Initialized, Role: FOLLOWER
I20251023 07:58:35.340005 18293 consensus_queue.cc:260] T 5d4096f60c864412bb51be0c52c22961 P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } }
I20251023 07:58:35.341221 18165 tablet_service.cc:1505] Processing CreateTablet for tablet 14e6f2c3d85b437cac3ead436d5494a7 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20251023 07:58:35.342183 18087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f7e006a09224285b1e5df5694ff72ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.342506 18165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14e6f2c3d85b437cac3ead436d5494a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.344326 18232 tablet_service.cc:1505] Processing CreateTablet for tablet 1f437560602a470ca62b7a1fa9471026 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20251023 07:58:35.323321 18291 ts_tablet_manager.cc:1434] T abefe27ebb4c4179a8620d4e638fe119 P 982df35c5b554a8fa64807352c4f34ee: Time spent starting tablet: real 0.112s user 0.008s sys 0.001s
I20251023 07:58:35.248353 18085 tablet_service.cc:1505] Processing CreateTablet for tablet 290b1b1fd4ef42cf9f0b285d4bf5ed36 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20251023 07:58:35.234139 18092 tablet_service.cc:1505] Processing CreateTablet for tablet 1178e2ed919b40f29672fc6233b71cf3 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20251023 07:58:35.329913 18295 raft_consensus.cc:515] T e4884051da6c4cdc9e0811e70667dd19 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:35.350132 18085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 290b1b1fd4ef42cf9f0b285d4bf5ed36. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.321918 18167 tablet_service.cc:1505] Processing CreateTablet for tablet 25d22e66fcd6444a9b9c469acd781e59 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20251023 07:58:35.352229 18295 leader_election.cc:290] T e4884051da6c4cdc9e0811e70667dd19 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:35.368225 18092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1178e2ed919b40f29672fc6233b71cf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.370302 18239 tablet_service.cc:1505] Processing CreateTablet for tablet 2d81605b8fe7427b94af7f3c481ed765 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20251023 07:58:35.374368 18239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d81605b8fe7427b94af7f3c481ed765. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.377871 18232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f437560602a470ca62b7a1fa9471026. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.378903 18160 tablet_service.cc:1505] Processing CreateTablet for tablet c6c529d344cc483a96dbb509ca4c5890 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20251023 07:58:35.321345 18088 tablet_service.cc:1505] Processing CreateTablet for tablet 55de6ceb03f343b09190cb2fb4bbe144 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20251023 07:58:35.383162 18088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55de6ceb03f343b09190cb2fb4bbe144. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.384225 18083 tablet_service.cc:1505] Processing CreateTablet for tablet 14e6f2c3d85b437cac3ead436d5494a7 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20251023 07:58:35.396210 18084 tablet_service.cc:1505] Processing CreateTablet for tablet b19b550093fb4ab181e62957d89460e7 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20251023 07:58:35.396620 18299 raft_consensus.cc:493] T abefe27ebb4c4179a8620d4e638fe119 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:35.397151 18299 raft_consensus.cc:515] T abefe27ebb4c4179a8620d4e638fe119 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:35.398144 18158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1178e2ed919b40f29672fc6233b71cf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.397637 18084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b19b550093fb4ab181e62957d89460e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.399214 18167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25d22e66fcd6444a9b9c469acd781e59. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.404263 18241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6c529d344cc483a96dbb509ca4c5890. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.414055 18089 tablet_service.cc:1505] Processing CreateTablet for tablet c6c529d344cc483a96dbb509ca4c5890 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20251023 07:58:35.415881 18089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6c529d344cc483a96dbb509ca4c5890. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.396202 18161 tablet_service.cc:1505] Processing CreateTablet for tablet 1f437560602a470ca62b7a1fa9471026 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20251023 07:58:35.377135 18233 tablet_service.cc:1505] Processing CreateTablet for tablet 07b28d84c73d42d583d6f80199700309 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20251023 07:58:35.420222 18291 tablet_bootstrap.cc:492] T 4117fd2188e14b9aacc56f82245a3cc6 P 982df35c5b554a8fa64807352c4f34ee: Bootstrap starting.
I20251023 07:58:35.421263 18233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07b28d84c73d42d583d6f80199700309. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.417322 18161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f437560602a470ca62b7a1fa9471026. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.430451 18160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6c529d344cc483a96dbb509ca4c5890. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.438479 18292 ts_tablet_manager.cc:1434] T 3d1032da07fd44be9c392e8f4cd2af1f P b3a1328f9c8c484fab08292ce2171ec9: Time spent starting tablet: real 0.246s user 0.020s sys 0.042s
I20251023 07:58:35.439627 18292 tablet_bootstrap.cc:492] T abefe27ebb4c4179a8620d4e638fe119 P b3a1328f9c8c484fab08292ce2171ec9: Bootstrap starting.
W20251023 07:58:35.445770 17985 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.16.126.2:45799, user_credentials={real_user=slave}} blocked reactor thread for 64994.2us
I20251023 07:58:35.448290 18090 tablet_service.cc:1505] Processing CreateTablet for tablet 1f437560602a470ca62b7a1fa9471026 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
W20251023 07:58:35.454296 17987 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.16.126.1:44025, user_credentials={real_user=slave}} blocked reactor thread for 60380.6us
I20251023 07:58:35.455394 18293 ts_tablet_manager.cc:1434] T 5d4096f60c864412bb51be0c52c22961 P 10dfae53d0c941f08bded43539841761: Time spent starting tablet: real 0.124s user 0.010s sys 0.008s
I20251023 07:58:35.456794 18293 tablet_bootstrap.cc:492] T 1f184d89e4244f12af7afd690bc7027d P 10dfae53d0c941f08bded43539841761: Bootstrap starting.
I20251023 07:58:35.465988 18299 leader_election.cc:290] T abefe27ebb4c4179a8620d4e638fe119 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:58:35.482419 18090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f437560602a470ca62b7a1fa9471026. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.453086 18162 tablet_service.cc:1505] Processing CreateTablet for tablet 2d81605b8fe7427b94af7f3c481ed765 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20251023 07:58:35.484200 18162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d81605b8fe7427b94af7f3c481ed765. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.483217 18083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14e6f2c3d85b437cac3ead436d5494a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.504990 18091 tablet_service.cc:1505] Processing CreateTablet for tablet 2d81605b8fe7427b94af7f3c481ed765 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20251023 07:58:35.510854 18091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d81605b8fe7427b94af7f3c481ed765. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.518477 18291 tablet_bootstrap.cc:654] T 4117fd2188e14b9aacc56f82245a3cc6 P 982df35c5b554a8fa64807352c4f34ee: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:35.520881 18163 tablet_service.cc:1505] Processing CreateTablet for tablet 7a0f3569fcc34ba8b721d4ca9f31b6fa (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20251023 07:58:35.522316 18086 tablet_service.cc:1505] Processing CreateTablet for tablet 07b28d84c73d42d583d6f80199700309 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20251023 07:58:35.544744 18251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e4884051da6c4cdc9e0811e70667dd19" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:35.545809 18086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07b28d84c73d42d583d6f80199700309. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.522480 18166 tablet_service.cc:1505] Processing CreateTablet for tablet 07b28d84c73d42d583d6f80199700309 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20251023 07:58:35.527597 18102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e4884051da6c4cdc9e0811e70667dd19" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
W20251023 07:58:35.552464 18143 leader_election.cc:343] T e4884051da6c4cdc9e0811e70667dd19 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): Illegal state: must be running to vote when last-logged opid is not known
W20251023 07:58:35.553144 18142 leader_election.cc:343] T e4884051da6c4cdc9e0811e70667dd19 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:35.553685 18142 leader_election.cc:304] T e4884051da6c4cdc9e0811e70667dd19 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10dfae53d0c941f08bded43539841761; no voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9
I20251023 07:58:35.554978 18301 raft_consensus.cc:2749] T e4884051da6c4cdc9e0811e70667dd19 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:58:35.555441 18239 tablet_service.cc:1505] Processing CreateTablet for tablet f90cf0955288472898eff5b7e6459195 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20251023 07:58:35.556712 18239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f90cf0955288472898eff5b7e6459195. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.529779 18163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a0f3569fcc34ba8b721d4ca9f31b6fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.560349 18235 tablet_service.cc:1505] Processing CreateTablet for tablet 231c8691a471417c859146b4e7b4b440 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20251023 07:58:35.561280 18166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07b28d84c73d42d583d6f80199700309. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.553088 18238 tablet_service.cc:1505] Processing CreateTablet for tablet 7a0f3569fcc34ba8b721d4ca9f31b6fa (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20251023 07:58:35.563194 18237 tablet_service.cc:1505] Processing CreateTablet for tablet 732495dddec64a3aa196110bfda45b37 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20251023 07:58:35.564507 18235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 231c8691a471417c859146b4e7b4b440. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.569797 18238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a0f3569fcc34ba8b721d4ca9f31b6fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.538193 18084 tablet_service.cc:1505] Processing CreateTablet for tablet 7a0f3569fcc34ba8b721d4ca9f31b6fa (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20251023 07:58:35.570796 18084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a0f3569fcc34ba8b721d4ca9f31b6fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.575938 18092 tablet_service.cc:1505] Processing CreateTablet for tablet 732495dddec64a3aa196110bfda45b37 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20251023 07:58:35.580183 18167 tablet_service.cc:1505] Processing CreateTablet for tablet 732495dddec64a3aa196110bfda45b37 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20251023 07:58:35.582629 18167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 732495dddec64a3aa196110bfda45b37. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.583670 18240 tablet_service.cc:1505] Processing CreateTablet for tablet 01f269ca63a8498498956fb3577f35d3 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20251023 07:58:35.521413 18159 tablet_service.cc:1505] Processing CreateTablet for tablet f90cf0955288472898eff5b7e6459195 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20251023 07:58:35.586033 18159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f90cf0955288472898eff5b7e6459195. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.586447 18083 tablet_service.cc:1505] Processing CreateTablet for tablet 231c8691a471417c859146b4e7b4b440 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20251023 07:58:35.587456 18291 tablet_bootstrap.cc:492] T 4117fd2188e14b9aacc56f82245a3cc6 P 982df35c5b554a8fa64807352c4f34ee: No bootstrap required, opened a new log
I20251023 07:58:35.587961 18291 ts_tablet_manager.cc:1403] T 4117fd2188e14b9aacc56f82245a3cc6 P 982df35c5b554a8fa64807352c4f34ee: Time spent bootstrapping tablet: real 0.168s user 0.002s sys 0.009s
I20251023 07:58:35.590644 18234 tablet_service.cc:1505] Processing CreateTablet for tablet 33ee36de303b458e88fa6bad4587c0e6 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20251023 07:58:35.590912 18291 raft_consensus.cc:359] T 4117fd2188e14b9aacc56f82245a3cc6 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:35.591746 18291 raft_consensus.cc:385] T 4117fd2188e14b9aacc56f82245a3cc6 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:35.527900 18164 tablet_service.cc:1505] Processing CreateTablet for tablet 231c8691a471417c859146b4e7b4b440 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20251023 07:58:35.592092 18291 raft_consensus.cc:740] T 4117fd2188e14b9aacc56f82245a3cc6 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Initialized, Role: FOLLOWER
I20251023 07:58:35.592859 18164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 231c8691a471417c859146b4e7b4b440. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.596369 18085 tablet_service.cc:1505] Processing CreateTablet for tablet e25fd146cb564be69022d0f53010bbfa (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20251023 07:58:35.592878 18291 consensus_queue.cc:260] T 4117fd2188e14b9aacc56f82245a3cc6 P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:35.601466 18291 ts_tablet_manager.cc:1434] T 4117fd2188e14b9aacc56f82245a3cc6 P 982df35c5b554a8fa64807352c4f34ee: Time spent starting tablet: real 0.013s user 0.008s sys 0.001s
I20251023 07:58:35.601692 18092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 732495dddec64a3aa196110bfda45b37. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.602432 18291 tablet_bootstrap.cc:492] T e4884051da6c4cdc9e0811e70667dd19 P 982df35c5b554a8fa64807352c4f34ee: Bootstrap starting.
I20251023 07:58:35.603101 18083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 231c8691a471417c859146b4e7b4b440. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.608665 18165 tablet_service.cc:1505] Processing CreateTablet for tablet e25fd146cb564be69022d0f53010bbfa (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20251023 07:58:35.574337 18087 tablet_service.cc:1505] Processing CreateTablet for tablet f90cf0955288472898eff5b7e6459195 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20251023 07:58:35.614580 18236 tablet_service.cc:1505] Processing CreateTablet for tablet a939fd9e853a45d1aa626a4566c14abc (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20251023 07:58:35.563225 18232 tablet_service.cc:1505] Processing CreateTablet for tablet e25fd146cb564be69022d0f53010bbfa (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20251023 07:58:35.616648 18237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 732495dddec64a3aa196110bfda45b37. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.617722 18240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01f269ca63a8498498956fb3577f35d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.621733 18232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e25fd146cb564be69022d0f53010bbfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.628026 18088 tablet_service.cc:1505] Processing CreateTablet for tablet 01f269ca63a8498498956fb3577f35d3 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20251023 07:58:35.630959 18234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33ee36de303b458e88fa6bad4587c0e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.631081 18177 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "abefe27ebb4c4179a8620d4e638fe119" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
W20251023 07:58:35.632723 18215 leader_election.cc:343] T abefe27ebb4c4179a8620d4e638fe119 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:35.614614 18087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f90cf0955288472898eff5b7e6459195. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.635515 18167 tablet_service.cc:1505] Processing CreateTablet for tablet 01f269ca63a8498498956fb3577f35d3 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20251023 07:58:35.639065 18293 tablet_bootstrap.cc:700] T 1f184d89e4244f12af7afd690bc7027d P 10dfae53d0c941f08bded43539841761: Time spent opening tablet: real 0.138s user 0.005s sys 0.000s
I20251023 07:58:35.639794 18293 tablet_bootstrap.cc:654] T 1f184d89e4244f12af7afd690bc7027d P 10dfae53d0c941f08bded43539841761: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:35.643765 18088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01f269ca63a8498498956fb3577f35d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.649756 18300 raft_consensus.cc:493] T 3d1032da07fd44be9c392e8f4cd2af1f P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:35.650271 18300 raft_consensus.cc:515] T 3d1032da07fd44be9c392e8f4cd2af1f P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:35.652830 18300 leader_election.cc:290] T 3d1032da07fd44be9c392e8f4cd2af1f P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:35.658205 18236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a939fd9e853a45d1aa626a4566c14abc. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.670503 18235 tablet_service.cc:1505] Processing CreateTablet for tablet e85adbfd669946ce9f939c02865fea6a (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20251023 07:58:35.671845 18235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e85adbfd669946ce9f939c02865fea6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.659703 18292 tablet_bootstrap.cc:654] T abefe27ebb4c4179a8620d4e638fe119 P b3a1328f9c8c484fab08292ce2171ec9: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:35.676985 18167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01f269ca63a8498498956fb3577f35d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.684882 18162 tablet_service.cc:1505] Processing CreateTablet for tablet 33ee36de303b458e88fa6bad4587c0e6 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20251023 07:58:35.683336 18085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e25fd146cb564be69022d0f53010bbfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.689952 18160 tablet_service.cc:1505] Processing CreateTablet for tablet a939fd9e853a45d1aa626a4566c14abc (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20251023 07:58:35.690176 18158 tablet_service.cc:1505] Processing CreateTablet for tablet 063924334ed846f3bd41c36cc4651236 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20251023 07:58:35.692437 18233 tablet_service.cc:1505] Processing CreateTablet for tablet c8b2781a072e401dba80e2879748e681 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20251023 07:58:35.707955 18165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e25fd146cb564be69022d0f53010bbfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.728924 18158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 063924334ed846f3bd41c36cc4651236. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.672519 18240 tablet_service.cc:1505] Processing CreateTablet for tablet 063924334ed846f3bd41c36cc4651236 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20251023 07:58:35.720772 18301 raft_consensus.cc:493] T 5d4096f60c864412bb51be0c52c22961 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:35.722765 18161 tablet_service.cc:1505] Processing CreateTablet for tablet c8b2781a072e401dba80e2879748e681 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20251023 07:58:35.725733 18164 tablet_service.cc:1505] Processing CreateTablet for tablet 3e78cdb4b2af4f5a855ec00a07f2cbc9 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20251023 07:58:35.739315 18162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33ee36de303b458e88fa6bad4587c0e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.737100 18301 raft_consensus.cc:515] T 5d4096f60c864412bb51be0c52c22961 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } }
I20251023 07:58:35.740141 18164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e78cdb4b2af4f5a855ec00a07f2cbc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.740963 18161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8b2781a072e401dba80e2879748e681. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.741329 18301 leader_election.cc:290] T 5d4096f60c864412bb51be0c52c22961 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061), b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025)
I20251023 07:58:35.744282 18102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d4096f60c864412bb51be0c52c22961" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:35.750329 18166 tablet_service.cc:1505] Processing CreateTablet for tablet e85adbfd669946ce9f939c02865fea6a (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
W20251023 07:58:35.751247 18143 leader_election.cc:343] T 5d4096f60c864412bb51be0c52c22961 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:35.752122 18166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e85adbfd669946ce9f939c02865fea6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.771170 18241 tablet_service.cc:1505] Processing CreateTablet for tablet 3e78cdb4b2af4f5a855ec00a07f2cbc9 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20251023 07:58:35.781067 18251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d4096f60c864412bb51be0c52c22961" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
W20251023 07:58:35.782438 18142 leader_election.cc:343] T 5d4096f60c864412bb51be0c52c22961 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:35.782958 18142 leader_election.cc:304] T 5d4096f60c864412bb51be0c52c22961 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10dfae53d0c941f08bded43539841761; no voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9
I20251023 07:58:35.784216 18301 raft_consensus.cc:2749] T 5d4096f60c864412bb51be0c52c22961 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:58:35.799310 18087 tablet_service.cc:1505] Processing CreateTablet for tablet 33ee36de303b458e88fa6bad4587c0e6 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20251023 07:58:35.801163 18087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33ee36de303b458e88fa6bad4587c0e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.804039 18292 tablet_bootstrap.cc:492] T abefe27ebb4c4179a8620d4e638fe119 P b3a1328f9c8c484fab08292ce2171ec9: No bootstrap required, opened a new log
I20251023 07:58:35.804545 18292 ts_tablet_manager.cc:1403] T abefe27ebb4c4179a8620d4e638fe119 P b3a1328f9c8c484fab08292ce2171ec9: Time spent bootstrapping tablet: real 0.365s user 0.028s sys 0.015s
I20251023 07:58:35.805160 18090 tablet_service.cc:1505] Processing CreateTablet for tablet a939fd9e853a45d1aa626a4566c14abc (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20251023 07:58:35.806520 18090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a939fd9e853a45d1aa626a4566c14abc. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.807447 18292 raft_consensus.cc:359] T abefe27ebb4c4179a8620d4e638fe119 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:35.808212 18292 raft_consensus.cc:385] T abefe27ebb4c4179a8620d4e638fe119 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:35.808501 18292 raft_consensus.cc:740] T abefe27ebb4c4179a8620d4e638fe119 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Initialized, Role: FOLLOWER
I20251023 07:58:35.809377 18292 consensus_queue.cc:260] T abefe27ebb4c4179a8620d4e638fe119 P b3a1328f9c8c484fab08292ce2171ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:35.811285 18177 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3d1032da07fd44be9c392e8f4cd2af1f" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
W20251023 07:58:35.812595 18066 leader_election.cc:343] T 3d1032da07fd44be9c392e8f4cd2af1f P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:35.814970 18292 ts_tablet_manager.cc:1434] T abefe27ebb4c4179a8620d4e638fe119 P b3a1328f9c8c484fab08292ce2171ec9: Time spent starting tablet: real 0.010s user 0.008s sys 0.000s
I20251023 07:58:35.815330 18088 tablet_service.cc:1505] Processing CreateTablet for tablet 063924334ed846f3bd41c36cc4651236 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20251023 07:58:35.815941 18292 tablet_bootstrap.cc:492] T 5585a11a884140c7abc7d5a3b6ab86f3 P b3a1328f9c8c484fab08292ce2171ec9: Bootstrap starting.
I20251023 07:58:35.816617 18088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 063924334ed846f3bd41c36cc4651236. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.821378 18102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "abefe27ebb4c4179a8620d4e638fe119" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:35.822136 18102 raft_consensus.cc:2468] T abefe27ebb4c4179a8620d4e638fe119 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 0.
I20251023 07:58:35.823015 18291 tablet_bootstrap.cc:654] T e4884051da6c4cdc9e0811e70667dd19 P 982df35c5b554a8fa64807352c4f34ee: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:35.795617 18160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a939fd9e853a45d1aa626a4566c14abc. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.831789 18217 leader_election.cc:304] T abefe27ebb4c4179a8620d4e638fe119 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9; no voters: 10dfae53d0c941f08bded43539841761
I20251023 07:58:35.837944 18161 tablet_service.cc:1505] Processing CreateTablet for tablet 5939b6a960ea4b0581b61ccdcdfa7c37 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20251023 07:58:35.844991 18299 raft_consensus.cc:2804] T abefe27ebb4c4179a8620d4e638fe119 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:58:35.845515 18299 raft_consensus.cc:493] T abefe27ebb4c4179a8620d4e638fe119 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:35.845945 18299 raft_consensus.cc:3060] T abefe27ebb4c4179a8620d4e638fe119 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:35.848065 18234 tablet_service.cc:1505] Processing CreateTablet for tablet 5939b6a960ea4b0581b61ccdcdfa7c37 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20251023 07:58:35.843432 18089 tablet_service.cc:1505] Processing CreateTablet for tablet c8b2781a072e401dba80e2879748e681 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20251023 07:58:35.829293 18233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8b2781a072e401dba80e2879748e681. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.860766 18240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 063924334ed846f3bd41c36cc4651236. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.867650 18234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5939b6a960ea4b0581b61ccdcdfa7c37. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.867722 18161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5939b6a960ea4b0581b61ccdcdfa7c37. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.816320 18086 tablet_service.cc:1505] Processing CreateTablet for tablet e85adbfd669946ce9f939c02865fea6a (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20251023 07:58:35.888676 18237 tablet_service.cc:1505] Processing CreateTablet for tablet 3c5c040d6ebe40e5a5be6be47de5a7bc (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20251023 07:58:35.898047 18241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e78cdb4b2af4f5a855ec00a07f2cbc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.900065 18238 tablet_service.cc:1505] Processing CreateTablet for tablet 931f55bec99140c69a4b5654b691c861 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20251023 07:58:35.901170 18292 tablet_bootstrap.cc:654] T 5585a11a884140c7abc7d5a3b6ab86f3 P b3a1328f9c8c484fab08292ce2171ec9: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:35.902926 18251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3d1032da07fd44be9c392e8f4cd2af1f" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
W20251023 07:58:35.904327 18067 leader_election.cc:343] T 3d1032da07fd44be9c392e8f4cd2af1f P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:35.904801 18067 leader_election.cc:304] T 3d1032da07fd44be9c392e8f4cd2af1f P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3a1328f9c8c484fab08292ce2171ec9; no voters: 10dfae53d0c941f08bded43539841761, 982df35c5b554a8fa64807352c4f34ee
I20251023 07:58:35.906018 18300 raft_consensus.cc:2749] T 3d1032da07fd44be9c392e8f4cd2af1f P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:58:35.901515 18238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 931f55bec99140c69a4b5654b691c861. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.902755 18163 tablet_service.cc:1505] Processing CreateTablet for tablet 3c5c040d6ebe40e5a5be6be47de5a7bc (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20251023 07:58:35.910859 18236 tablet_service.cc:1505] Processing CreateTablet for tablet 714c3ef74ecc47419a20ab7e23217e5e (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20251023 07:58:35.912566 18090 tablet_service.cc:1505] Processing CreateTablet for tablet 3e78cdb4b2af4f5a855ec00a07f2cbc9 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20251023 07:58:35.913961 18090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e78cdb4b2af4f5a855ec00a07f2cbc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.919770 18291 tablet_bootstrap.cc:492] T e4884051da6c4cdc9e0811e70667dd19 P 982df35c5b554a8fa64807352c4f34ee: No bootstrap required, opened a new log
I20251023 07:58:35.920275 18291 ts_tablet_manager.cc:1403] T e4884051da6c4cdc9e0811e70667dd19 P 982df35c5b554a8fa64807352c4f34ee: Time spent bootstrapping tablet: real 0.318s user 0.030s sys 0.042s
I20251023 07:58:35.920596 18083 tablet_service.cc:1505] Processing CreateTablet for tablet 5939b6a960ea4b0581b61ccdcdfa7c37 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20251023 07:58:35.921005 18164 tablet_service.cc:1505] Processing CreateTablet for tablet 931f55bec99140c69a4b5654b691c861 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20251023 07:58:35.922216 18164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 931f55bec99140c69a4b5654b691c861. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.924191 18232 tablet_service.cc:1505] Processing CreateTablet for tablet 85799f6eb6ae41fa9620accb877d8708 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20251023 07:58:35.924845 18293 tablet_bootstrap.cc:492] T 1f184d89e4244f12af7afd690bc7027d P 10dfae53d0c941f08bded43539841761: No bootstrap required, opened a new log
I20251023 07:58:35.925485 18293 ts_tablet_manager.cc:1403] T 1f184d89e4244f12af7afd690bc7027d P 10dfae53d0c941f08bded43539841761: Time spent bootstrapping tablet: real 0.469s user 0.011s sys 0.031s
I20251023 07:58:35.925935 18163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c5c040d6ebe40e5a5be6be47de5a7bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.924036 18291 raft_consensus.cc:359] T e4884051da6c4cdc9e0811e70667dd19 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:35.928668 18291 raft_consensus.cc:385] T e4884051da6c4cdc9e0811e70667dd19 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:35.929049 18291 raft_consensus.cc:740] T e4884051da6c4cdc9e0811e70667dd19 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Initialized, Role: FOLLOWER
I20251023 07:58:35.929976 18291 consensus_queue.cc:260] T e4884051da6c4cdc9e0811e70667dd19 P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:35.928227 18293 raft_consensus.cc:359] T 1f184d89e4244f12af7afd690bc7027d P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:35.936527 18293 raft_consensus.cc:385] T 1f184d89e4244f12af7afd690bc7027d P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:35.943100 18293 raft_consensus.cc:740] T 1f184d89e4244f12af7afd690bc7027d P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Initialized, Role: FOLLOWER
I20251023 07:58:35.956292 18237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c5c040d6ebe40e5a5be6be47de5a7bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.964032 18235 tablet_service.cc:1505] Processing CreateTablet for tablet ce0cc368c5054eef9dca968072a2d4fd (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20251023 07:58:35.965624 18232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85799f6eb6ae41fa9620accb877d8708. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.966707 18235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce0cc368c5054eef9dca968072a2d4fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.965198 18092 tablet_service.cc:1505] Processing CreateTablet for tablet 3c5c040d6ebe40e5a5be6be47de5a7bc (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20251023 07:58:35.971498 18085 tablet_service.cc:1505] Processing CreateTablet for tablet 931f55bec99140c69a4b5654b691c861 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20251023 07:58:35.976825 18089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8b2781a072e401dba80e2879748e681. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.985219 18091 tablet_service.cc:1505] Processing CreateTablet for tablet 714c3ef74ecc47419a20ab7e23217e5e (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20251023 07:58:35.986135 18299 raft_consensus.cc:515] T abefe27ebb4c4179a8620d4e638fe119 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:35.988874 18299 leader_election.cc:290] T abefe27ebb4c4179a8620d4e638fe119 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 election: Requested vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:58:35.989338 18316 raft_consensus.cc:493] T e4884051da6c4cdc9e0811e70667dd19 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:35.989992 18316 raft_consensus.cc:515] T e4884051da6c4cdc9e0811e70667dd19 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:35.992722 18316 leader_election.cc:290] T e4884051da6c4cdc9e0811e70667dd19 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:58:35.975955 18293 consensus_queue.cc:260] T 1f184d89e4244f12af7afd690bc7027d P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:35.924135 18239 tablet_service.cc:1505] Processing CreateTablet for tablet dad81a56e87946cbb2a7f3e33c2e2bd4 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20251023 07:58:36.015053 18291 ts_tablet_manager.cc:1434] T e4884051da6c4cdc9e0811e70667dd19 P 982df35c5b554a8fa64807352c4f34ee: Time spent starting tablet: real 0.094s user 0.008s sys 0.007s
I20251023 07:58:36.016321 18291 tablet_bootstrap.cc:492] T 5d4096f60c864412bb51be0c52c22961 P 982df35c5b554a8fa64807352c4f34ee: Bootstrap starting.
I20251023 07:58:36.016464 18159 tablet_service.cc:1505] Processing CreateTablet for tablet 714c3ef74ecc47419a20ab7e23217e5e (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20251023 07:58:36.018421 18159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 714c3ef74ecc47419a20ab7e23217e5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:35.975307 18162 tablet_service.cc:1505] Processing CreateTablet for tablet 9bc482083f3b4c9ba97b8769ece194ad (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20251023 07:58:36.022658 18162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bc482083f3b4c9ba97b8769ece194ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:36.005162 18293 ts_tablet_manager.cc:1434] T 1f184d89e4244f12af7afd690bc7027d P 10dfae53d0c941f08bded43539841761: Time spent starting tablet: real 0.079s user 0.005s sys 0.002s
I20251023 07:58:36.028115 18086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e85adbfd669946ce9f939c02865fea6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:36.027968 18102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "abefe27ebb4c4179a8620d4e638fe119" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
I20251023 07:58:36.028631 18101 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e4884051da6c4cdc9e0811e70667dd19" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:36.034974 18084 tablet_service.cc:1505] Processing CreateTablet for tablet dad81a56e87946cbb2a7f3e33c2e2bd4 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20251023 07:58:36.035485 18165 tablet_service.cc:1505] Processing CreateTablet for tablet dad81a56e87946cbb2a7f3e33c2e2bd4 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20251023 07:58:36.026556 18236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 714c3ef74ecc47419a20ab7e23217e5e. 1 dirs total, 0 dirs full, 0 dirs failed
W20251023 07:58:36.041301 18217 leader_election.cc:343] T e4884051da6c4cdc9e0811e70667dd19 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:36.042454 18102 raft_consensus.cc:3060] T abefe27ebb4c4179a8620d4e638fe119 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:36.047010 18088 tablet_service.cc:1505] Processing CreateTablet for tablet 85799f6eb6ae41fa9620accb877d8708 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20251023 07:58:36.048596 18084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dad81a56e87946cbb2a7f3e33c2e2bd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:36.057749 18091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 714c3ef74ecc47419a20ab7e23217e5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:36.059939 18317 raft_consensus.cc:493] T 4117fd2188e14b9aacc56f82245a3cc6 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:36.060565 18317 raft_consensus.cc:515] T 4117fd2188e14b9aacc56f82245a3cc6 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.062103 18088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85799f6eb6ae41fa9620accb877d8708. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:36.063251 18317 leader_election.cc:290] T 4117fd2188e14b9aacc56f82245a3cc6 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:58:36.063712 18292 tablet_bootstrap.cc:492] T 5585a11a884140c7abc7d5a3b6ab86f3 P b3a1328f9c8c484fab08292ce2171ec9: No bootstrap required, opened a new log
I20251023 07:58:36.063616 18101 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4117fd2188e14b9aacc56f82245a3cc6" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:36.064217 18292 ts_tablet_manager.cc:1403] T 5585a11a884140c7abc7d5a3b6ab86f3 P b3a1328f9c8c484fab08292ce2171ec9: Time spent bootstrapping tablet: real 0.248s user 0.039s sys 0.037s
W20251023 07:58:36.065032 18217 leader_election.cc:343] T 4117fd2188e14b9aacc56f82245a3cc6 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:36.067062 18292 raft_consensus.cc:359] T 5585a11a884140c7abc7d5a3b6ab86f3 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.067749 18292 raft_consensus.cc:385] T 5585a11a884140c7abc7d5a3b6ab86f3 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:36.068027 18292 raft_consensus.cc:740] T 5585a11a884140c7abc7d5a3b6ab86f3 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Initialized, Role: FOLLOWER
I20251023 07:58:36.068667 18292 consensus_queue.cc:260] T 5585a11a884140c7abc7d5a3b6ab86f3 P b3a1328f9c8c484fab08292ce2171ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.069576 18293 tablet_bootstrap.cc:492] T 79fcf5e4a38448ba95c62cc1ffe2823a P 10dfae53d0c941f08bded43539841761: Bootstrap starting.
I20251023 07:58:36.071018 18102 raft_consensus.cc:2468] T abefe27ebb4c4179a8620d4e638fe119 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 1.
I20251023 07:58:36.072228 18217 leader_election.cc:304] T abefe27ebb4c4179a8620d4e638fe119 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:58:36.073189 18092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c5c040d6ebe40e5a5be6be47de5a7bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:36.073262 18292 ts_tablet_manager.cc:1434] T 5585a11a884140c7abc7d5a3b6ab86f3 P b3a1328f9c8c484fab08292ce2171ec9: Time spent starting tablet: real 0.009s user 0.004s sys 0.004s
I20251023 07:58:36.077234 18167 tablet_service.cc:1505] Processing CreateTablet for tablet ce0cc368c5054eef9dca968072a2d4fd (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20251023 07:58:36.082265 18177 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "abefe27ebb4c4179a8620d4e638fe119" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761"
I20251023 07:58:36.082161 18158 tablet_service.cc:1505] Processing CreateTablet for tablet 85799f6eb6ae41fa9620accb877d8708 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20251023 07:58:36.082767 18292 tablet_bootstrap.cc:492] T 4117fd2188e14b9aacc56f82245a3cc6 P b3a1328f9c8c484fab08292ce2171ec9: Bootstrap starting.
I20251023 07:58:36.089748 18239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dad81a56e87946cbb2a7f3e33c2e2bd4. 1 dirs total, 0 dirs full, 0 dirs failed
W20251023 07:58:36.090963 18215 leader_election.cc:343] T abefe27ebb4c4179a8620d4e638fe119 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:36.080539 18317 raft_consensus.cc:2804] T abefe27ebb4c4179a8620d4e638fe119 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:58:36.092317 18317 raft_consensus.cc:697] T abefe27ebb4c4179a8620d4e638fe119 P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Becoming Leader. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Running, Role: LEADER
I20251023 07:58:36.097550 18175 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4117fd2188e14b9aacc56f82245a3cc6" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:36.100204 18300 raft_consensus.cc:493] T 5585a11a884140c7abc7d5a3b6ab86f3 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:36.100451 18176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e4884051da6c4cdc9e0811e70667dd19" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:36.093294 18317 consensus_queue.cc:237] T abefe27ebb4c4179a8620d4e638fe119 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.100886 18083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5939b6a960ea4b0581b61ccdcdfa7c37. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:36.101186 18176 raft_consensus.cc:2468] T e4884051da6c4cdc9e0811e70667dd19 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 0.
W20251023 07:58:36.109164 18048 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20251023 07:58:36.131171 18235 tablet_service.cc:1505] Processing CreateTablet for tablet 0d6dd28a0f414e8e93fe9cf4c98ce4a2 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20251023 07:58:36.132386 18235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d6dd28a0f414e8e93fe9cf4c98ce4a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:36.133764 18085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 931f55bec99140c69a4b5654b691c861. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:36.139686 18241 tablet_service.cc:1505] Processing CreateTablet for tablet 9bc482083f3b4c9ba97b8769ece194ad (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20251023 07:58:36.140954 18241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bc482083f3b4c9ba97b8769ece194ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:36.110515 18087 tablet_service.cc:1505] Processing CreateTablet for tablet ce0cc368c5054eef9dca968072a2d4fd (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20251023 07:58:36.118129 18165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dad81a56e87946cbb2a7f3e33c2e2bd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:36.116202 18237 tablet_service.cc:1505] Processing CreateTablet for tablet ae4437d151054b59a0e93ca01a9609c7 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20251023 07:58:36.100893 18300 raft_consensus.cc:515] T 5585a11a884140c7abc7d5a3b6ab86f3 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.145825 18237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae4437d151054b59a0e93ca01a9609c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:36.146623 18300 leader_election.cc:290] T 5585a11a884140c7abc7d5a3b6ab86f3 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:36.147478 18176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5585a11a884140c7abc7d5a3b6ab86f3" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:36.148061 18087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce0cc368c5054eef9dca968072a2d4fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:36.148990 18301 raft_consensus.cc:493] T 1f184d89e4244f12af7afd690bc7027d P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20251023 07:58:36.149041 18066 leader_election.cc:343] T 5585a11a884140c7abc7d5a3b6ab86f3 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:36.113946 18240 tablet_service.cc:1505] Processing CreateTablet for tablet 8f25975c7ab4439c9975a5e5604727dc (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20251023 07:58:36.113061 18293 tablet_bootstrap.cc:654] T 79fcf5e4a38448ba95c62cc1ffe2823a P 10dfae53d0c941f08bded43539841761: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:36.149554 18301 raft_consensus.cc:515] T 1f184d89e4244f12af7afd690bc7027d P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.150396 18240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f25975c7ab4439c9975a5e5604727dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:36.151499 18301 leader_election.cc:290] T 1f184d89e4244f12af7afd690bc7027d P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:36.152453 18167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce0cc368c5054eef9dca968072a2d4fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:36.153350 18102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1f184d89e4244f12af7afd690bc7027d" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:36.154615 18158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85799f6eb6ae41fa9620accb877d8708. 1 dirs total, 0 dirs full, 0 dirs failed
W20251023 07:58:36.154635 18143 leader_election.cc:343] T 1f184d89e4244f12af7afd690bc7027d P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): Illegal state: must be running to vote when last-logged opid is not known
W20251023 07:58:36.115636 18215 leader_election.cc:343] T 4117fd2188e14b9aacc56f82245a3cc6 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:36.155844 18215 leader_election.cc:304] T 4117fd2188e14b9aacc56f82245a3cc6 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee; no voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9
I20251023 07:58:36.155897 18164 tablet_service.cc:1505] Processing CreateTablet for tablet d3b72ceda32a4ebc8de6e7a7992498aa (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20251023 07:58:36.156183 18163 tablet_service.cc:1505] Processing CreateTablet for tablet 8f25975c7ab4439c9975a5e5604727dc (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20251023 07:58:36.157197 18164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3b72ceda32a4ebc8de6e7a7992498aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:36.159839 18251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1f184d89e4244f12af7afd690bc7027d" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:36.161306 18251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5585a11a884140c7abc7d5a3b6ab86f3" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:36.165253 18215 leader_election.cc:304] T e4884051da6c4cdc9e0811e70667dd19 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10dfae53d0c941f08bded43539841761, 982df35c5b554a8fa64807352c4f34ee; no voters: b3a1328f9c8c484fab08292ce2171ec9
I20251023 07:58:36.166059 18317 raft_consensus.cc:2749] T 4117fd2188e14b9aacc56f82245a3cc6 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:58:36.166827 18317 raft_consensus.cc:2804] T e4884051da6c4cdc9e0811e70667dd19 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:58:36.167171 18317 raft_consensus.cc:493] T e4884051da6c4cdc9e0811e70667dd19 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:36.167500 18317 raft_consensus.cc:3060] T e4884051da6c4cdc9e0811e70667dd19 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:36.110456 18233 tablet_service.cc:1505] Processing CreateTablet for tablet d3b72ceda32a4ebc8de6e7a7992498aa (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20251023 07:58:36.170755 18233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3b72ceda32a4ebc8de6e7a7992498aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:36.171300 18162 tablet_service.cc:1505] Processing CreateTablet for tablet 0d6dd28a0f414e8e93fe9cf4c98ce4a2 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20251023 07:58:36.172628 18162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d6dd28a0f414e8e93fe9cf4c98ce4a2. 1 dirs total, 0 dirs full, 0 dirs failed
W20251023 07:58:36.178231 18142 leader_election.cc:343] T 1f184d89e4244f12af7afd690bc7027d P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:36.178694 18142 leader_election.cc:304] T 1f184d89e4244f12af7afd690bc7027d P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10dfae53d0c941f08bded43539841761; no voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9
I20251023 07:58:36.179790 18301 raft_consensus.cc:2749] T 1f184d89e4244f12af7afd690bc7027d P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251023 07:58:36.180886 18067 leader_election.cc:343] T 5585a11a884140c7abc7d5a3b6ab86f3 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:36.181342 18067 leader_election.cc:304] T 5585a11a884140c7abc7d5a3b6ab86f3 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3a1328f9c8c484fab08292ce2171ec9; no voters: 10dfae53d0c941f08bded43539841761, 982df35c5b554a8fa64807352c4f34ee
I20251023 07:58:36.182427 18300 raft_consensus.cc:2749] T 5585a11a884140c7abc7d5a3b6ab86f3 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:58:36.182631 18090 tablet_service.cc:1505] Processing CreateTablet for tablet d3b72ceda32a4ebc8de6e7a7992498aa (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20251023 07:58:36.184000 18090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3b72ceda32a4ebc8de6e7a7992498aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:36.184993 18163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f25975c7ab4439c9975a5e5604727dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:36.187704 18088 tablet_service.cc:1505] Processing CreateTablet for tablet 8f25975c7ab4439c9975a5e5604727dc (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20251023 07:58:36.189244 18088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f25975c7ab4439c9975a5e5604727dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:36.165109 18161 tablet_service.cc:1505] Processing CreateTablet for tablet ae4437d151054b59a0e93ca01a9609c7 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20251023 07:58:36.192001 18161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae4437d151054b59a0e93ca01a9609c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:36.169898 18292 tablet_bootstrap.cc:654] T 4117fd2188e14b9aacc56f82245a3cc6 P b3a1328f9c8c484fab08292ce2171ec9: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:36.201635 18293 tablet_bootstrap.cc:492] T 79fcf5e4a38448ba95c62cc1ffe2823a P 10dfae53d0c941f08bded43539841761: No bootstrap required, opened a new log
I20251023 07:58:36.202137 18293 ts_tablet_manager.cc:1403] T 79fcf5e4a38448ba95c62cc1ffe2823a P 10dfae53d0c941f08bded43539841761: Time spent bootstrapping tablet: real 0.149s user 0.010s sys 0.004s
I20251023 07:58:36.201522 18000 catalog_manager.cc:5649] T abefe27ebb4c4179a8620d4e638fe119 P 982df35c5b554a8fa64807352c4f34ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 982df35c5b554a8fa64807352c4f34ee (127.16.126.3). New cstate: current_term: 1 leader_uuid: "982df35c5b554a8fa64807352c4f34ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: HEALTHY } } }
I20251023 07:58:36.205972 18293 raft_consensus.cc:359] T 79fcf5e4a38448ba95c62cc1ffe2823a P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.206702 18293 raft_consensus.cc:385] T 79fcf5e4a38448ba95c62cc1ffe2823a P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:36.206987 18293 raft_consensus.cc:740] T 79fcf5e4a38448ba95c62cc1ffe2823a P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Initialized, Role: FOLLOWER
I20251023 07:58:36.210433 18086 tablet_service.cc:1505] Processing CreateTablet for tablet ae4437d151054b59a0e93ca01a9609c7 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20251023 07:58:36.210665 18317 raft_consensus.cc:515] T e4884051da6c4cdc9e0811e70667dd19 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.211827 18086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae4437d151054b59a0e93ca01a9609c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:36.213640 18176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e4884051da6c4cdc9e0811e70667dd19" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761"
I20251023 07:58:36.214257 18176 raft_consensus.cc:3060] T e4884051da6c4cdc9e0811e70667dd19 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:36.213640 18102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e4884051da6c4cdc9e0811e70667dd19" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
W20251023 07:58:36.219063 18217 leader_election.cc:343] T e4884051da6c4cdc9e0811e70667dd19 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:36.223493 18176 raft_consensus.cc:2468] T e4884051da6c4cdc9e0811e70667dd19 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 1.
I20251023 07:58:36.225787 18215 leader_election.cc:304] T e4884051da6c4cdc9e0811e70667dd19 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10dfae53d0c941f08bded43539841761, 982df35c5b554a8fa64807352c4f34ee; no voters: b3a1328f9c8c484fab08292ce2171ec9
I20251023 07:58:36.226758 18319 raft_consensus.cc:2804] T e4884051da6c4cdc9e0811e70667dd19 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:58:36.227481 18319 raft_consensus.cc:697] T e4884051da6c4cdc9e0811e70667dd19 P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Becoming Leader. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Running, Role: LEADER
I20251023 07:58:36.228395 18319 consensus_queue.cc:237] T e4884051da6c4cdc9e0811e70667dd19 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.177263 18291 tablet_bootstrap.cc:654] T 5d4096f60c864412bb51be0c52c22961 P 982df35c5b554a8fa64807352c4f34ee: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:36.267386 18085 tablet_service.cc:1505] Processing CreateTablet for tablet 0d6dd28a0f414e8e93fe9cf4c98ce4a2 (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20251023 07:58:36.268074 18087 tablet_service.cc:1505] Processing CreateTablet for tablet 9bc482083f3b4c9ba97b8769ece194ad (DEFAULT_TABLE table=test-workload [id=8bb191a5531a4d4fb58a25b13d592213]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20251023 07:58:36.268725 18085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d6dd28a0f414e8e93fe9cf4c98ce4a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:36.269384 18087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bc482083f3b4c9ba97b8769ece194ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:36.273504 18293 consensus_queue.cc:260] T 79fcf5e4a38448ba95c62cc1ffe2823a P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.275869 18293 ts_tablet_manager.cc:1434] T 79fcf5e4a38448ba95c62cc1ffe2823a P 10dfae53d0c941f08bded43539841761: Time spent starting tablet: real 0.073s user 0.006s sys 0.000s
I20251023 07:58:36.276871 18293 tablet_bootstrap.cc:492] T 744a3368282b44d9b9618922875d20d3 P 10dfae53d0c941f08bded43539841761: Bootstrap starting.
I20251023 07:58:36.245865 18317 leader_election.cc:290] T e4884051da6c4cdc9e0811e70667dd19 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 election: Requested vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:58:36.319531 18291 tablet_bootstrap.cc:492] T 5d4096f60c864412bb51be0c52c22961 P 982df35c5b554a8fa64807352c4f34ee: No bootstrap required, opened a new log
I20251023 07:58:36.325928 18291 ts_tablet_manager.cc:1403] T 5d4096f60c864412bb51be0c52c22961 P 982df35c5b554a8fa64807352c4f34ee: Time spent bootstrapping tablet: real 0.310s user 0.021s sys 0.017s
I20251023 07:58:36.327217 18292 tablet_bootstrap.cc:492] T 4117fd2188e14b9aacc56f82245a3cc6 P b3a1328f9c8c484fab08292ce2171ec9: No bootstrap required, opened a new log
I20251023 07:58:36.327667 18292 ts_tablet_manager.cc:1403] T 4117fd2188e14b9aacc56f82245a3cc6 P b3a1328f9c8c484fab08292ce2171ec9: Time spent bootstrapping tablet: real 0.245s user 0.007s sys 0.018s
I20251023 07:58:36.328897 18291 raft_consensus.cc:359] T 5d4096f60c864412bb51be0c52c22961 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } }
I20251023 07:58:36.329651 18291 raft_consensus.cc:385] T 5d4096f60c864412bb51be0c52c22961 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:36.329942 18291 raft_consensus.cc:740] T 5d4096f60c864412bb51be0c52c22961 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Initialized, Role: FOLLOWER
I20251023 07:58:36.330446 18292 raft_consensus.cc:359] T 4117fd2188e14b9aacc56f82245a3cc6 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.330610 18291 consensus_queue.cc:260] T 5d4096f60c864412bb51be0c52c22961 P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } }
I20251023 07:58:36.331192 18292 raft_consensus.cc:385] T 4117fd2188e14b9aacc56f82245a3cc6 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:36.332072 18292 raft_consensus.cc:740] T 4117fd2188e14b9aacc56f82245a3cc6 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Initialized, Role: FOLLOWER
I20251023 07:58:36.332942 18291 ts_tablet_manager.cc:1434] T 5d4096f60c864412bb51be0c52c22961 P 982df35c5b554a8fa64807352c4f34ee: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20251023 07:58:36.332778 18292 consensus_queue.cc:260] T 4117fd2188e14b9aacc56f82245a3cc6 P b3a1328f9c8c484fab08292ce2171ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.334918 18292 ts_tablet_manager.cc:1434] T 4117fd2188e14b9aacc56f82245a3cc6 P b3a1328f9c8c484fab08292ce2171ec9: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20251023 07:58:36.335986 18292 tablet_bootstrap.cc:492] T 79fcf5e4a38448ba95c62cc1ffe2823a P b3a1328f9c8c484fab08292ce2171ec9: Bootstrap starting.
I20251023 07:58:36.342283 18293 tablet_bootstrap.cc:654] T 744a3368282b44d9b9618922875d20d3 P 10dfae53d0c941f08bded43539841761: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:36.342845 18292 tablet_bootstrap.cc:654] T 79fcf5e4a38448ba95c62cc1ffe2823a P b3a1328f9c8c484fab08292ce2171ec9: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:36.361115 18300 raft_consensus.cc:493] T 4117fd2188e14b9aacc56f82245a3cc6 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:36.361862 18300 raft_consensus.cc:515] T 4117fd2188e14b9aacc56f82245a3cc6 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.364464 18300 leader_election.cc:290] T 4117fd2188e14b9aacc56f82245a3cc6 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:36.365442 18176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4117fd2188e14b9aacc56f82245a3cc6" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:36.366098 18251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4117fd2188e14b9aacc56f82245a3cc6" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:36.366727 18251 raft_consensus.cc:2468] T 4117fd2188e14b9aacc56f82245a3cc6 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3a1328f9c8c484fab08292ce2171ec9 in term 0.
W20251023 07:58:36.366824 18066 leader_election.cc:343] T 4117fd2188e14b9aacc56f82245a3cc6 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:36.368266 18067 leader_election.cc:304] T 4117fd2188e14b9aacc56f82245a3cc6 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9; no voters: 10dfae53d0c941f08bded43539841761
I20251023 07:58:36.369339 18300 raft_consensus.cc:2804] T 4117fd2188e14b9aacc56f82245a3cc6 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:58:36.369719 18300 raft_consensus.cc:493] T 4117fd2188e14b9aacc56f82245a3cc6 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:36.370043 18300 raft_consensus.cc:3060] T 4117fd2188e14b9aacc56f82245a3cc6 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:36.379351 18291 tablet_bootstrap.cc:492] T 1f184d89e4244f12af7afd690bc7027d P 982df35c5b554a8fa64807352c4f34ee: Bootstrap starting.
I20251023 07:58:36.384773 18300 raft_consensus.cc:515] T 4117fd2188e14b9aacc56f82245a3cc6 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.391002 18176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4117fd2188e14b9aacc56f82245a3cc6" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761"
W20251023 07:58:36.392328 18066 leader_election.cc:343] T 4117fd2188e14b9aacc56f82245a3cc6 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:36.395917 18251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4117fd2188e14b9aacc56f82245a3cc6" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
I20251023 07:58:36.396485 18251 raft_consensus.cc:3060] T 4117fd2188e14b9aacc56f82245a3cc6 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:36.401000 18291 tablet_bootstrap.cc:654] T 1f184d89e4244f12af7afd690bc7027d P 982df35c5b554a8fa64807352c4f34ee: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:36.404663 18251 raft_consensus.cc:2468] T 4117fd2188e14b9aacc56f82245a3cc6 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3a1328f9c8c484fab08292ce2171ec9 in term 1.
I20251023 07:58:36.405601 18300 leader_election.cc:290] T 4117fd2188e14b9aacc56f82245a3cc6 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 election: Requested vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:36.408241 18067 leader_election.cc:304] T 4117fd2188e14b9aacc56f82245a3cc6 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9; no voters: 10dfae53d0c941f08bded43539841761
I20251023 07:58:36.408876 18292 tablet_bootstrap.cc:492] T 79fcf5e4a38448ba95c62cc1ffe2823a P b3a1328f9c8c484fab08292ce2171ec9: No bootstrap required, opened a new log
I20251023 07:58:36.409502 18292 ts_tablet_manager.cc:1403] T 79fcf5e4a38448ba95c62cc1ffe2823a P b3a1328f9c8c484fab08292ce2171ec9: Time spent bootstrapping tablet: real 0.074s user 0.009s sys 0.026s
I20251023 07:58:36.412863 18293 tablet_bootstrap.cc:492] T 744a3368282b44d9b9618922875d20d3 P 10dfae53d0c941f08bded43539841761: No bootstrap required, opened a new log
I20251023 07:58:36.412635 18292 raft_consensus.cc:359] T 79fcf5e4a38448ba95c62cc1ffe2823a P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.413324 18293 ts_tablet_manager.cc:1403] T 744a3368282b44d9b9618922875d20d3 P 10dfae53d0c941f08bded43539841761: Time spent bootstrapping tablet: real 0.137s user 0.032s sys 0.030s
I20251023 07:58:36.413614 18300 raft_consensus.cc:2804] T 4117fd2188e14b9aacc56f82245a3cc6 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:58:36.415278 18300 raft_consensus.cc:697] T 4117fd2188e14b9aacc56f82245a3cc6 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Becoming Leader. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Running, Role: LEADER
I20251023 07:58:36.416122 18300 consensus_queue.cc:237] T 4117fd2188e14b9aacc56f82245a3cc6 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.413378 18292 raft_consensus.cc:385] T 79fcf5e4a38448ba95c62cc1ffe2823a P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:36.416739 18293 raft_consensus.cc:359] T 744a3368282b44d9b9618922875d20d3 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.416550 18000 catalog_manager.cc:5649] T e4884051da6c4cdc9e0811e70667dd19 P 982df35c5b554a8fa64807352c4f34ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 982df35c5b554a8fa64807352c4f34ee (127.16.126.3). New cstate: current_term: 1 leader_uuid: "982df35c5b554a8fa64807352c4f34ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: HEALTHY } } }
I20251023 07:58:36.417490 18292 raft_consensus.cc:740] T 79fcf5e4a38448ba95c62cc1ffe2823a P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Initialized, Role: FOLLOWER
I20251023 07:58:36.417526 18293 raft_consensus.cc:385] T 744a3368282b44d9b9618922875d20d3 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:36.418231 18293 raft_consensus.cc:740] T 744a3368282b44d9b9618922875d20d3 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Initialized, Role: FOLLOWER
I20251023 07:58:36.418627 18291 tablet_bootstrap.cc:492] T 1f184d89e4244f12af7afd690bc7027d P 982df35c5b554a8fa64807352c4f34ee: No bootstrap required, opened a new log
I20251023 07:58:36.419256 18291 ts_tablet_manager.cc:1403] T 1f184d89e4244f12af7afd690bc7027d P 982df35c5b554a8fa64807352c4f34ee: Time spent bootstrapping tablet: real 0.040s user 0.017s sys 0.004s
I20251023 07:58:36.418598 18292 consensus_queue.cc:260] T 79fcf5e4a38448ba95c62cc1ffe2823a P b3a1328f9c8c484fab08292ce2171ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.419096 18293 consensus_queue.cc:260] T 744a3368282b44d9b9618922875d20d3 P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.421753 18292 ts_tablet_manager.cc:1434] T 79fcf5e4a38448ba95c62cc1ffe2823a P b3a1328f9c8c484fab08292ce2171ec9: Time spent starting tablet: real 0.012s user 0.005s sys 0.002s
I20251023 07:58:36.421990 18291 raft_consensus.cc:359] T 1f184d89e4244f12af7afd690bc7027d P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.422683 18291 raft_consensus.cc:385] T 1f184d89e4244f12af7afd690bc7027d P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:36.422873 18292 tablet_bootstrap.cc:492] T 744a3368282b44d9b9618922875d20d3 P b3a1328f9c8c484fab08292ce2171ec9: Bootstrap starting.
I20251023 07:58:36.423002 18291 raft_consensus.cc:740] T 1f184d89e4244f12af7afd690bc7027d P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Initialized, Role: FOLLOWER
I20251023 07:58:36.423889 18291 consensus_queue.cc:260] T 1f184d89e4244f12af7afd690bc7027d P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.427259 18293 ts_tablet_manager.cc:1434] T 744a3368282b44d9b9618922875d20d3 P 10dfae53d0c941f08bded43539841761: Time spent starting tablet: real 0.014s user 0.007s sys 0.000s
I20251023 07:58:36.429841 18291 ts_tablet_manager.cc:1434] T 1f184d89e4244f12af7afd690bc7027d P 982df35c5b554a8fa64807352c4f34ee: Time spent starting tablet: real 0.010s user 0.006s sys 0.001s
I20251023 07:58:36.430383 18292 tablet_bootstrap.cc:654] T 744a3368282b44d9b9618922875d20d3 P b3a1328f9c8c484fab08292ce2171ec9: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:36.430963 18293 tablet_bootstrap.cc:492] T 33c314b036134d929890c744d68bc0cc P 10dfae53d0c941f08bded43539841761: Bootstrap starting.
I20251023 07:58:36.431277 18291 tablet_bootstrap.cc:492] T 79fcf5e4a38448ba95c62cc1ffe2823a P 982df35c5b554a8fa64807352c4f34ee: Bootstrap starting.
I20251023 07:58:36.436244 18301 raft_consensus.cc:493] T 744a3368282b44d9b9618922875d20d3 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:36.436753 18301 raft_consensus.cc:515] T 744a3368282b44d9b9618922875d20d3 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.440459 18102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "744a3368282b44d9b9618922875d20d3" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:36.440475 18301 leader_election.cc:290] T 744a3368282b44d9b9618922875d20d3 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
W20251023 07:58:36.442041 18143 leader_election.cc:343] T 744a3368282b44d9b9618922875d20d3 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:36.442509 18291 tablet_bootstrap.cc:654] T 79fcf5e4a38448ba95c62cc1ffe2823a P 982df35c5b554a8fa64807352c4f34ee: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:36.442399 18251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "744a3368282b44d9b9618922875d20d3" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
W20251023 07:58:36.445320 18142 leader_election.cc:343] T 744a3368282b44d9b9618922875d20d3 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:36.445827 18142 leader_election.cc:304] T 744a3368282b44d9b9618922875d20d3 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10dfae53d0c941f08bded43539841761; no voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9
I20251023 07:58:36.440500 18293 tablet_bootstrap.cc:654] T 33c314b036134d929890c744d68bc0cc P 10dfae53d0c941f08bded43539841761: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:36.447036 18301 raft_consensus.cc:2749] T 744a3368282b44d9b9618922875d20d3 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:58:36.449820 18292 tablet_bootstrap.cc:492] T 744a3368282b44d9b9618922875d20d3 P b3a1328f9c8c484fab08292ce2171ec9: No bootstrap required, opened a new log
I20251023 07:58:36.450445 18292 ts_tablet_manager.cc:1403] T 744a3368282b44d9b9618922875d20d3 P b3a1328f9c8c484fab08292ce2171ec9: Time spent bootstrapping tablet: real 0.028s user 0.015s sys 0.003s
I20251023 07:58:36.454017 18292 raft_consensus.cc:359] T 744a3368282b44d9b9618922875d20d3 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.454926 18292 raft_consensus.cc:385] T 744a3368282b44d9b9618922875d20d3 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:36.455294 18292 raft_consensus.cc:740] T 744a3368282b44d9b9618922875d20d3 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Initialized, Role: FOLLOWER
I20251023 07:58:36.457698 18292 consensus_queue.cc:260] T 744a3368282b44d9b9618922875d20d3 P b3a1328f9c8c484fab08292ce2171ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.458631 18291 tablet_bootstrap.cc:492] T 79fcf5e4a38448ba95c62cc1ffe2823a P 982df35c5b554a8fa64807352c4f34ee: No bootstrap required, opened a new log
I20251023 07:58:36.459115 18291 ts_tablet_manager.cc:1403] T 79fcf5e4a38448ba95c62cc1ffe2823a P 982df35c5b554a8fa64807352c4f34ee: Time spent bootstrapping tablet: real 0.028s user 0.015s sys 0.002s
I20251023 07:58:36.462157 18292 ts_tablet_manager.cc:1434] T 744a3368282b44d9b9618922875d20d3 P b3a1328f9c8c484fab08292ce2171ec9: Time spent starting tablet: real 0.011s user 0.004s sys 0.004s
I20251023 07:58:36.461941 18291 raft_consensus.cc:359] T 79fcf5e4a38448ba95c62cc1ffe2823a P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.462647 18291 raft_consensus.cc:385] T 79fcf5e4a38448ba95c62cc1ffe2823a P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:36.462961 18291 raft_consensus.cc:740] T 79fcf5e4a38448ba95c62cc1ffe2823a P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Initialized, Role: FOLLOWER
I20251023 07:58:36.463160 18292 tablet_bootstrap.cc:492] T 1f184d89e4244f12af7afd690bc7027d P b3a1328f9c8c484fab08292ce2171ec9: Bootstrap starting.
I20251023 07:58:36.463843 18291 consensus_queue.cc:260] T 79fcf5e4a38448ba95c62cc1ffe2823a P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.466753 18291 ts_tablet_manager.cc:1434] T 79fcf5e4a38448ba95c62cc1ffe2823a P 982df35c5b554a8fa64807352c4f34ee: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20251023 07:58:36.467892 18291 tablet_bootstrap.cc:492] T 3d1032da07fd44be9c392e8f4cd2af1f P 982df35c5b554a8fa64807352c4f34ee: Bootstrap starting.
I20251023 07:58:36.471045 18292 tablet_bootstrap.cc:654] T 1f184d89e4244f12af7afd690bc7027d P b3a1328f9c8c484fab08292ce2171ec9: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:36.471513 18293 tablet_bootstrap.cc:492] T 33c314b036134d929890c744d68bc0cc P 10dfae53d0c941f08bded43539841761: No bootstrap required, opened a new log
I20251023 07:58:36.472019 18293 ts_tablet_manager.cc:1403] T 33c314b036134d929890c744d68bc0cc P 10dfae53d0c941f08bded43539841761: Time spent bootstrapping tablet: real 0.042s user 0.013s sys 0.001s
I20251023 07:58:36.472509 17998 catalog_manager.cc:5649] T 4117fd2188e14b9aacc56f82245a3cc6 P b3a1328f9c8c484fab08292ce2171ec9 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1). New cstate: current_term: 1 leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } }
I20251023 07:58:36.474849 18293 raft_consensus.cc:359] T 33c314b036134d929890c744d68bc0cc P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.475515 18293 raft_consensus.cc:385] T 33c314b036134d929890c744d68bc0cc P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:36.475708 18293 raft_consensus.cc:740] T 33c314b036134d929890c744d68bc0cc P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Initialized, Role: FOLLOWER
I20251023 07:58:36.476235 18293 consensus_queue.cc:260] T 33c314b036134d929890c744d68bc0cc P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.478259 18293 ts_tablet_manager.cc:1434] T 33c314b036134d929890c744d68bc0cc P 10dfae53d0c941f08bded43539841761: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20251023 07:58:36.481773 18291 tablet_bootstrap.cc:654] T 3d1032da07fd44be9c392e8f4cd2af1f P 982df35c5b554a8fa64807352c4f34ee: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:36.483592 18293 tablet_bootstrap.cc:492] T 3d1032da07fd44be9c392e8f4cd2af1f P 10dfae53d0c941f08bded43539841761: Bootstrap starting.
I20251023 07:58:36.492933 18293 tablet_bootstrap.cc:654] T 3d1032da07fd44be9c392e8f4cd2af1f P 10dfae53d0c941f08bded43539841761: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:36.503520 18291 tablet_bootstrap.cc:492] T 3d1032da07fd44be9c392e8f4cd2af1f P 982df35c5b554a8fa64807352c4f34ee: No bootstrap required, opened a new log
I20251023 07:58:36.504101 18291 ts_tablet_manager.cc:1403] T 3d1032da07fd44be9c392e8f4cd2af1f P 982df35c5b554a8fa64807352c4f34ee: Time spent bootstrapping tablet: real 0.036s user 0.011s sys 0.004s
I20251023 07:58:36.505553 18293 tablet_bootstrap.cc:492] T 3d1032da07fd44be9c392e8f4cd2af1f P 10dfae53d0c941f08bded43539841761: No bootstrap required, opened a new log
I20251023 07:58:36.506050 18293 ts_tablet_manager.cc:1403] T 3d1032da07fd44be9c392e8f4cd2af1f P 10dfae53d0c941f08bded43539841761: Time spent bootstrapping tablet: real 0.023s user 0.017s sys 0.003s
I20251023 07:58:36.507097 18291 raft_consensus.cc:359] T 3d1032da07fd44be9c392e8f4cd2af1f P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.507858 18291 raft_consensus.cc:385] T 3d1032da07fd44be9c392e8f4cd2af1f P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:36.508160 18291 raft_consensus.cc:740] T 3d1032da07fd44be9c392e8f4cd2af1f P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Initialized, Role: FOLLOWER
I20251023 07:58:36.508878 18291 consensus_queue.cc:260] T 3d1032da07fd44be9c392e8f4cd2af1f P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.514806 18291 ts_tablet_manager.cc:1434] T 3d1032da07fd44be9c392e8f4cd2af1f P 982df35c5b554a8fa64807352c4f34ee: Time spent starting tablet: real 0.010s user 0.006s sys 0.000s
I20251023 07:58:36.515913 18291 tablet_bootstrap.cc:492] T fbc1ceb70a0c42c6871ea24480ee4221 P 982df35c5b554a8fa64807352c4f34ee: Bootstrap starting.
I20251023 07:58:36.519299 18293 raft_consensus.cc:359] T 3d1032da07fd44be9c392e8f4cd2af1f P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.520048 18293 raft_consensus.cc:385] T 3d1032da07fd44be9c392e8f4cd2af1f P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:36.520355 18293 raft_consensus.cc:740] T 3d1032da07fd44be9c392e8f4cd2af1f P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Initialized, Role: FOLLOWER
I20251023 07:58:36.524297 18293 consensus_queue.cc:260] T 3d1032da07fd44be9c392e8f4cd2af1f P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.528470 18293 ts_tablet_manager.cc:1434] T 3d1032da07fd44be9c392e8f4cd2af1f P 10dfae53d0c941f08bded43539841761: Time spent starting tablet: real 0.022s user 0.005s sys 0.001s
I20251023 07:58:36.529165 18292 tablet_bootstrap.cc:492] T 1f184d89e4244f12af7afd690bc7027d P b3a1328f9c8c484fab08292ce2171ec9: No bootstrap required, opened a new log
I20251023 07:58:36.529534 18293 tablet_bootstrap.cc:492] T fbc1ceb70a0c42c6871ea24480ee4221 P 10dfae53d0c941f08bded43539841761: Bootstrap starting.
I20251023 07:58:36.529803 18292 ts_tablet_manager.cc:1403] T 1f184d89e4244f12af7afd690bc7027d P b3a1328f9c8c484fab08292ce2171ec9: Time spent bootstrapping tablet: real 0.067s user 0.037s sys 0.026s
I20251023 07:58:36.532727 18292 raft_consensus.cc:359] T 1f184d89e4244f12af7afd690bc7027d P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.533680 18292 raft_consensus.cc:385] T 1f184d89e4244f12af7afd690bc7027d P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:36.534060 18292 raft_consensus.cc:740] T 1f184d89e4244f12af7afd690bc7027d P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Initialized, Role: FOLLOWER
I20251023 07:58:36.534969 18292 consensus_queue.cc:260] T 1f184d89e4244f12af7afd690bc7027d P b3a1328f9c8c484fab08292ce2171ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.536424 18291 tablet_bootstrap.cc:654] T fbc1ceb70a0c42c6871ea24480ee4221 P 982df35c5b554a8fa64807352c4f34ee: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:36.537000 18292 ts_tablet_manager.cc:1434] T 1f184d89e4244f12af7afd690bc7027d P b3a1328f9c8c484fab08292ce2171ec9: Time spent starting tablet: real 0.007s user 0.005s sys 0.001s
I20251023 07:58:36.538506 18292 tablet_bootstrap.cc:492] T fbc1ceb70a0c42c6871ea24480ee4221 P b3a1328f9c8c484fab08292ce2171ec9: Bootstrap starting.
I20251023 07:58:36.544848 18292 tablet_bootstrap.cc:654] T fbc1ceb70a0c42c6871ea24480ee4221 P b3a1328f9c8c484fab08292ce2171ec9: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:36.553607 18300 raft_consensus.cc:493] T 1f184d89e4244f12af7afd690bc7027d P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:36.554252 18300 raft_consensus.cc:515] T 1f184d89e4244f12af7afd690bc7027d P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.558044 18251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1f184d89e4244f12af7afd690bc7027d" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:36.558701 18176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1f184d89e4244f12af7afd690bc7027d" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:36.559499 18176 raft_consensus.cc:2468] T 1f184d89e4244f12af7afd690bc7027d P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3a1328f9c8c484fab08292ce2171ec9 in term 0.
I20251023 07:58:36.558722 18251 raft_consensus.cc:2468] T 1f184d89e4244f12af7afd690bc7027d P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3a1328f9c8c484fab08292ce2171ec9 in term 0.
I20251023 07:58:36.561986 18067 leader_election.cc:304] T 1f184d89e4244f12af7afd690bc7027d P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:58:36.563769 18300 leader_election.cc:290] T 1f184d89e4244f12af7afd690bc7027d P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:36.564790 18300 raft_consensus.cc:2804] T 1f184d89e4244f12af7afd690bc7027d P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:58:36.565227 18300 raft_consensus.cc:493] T 1f184d89e4244f12af7afd690bc7027d P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:36.565685 18300 raft_consensus.cc:3060] T 1f184d89e4244f12af7afd690bc7027d P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:36.573518 18293 tablet_bootstrap.cc:654] T fbc1ceb70a0c42c6871ea24480ee4221 P 10dfae53d0c941f08bded43539841761: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:36.573534 18291 tablet_bootstrap.cc:492] T fbc1ceb70a0c42c6871ea24480ee4221 P 982df35c5b554a8fa64807352c4f34ee: No bootstrap required, opened a new log
I20251023 07:58:36.574685 18317 raft_consensus.cc:493] T 79fcf5e4a38448ba95c62cc1ffe2823a P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:36.574956 18292 tablet_bootstrap.cc:492] T fbc1ceb70a0c42c6871ea24480ee4221 P b3a1328f9c8c484fab08292ce2171ec9: No bootstrap required, opened a new log
I20251023 07:58:36.575562 18292 ts_tablet_manager.cc:1403] T fbc1ceb70a0c42c6871ea24480ee4221 P b3a1328f9c8c484fab08292ce2171ec9: Time spent bootstrapping tablet: real 0.037s user 0.027s sys 0.008s
I20251023 07:58:36.575186 18317 raft_consensus.cc:515] T 79fcf5e4a38448ba95c62cc1ffe2823a P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.577586 18317 leader_election.cc:290] T 79fcf5e4a38448ba95c62cc1ffe2823a P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:58:36.578404 18102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79fcf5e4a38448ba95c62cc1ffe2823a" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:36.577075 18300 raft_consensus.cc:515] T 1f184d89e4244f12af7afd690bc7027d P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.579133 18102 raft_consensus.cc:2468] T 79fcf5e4a38448ba95c62cc1ffe2823a P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 0.
I20251023 07:58:36.578758 18292 raft_consensus.cc:359] T fbc1ceb70a0c42c6871ea24480ee4221 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.579756 18292 raft_consensus.cc:385] T fbc1ceb70a0c42c6871ea24480ee4221 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:36.580092 18292 raft_consensus.cc:740] T fbc1ceb70a0c42c6871ea24480ee4221 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Initialized, Role: FOLLOWER
I20251023 07:58:36.574215 18291 ts_tablet_manager.cc:1403] T fbc1ceb70a0c42c6871ea24480ee4221 P 982df35c5b554a8fa64807352c4f34ee: Time spent bootstrapping tablet: real 0.059s user 0.009s sys 0.033s
I20251023 07:58:36.580739 18217 leader_election.cc:304] T 79fcf5e4a38448ba95c62cc1ffe2823a P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:58:36.580971 18292 consensus_queue.cc:260] T fbc1ceb70a0c42c6871ea24480ee4221 P b3a1328f9c8c484fab08292ce2171ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.581524 18176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79fcf5e4a38448ba95c62cc1ffe2823a" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:36.581626 18317 raft_consensus.cc:2804] T 79fcf5e4a38448ba95c62cc1ffe2823a P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:58:36.582113 18317 raft_consensus.cc:493] T 79fcf5e4a38448ba95c62cc1ffe2823a P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:36.582173 18176 raft_consensus.cc:2468] T 79fcf5e4a38448ba95c62cc1ffe2823a P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 0.
I20251023 07:58:36.582552 18317 raft_consensus.cc:3060] T 79fcf5e4a38448ba95c62cc1ffe2823a P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:36.583251 18175 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1f184d89e4244f12af7afd690bc7027d" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761"
I20251023 07:58:36.583709 18292 ts_tablet_manager.cc:1434] T fbc1ceb70a0c42c6871ea24480ee4221 P b3a1328f9c8c484fab08292ce2171ec9: Time spent starting tablet: real 0.008s user 0.004s sys 0.002s
I20251023 07:58:36.583814 18175 raft_consensus.cc:3060] T 1f184d89e4244f12af7afd690bc7027d P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:36.584775 18292 tablet_bootstrap.cc:492] T e4884051da6c4cdc9e0811e70667dd19 P b3a1328f9c8c484fab08292ce2171ec9: Bootstrap starting.
I20251023 07:58:36.585378 18301 raft_consensus.cc:493] T 3d1032da07fd44be9c392e8f4cd2af1f P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:36.585839 18301 raft_consensus.cc:515] T 3d1032da07fd44be9c392e8f4cd2af1f P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.592031 18102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3d1032da07fd44be9c392e8f4cd2af1f" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:36.592509 18301 leader_election.cc:290] T 3d1032da07fd44be9c392e8f4cd2af1f P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:36.592681 18102 raft_consensus.cc:2468] T 3d1032da07fd44be9c392e8f4cd2af1f P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 0.
I20251023 07:58:36.593159 18251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3d1032da07fd44be9c392e8f4cd2af1f" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:36.593906 18251 raft_consensus.cc:2468] T 3d1032da07fd44be9c392e8f4cd2af1f P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 0.
I20251023 07:58:36.593796 18317 raft_consensus.cc:515] T 79fcf5e4a38448ba95c62cc1ffe2823a P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.594965 18292 tablet_bootstrap.cc:654] T e4884051da6c4cdc9e0811e70667dd19 P b3a1328f9c8c484fab08292ce2171ec9: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:36.595134 18142 leader_election.cc:304] T 3d1032da07fd44be9c392e8f4cd2af1f P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, 982df35c5b554a8fa64807352c4f34ee; no voters:
I20251023 07:58:36.596709 18102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79fcf5e4a38448ba95c62cc1ffe2823a" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
I20251023 07:58:36.597357 18102 raft_consensus.cc:3060] T 79fcf5e4a38448ba95c62cc1ffe2823a P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:36.598847 18175 raft_consensus.cc:2468] T 1f184d89e4244f12af7afd690bc7027d P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3a1328f9c8c484fab08292ce2171ec9 in term 1.
I20251023 07:58:36.599421 18332 raft_consensus.cc:493] T 744a3368282b44d9b9618922875d20d3 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:36.599942 18066 leader_election.cc:304] T 1f184d89e4244f12af7afd690bc7027d P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:58:36.599879 18332 raft_consensus.cc:515] T 744a3368282b44d9b9618922875d20d3 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.600733 18292 tablet_bootstrap.cc:492] T e4884051da6c4cdc9e0811e70667dd19 P b3a1328f9c8c484fab08292ce2171ec9: No bootstrap required, opened a new log
I20251023 07:58:36.601262 18292 ts_tablet_manager.cc:1403] T e4884051da6c4cdc9e0811e70667dd19 P b3a1328f9c8c484fab08292ce2171ec9: Time spent bootstrapping tablet: real 0.017s user 0.013s sys 0.002s
I20251023 07:58:36.602088 18332 leader_election.cc:290] T 744a3368282b44d9b9618922875d20d3 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:36.602593 18332 raft_consensus.cc:2804] T 1f184d89e4244f12af7afd690bc7027d P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:58:36.603008 18332 raft_consensus.cc:697] T 1f184d89e4244f12af7afd690bc7027d P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Becoming Leader. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Running, Role: LEADER
I20251023 07:58:36.603144 18251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "744a3368282b44d9b9618922875d20d3" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:36.603312 18301 raft_consensus.cc:2804] T 3d1032da07fd44be9c392e8f4cd2af1f P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:58:36.603719 18301 raft_consensus.cc:493] T 3d1032da07fd44be9c392e8f4cd2af1f P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:36.604097 18301 raft_consensus.cc:3060] T 3d1032da07fd44be9c392e8f4cd2af1f P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:36.603842 18332 consensus_queue.cc:237] T 1f184d89e4244f12af7afd690bc7027d P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
W20251023 07:58:36.604488 18067 leader_election.cc:343] T 744a3368282b44d9b9618922875d20d3 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:36.604817 18292 raft_consensus.cc:359] T e4884051da6c4cdc9e0811e70667dd19 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.607499 18292 raft_consensus.cc:385] T e4884051da6c4cdc9e0811e70667dd19 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:36.607801 18292 raft_consensus.cc:740] T e4884051da6c4cdc9e0811e70667dd19 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Initialized, Role: FOLLOWER
I20251023 07:58:36.608508 18293 tablet_bootstrap.cc:492] T fbc1ceb70a0c42c6871ea24480ee4221 P 10dfae53d0c941f08bded43539841761: No bootstrap required, opened a new log
I20251023 07:58:36.608530 18292 consensus_queue.cc:260] T e4884051da6c4cdc9e0811e70667dd19 P b3a1328f9c8c484fab08292ce2171ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.608615 18102 raft_consensus.cc:2468] T 79fcf5e4a38448ba95c62cc1ffe2823a P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 1.
I20251023 07:58:36.610208 18176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "744a3368282b44d9b9618922875d20d3" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:36.610729 18217 leader_election.cc:304] T 79fcf5e4a38448ba95c62cc1ffe2823a P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:58:36.611119 18292 ts_tablet_manager.cc:1434] T e4884051da6c4cdc9e0811e70667dd19 P b3a1328f9c8c484fab08292ce2171ec9: Time spent starting tablet: real 0.009s user 0.006s sys 0.000s
I20251023 07:58:36.611701 18319 raft_consensus.cc:2804] T 79fcf5e4a38448ba95c62cc1ffe2823a P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:58:36.612176 18292 tablet_bootstrap.cc:492] T 33c314b036134d929890c744d68bc0cc P b3a1328f9c8c484fab08292ce2171ec9: Bootstrap starting.
I20251023 07:58:36.612252 18319 raft_consensus.cc:697] T 79fcf5e4a38448ba95c62cc1ffe2823a P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Becoming Leader. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Running, Role: LEADER
I20251023 07:58:36.613317 18319 consensus_queue.cc:237] T 79fcf5e4a38448ba95c62cc1ffe2823a P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.610805 18176 raft_consensus.cc:2468] T 744a3368282b44d9b9618922875d20d3 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3a1328f9c8c484fab08292ce2171ec9 in term 0.
I20251023 07:58:36.618600 18293 ts_tablet_manager.cc:1403] T fbc1ceb70a0c42c6871ea24480ee4221 P 10dfae53d0c941f08bded43539841761: Time spent bootstrapping tablet: real 0.089s user 0.007s sys 0.006s
I20251023 07:58:36.619295 18066 leader_election.cc:304] T 744a3368282b44d9b9618922875d20d3 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9; no voters: 982df35c5b554a8fa64807352c4f34ee
I20251023 07:58:36.621469 18292 tablet_bootstrap.cc:654] T 33c314b036134d929890c744d68bc0cc P b3a1328f9c8c484fab08292ce2171ec9: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:36.621371 18291 raft_consensus.cc:359] T fbc1ceb70a0c42c6871ea24480ee4221 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.622246 18291 raft_consensus.cc:385] T fbc1ceb70a0c42c6871ea24480ee4221 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:36.622536 18291 raft_consensus.cc:740] T fbc1ceb70a0c42c6871ea24480ee4221 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Initialized, Role: FOLLOWER
I20251023 07:58:36.623287 18291 consensus_queue.cc:260] T fbc1ceb70a0c42c6871ea24480ee4221 P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.625173 18344 raft_consensus.cc:2804] T 744a3368282b44d9b9618922875d20d3 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:58:36.625651 18344 raft_consensus.cc:493] T 744a3368282b44d9b9618922875d20d3 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:36.625985 18344 raft_consensus.cc:3060] T 744a3368282b44d9b9618922875d20d3 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:36.628281 18000 catalog_manager.cc:5649] T 1f184d89e4244f12af7afd690bc7027d P b3a1328f9c8c484fab08292ce2171ec9 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1). New cstate: current_term: 1 leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } }
I20251023 07:58:36.629302 18291 ts_tablet_manager.cc:1434] T fbc1ceb70a0c42c6871ea24480ee4221 P 982df35c5b554a8fa64807352c4f34ee: Time spent starting tablet: real 0.048s user 0.002s sys 0.004s
I20251023 07:58:36.624464 18293 raft_consensus.cc:359] T fbc1ceb70a0c42c6871ea24480ee4221 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.631410 18293 raft_consensus.cc:385] T fbc1ceb70a0c42c6871ea24480ee4221 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:36.631639 18293 raft_consensus.cc:740] T fbc1ceb70a0c42c6871ea24480ee4221 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Initialized, Role: FOLLOWER
I20251023 07:58:36.631964 18291 tablet_bootstrap.cc:492] T eeadb773c7dc416581b44225256a4c3b P 982df35c5b554a8fa64807352c4f34ee: Bootstrap starting.
I20251023 07:58:36.632148 18293 consensus_queue.cc:260] T fbc1ceb70a0c42c6871ea24480ee4221 P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.632649 18317 leader_election.cc:290] T 79fcf5e4a38448ba95c62cc1ffe2823a P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 election: Requested vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:58:36.632699 18175 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79fcf5e4a38448ba95c62cc1ffe2823a" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761"
I20251023 07:58:36.633822 18175 raft_consensus.cc:3060] T 79fcf5e4a38448ba95c62cc1ffe2823a P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:36.634073 18316 consensus_queue.cc:1048] T abefe27ebb4c4179a8620d4e638fe119 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:36.641316 18291 tablet_bootstrap.cc:654] T eeadb773c7dc416581b44225256a4c3b P 982df35c5b554a8fa64807352c4f34ee: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:36.642844 18102 raft_consensus.cc:3060] T e4884051da6c4cdc9e0811e70667dd19 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:36.646287 18251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1f184d89e4244f12af7afd690bc7027d" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
I20251023 07:58:36.651126 18251 raft_consensus.cc:3060] T 1f184d89e4244f12af7afd690bc7027d P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:36.659766 18175 raft_consensus.cc:2468] T 79fcf5e4a38448ba95c62cc1ffe2823a P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 1.
I20251023 07:58:36.647739 18300 leader_election.cc:290] T 1f184d89e4244f12af7afd690bc7027d P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 election: Requested vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:36.666617 18251 raft_consensus.cc:2468] T 1f184d89e4244f12af7afd690bc7027d P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3a1328f9c8c484fab08292ce2171ec9 in term 1.
I20251023 07:58:36.653761 17999 catalog_manager.cc:5649] T 79fcf5e4a38448ba95c62cc1ffe2823a P 982df35c5b554a8fa64807352c4f34ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 982df35c5b554a8fa64807352c4f34ee (127.16.126.3). New cstate: current_term: 1 leader_uuid: "982df35c5b554a8fa64807352c4f34ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: HEALTHY } } }
I20251023 07:58:36.670881 18292 tablet_bootstrap.cc:492] T 33c314b036134d929890c744d68bc0cc P b3a1328f9c8c484fab08292ce2171ec9: No bootstrap required, opened a new log
I20251023 07:58:36.671017 18293 ts_tablet_manager.cc:1434] T fbc1ceb70a0c42c6871ea24480ee4221 P 10dfae53d0c941f08bded43539841761: Time spent starting tablet: real 0.052s user 0.015s sys 0.001s
I20251023 07:58:36.671356 18292 ts_tablet_manager.cc:1403] T 33c314b036134d929890c744d68bc0cc P b3a1328f9c8c484fab08292ce2171ec9: Time spent bootstrapping tablet: real 0.059s user 0.031s sys 0.009s
I20251023 07:58:36.673959 18292 raft_consensus.cc:359] T 33c314b036134d929890c744d68bc0cc P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.674666 18292 raft_consensus.cc:385] T 33c314b036134d929890c744d68bc0cc P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:36.674103 18344 raft_consensus.cc:515] T 744a3368282b44d9b9618922875d20d3 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.674970 18292 raft_consensus.cc:740] T 33c314b036134d929890c744d68bc0cc P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Initialized, Role: FOLLOWER
I20251023 07:58:36.676015 18319 consensus_queue.cc:1048] T e4884051da6c4cdc9e0811e70667dd19 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:36.675925 18292 consensus_queue.cc:260] T 33c314b036134d929890c744d68bc0cc P b3a1328f9c8c484fab08292ce2171ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.677536 18176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "744a3368282b44d9b9618922875d20d3" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761"
I20251023 07:58:36.678156 18292 ts_tablet_manager.cc:1434] T 33c314b036134d929890c744d68bc0cc P b3a1328f9c8c484fab08292ce2171ec9: Time spent starting tablet: real 0.007s user 0.002s sys 0.005s
I20251023 07:58:36.678087 18176 raft_consensus.cc:3060] T 744a3368282b44d9b9618922875d20d3 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:36.679024 18292 tablet_bootstrap.cc:492] T 5d4096f60c864412bb51be0c52c22961 P b3a1328f9c8c484fab08292ce2171ec9: Bootstrap starting.
I20251023 07:58:36.684862 18292 tablet_bootstrap.cc:654] T 5d4096f60c864412bb51be0c52c22961 P b3a1328f9c8c484fab08292ce2171ec9: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:36.686132 18176 raft_consensus.cc:2468] T 744a3368282b44d9b9618922875d20d3 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3a1328f9c8c484fab08292ce2171ec9 in term 1.
I20251023 07:58:36.687501 18066 leader_election.cc:304] T 744a3368282b44d9b9618922875d20d3 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:58:36.688128 18319 consensus_queue.cc:1048] T e4884051da6c4cdc9e0811e70667dd19 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:36.690646 18300 raft_consensus.cc:2804] T 744a3368282b44d9b9618922875d20d3 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:58:36.696899 18300 raft_consensus.cc:697] T 744a3368282b44d9b9618922875d20d3 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Becoming Leader. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Running, Role: LEADER
I20251023 07:58:36.695837 18293 tablet_bootstrap.cc:492] T 5585a11a884140c7abc7d5a3b6ab86f3 P 10dfae53d0c941f08bded43539841761: Bootstrap starting.
W20251023 07:58:36.695914 18215 consensus_peers.cc:597] T abefe27ebb4c4179a8620d4e638fe119 P 982df35c5b554a8fa64807352c4f34ee -> Peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Couldn't send request to peer 10dfae53d0c941f08bded43539841761. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:58:36.698212 18300 consensus_queue.cc:237] T 744a3368282b44d9b9618922875d20d3 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.704615 18344 leader_election.cc:290] T 744a3368282b44d9b9618922875d20d3 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 election: Requested vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:36.704900 18251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "744a3368282b44d9b9618922875d20d3" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
W20251023 07:58:36.706209 18067 leader_election.cc:343] T 744a3368282b44d9b9618922875d20d3 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:36.710978 18301 raft_consensus.cc:515] T 3d1032da07fd44be9c392e8f4cd2af1f P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.717504 18291 tablet_bootstrap.cc:492] T eeadb773c7dc416581b44225256a4c3b P 982df35c5b554a8fa64807352c4f34ee: No bootstrap required, opened a new log
I20251023 07:58:36.718145 18291 ts_tablet_manager.cc:1403] T eeadb773c7dc416581b44225256a4c3b P 982df35c5b554a8fa64807352c4f34ee: Time spent bootstrapping tablet: real 0.086s user 0.013s sys 0.000s
I20251023 07:58:36.719296 18293 tablet_bootstrap.cc:654] T 5585a11a884140c7abc7d5a3b6ab86f3 P 10dfae53d0c941f08bded43539841761: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:36.719862 18301 leader_election.cc:290] T 3d1032da07fd44be9c392e8f4cd2af1f P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 election: Requested vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:36.720934 18251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3d1032da07fd44be9c392e8f4cd2af1f" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
I20251023 07:58:36.721743 18251 raft_consensus.cc:3060] T 3d1032da07fd44be9c392e8f4cd2af1f P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:36.722626 18102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3d1032da07fd44be9c392e8f4cd2af1f" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
I20251023 07:58:36.723474 18102 raft_consensus.cc:3060] T 3d1032da07fd44be9c392e8f4cd2af1f P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:36.721873 18292 tablet_bootstrap.cc:492] T 5d4096f60c864412bb51be0c52c22961 P b3a1328f9c8c484fab08292ce2171ec9: No bootstrap required, opened a new log
I20251023 07:58:36.725378 18292 ts_tablet_manager.cc:1403] T 5d4096f60c864412bb51be0c52c22961 P b3a1328f9c8c484fab08292ce2171ec9: Time spent bootstrapping tablet: real 0.047s user 0.011s sys 0.011s
I20251023 07:58:36.734736 18102 raft_consensus.cc:2468] T 3d1032da07fd44be9c392e8f4cd2af1f P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 1.
I20251023 07:58:36.736750 18292 raft_consensus.cc:359] T 5d4096f60c864412bb51be0c52c22961 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } }
I20251023 07:58:36.737860 18292 raft_consensus.cc:385] T 5d4096f60c864412bb51be0c52c22961 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:36.738220 18292 raft_consensus.cc:740] T 5d4096f60c864412bb51be0c52c22961 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Initialized, Role: FOLLOWER
I20251023 07:58:36.739235 18292 consensus_queue.cc:260] T 5d4096f60c864412bb51be0c52c22961 P b3a1328f9c8c484fab08292ce2171ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } }
I20251023 07:58:36.742044 18292 ts_tablet_manager.cc:1434] T 5d4096f60c864412bb51be0c52c22961 P b3a1328f9c8c484fab08292ce2171ec9: Time spent starting tablet: real 0.016s user 0.007s sys 0.000s
I20251023 07:58:36.743238 18292 tablet_bootstrap.cc:492] T b9841e711f8e4a019c2d0dec5409474c P b3a1328f9c8c484fab08292ce2171ec9: Bootstrap starting.
I20251023 07:58:36.744323 18143 leader_election.cc:304] T 3d1032da07fd44be9c392e8f4cd2af1f P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:58:36.745517 18301 raft_consensus.cc:2804] T 3d1032da07fd44be9c392e8f4cd2af1f P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:58:36.746105 18301 raft_consensus.cc:697] T 3d1032da07fd44be9c392e8f4cd2af1f P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Becoming Leader. State: Replica: 10dfae53d0c941f08bded43539841761, State: Running, Role: LEADER
I20251023 07:58:36.747123 18301 consensus_queue.cc:237] T 3d1032da07fd44be9c392e8f4cd2af1f P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.729703 18291 raft_consensus.cc:359] T eeadb773c7dc416581b44225256a4c3b P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.750023 18291 raft_consensus.cc:385] T eeadb773c7dc416581b44225256a4c3b P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:36.750303 18291 raft_consensus.cc:740] T eeadb773c7dc416581b44225256a4c3b P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Initialized, Role: FOLLOWER
I20251023 07:58:36.750945 18291 consensus_queue.cc:260] T eeadb773c7dc416581b44225256a4c3b P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.753024 18291 ts_tablet_manager.cc:1434] T eeadb773c7dc416581b44225256a4c3b P 982df35c5b554a8fa64807352c4f34ee: Time spent starting tablet: real 0.035s user 0.005s sys 0.000s
I20251023 07:58:36.753810 18317 raft_consensus.cc:493] T 5d4096f60c864412bb51be0c52c22961 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:36.754312 18317 raft_consensus.cc:515] T 5d4096f60c864412bb51be0c52c22961 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } }
I20251023 07:58:36.756816 18317 leader_election.cc:290] T 5d4096f60c864412bb51be0c52c22961 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025)
I20251023 07:58:36.759541 18176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d4096f60c864412bb51be0c52c22961" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:36.760187 18176 raft_consensus.cc:2468] T 5d4096f60c864412bb51be0c52c22961 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 0.
I20251023 07:58:36.761336 18215 leader_election.cc:304] T 5d4096f60c864412bb51be0c52c22961 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, 982df35c5b554a8fa64807352c4f34ee; no voters:
I20251023 07:58:36.762228 18317 raft_consensus.cc:2804] T 5d4096f60c864412bb51be0c52c22961 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:58:36.762614 18317 raft_consensus.cc:493] T 5d4096f60c864412bb51be0c52c22961 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:36.763018 18317 raft_consensus.cc:3060] T 5d4096f60c864412bb51be0c52c22961 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:36.763370 18102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d4096f60c864412bb51be0c52c22961" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:36.764001 18102 raft_consensus.cc:2468] T 5d4096f60c864412bb51be0c52c22961 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 0.
I20251023 07:58:36.769642 18292 tablet_bootstrap.cc:654] T b9841e711f8e4a019c2d0dec5409474c P b3a1328f9c8c484fab08292ce2171ec9: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:36.773979 18317 raft_consensus.cc:515] T 5d4096f60c864412bb51be0c52c22961 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } }
I20251023 07:58:36.776641 18176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d4096f60c864412bb51be0c52c22961" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761"
I20251023 07:58:36.777212 18176 raft_consensus.cc:3060] T 5d4096f60c864412bb51be0c52c22961 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:36.781159 18293 tablet_bootstrap.cc:492] T 5585a11a884140c7abc7d5a3b6ab86f3 P 10dfae53d0c941f08bded43539841761: No bootstrap required, opened a new log
I20251023 07:58:36.781803 18293 ts_tablet_manager.cc:1403] T 5585a11a884140c7abc7d5a3b6ab86f3 P 10dfae53d0c941f08bded43539841761: Time spent bootstrapping tablet: real 0.086s user 0.023s sys 0.006s
I20251023 07:58:36.785244 18293 raft_consensus.cc:359] T 5585a11a884140c7abc7d5a3b6ab86f3 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.786161 18293 raft_consensus.cc:385] T 5585a11a884140c7abc7d5a3b6ab86f3 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:36.786355 18317 leader_election.cc:290] T 5d4096f60c864412bb51be0c52c22961 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 election: Requested vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025)
I20251023 07:58:36.785398 18251 raft_consensus.cc:2468] T 3d1032da07fd44be9c392e8f4cd2af1f P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 1.
I20251023 07:58:36.788628 18291 tablet_bootstrap.cc:492] T 744a3368282b44d9b9618922875d20d3 P 982df35c5b554a8fa64807352c4f34ee: Bootstrap starting.
I20251023 07:58:36.790720 18100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d4096f60c864412bb51be0c52c22961" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
I20251023 07:58:36.791355 18100 raft_consensus.cc:3060] T 5d4096f60c864412bb51be0c52c22961 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:36.786523 18293 raft_consensus.cc:740] T 5585a11a884140c7abc7d5a3b6ab86f3 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Initialized, Role: FOLLOWER
I20251023 07:58:36.794438 18293 consensus_queue.cc:260] T 5585a11a884140c7abc7d5a3b6ab86f3 P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.796614 18293 ts_tablet_manager.cc:1434] T 5585a11a884140c7abc7d5a3b6ab86f3 P 10dfae53d0c941f08bded43539841761: Time spent starting tablet: real 0.014s user 0.004s sys 0.002s
I20251023 07:58:36.797554 18293 tablet_bootstrap.cc:492] T 4117fd2188e14b9aacc56f82245a3cc6 P 10dfae53d0c941f08bded43539841761: Bootstrap starting.
I20251023 07:58:36.799427 18000 catalog_manager.cc:5649] T 744a3368282b44d9b9618922875d20d3 P b3a1328f9c8c484fab08292ce2171ec9 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1). New cstate: current_term: 1 leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } }
I20251023 07:58:36.806202 18100 raft_consensus.cc:2468] T 5d4096f60c864412bb51be0c52c22961 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 1.
I20251023 07:58:36.807277 18293 tablet_bootstrap.cc:654] T 4117fd2188e14b9aacc56f82245a3cc6 P 10dfae53d0c941f08bded43539841761: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:36.807505 18217 leader_election.cc:304] T 5d4096f60c864412bb51be0c52c22961 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:58:36.808372 18292 tablet_bootstrap.cc:492] T b9841e711f8e4a019c2d0dec5409474c P b3a1328f9c8c484fab08292ce2171ec9: No bootstrap required, opened a new log
I20251023 07:58:36.808364 18317 raft_consensus.cc:2804] T 5d4096f60c864412bb51be0c52c22961 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:58:36.809018 18292 ts_tablet_manager.cc:1403] T b9841e711f8e4a019c2d0dec5409474c P b3a1328f9c8c484fab08292ce2171ec9: Time spent bootstrapping tablet: real 0.066s user 0.017s sys 0.000s
I20251023 07:58:36.809062 18317 raft_consensus.cc:697] T 5d4096f60c864412bb51be0c52c22961 P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Becoming Leader. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Running, Role: LEADER
I20251023 07:58:36.812234 18317 consensus_queue.cc:237] T 5d4096f60c864412bb51be0c52c22961 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } }
I20251023 07:58:36.813647 18300 consensus_queue.cc:1048] T 4117fd2188e14b9aacc56f82245a3cc6 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:36.814123 18292 raft_consensus.cc:359] T b9841e711f8e4a019c2d0dec5409474c P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.814862 18292 raft_consensus.cc:385] T b9841e711f8e4a019c2d0dec5409474c P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:36.815135 18292 raft_consensus.cc:740] T b9841e711f8e4a019c2d0dec5409474c P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Initialized, Role: FOLLOWER
I20251023 07:58:36.806704 18176 raft_consensus.cc:2468] T 5d4096f60c864412bb51be0c52c22961 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 1.
I20251023 07:58:36.815793 18292 consensus_queue.cc:260] T b9841e711f8e4a019c2d0dec5409474c P b3a1328f9c8c484fab08292ce2171ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.811368 18291 tablet_bootstrap.cc:654] T 744a3368282b44d9b9618922875d20d3 P 982df35c5b554a8fa64807352c4f34ee: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:36.818027 18292 ts_tablet_manager.cc:1434] T b9841e711f8e4a019c2d0dec5409474c P b3a1328f9c8c484fab08292ce2171ec9: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20251023 07:58:36.818990 18292 tablet_bootstrap.cc:492] T eeadb773c7dc416581b44225256a4c3b P b3a1328f9c8c484fab08292ce2171ec9: Bootstrap starting.
I20251023 07:58:36.824952 18292 tablet_bootstrap.cc:654] T eeadb773c7dc416581b44225256a4c3b P b3a1328f9c8c484fab08292ce2171ec9: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:36.828514 18000 catalog_manager.cc:5649] T 3d1032da07fd44be9c392e8f4cd2af1f P 10dfae53d0c941f08bded43539841761 reported cstate change: term changed from 0 to 1, leader changed from <none> to 10dfae53d0c941f08bded43539841761 (127.16.126.2). New cstate: current_term: 1 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } }
W20251023 07:58:36.843962 18066 consensus_peers.cc:597] T 4117fd2188e14b9aacc56f82245a3cc6 P b3a1328f9c8c484fab08292ce2171ec9 -> Peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Couldn't send request to peer 10dfae53d0c941f08bded43539841761. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:58:36.855613 18291 tablet_bootstrap.cc:492] T 744a3368282b44d9b9618922875d20d3 P 982df35c5b554a8fa64807352c4f34ee: No bootstrap required, opened a new log
I20251023 07:58:36.856104 18291 ts_tablet_manager.cc:1403] T 744a3368282b44d9b9618922875d20d3 P 982df35c5b554a8fa64807352c4f34ee: Time spent bootstrapping tablet: real 0.068s user 0.012s sys 0.009s
I20251023 07:58:36.858448 18291 raft_consensus.cc:359] T 744a3368282b44d9b9618922875d20d3 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.859098 18291 raft_consensus.cc:385] T 744a3368282b44d9b9618922875d20d3 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:36.859377 18291 raft_consensus.cc:740] T 744a3368282b44d9b9618922875d20d3 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Initialized, Role: FOLLOWER
I20251023 07:58:36.859987 18291 consensus_queue.cc:260] T 744a3368282b44d9b9618922875d20d3 P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.862067 18291 ts_tablet_manager.cc:1434] T 744a3368282b44d9b9618922875d20d3 P 982df35c5b554a8fa64807352c4f34ee: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20251023 07:58:36.863009 18291 tablet_bootstrap.cc:492] T 5585a11a884140c7abc7d5a3b6ab86f3 P 982df35c5b554a8fa64807352c4f34ee: Bootstrap starting.
I20251023 07:58:36.867033 18293 tablet_bootstrap.cc:492] T 4117fd2188e14b9aacc56f82245a3cc6 P 10dfae53d0c941f08bded43539841761: No bootstrap required, opened a new log
I20251023 07:58:36.867489 18293 ts_tablet_manager.cc:1403] T 4117fd2188e14b9aacc56f82245a3cc6 P 10dfae53d0c941f08bded43539841761: Time spent bootstrapping tablet: real 0.070s user 0.013s sys 0.000s
I20251023 07:58:36.867645 18292 tablet_bootstrap.cc:492] T eeadb773c7dc416581b44225256a4c3b P b3a1328f9c8c484fab08292ce2171ec9: No bootstrap required, opened a new log
I20251023 07:58:36.867944 18291 tablet_bootstrap.cc:654] T 5585a11a884140c7abc7d5a3b6ab86f3 P 982df35c5b554a8fa64807352c4f34ee: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:36.868050 18292 ts_tablet_manager.cc:1403] T eeadb773c7dc416581b44225256a4c3b P b3a1328f9c8c484fab08292ce2171ec9: Time spent bootstrapping tablet: real 0.049s user 0.001s sys 0.036s
I20251023 07:58:36.870141 18293 raft_consensus.cc:359] T 4117fd2188e14b9aacc56f82245a3cc6 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.870412 18292 raft_consensus.cc:359] T eeadb773c7dc416581b44225256a4c3b P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.870893 18293 raft_consensus.cc:385] T 4117fd2188e14b9aacc56f82245a3cc6 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:36.871006 18292 raft_consensus.cc:385] T eeadb773c7dc416581b44225256a4c3b P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:36.871320 18293 raft_consensus.cc:740] T 4117fd2188e14b9aacc56f82245a3cc6 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Initialized, Role: FOLLOWER
I20251023 07:58:36.871377 18292 raft_consensus.cc:740] T eeadb773c7dc416581b44225256a4c3b P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Initialized, Role: FOLLOWER
I20251023 07:58:36.872237 18292 consensus_queue.cc:260] T eeadb773c7dc416581b44225256a4c3b P b3a1328f9c8c484fab08292ce2171ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.872237 18293 consensus_queue.cc:260] T 4117fd2188e14b9aacc56f82245a3cc6 P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.874519 18293 ts_tablet_manager.cc:1434] T 4117fd2188e14b9aacc56f82245a3cc6 P 10dfae53d0c941f08bded43539841761: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20251023 07:58:36.875388 18293 tablet_bootstrap.cc:492] T abefe27ebb4c4179a8620d4e638fe119 P 10dfae53d0c941f08bded43539841761: Bootstrap starting.
I20251023 07:58:36.875895 17999 catalog_manager.cc:5649] T 5d4096f60c864412bb51be0c52c22961 P 982df35c5b554a8fa64807352c4f34ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 982df35c5b554a8fa64807352c4f34ee (127.16.126.3). New cstate: current_term: 1 leader_uuid: "982df35c5b554a8fa64807352c4f34ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } }
I20251023 07:58:36.878196 18292 ts_tablet_manager.cc:1434] T eeadb773c7dc416581b44225256a4c3b P b3a1328f9c8c484fab08292ce2171ec9: Time spent starting tablet: real 0.010s user 0.004s sys 0.003s
I20251023 07:58:36.879199 18292 tablet_bootstrap.cc:492] T 1f539da81d60449b9d96866c7ceee1be P b3a1328f9c8c484fab08292ce2171ec9: Bootstrap starting.
I20251023 07:58:36.880947 18293 tablet_bootstrap.cc:654] T abefe27ebb4c4179a8620d4e638fe119 P 10dfae53d0c941f08bded43539841761: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:36.884814 18292 tablet_bootstrap.cc:654] T 1f539da81d60449b9d96866c7ceee1be P b3a1328f9c8c484fab08292ce2171ec9: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:36.893767 18301 raft_consensus.cc:493] T 5585a11a884140c7abc7d5a3b6ab86f3 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:36.894344 18301 raft_consensus.cc:515] T 5585a11a884140c7abc7d5a3b6ab86f3 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.896349 18301 leader_election.cc:290] T 5585a11a884140c7abc7d5a3b6ab86f3 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:36.898329 18251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5585a11a884140c7abc7d5a3b6ab86f3" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:36.899276 18291 tablet_bootstrap.cc:492] T 5585a11a884140c7abc7d5a3b6ab86f3 P 982df35c5b554a8fa64807352c4f34ee: No bootstrap required, opened a new log
W20251023 07:58:36.899477 18142 leader_election.cc:343] T 5585a11a884140c7abc7d5a3b6ab86f3 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:36.899876 18291 ts_tablet_manager.cc:1403] T 5585a11a884140c7abc7d5a3b6ab86f3 P 982df35c5b554a8fa64807352c4f34ee: Time spent bootstrapping tablet: real 0.037s user 0.012s sys 0.017s
I20251023 07:58:36.899758 18100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5585a11a884140c7abc7d5a3b6ab86f3" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:36.900518 18100 raft_consensus.cc:2468] T 5585a11a884140c7abc7d5a3b6ab86f3 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 0.
I20251023 07:58:36.901775 18143 leader_election.cc:304] T 5585a11a884140c7abc7d5a3b6ab86f3 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9; no voters: 982df35c5b554a8fa64807352c4f34ee
I20251023 07:58:36.902436 18301 raft_consensus.cc:493] T 33c314b036134d929890c744d68bc0cc P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:36.903044 18349 raft_consensus.cc:2804] T 5585a11a884140c7abc7d5a3b6ab86f3 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:58:36.903201 18293 tablet_bootstrap.cc:492] T abefe27ebb4c4179a8620d4e638fe119 P 10dfae53d0c941f08bded43539841761: No bootstrap required, opened a new log
I20251023 07:58:36.902904 18301 raft_consensus.cc:515] T 33c314b036134d929890c744d68bc0cc P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.903455 18349 raft_consensus.cc:493] T 5585a11a884140c7abc7d5a3b6ab86f3 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:36.903708 18293 ts_tablet_manager.cc:1403] T abefe27ebb4c4179a8620d4e638fe119 P 10dfae53d0c941f08bded43539841761: Time spent bootstrapping tablet: real 0.029s user 0.011s sys 0.000s
I20251023 07:58:36.903859 18349 raft_consensus.cc:3060] T 5585a11a884140c7abc7d5a3b6ab86f3 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:36.903808 18291 raft_consensus.cc:359] T 5585a11a884140c7abc7d5a3b6ab86f3 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.904696 18291 raft_consensus.cc:385] T 5585a11a884140c7abc7d5a3b6ab86f3 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:36.905025 18291 raft_consensus.cc:740] T 5585a11a884140c7abc7d5a3b6ab86f3 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Initialized, Role: FOLLOWER
I20251023 07:58:36.905334 18301 leader_election.cc:290] T 33c314b036134d929890c744d68bc0cc P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:36.905767 18291 consensus_queue.cc:260] T 5585a11a884140c7abc7d5a3b6ab86f3 P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.908018 18291 ts_tablet_manager.cc:1434] T 5585a11a884140c7abc7d5a3b6ab86f3 P 982df35c5b554a8fa64807352c4f34ee: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20251023 07:58:36.907168 18293 raft_consensus.cc:359] T abefe27ebb4c4179a8620d4e638fe119 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.908471 18293 raft_consensus.cc:385] T abefe27ebb4c4179a8620d4e638fe119 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:36.908766 18293 raft_consensus.cc:740] T abefe27ebb4c4179a8620d4e638fe119 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Initialized, Role: FOLLOWER
I20251023 07:58:36.907228 18251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "33c314b036134d929890c744d68bc0cc" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:36.909510 18100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "33c314b036134d929890c744d68bc0cc" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:36.909406 18293 consensus_queue.cc:260] T abefe27ebb4c4179a8620d4e638fe119 P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.910187 18100 raft_consensus.cc:2468] T 33c314b036134d929890c744d68bc0cc P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 0.
I20251023 07:58:36.912393 18293 ts_tablet_manager.cc:1434] T abefe27ebb4c4179a8620d4e638fe119 P 10dfae53d0c941f08bded43539841761: Time spent starting tablet: real 0.008s user 0.004s sys 0.004s
I20251023 07:58:36.912424 18291 tablet_bootstrap.cc:492] T 33c314b036134d929890c744d68bc0cc P 982df35c5b554a8fa64807352c4f34ee: Bootstrap starting.
I20251023 07:58:36.913727 18293 tablet_bootstrap.cc:492] T eeadb773c7dc416581b44225256a4c3b P 10dfae53d0c941f08bded43539841761: Bootstrap starting.
I20251023 07:58:36.918221 18143 leader_election.cc:304] T 33c314b036134d929890c744d68bc0cc P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:58:36.918164 18349 raft_consensus.cc:515] T 5585a11a884140c7abc7d5a3b6ab86f3 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.919001 18291 tablet_bootstrap.cc:654] T 33c314b036134d929890c744d68bc0cc P 982df35c5b554a8fa64807352c4f34ee: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:36.919082 18301 raft_consensus.cc:2804] T 33c314b036134d929890c744d68bc0cc P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:58:36.919469 18301 raft_consensus.cc:493] T 33c314b036134d929890c744d68bc0cc P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:36.919906 18301 raft_consensus.cc:3060] T 33c314b036134d929890c744d68bc0cc P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:36.920954 18100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5585a11a884140c7abc7d5a3b6ab86f3" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
I20251023 07:58:36.921602 18100 raft_consensus.cc:3060] T 5585a11a884140c7abc7d5a3b6ab86f3 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Advancing to term 1
W20251023 07:58:36.925491 18142 leader_election.cc:343] T 33c314b036134d929890c744d68bc0cc P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:36.928735 18100 raft_consensus.cc:2468] T 5585a11a884140c7abc7d5a3b6ab86f3 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 1.
I20251023 07:58:36.929384 18293 tablet_bootstrap.cc:654] T eeadb773c7dc416581b44225256a4c3b P 10dfae53d0c941f08bded43539841761: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:36.930022 18143 leader_election.cc:304] T 5585a11a884140c7abc7d5a3b6ab86f3 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:58:36.934067 18251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5585a11a884140c7abc7d5a3b6ab86f3" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
I20251023 07:58:36.934702 18251 raft_consensus.cc:3060] T 5585a11a884140c7abc7d5a3b6ab86f3 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:36.935494 18301 raft_consensus.cc:515] T 33c314b036134d929890c744d68bc0cc P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.938436 18301 leader_election.cc:290] T 33c314b036134d929890c744d68bc0cc P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 election: Requested vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:36.939217 18301 raft_consensus.cc:2804] T 5585a11a884140c7abc7d5a3b6ab86f3 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:58:36.939868 18301 raft_consensus.cc:697] T 5585a11a884140c7abc7d5a3b6ab86f3 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Becoming Leader. State: Replica: 10dfae53d0c941f08bded43539841761, State: Running, Role: LEADER
I20251023 07:58:36.941035 18301 consensus_queue.cc:237] T 5585a11a884140c7abc7d5a3b6ab86f3 P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.942713 18250 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "33c314b036134d929890c744d68bc0cc" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
W20251023 07:58:36.944106 18142 leader_election.cc:343] T 33c314b036134d929890c744d68bc0cc P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:36.945978 18349 leader_election.cc:290] T 5585a11a884140c7abc7d5a3b6ab86f3 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 election: Requested vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:36.946280 18251 raft_consensus.cc:2468] T 5585a11a884140c7abc7d5a3b6ab86f3 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 1.
I20251023 07:58:36.947726 18292 tablet_bootstrap.cc:492] T 1f539da81d60449b9d96866c7ceee1be P b3a1328f9c8c484fab08292ce2171ec9: No bootstrap required, opened a new log
I20251023 07:58:36.948395 18292 ts_tablet_manager.cc:1403] T 1f539da81d60449b9d96866c7ceee1be P b3a1328f9c8c484fab08292ce2171ec9: Time spent bootstrapping tablet: real 0.069s user 0.011s sys 0.004s
I20251023 07:58:36.949975 18100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "33c314b036134d929890c744d68bc0cc" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
I20251023 07:58:36.950215 18293 tablet_bootstrap.cc:492] T eeadb773c7dc416581b44225256a4c3b P 10dfae53d0c941f08bded43539841761: No bootstrap required, opened a new log
I20251023 07:58:36.950577 18100 raft_consensus.cc:3060] T 33c314b036134d929890c744d68bc0cc P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:36.950881 18293 ts_tablet_manager.cc:1403] T eeadb773c7dc416581b44225256a4c3b P 10dfae53d0c941f08bded43539841761: Time spent bootstrapping tablet: real 0.037s user 0.010s sys 0.003s
I20251023 07:58:36.951418 18292 raft_consensus.cc:359] T 1f539da81d60449b9d96866c7ceee1be P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.952121 18292 raft_consensus.cc:385] T 1f539da81d60449b9d96866c7ceee1be P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:36.952390 18292 raft_consensus.cc:740] T 1f539da81d60449b9d96866c7ceee1be P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Initialized, Role: FOLLOWER
I20251023 07:58:36.953127 18292 consensus_queue.cc:260] T 1f539da81d60449b9d96866c7ceee1be P b3a1328f9c8c484fab08292ce2171ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.954681 18293 raft_consensus.cc:359] T eeadb773c7dc416581b44225256a4c3b P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.955554 18293 raft_consensus.cc:385] T eeadb773c7dc416581b44225256a4c3b P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:36.955890 18293 raft_consensus.cc:740] T eeadb773c7dc416581b44225256a4c3b P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Initialized, Role: FOLLOWER
I20251023 07:58:36.956836 18293 consensus_queue.cc:260] T eeadb773c7dc416581b44225256a4c3b P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.957912 18100 raft_consensus.cc:2468] T 33c314b036134d929890c744d68bc0cc P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 1.
I20251023 07:58:36.950525 18291 tablet_bootstrap.cc:492] T 33c314b036134d929890c744d68bc0cc P 982df35c5b554a8fa64807352c4f34ee: No bootstrap required, opened a new log
I20251023 07:58:36.959357 18291 ts_tablet_manager.cc:1403] T 33c314b036134d929890c744d68bc0cc P 982df35c5b554a8fa64807352c4f34ee: Time spent bootstrapping tablet: real 0.047s user 0.014s sys 0.024s
I20251023 07:58:36.959067 18143 leader_election.cc:304] T 33c314b036134d929890c744d68bc0cc P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9; no voters: 982df35c5b554a8fa64807352c4f34ee
I20251023 07:58:36.960136 18349 raft_consensus.cc:2804] T 33c314b036134d929890c744d68bc0cc P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:58:36.960744 18349 raft_consensus.cc:697] T 33c314b036134d929890c744d68bc0cc P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Becoming Leader. State: Replica: 10dfae53d0c941f08bded43539841761, State: Running, Role: LEADER
I20251023 07:58:36.962039 18291 raft_consensus.cc:359] T 33c314b036134d929890c744d68bc0cc P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.961875 18349 consensus_queue.cc:237] T 33c314b036134d929890c744d68bc0cc P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.962728 18291 raft_consensus.cc:385] T 33c314b036134d929890c744d68bc0cc P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:36.963024 18291 raft_consensus.cc:740] T 33c314b036134d929890c744d68bc0cc P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Initialized, Role: FOLLOWER
I20251023 07:58:36.963675 18291 consensus_queue.cc:260] T 33c314b036134d929890c744d68bc0cc P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.965677 18291 ts_tablet_manager.cc:1434] T 33c314b036134d929890c744d68bc0cc P 982df35c5b554a8fa64807352c4f34ee: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20251023 07:58:36.966408 18317 raft_consensus.cc:493] T 33c314b036134d929890c744d68bc0cc P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:36.966913 18317 raft_consensus.cc:515] T 33c314b036134d929890c744d68bc0cc P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.968354 18291 tablet_bootstrap.cc:492] T fe0293c22cae49cfa7cd698f17626a35 P 982df35c5b554a8fa64807352c4f34ee: Bootstrap starting.
I20251023 07:58:36.968830 18317 leader_election.cc:290] T 33c314b036134d929890c744d68bc0cc P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:58:36.970311 18100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "33c314b036134d929890c744d68bc0cc" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:36.971119 18100 raft_consensus.cc:2393] T 33c314b036134d929890c744d68bc0cc P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 982df35c5b554a8fa64807352c4f34ee in current term 1: Already voted for candidate 10dfae53d0c941f08bded43539841761 in this term.
I20251023 07:58:36.971259 18176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "33c314b036134d929890c744d68bc0cc" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:36.971367 18293 ts_tablet_manager.cc:1434] T eeadb773c7dc416581b44225256a4c3b P 10dfae53d0c941f08bded43539841761: Time spent starting tablet: real 0.020s user 0.007s sys 0.000s
I20251023 07:58:36.972744 18293 tablet_bootstrap.cc:492] T e99e859ac34a47c4b2859ec2638d17e5 P 10dfae53d0c941f08bded43539841761: Bootstrap starting.
I20251023 07:58:36.973519 18215 leader_election.cc:304] T 33c314b036134d929890c744d68bc0cc P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee; no voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9
I20251023 07:58:36.974751 18317 raft_consensus.cc:3060] T 33c314b036134d929890c744d68bc0cc P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:36.976924 18291 tablet_bootstrap.cc:654] T fe0293c22cae49cfa7cd698f17626a35 P 982df35c5b554a8fa64807352c4f34ee: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:36.980901 18372 raft_consensus.cc:493] T fbc1ceb70a0c42c6871ea24480ee4221 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:36.981652 18372 raft_consensus.cc:515] T fbc1ceb70a0c42c6871ea24480ee4221 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.984927 18372 leader_election.cc:290] T fbc1ceb70a0c42c6871ea24480ee4221 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:36.985656 18372 raft_consensus.cc:493] T eeadb773c7dc416581b44225256a4c3b P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:36.986253 18372 raft_consensus.cc:515] T eeadb773c7dc416581b44225256a4c3b P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.988273 18251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fbc1ceb70a0c42c6871ea24480ee4221" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:36.989230 18251 raft_consensus.cc:2468] T fbc1ceb70a0c42c6871ea24480ee4221 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 0.
I20251023 07:58:36.990504 18344 raft_consensus.cc:493] T fbc1ceb70a0c42c6871ea24480ee4221 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:36.991158 18344 raft_consensus.cc:515] T fbc1ceb70a0c42c6871ea24480ee4221 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:36.995580 18176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fbc1ceb70a0c42c6871ea24480ee4221" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:36.996414 18176 raft_consensus.cc:2468] T fbc1ceb70a0c42c6871ea24480ee4221 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3a1328f9c8c484fab08292ce2171ec9 in term 0.
I20251023 07:58:36.998034 18066 leader_election.cc:304] T fbc1ceb70a0c42c6871ea24480ee4221 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:58:36.999173 18332 raft_consensus.cc:2804] T fbc1ceb70a0c42c6871ea24480ee4221 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:58:36.999661 18332 raft_consensus.cc:493] T fbc1ceb70a0c42c6871ea24480ee4221 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:36.999783 18142 leader_election.cc:304] T fbc1ceb70a0c42c6871ea24480ee4221 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, 982df35c5b554a8fa64807352c4f34ee; no voters:
I20251023 07:58:37.000133 18332 raft_consensus.cc:3060] T fbc1ceb70a0c42c6871ea24480ee4221 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:37.004089 18251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eeadb773c7dc416581b44225256a4c3b" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:37.004971 18251 raft_consensus.cc:2468] T eeadb773c7dc416581b44225256a4c3b P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 0.
I20251023 07:58:37.006433 18344 leader_election.cc:290] T fbc1ceb70a0c42c6871ea24480ee4221 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:37.008668 18142 leader_election.cc:304] T eeadb773c7dc416581b44225256a4c3b P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, 982df35c5b554a8fa64807352c4f34ee; no voters:
I20251023 07:58:37.010676 18251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fbc1ceb70a0c42c6871ea24480ee4221" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:37.011536 18251 raft_consensus.cc:2468] T fbc1ceb70a0c42c6871ea24480ee4221 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3a1328f9c8c484fab08292ce2171ec9 in term 0.
I20251023 07:58:37.013473 18332 raft_consensus.cc:515] T fbc1ceb70a0c42c6871ea24480ee4221 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:37.017236 18176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fbc1ceb70a0c42c6871ea24480ee4221" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761"
I20251023 07:58:37.018033 18176 raft_consensus.cc:3060] T fbc1ceb70a0c42c6871ea24480ee4221 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:37.021936 18372 leader_election.cc:290] T eeadb773c7dc416581b44225256a4c3b P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:37.025668 18292 ts_tablet_manager.cc:1434] T 1f539da81d60449b9d96866c7ceee1be P b3a1328f9c8c484fab08292ce2171ec9: Time spent starting tablet: real 0.077s user 0.007s sys 0.000s
I20251023 07:58:37.026551 18378 raft_consensus.cc:2804] T eeadb773c7dc416581b44225256a4c3b P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:58:37.030701 18176 raft_consensus.cc:2468] T fbc1ceb70a0c42c6871ea24480ee4221 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3a1328f9c8c484fab08292ce2171ec9 in term 1.
I20251023 07:58:37.032316 18066 leader_election.cc:304] T fbc1ceb70a0c42c6871ea24480ee4221 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:58:37.033461 18344 raft_consensus.cc:2804] T fbc1ceb70a0c42c6871ea24480ee4221 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:58:37.034322 18344 raft_consensus.cc:697] T fbc1ceb70a0c42c6871ea24480ee4221 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Becoming Leader. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Running, Role: LEADER
I20251023 07:58:37.035429 18344 consensus_queue.cc:237] T fbc1ceb70a0c42c6871ea24480ee4221 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:37.041582 18372 raft_consensus.cc:2764] T fbc1ceb70a0c42c6871ea24480ee4221 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20251023 07:58:37.047451 18317 raft_consensus.cc:2749] T 33c314b036134d929890c744d68bc0cc P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:58:37.049093 18293 tablet_bootstrap.cc:654] T e99e859ac34a47c4b2859ec2638d17e5 P 10dfae53d0c941f08bded43539841761: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:37.027091 18378 raft_consensus.cc:493] T eeadb773c7dc416581b44225256a4c3b P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:37.051038 18378 raft_consensus.cc:3060] T eeadb773c7dc416581b44225256a4c3b P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:37.057940 18332 leader_election.cc:290] T fbc1ceb70a0c42c6871ea24480ee4221 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 election: Requested vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:37.059720 18251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fbc1ceb70a0c42c6871ea24480ee4221" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
I20251023 07:58:37.060550 18251 raft_consensus.cc:3060] T fbc1ceb70a0c42c6871ea24480ee4221 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:37.069196 18292 tablet_bootstrap.cc:492] T fe0293c22cae49cfa7cd698f17626a35 P b3a1328f9c8c484fab08292ce2171ec9: Bootstrap starting.
I20251023 07:58:37.086083 18000 catalog_manager.cc:5649] T fbc1ceb70a0c42c6871ea24480ee4221 P b3a1328f9c8c484fab08292ce2171ec9 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1). New cstate: current_term: 1 leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } }
I20251023 07:58:37.087785 18293 tablet_bootstrap.cc:492] T e99e859ac34a47c4b2859ec2638d17e5 P 10dfae53d0c941f08bded43539841761: No bootstrap required, opened a new log
I20251023 07:58:37.088419 18293 ts_tablet_manager.cc:1403] T e99e859ac34a47c4b2859ec2638d17e5 P 10dfae53d0c941f08bded43539841761: Time spent bootstrapping tablet: real 0.116s user 0.011s sys 0.004s
I20251023 07:58:37.097359 18378 raft_consensus.cc:515] T eeadb773c7dc416581b44225256a4c3b P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:37.100942 18250 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eeadb773c7dc416581b44225256a4c3b" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
I20251023 07:58:37.102124 18250 raft_consensus.cc:3060] T eeadb773c7dc416581b44225256a4c3b P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:37.091913 18293 raft_consensus.cc:359] T e99e859ac34a47c4b2859ec2638d17e5 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:37.107264 18293 raft_consensus.cc:385] T e99e859ac34a47c4b2859ec2638d17e5 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:37.107590 18293 raft_consensus.cc:740] T e99e859ac34a47c4b2859ec2638d17e5 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Initialized, Role: FOLLOWER
I20251023 07:58:37.108384 18378 leader_election.cc:290] T eeadb773c7dc416581b44225256a4c3b P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 election: Requested vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:37.110071 18332 consensus_queue.cc:1048] T 1f184d89e4244f12af7afd690bc7027d P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20251023 07:58:37.112679 18293 consensus_queue.cc:260] T e99e859ac34a47c4b2859ec2638d17e5 P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:37.115692 18293 ts_tablet_manager.cc:1434] T e99e859ac34a47c4b2859ec2638d17e5 P 10dfae53d0c941f08bded43539841761: Time spent starting tablet: real 0.027s user 0.008s sys 0.000s
I20251023 07:58:37.123471 18100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fbc1ceb70a0c42c6871ea24480ee4221" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:37.124393 18102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eeadb773c7dc416581b44225256a4c3b" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:37.125247 18102 raft_consensus.cc:2468] T eeadb773c7dc416581b44225256a4c3b P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 0.
I20251023 07:58:37.127871 18102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eeadb773c7dc416581b44225256a4c3b" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
W20251023 07:58:37.128423 18048 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20251023 07:58:37.128552 18102 raft_consensus.cc:3060] T eeadb773c7dc416581b44225256a4c3b P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:37.130878 18293 tablet_bootstrap.cc:492] T 7fe190354178418bae8b7cc5abbb74ef P 10dfae53d0c941f08bded43539841761: Bootstrap starting.
I20251023 07:58:37.145103 18359 consensus_queue.cc:1048] T 79fcf5e4a38448ba95c62cc1ffe2823a P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20251023 07:58:37.158003 18248 raft_consensus.cc:3060] T 744a3368282b44d9b9618922875d20d3 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:37.164705 18293 tablet_bootstrap.cc:654] T 7fe190354178418bae8b7cc5abbb74ef P 10dfae53d0c941f08bded43539841761: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:37.161664 18344 consensus_queue.cc:1048] T 744a3368282b44d9b9618922875d20d3 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20251023 07:58:37.171458 18300 consensus_queue.cc:1048] T 1f184d89e4244f12af7afd690bc7027d P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:37.176178 18251 raft_consensus.cc:2468] T fbc1ceb70a0c42c6871ea24480ee4221 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3a1328f9c8c484fab08292ce2171ec9 in term 1.
I20251023 07:58:37.178049 18000 catalog_manager.cc:5649] T 5585a11a884140c7abc7d5a3b6ab86f3 P 10dfae53d0c941f08bded43539841761 reported cstate change: term changed from 0 to 1, leader changed from <none> to 10dfae53d0c941f08bded43539841761 (127.16.126.2). New cstate: current_term: 1 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } }
I20251023 07:58:37.180111 18359 raft_consensus.cc:493] T 744a3368282b44d9b9618922875d20d3 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:37.181061 18359 raft_consensus.cc:515] T 744a3368282b44d9b9618922875d20d3 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:37.188750 18344 consensus_queue.cc:1048] T 744a3368282b44d9b9618922875d20d3 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:58:37.201056 18301 consensus_queue.cc:1048] T 3d1032da07fd44be9c392e8f4cd2af1f P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:58:37.209829 18349 raft_consensus.cc:493] T e99e859ac34a47c4b2859ec2638d17e5 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:37.216728 18292 tablet_bootstrap.cc:654] T fe0293c22cae49cfa7cd698f17626a35 P b3a1328f9c8c484fab08292ce2171ec9: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:37.216456 18349 raft_consensus.cc:515] T e99e859ac34a47c4b2859ec2638d17e5 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:37.220960 18291 tablet_bootstrap.cc:492] T fe0293c22cae49cfa7cd698f17626a35 P 982df35c5b554a8fa64807352c4f34ee: No bootstrap required, opened a new log
I20251023 07:58:37.221488 18291 ts_tablet_manager.cc:1403] T fe0293c22cae49cfa7cd698f17626a35 P 982df35c5b554a8fa64807352c4f34ee: Time spent bootstrapping tablet: real 0.253s user 0.097s sys 0.099s
I20251023 07:58:37.231033 18349 leader_election.cc:290] T e99e859ac34a47c4b2859ec2638d17e5 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:37.232071 18317 consensus_queue.cc:1048] T 5d4096f60c864412bb51be0c52c22961 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:58:37.236222 18291 raft_consensus.cc:359] T fe0293c22cae49cfa7cd698f17626a35 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:37.237668 18100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e99e859ac34a47c4b2859ec2638d17e5" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:37.238873 18344 raft_consensus.cc:493] T 1f539da81d60449b9d96866c7ceee1be P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:37.239089 18176 raft_consensus.cc:3060] T 4117fd2188e14b9aacc56f82245a3cc6 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:37.239504 18344 raft_consensus.cc:515] T 1f539da81d60449b9d96866c7ceee1be P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
W20251023 07:58:37.240406 18143 leader_election.cc:343] T e99e859ac34a47c4b2859ec2638d17e5 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:37.232084 18102 raft_consensus.cc:2468] T eeadb773c7dc416581b44225256a4c3b P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 1.
I20251023 07:58:37.237162 18291 raft_consensus.cc:385] T fe0293c22cae49cfa7cd698f17626a35 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:37.244666 18291 raft_consensus.cc:740] T fe0293c22cae49cfa7cd698f17626a35 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Initialized, Role: FOLLOWER
I20251023 07:58:37.246270 18291 consensus_queue.cc:260] T fe0293c22cae49cfa7cd698f17626a35 P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:37.231716 18250 raft_consensus.cc:2468] T eeadb773c7dc416581b44225256a4c3b P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 1.
I20251023 07:58:37.249794 18293 tablet_bootstrap.cc:492] T 7fe190354178418bae8b7cc5abbb74ef P 10dfae53d0c941f08bded43539841761: No bootstrap required, opened a new log
I20251023 07:58:37.250609 18247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e99e859ac34a47c4b2859ec2638d17e5" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:37.253690 18173 raft_consensus.cc:3060] T abefe27ebb4c4179a8620d4e638fe119 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:37.255549 18300 raft_consensus.cc:493] T b9841e711f8e4a019c2d0dec5409474c P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:37.256114 18300 raft_consensus.cc:515] T b9841e711f8e4a019c2d0dec5409474c P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:37.244117 18143 leader_election.cc:304] T eeadb773c7dc416581b44225256a4c3b P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:58:37.259246 18172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1f539da81d60449b9d96866c7ceee1be" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:37.267632 18171 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b9841e711f8e4a019c2d0dec5409474c" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:37.275070 18349 raft_consensus.cc:2804] T eeadb773c7dc416581b44225256a4c3b P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:58:37.275754 18349 raft_consensus.cc:697] T eeadb773c7dc416581b44225256a4c3b P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Becoming Leader. State: Replica: 10dfae53d0c941f08bded43539841761, State: Running, Role: LEADER
I20251023 07:58:37.271135 18291 ts_tablet_manager.cc:1434] T fe0293c22cae49cfa7cd698f17626a35 P 982df35c5b554a8fa64807352c4f34ee: Time spent starting tablet: real 0.049s user 0.008s sys 0.000s
I20251023 07:58:37.276875 18349 consensus_queue.cc:237] T eeadb773c7dc416581b44225256a4c3b P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
W20251023 07:58:37.278290 18066 leader_election.cc:343] T 1f539da81d60449b9d96866c7ceee1be P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Illegal state: must be running to vote when last-logged opid is not known
W20251023 07:58:37.279134 18066 leader_election.cc:343] T b9841e711f8e4a019c2d0dec5409474c P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:37.277292 18291 tablet_bootstrap.cc:492] T b9841e711f8e4a019c2d0dec5409474c P 982df35c5b554a8fa64807352c4f34ee: Bootstrap starting.
I20251023 07:58:37.289212 18344 leader_election.cc:290] T 1f539da81d60449b9d96866c7ceee1be P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:37.416940 18293 ts_tablet_manager.cc:1403] T 7fe190354178418bae8b7cc5abbb74ef P 10dfae53d0c941f08bded43539841761: Time spent bootstrapping tablet: real 0.300s user 0.033s sys 0.025s
W20251023 07:58:37.426190 18217 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.1:44025, user_credentials={real_user=slave}} blocked reactor thread for 176679us
I20251023 07:58:37.325775 18359 leader_election.cc:290] T 744a3368282b44d9b9618922875d20d3 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:58:37.429407 18102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "744a3368282b44d9b9618922875d20d3" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:37.423199 18300 leader_election.cc:290] T b9841e711f8e4a019c2d0dec5409474c P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:37.435796 18292 tablet_bootstrap.cc:492] T fe0293c22cae49cfa7cd698f17626a35 P b3a1328f9c8c484fab08292ce2171ec9: No bootstrap required, opened a new log
I20251023 07:58:37.438637 18292 ts_tablet_manager.cc:1403] T fe0293c22cae49cfa7cd698f17626a35 P b3a1328f9c8c484fab08292ce2171ec9: Time spent bootstrapping tablet: real 0.370s user 0.023s sys 0.013s
I20251023 07:58:37.428179 18319 consensus_queue.cc:1048] T 79fcf5e4a38448ba95c62cc1ffe2823a P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20251023 07:58:37.462690 18378 consensus_queue.cc:1048] T 5585a11a884140c7abc7d5a3b6ab86f3 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:58:37.463513 18301 raft_consensus.cc:493] T 4117fd2188e14b9aacc56f82245a3cc6 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3a1328f9c8c484fab08292ce2171ec9)
I20251023 07:58:37.464237 18301 raft_consensus.cc:515] T 4117fd2188e14b9aacc56f82245a3cc6 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:37.439213 18372 consensus_queue.cc:1048] T 3d1032da07fd44be9c392e8f4cd2af1f P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
W20251023 07:58:37.509183 18215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.2:45799, user_credentials={real_user=slave}} blocked reactor thread for 259907us
I20251023 07:58:37.513886 18301 leader_election.cc:290] T 4117fd2188e14b9aacc56f82245a3cc6 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:37.544085 18378 consensus_queue.cc:1048] T 33c314b036134d929890c744d68bc0cc P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20251023 07:58:37.551399 18291 tablet_bootstrap.cc:654] T b9841e711f8e4a019c2d0dec5409474c P 982df35c5b554a8fa64807352c4f34ee: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:37.566202 18293 raft_consensus.cc:359] T 7fe190354178418bae8b7cc5abbb74ef P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:37.567947 18293 raft_consensus.cc:385] T 7fe190354178418bae8b7cc5abbb74ef P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:37.568197 18293 raft_consensus.cc:740] T 7fe190354178418bae8b7cc5abbb74ef P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Initialized, Role: FOLLOWER
W20251023 07:58:37.566926 18142 leader_election.cc:343] T e99e859ac34a47c4b2859ec2638d17e5 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:37.569227 18142 leader_election.cc:304] T e99e859ac34a47c4b2859ec2638d17e5 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10dfae53d0c941f08bded43539841761; no voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9
I20251023 07:58:37.570510 18248 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1f539da81d60449b9d96866c7ceee1be" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:37.544222 18098 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4117fd2188e14b9aacc56f82245a3cc6" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:37.572263 18293 consensus_queue.cc:260] T 7fe190354178418bae8b7cc5abbb74ef P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:37.573931 18292 raft_consensus.cc:359] T fe0293c22cae49cfa7cd698f17626a35 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:37.573330 18172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "744a3368282b44d9b9618922875d20d3" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:37.580679 18292 raft_consensus.cc:385] T fe0293c22cae49cfa7cd698f17626a35 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:37.581122 18292 raft_consensus.cc:740] T fe0293c22cae49cfa7cd698f17626a35 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Initialized, Role: FOLLOWER
I20251023 07:58:37.582006 18292 consensus_queue.cc:260] T fe0293c22cae49cfa7cd698f17626a35 P b3a1328f9c8c484fab08292ce2171ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
W20251023 07:58:37.585539 18281 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.IsCreateTableDone -> {remote=127.16.126.62:34671, user_credentials={real_user=slave}} blocked reactor thread for 72069.5us
I20251023 07:58:37.585258 18293 ts_tablet_manager.cc:1434] T 7fe190354178418bae8b7cc5abbb74ef P 10dfae53d0c941f08bded43539841761: Time spent starting tablet: real 0.168s user 0.006s sys 0.001s
I20251023 07:58:37.588272 18292 ts_tablet_manager.cc:1434] T fe0293c22cae49cfa7cd698f17626a35 P b3a1328f9c8c484fab08292ce2171ec9: Time spent starting tablet: real 0.149s user 0.004s sys 0.007s
I20251023 07:58:37.575829 18372 raft_consensus.cc:2749] T e99e859ac34a47c4b2859ec2638d17e5 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:58:37.589723 18292 tablet_bootstrap.cc:492] T 7fe190354178418bae8b7cc5abbb74ef P b3a1328f9c8c484fab08292ce2171ec9: Bootstrap starting.
I20251023 07:58:37.588310 18293 tablet_bootstrap.cc:492] T b9841e711f8e4a019c2d0dec5409474c P 10dfae53d0c941f08bded43539841761: Bootstrap starting.
I20251023 07:58:37.576328 18249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b9841e711f8e4a019c2d0dec5409474c" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:37.609912 18398 consensus_queue.cc:1048] T fbc1ceb70a0c42c6871ea24480ee4221 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:58:37.618494 18251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4117fd2188e14b9aacc56f82245a3cc6" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:37.621277 18317 consensus_queue.cc:1048] T 5d4096f60c864412bb51be0c52c22961 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:37.619439 18215 leader_election.cc:304] T 744a3368282b44d9b9618922875d20d3 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee; no voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9
I20251023 07:58:37.627516 18317 raft_consensus.cc:2749] T 744a3368282b44d9b9618922875d20d3 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251023 07:58:37.640743 18142 leader_election.cc:304] T 4117fd2188e14b9aacc56f82245a3cc6 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10dfae53d0c941f08bded43539841761; no voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9
I20251023 07:58:37.642428 18349 raft_consensus.cc:2749] T 4117fd2188e14b9aacc56f82245a3cc6 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20251023 07:58:37.649734 18067 leader_election.cc:343] T 1f539da81d60449b9d96866c7ceee1be P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:37.647087 18349 consensus_queue.cc:1048] T 5585a11a884140c7abc7d5a3b6ab86f3 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20251023 07:58:37.663734 18377 raft_consensus.cc:493] T abefe27ebb4c4179a8620d4e638fe119 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 982df35c5b554a8fa64807352c4f34ee)
I20251023 07:58:37.665410 18377 raft_consensus.cc:515] T abefe27ebb4c4179a8620d4e638fe119 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:37.669682 18372 consensus_queue.cc:1048] T 33c314b036134d929890c744d68bc0cc P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:37.676975 18000 catalog_manager.cc:5649] T eeadb773c7dc416581b44225256a4c3b P 10dfae53d0c941f08bded43539841761 reported cstate change: term changed from 0 to 1, leader changed from <none> to 10dfae53d0c941f08bded43539841761 (127.16.126.2). New cstate: current_term: 1 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } }
I20251023 07:58:37.681205 18000 catalog_manager.cc:5649] T 33c314b036134d929890c744d68bc0cc P 10dfae53d0c941f08bded43539841761 reported cstate change: term changed from 0 to 1, leader changed from <none> to 10dfae53d0c941f08bded43539841761 (127.16.126.2). New cstate: current_term: 1 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } }
I20251023 07:58:37.690420 18291 tablet_bootstrap.cc:492] T b9841e711f8e4a019c2d0dec5409474c P 982df35c5b554a8fa64807352c4f34ee: No bootstrap required, opened a new log
I20251023 07:58:37.691123 18291 ts_tablet_manager.cc:1403] T b9841e711f8e4a019c2d0dec5409474c P 982df35c5b554a8fa64807352c4f34ee: Time spent bootstrapping tablet: real 0.414s user 0.021s sys 0.010s
I20251023 07:58:37.702858 18291 raft_consensus.cc:359] T b9841e711f8e4a019c2d0dec5409474c P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:37.703583 18291 raft_consensus.cc:385] T b9841e711f8e4a019c2d0dec5409474c P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:37.706048 18293 tablet_bootstrap.cc:654] T b9841e711f8e4a019c2d0dec5409474c P 10dfae53d0c941f08bded43539841761: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:37.703883 18291 raft_consensus.cc:740] T b9841e711f8e4a019c2d0dec5409474c P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Initialized, Role: FOLLOWER
I20251023 07:58:37.655045 18067 leader_election.cc:304] T 1f539da81d60449b9d96866c7ceee1be P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3a1328f9c8c484fab08292ce2171ec9; no voters: 10dfae53d0c941f08bded43539841761, 982df35c5b554a8fa64807352c4f34ee
I20251023 07:58:37.709733 18291 consensus_queue.cc:260] T b9841e711f8e4a019c2d0dec5409474c P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:37.712184 18398 raft_consensus.cc:2749] T 1f539da81d60449b9d96866c7ceee1be P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251023 07:58:37.713992 18067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.126.3:46061, user_credentials={real_user=slave}} blocked reactor thread for 64320.9us
W20251023 07:58:37.715910 18067 leader_election.cc:343] T b9841e711f8e4a019c2d0dec5409474c P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:37.716572 18292 tablet_bootstrap.cc:654] T 7fe190354178418bae8b7cc5abbb74ef P b3a1328f9c8c484fab08292ce2171ec9: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:37.716444 18067 leader_election.cc:304] T b9841e711f8e4a019c2d0dec5409474c P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3a1328f9c8c484fab08292ce2171ec9; no voters: 10dfae53d0c941f08bded43539841761, 982df35c5b554a8fa64807352c4f34ee
I20251023 07:58:37.718199 18398 raft_consensus.cc:2749] T b9841e711f8e4a019c2d0dec5409474c P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:58:37.743304 18317 raft_consensus.cc:493] T fe0293c22cae49cfa7cd698f17626a35 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:37.744072 18317 raft_consensus.cc:515] T fe0293c22cae49cfa7cd698f17626a35 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:37.746711 18317 leader_election.cc:290] T fe0293c22cae49cfa7cd698f17626a35 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:58:37.748127 18173 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe0293c22cae49cfa7cd698f17626a35" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
W20251023 07:58:37.749632 18215 leader_election.cc:343] T fe0293c22cae49cfa7cd698f17626a35 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:37.752511 18377 leader_election.cc:290] T abefe27ebb4c4179a8620d4e638fe119 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:37.762991 18247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "abefe27ebb4c4179a8620d4e638fe119" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:37.767071 18291 ts_tablet_manager.cc:1434] T b9841e711f8e4a019c2d0dec5409474c P 982df35c5b554a8fa64807352c4f34ee: Time spent starting tablet: real 0.076s user 0.006s sys 0.002s
I20251023 07:58:37.768313 18291 tablet_bootstrap.cc:492] T 7fe190354178418bae8b7cc5abbb74ef P 982df35c5b554a8fa64807352c4f34ee: Bootstrap starting.
I20251023 07:58:37.770069 18096 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "abefe27ebb4c4179a8620d4e638fe119" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:37.772419 18143 leader_election.cc:304] T abefe27ebb4c4179a8620d4e638fe119 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10dfae53d0c941f08bded43539841761; no voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9
I20251023 07:58:37.774647 18349 raft_consensus.cc:2749] T abefe27ebb4c4179a8620d4e638fe119 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251023 07:58:37.801816 18293 tablet_bootstrap.cc:492] T b9841e711f8e4a019c2d0dec5409474c P 10dfae53d0c941f08bded43539841761: No bootstrap required, opened a new log
I20251023 07:58:37.802459 18293 ts_tablet_manager.cc:1403] T b9841e711f8e4a019c2d0dec5409474c P 10dfae53d0c941f08bded43539841761: Time spent bootstrapping tablet: real 0.215s user 0.009s sys 0.005s
I20251023 07:58:37.806156 18293 raft_consensus.cc:359] T b9841e711f8e4a019c2d0dec5409474c P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:37.807160 18293 raft_consensus.cc:385] T b9841e711f8e4a019c2d0dec5409474c P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:37.807512 18293 raft_consensus.cc:740] T b9841e711f8e4a019c2d0dec5409474c P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Initialized, Role: FOLLOWER
I20251023 07:58:37.810627 18293 consensus_queue.cc:260] T b9841e711f8e4a019c2d0dec5409474c P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:37.808383 18344 consensus_queue.cc:1048] T fbc1ceb70a0c42c6871ea24480ee4221 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20251023 07:58:37.825498 18102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe0293c22cae49cfa7cd698f17626a35" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:37.826246 18102 raft_consensus.cc:2468] T fe0293c22cae49cfa7cd698f17626a35 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 0.
I20251023 07:58:37.827608 18217 leader_election.cc:304] T fe0293c22cae49cfa7cd698f17626a35 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9; no voters: 10dfae53d0c941f08bded43539841761
I20251023 07:58:37.828035 18291 tablet_bootstrap.cc:654] T 7fe190354178418bae8b7cc5abbb74ef P 982df35c5b554a8fa64807352c4f34ee: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:37.830017 18293 ts_tablet_manager.cc:1434] T b9841e711f8e4a019c2d0dec5409474c P 10dfae53d0c941f08bded43539841761: Time spent starting tablet: real 0.027s user 0.003s sys 0.006s
I20251023 07:58:37.831290 18293 tablet_bootstrap.cc:492] T fe0293c22cae49cfa7cd698f17626a35 P 10dfae53d0c941f08bded43539841761: Bootstrap starting.
I20251023 07:58:37.832399 18319 raft_consensus.cc:2804] T fe0293c22cae49cfa7cd698f17626a35 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:58:37.835223 18319 raft_consensus.cc:493] T fe0293c22cae49cfa7cd698f17626a35 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:37.835595 18319 raft_consensus.cc:3060] T fe0293c22cae49cfa7cd698f17626a35 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:37.862712 18319 raft_consensus.cc:515] T fe0293c22cae49cfa7cd698f17626a35 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:37.884217 18102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe0293c22cae49cfa7cd698f17626a35" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
I20251023 07:58:37.884904 18102 raft_consensus.cc:3060] T fe0293c22cae49cfa7cd698f17626a35 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:37.892889 18102 raft_consensus.cc:2468] T fe0293c22cae49cfa7cd698f17626a35 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 1.
I20251023 07:58:37.871752 18292 tablet_bootstrap.cc:492] T 7fe190354178418bae8b7cc5abbb74ef P b3a1328f9c8c484fab08292ce2171ec9: No bootstrap required, opened a new log
I20251023 07:58:37.866210 18293 tablet_bootstrap.cc:654] T fe0293c22cae49cfa7cd698f17626a35 P 10dfae53d0c941f08bded43539841761: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:37.893899 18292 ts_tablet_manager.cc:1403] T 7fe190354178418bae8b7cc5abbb74ef P b3a1328f9c8c484fab08292ce2171ec9: Time spent bootstrapping tablet: real 0.305s user 0.022s sys 0.037s
I20251023 07:58:37.902520 18172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe0293c22cae49cfa7cd698f17626a35" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761"
I20251023 07:58:37.903976 18217 leader_election.cc:304] T fe0293c22cae49cfa7cd698f17626a35 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:58:37.904866 18317 raft_consensus.cc:2804] T fe0293c22cae49cfa7cd698f17626a35 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:58:37.905331 18317 raft_consensus.cc:697] T fe0293c22cae49cfa7cd698f17626a35 P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Becoming Leader. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Running, Role: LEADER
I20251023 07:58:37.905954 18292 raft_consensus.cc:359] T 7fe190354178418bae8b7cc5abbb74ef P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:37.906154 18317 consensus_queue.cc:237] T fe0293c22cae49cfa7cd698f17626a35 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:37.906636 18292 raft_consensus.cc:385] T 7fe190354178418bae8b7cc5abbb74ef P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:37.906909 18292 raft_consensus.cc:740] T 7fe190354178418bae8b7cc5abbb74ef P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Initialized, Role: FOLLOWER
I20251023 07:58:37.907501 18292 consensus_queue.cc:260] T 7fe190354178418bae8b7cc5abbb74ef P b3a1328f9c8c484fab08292ce2171ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:37.909619 18292 ts_tablet_manager.cc:1434] T 7fe190354178418bae8b7cc5abbb74ef P b3a1328f9c8c484fab08292ce2171ec9: Time spent starting tablet: real 0.015s user 0.007s sys 0.000s
W20251023 07:58:37.909801 18215 leader_election.cc:343] T fe0293c22cae49cfa7cd698f17626a35 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:37.910548 18292 tablet_bootstrap.cc:492] T c6022ad5a70c4b4f8f34339956122cb7 P b3a1328f9c8c484fab08292ce2171ec9: Bootstrap starting.
I20251023 07:58:37.913537 18319 leader_election.cc:290] T fe0293c22cae49cfa7cd698f17626a35 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 election: Requested vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:58:37.919620 18291 tablet_bootstrap.cc:492] T 7fe190354178418bae8b7cc5abbb74ef P 982df35c5b554a8fa64807352c4f34ee: No bootstrap required, opened a new log
I20251023 07:58:37.920123 18291 ts_tablet_manager.cc:1403] T 7fe190354178418bae8b7cc5abbb74ef P 982df35c5b554a8fa64807352c4f34ee: Time spent bootstrapping tablet: real 0.152s user 0.012s sys 0.004s
I20251023 07:58:37.923017 18291 raft_consensus.cc:359] T 7fe190354178418bae8b7cc5abbb74ef P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:37.923909 18291 raft_consensus.cc:385] T 7fe190354178418bae8b7cc5abbb74ef P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:37.924245 18291 raft_consensus.cc:740] T 7fe190354178418bae8b7cc5abbb74ef P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Initialized, Role: FOLLOWER
I20251023 07:58:37.925053 18291 consensus_queue.cc:260] T 7fe190354178418bae8b7cc5abbb74ef P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:37.927650 18291 ts_tablet_manager.cc:1434] T 7fe190354178418bae8b7cc5abbb74ef P 982df35c5b554a8fa64807352c4f34ee: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20251023 07:58:37.928745 18291 tablet_bootstrap.cc:492] T 1f539da81d60449b9d96866c7ceee1be P 982df35c5b554a8fa64807352c4f34ee: Bootstrap starting.
I20251023 07:58:37.937234 18291 tablet_bootstrap.cc:654] T 1f539da81d60449b9d96866c7ceee1be P 982df35c5b554a8fa64807352c4f34ee: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:37.937287 18292 tablet_bootstrap.cc:654] T c6022ad5a70c4b4f8f34339956122cb7 P b3a1328f9c8c484fab08292ce2171ec9: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:37.942157 18293 tablet_bootstrap.cc:492] T fe0293c22cae49cfa7cd698f17626a35 P 10dfae53d0c941f08bded43539841761: No bootstrap required, opened a new log
I20251023 07:58:37.942715 18293 ts_tablet_manager.cc:1403] T fe0293c22cae49cfa7cd698f17626a35 P 10dfae53d0c941f08bded43539841761: Time spent bootstrapping tablet: real 0.112s user 0.012s sys 0.003s
I20251023 07:58:37.945228 18293 raft_consensus.cc:359] T fe0293c22cae49cfa7cd698f17626a35 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:37.946161 18293 raft_consensus.cc:385] T fe0293c22cae49cfa7cd698f17626a35 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:37.946687 18293 raft_consensus.cc:740] T fe0293c22cae49cfa7cd698f17626a35 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Initialized, Role: FOLLOWER
I20251023 07:58:37.951385 18377 consensus_queue.cc:1048] T eeadb773c7dc416581b44225256a4c3b P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:37.953578 18293 consensus_queue.cc:260] T fe0293c22cae49cfa7cd698f17626a35 P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:37.956002 18293 ts_tablet_manager.cc:1434] T fe0293c22cae49cfa7cd698f17626a35 P 10dfae53d0c941f08bded43539841761: Time spent starting tablet: real 0.013s user 0.004s sys 0.000s
I20251023 07:58:37.956940 18293 tablet_bootstrap.cc:492] T a83dfc7a7d784b52b9c74bbc451ad603 P 10dfae53d0c941f08bded43539841761: Bootstrap starting.
I20251023 07:58:37.960729 18291 tablet_bootstrap.cc:492] T 1f539da81d60449b9d96866c7ceee1be P 982df35c5b554a8fa64807352c4f34ee: No bootstrap required, opened a new log
I20251023 07:58:37.961329 18291 ts_tablet_manager.cc:1403] T 1f539da81d60449b9d96866c7ceee1be P 982df35c5b554a8fa64807352c4f34ee: Time spent bootstrapping tablet: real 0.033s user 0.011s sys 0.003s
I20251023 07:58:37.963030 18293 tablet_bootstrap.cc:654] T a83dfc7a7d784b52b9c74bbc451ad603 P 10dfae53d0c941f08bded43539841761: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:37.967180 18292 tablet_bootstrap.cc:492] T c6022ad5a70c4b4f8f34339956122cb7 P b3a1328f9c8c484fab08292ce2171ec9: No bootstrap required, opened a new log
I20251023 07:58:37.967634 18292 ts_tablet_manager.cc:1403] T c6022ad5a70c4b4f8f34339956122cb7 P b3a1328f9c8c484fab08292ce2171ec9: Time spent bootstrapping tablet: real 0.057s user 0.011s sys 0.000s
I20251023 07:58:37.970324 18292 raft_consensus.cc:359] T c6022ad5a70c4b4f8f34339956122cb7 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:37.971002 18292 raft_consensus.cc:385] T c6022ad5a70c4b4f8f34339956122cb7 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:37.971267 18292 raft_consensus.cc:740] T c6022ad5a70c4b4f8f34339956122cb7 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Initialized, Role: FOLLOWER
I20251023 07:58:37.971843 18292 consensus_queue.cc:260] T c6022ad5a70c4b4f8f34339956122cb7 P b3a1328f9c8c484fab08292ce2171ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:37.973975 18292 ts_tablet_manager.cc:1434] T c6022ad5a70c4b4f8f34339956122cb7 P b3a1328f9c8c484fab08292ce2171ec9: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20251023 07:58:37.974849 18292 tablet_bootstrap.cc:492] T a83dfc7a7d784b52b9c74bbc451ad603 P b3a1328f9c8c484fab08292ce2171ec9: Bootstrap starting.
I20251023 07:58:37.978469 18372 consensus_queue.cc:1048] T eeadb773c7dc416581b44225256a4c3b P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:37.964660 18291 raft_consensus.cc:359] T 1f539da81d60449b9d96866c7ceee1be P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:37.980037 18291 raft_consensus.cc:385] T 1f539da81d60449b9d96866c7ceee1be P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:37.980324 18291 raft_consensus.cc:740] T 1f539da81d60449b9d96866c7ceee1be P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Initialized, Role: FOLLOWER
I20251023 07:58:37.980968 18291 consensus_queue.cc:260] T 1f539da81d60449b9d96866c7ceee1be P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:37.983433 18291 ts_tablet_manager.cc:1434] T 1f539da81d60449b9d96866c7ceee1be P 982df35c5b554a8fa64807352c4f34ee: Time spent starting tablet: real 0.022s user 0.006s sys 0.000s
I20251023 07:58:37.984267 18291 tablet_bootstrap.cc:492] T eb40d8c2f73d48868bfc3ef3889bea45 P 982df35c5b554a8fa64807352c4f34ee: Bootstrap starting.
I20251023 07:58:38.012981 18291 tablet_bootstrap.cc:654] T eb40d8c2f73d48868bfc3ef3889bea45 P 982df35c5b554a8fa64807352c4f34ee: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:38.019732 18292 tablet_bootstrap.cc:654] T a83dfc7a7d784b52b9c74bbc451ad603 P b3a1328f9c8c484fab08292ce2171ec9: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:38.020226 18293 tablet_bootstrap.cc:492] T a83dfc7a7d784b52b9c74bbc451ad603 P 10dfae53d0c941f08bded43539841761: No bootstrap required, opened a new log
I20251023 07:58:38.020761 18293 ts_tablet_manager.cc:1403] T a83dfc7a7d784b52b9c74bbc451ad603 P 10dfae53d0c941f08bded43539841761: Time spent bootstrapping tablet: real 0.064s user 0.027s sys 0.027s
I20251023 07:58:38.023590 18293 raft_consensus.cc:359] T a83dfc7a7d784b52b9c74bbc451ad603 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.024199 18293 raft_consensus.cc:385] T a83dfc7a7d784b52b9c74bbc451ad603 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:38.024423 18293 raft_consensus.cc:740] T a83dfc7a7d784b52b9c74bbc451ad603 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Initialized, Role: FOLLOWER
I20251023 07:58:38.024987 18293 consensus_queue.cc:260] T a83dfc7a7d784b52b9c74bbc451ad603 P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.027252 18293 ts_tablet_manager.cc:1434] T a83dfc7a7d784b52b9c74bbc451ad603 P 10dfae53d0c941f08bded43539841761: Time spent starting tablet: real 0.006s user 0.002s sys 0.003s
I20251023 07:58:38.026783 17997 catalog_manager.cc:5649] T fe0293c22cae49cfa7cd698f17626a35 P 982df35c5b554a8fa64807352c4f34ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 982df35c5b554a8fa64807352c4f34ee (127.16.126.3). New cstate: current_term: 1 leader_uuid: "982df35c5b554a8fa64807352c4f34ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: HEALTHY } } }
I20251023 07:58:38.033066 18293 tablet_bootstrap.cc:492] T eb40d8c2f73d48868bfc3ef3889bea45 P 10dfae53d0c941f08bded43539841761: Bootstrap starting.
I20251023 07:58:38.035202 18372 raft_consensus.cc:493] T a83dfc7a7d784b52b9c74bbc451ad603 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:38.035703 18372 raft_consensus.cc:515] T a83dfc7a7d784b52b9c74bbc451ad603 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.037638 18372 leader_election.cc:290] T a83dfc7a7d784b52b9c74bbc451ad603 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:38.039116 18251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a83dfc7a7d784b52b9c74bbc451ad603" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
W20251023 07:58:38.040848 18142 leader_election.cc:343] T a83dfc7a7d784b52b9c74bbc451ad603 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:38.041188 18292 tablet_bootstrap.cc:492] T a83dfc7a7d784b52b9c74bbc451ad603 P b3a1328f9c8c484fab08292ce2171ec9: No bootstrap required, opened a new log
I20251023 07:58:38.041126 18102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a83dfc7a7d784b52b9c74bbc451ad603" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:38.041893 18292 ts_tablet_manager.cc:1403] T a83dfc7a7d784b52b9c74bbc451ad603 P b3a1328f9c8c484fab08292ce2171ec9: Time spent bootstrapping tablet: real 0.067s user 0.003s sys 0.011s
W20251023 07:58:38.042568 18143 leader_election.cc:343] T a83dfc7a7d784b52b9c74bbc451ad603 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:38.043022 18143 leader_election.cc:304] T a83dfc7a7d784b52b9c74bbc451ad603 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10dfae53d0c941f08bded43539841761; no voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9
I20251023 07:58:38.045214 18372 raft_consensus.cc:2749] T a83dfc7a7d784b52b9c74bbc451ad603 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:58:38.045163 18292 raft_consensus.cc:359] T a83dfc7a7d784b52b9c74bbc451ad603 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.047101 18292 raft_consensus.cc:385] T a83dfc7a7d784b52b9c74bbc451ad603 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:38.047358 18292 raft_consensus.cc:740] T a83dfc7a7d784b52b9c74bbc451ad603 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Initialized, Role: FOLLOWER
I20251023 07:58:38.047941 18291 tablet_bootstrap.cc:492] T eb40d8c2f73d48868bfc3ef3889bea45 P 982df35c5b554a8fa64807352c4f34ee: No bootstrap required, opened a new log
I20251023 07:58:38.048435 18291 ts_tablet_manager.cc:1403] T eb40d8c2f73d48868bfc3ef3889bea45 P 982df35c5b554a8fa64807352c4f34ee: Time spent bootstrapping tablet: real 0.064s user 0.020s sys 0.020s
I20251023 07:58:38.048024 18292 consensus_queue.cc:260] T a83dfc7a7d784b52b9c74bbc451ad603 P b3a1328f9c8c484fab08292ce2171ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.050992 18291 raft_consensus.cc:359] T eb40d8c2f73d48868bfc3ef3889bea45 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.051664 18291 raft_consensus.cc:385] T eb40d8c2f73d48868bfc3ef3889bea45 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:38.051934 18291 raft_consensus.cc:740] T eb40d8c2f73d48868bfc3ef3889bea45 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Initialized, Role: FOLLOWER
I20251023 07:58:38.052645 18291 consensus_queue.cc:260] T eb40d8c2f73d48868bfc3ef3889bea45 P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.056955 18293 tablet_bootstrap.cc:654] T eb40d8c2f73d48868bfc3ef3889bea45 P 10dfae53d0c941f08bded43539841761: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:38.059933 18372 raft_consensus.cc:493] T 7fe190354178418bae8b7cc5abbb74ef P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:38.059952 18317 raft_consensus.cc:493] T b9841e711f8e4a019c2d0dec5409474c P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:38.060509 18372 raft_consensus.cc:515] T 7fe190354178418bae8b7cc5abbb74ef P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.061133 18317 raft_consensus.cc:515] T b9841e711f8e4a019c2d0dec5409474c P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.063124 18317 leader_election.cc:290] T b9841e711f8e4a019c2d0dec5409474c P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:58:38.065223 18102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b9841e711f8e4a019c2d0dec5409474c" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:38.065909 18251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7fe190354178418bae8b7cc5abbb74ef" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:38.066483 18292 ts_tablet_manager.cc:1434] T a83dfc7a7d784b52b9c74bbc451ad603 P b3a1328f9c8c484fab08292ce2171ec9: Time spent starting tablet: real 0.024s user 0.005s sys 0.001s
I20251023 07:58:38.066537 18251 raft_consensus.cc:2468] T 7fe190354178418bae8b7cc5abbb74ef P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 0.
I20251023 07:58:38.067070 18097 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7fe190354178418bae8b7cc5abbb74ef" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:38.065924 18102 raft_consensus.cc:2468] T b9841e711f8e4a019c2d0dec5409474c P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 0.
I20251023 07:58:38.067957 18097 raft_consensus.cc:2468] T 7fe190354178418bae8b7cc5abbb74ef P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 0.
I20251023 07:58:38.068960 18217 leader_election.cc:304] T b9841e711f8e4a019c2d0dec5409474c P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:58:38.069284 18172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b9841e711f8e4a019c2d0dec5409474c" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:38.070168 18317 raft_consensus.cc:2804] T b9841e711f8e4a019c2d0dec5409474c P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:58:38.070541 18317 raft_consensus.cc:493] T b9841e711f8e4a019c2d0dec5409474c P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:38.070437 18172 raft_consensus.cc:2468] T b9841e711f8e4a019c2d0dec5409474c P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 0.
I20251023 07:58:38.071013 18317 raft_consensus.cc:3060] T b9841e711f8e4a019c2d0dec5409474c P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:38.071926 18142 leader_election.cc:304] T 7fe190354178418bae8b7cc5abbb74ef P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, 982df35c5b554a8fa64807352c4f34ee; no voters:
I20251023 07:58:38.073288 18403 raft_consensus.cc:2804] T 7fe190354178418bae8b7cc5abbb74ef P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:58:38.073810 18403 raft_consensus.cc:493] T 7fe190354178418bae8b7cc5abbb74ef P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:38.074229 18403 raft_consensus.cc:3060] T 7fe190354178418bae8b7cc5abbb74ef P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:38.075991 18292 tablet_bootstrap.cc:492] T eb40d8c2f73d48868bfc3ef3889bea45 P b3a1328f9c8c484fab08292ce2171ec9: Bootstrap starting.
I20251023 07:58:38.055156 18291 ts_tablet_manager.cc:1434] T eb40d8c2f73d48868bfc3ef3889bea45 P 982df35c5b554a8fa64807352c4f34ee: Time spent starting tablet: real 0.006s user 0.006s sys 0.001s
I20251023 07:58:38.083986 18372 leader_election.cc:290] T 7fe190354178418bae8b7cc5abbb74ef P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:38.086834 18291 tablet_bootstrap.cc:492] T c63b5a4dc8eb4b6e918608f281183068 P 982df35c5b554a8fa64807352c4f34ee: Bootstrap starting.
I20251023 07:58:38.090237 18292 tablet_bootstrap.cc:654] T eb40d8c2f73d48868bfc3ef3889bea45 P b3a1328f9c8c484fab08292ce2171ec9: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:38.095387 18293 tablet_bootstrap.cc:492] T eb40d8c2f73d48868bfc3ef3889bea45 P 10dfae53d0c941f08bded43539841761: No bootstrap required, opened a new log
I20251023 07:58:38.094163 18403 raft_consensus.cc:515] T 7fe190354178418bae8b7cc5abbb74ef P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.098929 18403 leader_election.cc:290] T 7fe190354178418bae8b7cc5abbb74ef P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 election: Requested vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:38.095855 18293 ts_tablet_manager.cc:1403] T eb40d8c2f73d48868bfc3ef3889bea45 P 10dfae53d0c941f08bded43539841761: Time spent bootstrapping tablet: real 0.063s user 0.025s sys 0.017s
I20251023 07:58:38.099156 18317 raft_consensus.cc:515] T b9841e711f8e4a019c2d0dec5409474c P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.100205 18102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7fe190354178418bae8b7cc5abbb74ef" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
I20251023 07:58:38.100817 18102 raft_consensus.cc:3060] T 7fe190354178418bae8b7cc5abbb74ef P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:38.101940 18097 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b9841e711f8e4a019c2d0dec5409474c" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
I20251023 07:58:38.102494 18097 raft_consensus.cc:3060] T b9841e711f8e4a019c2d0dec5409474c P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:38.102351 18293 raft_consensus.cc:359] T eb40d8c2f73d48868bfc3ef3889bea45 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.103046 18293 raft_consensus.cc:385] T eb40d8c2f73d48868bfc3ef3889bea45 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:38.103309 18293 raft_consensus.cc:740] T eb40d8c2f73d48868bfc3ef3889bea45 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Initialized, Role: FOLLOWER
I20251023 07:58:38.103945 18293 consensus_queue.cc:260] T eb40d8c2f73d48868bfc3ef3889bea45 P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.105578 18251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7fe190354178418bae8b7cc5abbb74ef" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
I20251023 07:58:38.106128 18251 raft_consensus.cc:3060] T 7fe190354178418bae8b7cc5abbb74ef P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:38.106093 18293 ts_tablet_manager.cc:1434] T eb40d8c2f73d48868bfc3ef3889bea45 P 10dfae53d0c941f08bded43539841761: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20251023 07:58:38.108022 18293 tablet_bootstrap.cc:492] T 1f539da81d60449b9d96866c7ceee1be P 10dfae53d0c941f08bded43539841761: Bootstrap starting.
I20251023 07:58:38.114025 18102 raft_consensus.cc:2468] T 7fe190354178418bae8b7cc5abbb74ef P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 1.
I20251023 07:58:38.119979 18317 leader_election.cc:290] T b9841e711f8e4a019c2d0dec5409474c P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 election: Requested vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:58:38.121279 18251 raft_consensus.cc:2468] T 7fe190354178418bae8b7cc5abbb74ef P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 1.
I20251023 07:58:38.122148 18172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b9841e711f8e4a019c2d0dec5409474c" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761"
I20251023 07:58:38.122818 18172 raft_consensus.cc:3060] T b9841e711f8e4a019c2d0dec5409474c P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:38.123111 18143 leader_election.cc:304] T 7fe190354178418bae8b7cc5abbb74ef P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:58:38.124501 18403 raft_consensus.cc:2804] T 7fe190354178418bae8b7cc5abbb74ef P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:58:38.124949 18403 raft_consensus.cc:697] T 7fe190354178418bae8b7cc5abbb74ef P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Becoming Leader. State: Replica: 10dfae53d0c941f08bded43539841761, State: Running, Role: LEADER
I20251023 07:58:38.125173 18291 tablet_bootstrap.cc:654] T c63b5a4dc8eb4b6e918608f281183068 P 982df35c5b554a8fa64807352c4f34ee: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:38.120244 18097 raft_consensus.cc:2468] T b9841e711f8e4a019c2d0dec5409474c P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 1.
I20251023 07:58:38.126387 18403 consensus_queue.cc:237] T 7fe190354178418bae8b7cc5abbb74ef P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.128085 18217 leader_election.cc:304] T b9841e711f8e4a019c2d0dec5409474c P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:58:38.129040 18359 raft_consensus.cc:2804] T b9841e711f8e4a019c2d0dec5409474c P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:58:38.129506 18359 raft_consensus.cc:697] T b9841e711f8e4a019c2d0dec5409474c P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Becoming Leader. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Running, Role: LEADER
I20251023 07:58:38.130287 18359 consensus_queue.cc:237] T b9841e711f8e4a019c2d0dec5409474c P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.136539 18292 tablet_bootstrap.cc:492] T eb40d8c2f73d48868bfc3ef3889bea45 P b3a1328f9c8c484fab08292ce2171ec9: No bootstrap required, opened a new log
I20251023 07:58:38.137060 18292 ts_tablet_manager.cc:1403] T eb40d8c2f73d48868bfc3ef3889bea45 P b3a1328f9c8c484fab08292ce2171ec9: Time spent bootstrapping tablet: real 0.061s user 0.019s sys 0.006s
I20251023 07:58:38.137701 18172 raft_consensus.cc:2468] T b9841e711f8e4a019c2d0dec5409474c P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 1.
I20251023 07:58:38.145751 18292 raft_consensus.cc:359] T eb40d8c2f73d48868bfc3ef3889bea45 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.146591 18292 raft_consensus.cc:385] T eb40d8c2f73d48868bfc3ef3889bea45 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:38.146801 18292 raft_consensus.cc:740] T eb40d8c2f73d48868bfc3ef3889bea45 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Initialized, Role: FOLLOWER
I20251023 07:58:38.147266 18292 consensus_queue.cc:260] T eb40d8c2f73d48868bfc3ef3889bea45 P b3a1328f9c8c484fab08292ce2171ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.151984 18293 tablet_bootstrap.cc:654] T 1f539da81d60449b9d96866c7ceee1be P 10dfae53d0c941f08bded43539841761: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:38.154145 18292 ts_tablet_manager.cc:1434] T eb40d8c2f73d48868bfc3ef3889bea45 P b3a1328f9c8c484fab08292ce2171ec9: Time spent starting tablet: real 0.017s user 0.006s sys 0.000s
I20251023 07:58:38.155205 18292 tablet_bootstrap.cc:492] T e99e859ac34a47c4b2859ec2638d17e5 P b3a1328f9c8c484fab08292ce2171ec9: Bootstrap starting.
I20251023 07:58:38.174255 18000 catalog_manager.cc:5649] T b9841e711f8e4a019c2d0dec5409474c P 982df35c5b554a8fa64807352c4f34ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 982df35c5b554a8fa64807352c4f34ee (127.16.126.3). New cstate: current_term: 1 leader_uuid: "982df35c5b554a8fa64807352c4f34ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: HEALTHY } } }
I20251023 07:58:38.181056 18291 tablet_bootstrap.cc:492] T c63b5a4dc8eb4b6e918608f281183068 P 982df35c5b554a8fa64807352c4f34ee: No bootstrap required, opened a new log
I20251023 07:58:38.181577 18291 ts_tablet_manager.cc:1403] T c63b5a4dc8eb4b6e918608f281183068 P 982df35c5b554a8fa64807352c4f34ee: Time spent bootstrapping tablet: real 0.095s user 0.017s sys 0.000s
I20251023 07:58:38.183797 18292 tablet_bootstrap.cc:654] T e99e859ac34a47c4b2859ec2638d17e5 P b3a1328f9c8c484fab08292ce2171ec9: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:38.184012 18291 raft_consensus.cc:359] T c63b5a4dc8eb4b6e918608f281183068 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.184571 18291 raft_consensus.cc:385] T c63b5a4dc8eb4b6e918608f281183068 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:38.184785 18291 raft_consensus.cc:740] T c63b5a4dc8eb4b6e918608f281183068 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Initialized, Role: FOLLOWER
I20251023 07:58:38.185346 18291 consensus_queue.cc:260] T c63b5a4dc8eb4b6e918608f281183068 P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
W20251023 07:58:38.186901 18048 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20251023 07:58:38.187217 18291 ts_tablet_manager.cc:1434] T c63b5a4dc8eb4b6e918608f281183068 P 982df35c5b554a8fa64807352c4f34ee: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20251023 07:58:38.187975 18291 tablet_bootstrap.cc:492] T 5f7e006a09224285b1e5df5694ff72ae P 982df35c5b554a8fa64807352c4f34ee: Bootstrap starting.
I20251023 07:58:38.195580 18291 tablet_bootstrap.cc:654] T 5f7e006a09224285b1e5df5694ff72ae P 982df35c5b554a8fa64807352c4f34ee: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:38.200160 18291 tablet_bootstrap.cc:492] T 5f7e006a09224285b1e5df5694ff72ae P 982df35c5b554a8fa64807352c4f34ee: No bootstrap required, opened a new log
I20251023 07:58:38.200603 18291 ts_tablet_manager.cc:1403] T 5f7e006a09224285b1e5df5694ff72ae P 982df35c5b554a8fa64807352c4f34ee: Time spent bootstrapping tablet: real 0.013s user 0.009s sys 0.000s
I20251023 07:58:38.203161 18291 raft_consensus.cc:359] T 5f7e006a09224285b1e5df5694ff72ae P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.203913 18291 raft_consensus.cc:385] T 5f7e006a09224285b1e5df5694ff72ae P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:38.204175 18291 raft_consensus.cc:740] T 5f7e006a09224285b1e5df5694ff72ae P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Initialized, Role: FOLLOWER
I20251023 07:58:38.204771 18291 consensus_queue.cc:260] T 5f7e006a09224285b1e5df5694ff72ae P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.206386 18291 ts_tablet_manager.cc:1434] T 5f7e006a09224285b1e5df5694ff72ae P 982df35c5b554a8fa64807352c4f34ee: Time spent starting tablet: real 0.005s user 0.007s sys 0.000s
I20251023 07:58:38.207258 18291 tablet_bootstrap.cc:492] T b19b550093fb4ab181e62957d89460e7 P 982df35c5b554a8fa64807352c4f34ee: Bootstrap starting.
I20251023 07:58:38.211073 18293 tablet_bootstrap.cc:492] T 1f539da81d60449b9d96866c7ceee1be P 10dfae53d0c941f08bded43539841761: No bootstrap required, opened a new log
I20251023 07:58:38.211414 18293 ts_tablet_manager.cc:1403] T 1f539da81d60449b9d96866c7ceee1be P 10dfae53d0c941f08bded43539841761: Time spent bootstrapping tablet: real 0.104s user 0.009s sys 0.005s
I20251023 07:58:38.212857 18291 tablet_bootstrap.cc:654] T b19b550093fb4ab181e62957d89460e7 P 982df35c5b554a8fa64807352c4f34ee: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:38.213238 18293 raft_consensus.cc:359] T 1f539da81d60449b9d96866c7ceee1be P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.213996 18293 raft_consensus.cc:385] T 1f539da81d60449b9d96866c7ceee1be P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:38.214270 18293 raft_consensus.cc:740] T 1f539da81d60449b9d96866c7ceee1be P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Initialized, Role: FOLLOWER
I20251023 07:58:38.215098 18317 raft_consensus.cc:493] T 5f7e006a09224285b1e5df5694ff72ae P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:38.215557 18317 raft_consensus.cc:515] T 5f7e006a09224285b1e5df5694ff72ae P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.216049 18292 tablet_bootstrap.cc:492] T e99e859ac34a47c4b2859ec2638d17e5 P b3a1328f9c8c484fab08292ce2171ec9: No bootstrap required, opened a new log
I20251023 07:58:38.216517 18292 ts_tablet_manager.cc:1403] T e99e859ac34a47c4b2859ec2638d17e5 P b3a1328f9c8c484fab08292ce2171ec9: Time spent bootstrapping tablet: real 0.062s user 0.021s sys 0.003s
I20251023 07:58:38.217556 18317 leader_election.cc:290] T 5f7e006a09224285b1e5df5694ff72ae P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:58:38.218688 18172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5f7e006a09224285b1e5df5694ff72ae" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:38.219200 18097 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5f7e006a09224285b1e5df5694ff72ae" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:38.219165 18292 raft_consensus.cc:359] T e99e859ac34a47c4b2859ec2638d17e5 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.219928 18292 raft_consensus.cc:385] T e99e859ac34a47c4b2859ec2638d17e5 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:38.220196 18292 raft_consensus.cc:740] T e99e859ac34a47c4b2859ec2638d17e5 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Initialized, Role: FOLLOWER
W20251023 07:58:38.220214 18215 leader_election.cc:343] T 5f7e006a09224285b1e5df5694ff72ae P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Illegal state: must be running to vote when last-logged opid is not known
W20251023 07:58:38.220737 18217 leader_election.cc:343] T 5f7e006a09224285b1e5df5694ff72ae P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:38.220877 18292 consensus_queue.cc:260] T e99e859ac34a47c4b2859ec2638d17e5 P b3a1328f9c8c484fab08292ce2171ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.221204 18217 leader_election.cc:304] T 5f7e006a09224285b1e5df5694ff72ae P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee; no voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9
I20251023 07:58:38.220979 17998 catalog_manager.cc:5649] T 7fe190354178418bae8b7cc5abbb74ef P 10dfae53d0c941f08bded43539841761 reported cstate change: term changed from 0 to 1, leader changed from <none> to 10dfae53d0c941f08bded43539841761 (127.16.126.2). New cstate: current_term: 1 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } }
I20251023 07:58:38.222450 18317 raft_consensus.cc:2749] T 5f7e006a09224285b1e5df5694ff72ae P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:58:38.223508 18292 ts_tablet_manager.cc:1434] T e99e859ac34a47c4b2859ec2638d17e5 P b3a1328f9c8c484fab08292ce2171ec9: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20251023 07:58:38.223322 18293 consensus_queue.cc:260] T 1f539da81d60449b9d96866c7ceee1be P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.224426 18292 tablet_bootstrap.cc:492] T 3e4d005972f44619b0cf23f4978f51c4 P b3a1328f9c8c484fab08292ce2171ec9: Bootstrap starting.
I20251023 07:58:38.225883 18293 ts_tablet_manager.cc:1434] T 1f539da81d60449b9d96866c7ceee1be P 10dfae53d0c941f08bded43539841761: Time spent starting tablet: real 0.014s user 0.006s sys 0.001s
I20251023 07:58:38.226866 18293 tablet_bootstrap.cc:492] T c6022ad5a70c4b4f8f34339956122cb7 P 10dfae53d0c941f08bded43539841761: Bootstrap starting.
I20251023 07:58:38.230897 18292 tablet_bootstrap.cc:654] T 3e4d005972f44619b0cf23f4978f51c4 P b3a1328f9c8c484fab08292ce2171ec9: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:38.233378 18293 tablet_bootstrap.cc:654] T c6022ad5a70c4b4f8f34339956122cb7 P 10dfae53d0c941f08bded43539841761: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:38.237277 18403 raft_consensus.cc:493] T fe0293c22cae49cfa7cd698f17626a35 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:38.237985 18403 raft_consensus.cc:515] T fe0293c22cae49cfa7cd698f17626a35 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.241793 18403 leader_election.cc:290] T fe0293c22cae49cfa7cd698f17626a35 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:38.242210 18251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe0293c22cae49cfa7cd698f17626a35" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:38.242972 18292 tablet_bootstrap.cc:492] T 3e4d005972f44619b0cf23f4978f51c4 P b3a1328f9c8c484fab08292ce2171ec9: No bootstrap required, opened a new log
I20251023 07:58:38.243409 18292 ts_tablet_manager.cc:1403] T 3e4d005972f44619b0cf23f4978f51c4 P b3a1328f9c8c484fab08292ce2171ec9: Time spent bootstrapping tablet: real 0.019s user 0.012s sys 0.004s
I20251023 07:58:38.243956 18097 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe0293c22cae49cfa7cd698f17626a35" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:38.244684 18097 raft_consensus.cc:2393] T fe0293c22cae49cfa7cd698f17626a35 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10dfae53d0c941f08bded43539841761 in current term 1: Already voted for candidate 982df35c5b554a8fa64807352c4f34ee in this term.
I20251023 07:58:38.245820 18292 raft_consensus.cc:359] T 3e4d005972f44619b0cf23f4978f51c4 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.246428 18142 leader_election.cc:304] T fe0293c22cae49cfa7cd698f17626a35 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10dfae53d0c941f08bded43539841761; no voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9
I20251023 07:58:38.247881 18403 raft_consensus.cc:3060] T fe0293c22cae49cfa7cd698f17626a35 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:38.246452 18292 raft_consensus.cc:385] T 3e4d005972f44619b0cf23f4978f51c4 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:38.254894 18292 raft_consensus.cc:740] T 3e4d005972f44619b0cf23f4978f51c4 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Initialized, Role: FOLLOWER
I20251023 07:58:38.255494 18292 consensus_queue.cc:260] T 3e4d005972f44619b0cf23f4978f51c4 P b3a1328f9c8c484fab08292ce2171ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.257525 18292 ts_tablet_manager.cc:1434] T 3e4d005972f44619b0cf23f4978f51c4 P b3a1328f9c8c484fab08292ce2171ec9: Time spent starting tablet: real 0.014s user 0.005s sys 0.000s
I20251023 07:58:38.258447 18292 tablet_bootstrap.cc:492] T ce0069d7c0cf4dee84a85731209358f7 P b3a1328f9c8c484fab08292ce2171ec9: Bootstrap starting.
I20251023 07:58:38.258976 18403 raft_consensus.cc:2749] T fe0293c22cae49cfa7cd698f17626a35 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:58:38.263531 18292 tablet_bootstrap.cc:654] T ce0069d7c0cf4dee84a85731209358f7 P b3a1328f9c8c484fab08292ce2171ec9: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:38.274969 18293 tablet_bootstrap.cc:492] T c6022ad5a70c4b4f8f34339956122cb7 P 10dfae53d0c941f08bded43539841761: No bootstrap required, opened a new log
I20251023 07:58:38.275094 18291 tablet_bootstrap.cc:492] T b19b550093fb4ab181e62957d89460e7 P 982df35c5b554a8fa64807352c4f34ee: No bootstrap required, opened a new log
I20251023 07:58:38.275517 18293 ts_tablet_manager.cc:1403] T c6022ad5a70c4b4f8f34339956122cb7 P 10dfae53d0c941f08bded43539841761: Time spent bootstrapping tablet: real 0.049s user 0.011s sys 0.004s
I20251023 07:58:38.275597 18291 ts_tablet_manager.cc:1403] T b19b550093fb4ab181e62957d89460e7 P 982df35c5b554a8fa64807352c4f34ee: Time spent bootstrapping tablet: real 0.069s user 0.006s sys 0.023s
I20251023 07:58:38.277094 18292 tablet_bootstrap.cc:492] T ce0069d7c0cf4dee84a85731209358f7 P b3a1328f9c8c484fab08292ce2171ec9: No bootstrap required, opened a new log
I20251023 07:58:38.277601 18292 ts_tablet_manager.cc:1403] T ce0069d7c0cf4dee84a85731209358f7 P b3a1328f9c8c484fab08292ce2171ec9: Time spent bootstrapping tablet: real 0.019s user 0.011s sys 0.000s
I20251023 07:58:38.278295 18291 raft_consensus.cc:359] T b19b550093fb4ab181e62957d89460e7 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.278968 18291 raft_consensus.cc:385] T b19b550093fb4ab181e62957d89460e7 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:38.278657 18293 raft_consensus.cc:359] T c6022ad5a70c4b4f8f34339956122cb7 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.279275 18291 raft_consensus.cc:740] T b19b550093fb4ab181e62957d89460e7 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Initialized, Role: FOLLOWER
I20251023 07:58:38.279680 18293 raft_consensus.cc:385] T c6022ad5a70c4b4f8f34339956122cb7 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:38.280050 18293 raft_consensus.cc:740] T c6022ad5a70c4b4f8f34339956122cb7 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Initialized, Role: FOLLOWER
I20251023 07:58:38.279856 18292 raft_consensus.cc:359] T ce0069d7c0cf4dee84a85731209358f7 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.280134 18291 consensus_queue.cc:260] T b19b550093fb4ab181e62957d89460e7 P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.280673 18292 raft_consensus.cc:385] T ce0069d7c0cf4dee84a85731209358f7 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:38.280946 18292 raft_consensus.cc:740] T ce0069d7c0cf4dee84a85731209358f7 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Initialized, Role: FOLLOWER
I20251023 07:58:38.281127 18293 consensus_queue.cc:260] T c6022ad5a70c4b4f8f34339956122cb7 P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.281581 18292 consensus_queue.cc:260] T ce0069d7c0cf4dee84a85731209358f7 P b3a1328f9c8c484fab08292ce2171ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.283666 18292 ts_tablet_manager.cc:1434] T ce0069d7c0cf4dee84a85731209358f7 P b3a1328f9c8c484fab08292ce2171ec9: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20251023 07:58:38.284526 18292 tablet_bootstrap.cc:492] T c63b5a4dc8eb4b6e918608f281183068 P b3a1328f9c8c484fab08292ce2171ec9: Bootstrap starting.
I20251023 07:58:38.290160 18344 raft_consensus.cc:493] T a83dfc7a7d784b52b9c74bbc451ad603 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:38.290506 18292 tablet_bootstrap.cc:654] T c63b5a4dc8eb4b6e918608f281183068 P b3a1328f9c8c484fab08292ce2171ec9: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:38.290717 18344 raft_consensus.cc:515] T a83dfc7a7d784b52b9c74bbc451ad603 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.292876 18344 leader_election.cc:290] T a83dfc7a7d784b52b9c74bbc451ad603 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:38.294526 18293 ts_tablet_manager.cc:1434] T c6022ad5a70c4b4f8f34339956122cb7 P 10dfae53d0c941f08bded43539841761: Time spent starting tablet: real 0.019s user 0.008s sys 0.000s
I20251023 07:58:38.296720 18172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a83dfc7a7d784b52b9c74bbc451ad603" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:38.297358 18172 raft_consensus.cc:2468] T a83dfc7a7d784b52b9c74bbc451ad603 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3a1328f9c8c484fab08292ce2171ec9 in term 0.
I20251023 07:58:38.295265 18251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a83dfc7a7d784b52b9c74bbc451ad603" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:38.299024 18066 leader_election.cc:304] T a83dfc7a7d784b52b9c74bbc451ad603 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9; no voters:
W20251023 07:58:38.300208 18067 leader_election.cc:343] T a83dfc7a7d784b52b9c74bbc451ad603 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:38.300343 18344 raft_consensus.cc:2804] T a83dfc7a7d784b52b9c74bbc451ad603 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:58:38.300719 18344 raft_consensus.cc:493] T a83dfc7a7d784b52b9c74bbc451ad603 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:38.301050 18344 raft_consensus.cc:3060] T a83dfc7a7d784b52b9c74bbc451ad603 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:38.302104 18293 tablet_bootstrap.cc:492] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 10dfae53d0c941f08bded43539841761: Bootstrap starting.
I20251023 07:58:38.303259 18292 tablet_bootstrap.cc:492] T c63b5a4dc8eb4b6e918608f281183068 P b3a1328f9c8c484fab08292ce2171ec9: No bootstrap required, opened a new log
I20251023 07:58:38.305873 18292 ts_tablet_manager.cc:1403] T c63b5a4dc8eb4b6e918608f281183068 P b3a1328f9c8c484fab08292ce2171ec9: Time spent bootstrapping tablet: real 0.022s user 0.008s sys 0.005s
I20251023 07:58:38.306324 18317 raft_consensus.cc:493] T eb40d8c2f73d48868bfc3ef3889bea45 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:38.306823 18317 raft_consensus.cc:515] T eb40d8c2f73d48868bfc3ef3889bea45 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.308475 18344 raft_consensus.cc:515] T a83dfc7a7d784b52b9c74bbc451ad603 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.297542 18291 ts_tablet_manager.cc:1434] T b19b550093fb4ab181e62957d89460e7 P 982df35c5b554a8fa64807352c4f34ee: Time spent starting tablet: real 0.022s user 0.005s sys 0.002s
I20251023 07:58:38.312325 18293 tablet_bootstrap.cc:654] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 10dfae53d0c941f08bded43539841761: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:38.314553 18291 tablet_bootstrap.cc:492] T e99e859ac34a47c4b2859ec2638d17e5 P 982df35c5b554a8fa64807352c4f34ee: Bootstrap starting.
I20251023 07:58:38.318809 18251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a83dfc7a7d784b52b9c74bbc451ad603" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
I20251023 07:58:38.321224 18344 leader_election.cc:290] T a83dfc7a7d784b52b9c74bbc451ad603 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 election: Requested vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:38.325654 18291 tablet_bootstrap.cc:654] T e99e859ac34a47c4b2859ec2638d17e5 P 982df35c5b554a8fa64807352c4f34ee: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:38.312410 18172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eb40d8c2f73d48868bfc3ef3889bea45" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:38.313606 18097 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eb40d8c2f73d48868bfc3ef3889bea45" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:38.313931 18292 raft_consensus.cc:359] T c63b5a4dc8eb4b6e918608f281183068 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.308883 18317 leader_election.cc:290] T eb40d8c2f73d48868bfc3ef3889bea45 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:58:38.329146 18292 raft_consensus.cc:385] T c63b5a4dc8eb4b6e918608f281183068 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:38.329602 18292 raft_consensus.cc:740] T c63b5a4dc8eb4b6e918608f281183068 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Initialized, Role: FOLLOWER
W20251023 07:58:38.329833 18067 leader_election.cc:343] T a83dfc7a7d784b52b9c74bbc451ad603 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:38.330624 18174 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a83dfc7a7d784b52b9c74bbc451ad603" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761"
I20251023 07:58:38.330453 18292 consensus_queue.cc:260] T c63b5a4dc8eb4b6e918608f281183068 P b3a1328f9c8c484fab08292ce2171ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.331204 18174 raft_consensus.cc:3060] T a83dfc7a7d784b52b9c74bbc451ad603 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:38.330467 18097 raft_consensus.cc:2468] T eb40d8c2f73d48868bfc3ef3889bea45 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 0.
I20251023 07:58:38.334863 18344 raft_consensus.cc:493] T ce0069d7c0cf4dee84a85731209358f7 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:38.335464 18344 raft_consensus.cc:515] T ce0069d7c0cf4dee84a85731209358f7 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.337898 18172 raft_consensus.cc:2468] T eb40d8c2f73d48868bfc3ef3889bea45 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 0.
I20251023 07:58:38.337982 18344 leader_election.cc:290] T ce0069d7c0cf4dee84a85731209358f7 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:38.342548 18292 ts_tablet_manager.cc:1434] T c63b5a4dc8eb4b6e918608f281183068 P b3a1328f9c8c484fab08292ce2171ec9: Time spent starting tablet: real 0.036s user 0.007s sys 0.000s
I20251023 07:58:38.343773 18292 tablet_bootstrap.cc:492] T 94cd6588f7824a30ba02f891ae089671 P b3a1328f9c8c484fab08292ce2171ec9: Bootstrap starting.
I20251023 07:58:38.349676 18251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce0069d7c0cf4dee84a85731209358f7" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:38.341398 18217 leader_election.cc:304] T eb40d8c2f73d48868bfc3ef3889bea45 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:58:38.353641 18317 raft_consensus.cc:2804] T eb40d8c2f73d48868bfc3ef3889bea45 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Leader pre-election won for term 1
W20251023 07:58:38.355448 18067 leader_election.cc:343] T ce0069d7c0cf4dee84a85731209358f7 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:38.354115 18317 raft_consensus.cc:493] T eb40d8c2f73d48868bfc3ef3889bea45 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:38.356545 18317 raft_consensus.cc:3060] T eb40d8c2f73d48868bfc3ef3889bea45 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:38.363205 18172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce0069d7c0cf4dee84a85731209358f7" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:38.340021 18174 raft_consensus.cc:2468] T a83dfc7a7d784b52b9c74bbc451ad603 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3a1328f9c8c484fab08292ce2171ec9 in term 1.
W20251023 07:58:38.365248 18066 leader_election.cc:343] T ce0069d7c0cf4dee84a85731209358f7 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:38.365718 18066 leader_election.cc:304] T ce0069d7c0cf4dee84a85731209358f7 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3a1328f9c8c484fab08292ce2171ec9; no voters: 10dfae53d0c941f08bded43539841761, 982df35c5b554a8fa64807352c4f34ee
I20251023 07:58:38.366905 18066 leader_election.cc:304] T a83dfc7a7d784b52b9c74bbc451ad603 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9; no voters: 982df35c5b554a8fa64807352c4f34ee
I20251023 07:58:38.367671 18400 raft_consensus.cc:2749] T ce0069d7c0cf4dee84a85731209358f7 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:58:38.368430 18400 raft_consensus.cc:2804] T a83dfc7a7d784b52b9c74bbc451ad603 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:58:38.368952 18400 raft_consensus.cc:697] T a83dfc7a7d784b52b9c74bbc451ad603 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Becoming Leader. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Running, Role: LEADER
I20251023 07:58:38.370029 18400 consensus_queue.cc:237] T a83dfc7a7d784b52b9c74bbc451ad603 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.377974 18291 tablet_bootstrap.cc:492] T e99e859ac34a47c4b2859ec2638d17e5 P 982df35c5b554a8fa64807352c4f34ee: No bootstrap required, opened a new log
I20251023 07:58:38.378427 18291 ts_tablet_manager.cc:1403] T e99e859ac34a47c4b2859ec2638d17e5 P 982df35c5b554a8fa64807352c4f34ee: Time spent bootstrapping tablet: real 0.064s user 0.018s sys 0.013s
I20251023 07:58:38.381522 18292 tablet_bootstrap.cc:654] T 94cd6588f7824a30ba02f891ae089671 P b3a1328f9c8c484fab08292ce2171ec9: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:38.381201 18291 raft_consensus.cc:359] T e99e859ac34a47c4b2859ec2638d17e5 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.385075 18317 raft_consensus.cc:515] T eb40d8c2f73d48868bfc3ef3889bea45 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.383394 18291 raft_consensus.cc:385] T e99e859ac34a47c4b2859ec2638d17e5 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:38.385753 18359 consensus_queue.cc:1048] T fe0293c22cae49cfa7cd698f17626a35 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:38.385872 18291 raft_consensus.cc:740] T e99e859ac34a47c4b2859ec2638d17e5 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Initialized, Role: FOLLOWER
I20251023 07:58:38.388011 18097 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eb40d8c2f73d48868bfc3ef3889bea45" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
I20251023 07:58:38.388406 18293 tablet_bootstrap.cc:492] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 10dfae53d0c941f08bded43539841761: No bootstrap required, opened a new log
I20251023 07:58:38.388680 18097 raft_consensus.cc:3060] T eb40d8c2f73d48868bfc3ef3889bea45 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:38.388847 18293 ts_tablet_manager.cc:1403] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 10dfae53d0c941f08bded43539841761: Time spent bootstrapping tablet: real 0.087s user 0.025s sys 0.034s
I20251023 07:58:38.395869 18097 raft_consensus.cc:2468] T eb40d8c2f73d48868bfc3ef3889bea45 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 1.
I20251023 07:58:38.396957 18217 leader_election.cc:304] T eb40d8c2f73d48868bfc3ef3889bea45 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:58:38.397789 18359 raft_consensus.cc:2804] T eb40d8c2f73d48868bfc3ef3889bea45 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:58:38.398263 18359 raft_consensus.cc:697] T eb40d8c2f73d48868bfc3ef3889bea45 P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Becoming Leader. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Running, Role: LEADER
I20251023 07:58:38.398149 18291 consensus_queue.cc:260] T e99e859ac34a47c4b2859ec2638d17e5 P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.399659 18359 consensus_queue.cc:237] T eb40d8c2f73d48868bfc3ef3889bea45 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.401057 18291 ts_tablet_manager.cc:1434] T e99e859ac34a47c4b2859ec2638d17e5 P 982df35c5b554a8fa64807352c4f34ee: Time spent starting tablet: real 0.022s user 0.005s sys 0.000s
I20251023 07:58:38.402020 18291 tablet_bootstrap.cc:492] T 25d22e66fcd6444a9b9c469acd781e59 P 982df35c5b554a8fa64807352c4f34ee: Bootstrap starting.
I20251023 07:58:38.403189 18317 leader_election.cc:290] T eb40d8c2f73d48868bfc3ef3889bea45 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 election: Requested vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:58:38.404851 18172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eb40d8c2f73d48868bfc3ef3889bea45" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761"
I20251023 07:58:38.405534 18172 raft_consensus.cc:3060] T eb40d8c2f73d48868bfc3ef3889bea45 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:38.408631 18291 tablet_bootstrap.cc:654] T 25d22e66fcd6444a9b9c469acd781e59 P 982df35c5b554a8fa64807352c4f34ee: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:38.408409 17998 catalog_manager.cc:5649] T a83dfc7a7d784b52b9c74bbc451ad603 P b3a1328f9c8c484fab08292ce2171ec9 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1). New cstate: current_term: 1 leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } }
I20251023 07:58:38.412739 18172 raft_consensus.cc:2468] T eb40d8c2f73d48868bfc3ef3889bea45 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 1.
I20251023 07:58:38.397248 18293 raft_consensus.cc:359] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.416024 18293 raft_consensus.cc:385] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:38.416400 18293 raft_consensus.cc:740] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Initialized, Role: FOLLOWER
I20251023 07:58:38.419129 18293 consensus_queue.cc:260] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.419986 18292 tablet_bootstrap.cc:492] T 94cd6588f7824a30ba02f891ae089671 P b3a1328f9c8c484fab08292ce2171ec9: No bootstrap required, opened a new log
I20251023 07:58:38.420439 18292 ts_tablet_manager.cc:1403] T 94cd6588f7824a30ba02f891ae089671 P b3a1328f9c8c484fab08292ce2171ec9: Time spent bootstrapping tablet: real 0.077s user 0.015s sys 0.001s
I20251023 07:58:38.421321 18293 ts_tablet_manager.cc:1434] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 10dfae53d0c941f08bded43539841761: Time spent starting tablet: real 0.032s user 0.006s sys 0.000s
I20251023 07:58:38.422295 18293 tablet_bootstrap.cc:492] T b19b550093fb4ab181e62957d89460e7 P 10dfae53d0c941f08bded43539841761: Bootstrap starting.
I20251023 07:58:38.423022 18292 raft_consensus.cc:359] T 94cd6588f7824a30ba02f891ae089671 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.423683 18292 raft_consensus.cc:385] T 94cd6588f7824a30ba02f891ae089671 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:38.423947 18292 raft_consensus.cc:740] T 94cd6588f7824a30ba02f891ae089671 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Initialized, Role: FOLLOWER
I20251023 07:58:38.424537 18292 consensus_queue.cc:260] T 94cd6588f7824a30ba02f891ae089671 P b3a1328f9c8c484fab08292ce2171ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.427776 18292 ts_tablet_manager.cc:1434] T 94cd6588f7824a30ba02f891ae089671 P b3a1328f9c8c484fab08292ce2171ec9: Time spent starting tablet: real 0.007s user 0.004s sys 0.000s
I20251023 07:58:38.428840 18292 tablet_bootstrap.cc:492] T 25d22e66fcd6444a9b9c469acd781e59 P b3a1328f9c8c484fab08292ce2171ec9: Bootstrap starting.
I20251023 07:58:38.433694 18319 consensus_queue.cc:1048] T fe0293c22cae49cfa7cd698f17626a35 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:38.434579 18317 raft_consensus.cc:493] T 1f539da81d60449b9d96866c7ceee1be P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:38.434789 18292 tablet_bootstrap.cc:654] T 25d22e66fcd6444a9b9c469acd781e59 P b3a1328f9c8c484fab08292ce2171ec9: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:38.435081 18317 raft_consensus.cc:515] T 1f539da81d60449b9d96866c7ceee1be P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.436543 18291 tablet_bootstrap.cc:492] T 25d22e66fcd6444a9b9c469acd781e59 P 982df35c5b554a8fa64807352c4f34ee: No bootstrap required, opened a new log
I20251023 07:58:38.436983 18291 ts_tablet_manager.cc:1403] T 25d22e66fcd6444a9b9c469acd781e59 P 982df35c5b554a8fa64807352c4f34ee: Time spent bootstrapping tablet: real 0.035s user 0.006s sys 0.009s
I20251023 07:58:38.437443 18317 leader_election.cc:290] T 1f539da81d60449b9d96866c7ceee1be P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:58:38.438145 18102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1f539da81d60449b9d96866c7ceee1be" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:38.438741 18102 raft_consensus.cc:2468] T 1f539da81d60449b9d96866c7ceee1be P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 0.
I20251023 07:58:38.439254 18174 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1f539da81d60449b9d96866c7ceee1be" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:38.439476 18291 raft_consensus.cc:359] T 25d22e66fcd6444a9b9c469acd781e59 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.439854 18217 leader_election.cc:304] T 1f539da81d60449b9d96866c7ceee1be P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:58:38.440158 18291 raft_consensus.cc:385] T 25d22e66fcd6444a9b9c469acd781e59 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:38.440069 18174 raft_consensus.cc:2468] T 1f539da81d60449b9d96866c7ceee1be P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 0.
I20251023 07:58:38.440572 18291 raft_consensus.cc:740] T 25d22e66fcd6444a9b9c469acd781e59 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Initialized, Role: FOLLOWER
I20251023 07:58:38.442073 18403 raft_consensus.cc:493] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:38.442620 18403 raft_consensus.cc:515] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.445678 18102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "290b1b1fd4ef42cf9f0b285d4bf5ed36" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:38.446154 18292 tablet_bootstrap.cc:492] T 25d22e66fcd6444a9b9c469acd781e59 P b3a1328f9c8c484fab08292ce2171ec9: No bootstrap required, opened a new log
I20251023 07:58:38.446623 18292 ts_tablet_manager.cc:1403] T 25d22e66fcd6444a9b9c469acd781e59 P b3a1328f9c8c484fab08292ce2171ec9: Time spent bootstrapping tablet: real 0.018s user 0.009s sys 0.008s
I20251023 07:58:38.446655 18390 raft_consensus.cc:493] T c63b5a4dc8eb4b6e918608f281183068 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:38.447278 18390 raft_consensus.cc:515] T c63b5a4dc8eb4b6e918608f281183068 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
W20251023 07:58:38.447577 18143 leader_election.cc:343] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:38.449081 18403 leader_election.cc:290] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:38.449654 17997 catalog_manager.cc:5649] T eb40d8c2f73d48868bfc3ef3889bea45 P 982df35c5b554a8fa64807352c4f34ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 982df35c5b554a8fa64807352c4f34ee (127.16.126.3). New cstate: current_term: 1 leader_uuid: "982df35c5b554a8fa64807352c4f34ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: HEALTHY } } }
I20251023 07:58:38.450528 18102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c63b5a4dc8eb4b6e918608f281183068" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:38.450718 18172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c63b5a4dc8eb4b6e918608f281183068" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:38.451159 18102 raft_consensus.cc:2468] T c63b5a4dc8eb4b6e918608f281183068 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 0.
I20251023 07:58:38.452253 18217 leader_election.cc:304] T c63b5a4dc8eb4b6e918608f281183068 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:58:38.452529 18251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "290b1b1fd4ef42cf9f0b285d4bf5ed36" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:38.452999 18319 raft_consensus.cc:2804] T c63b5a4dc8eb4b6e918608f281183068 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:58:38.453348 18319 raft_consensus.cc:493] T c63b5a4dc8eb4b6e918608f281183068 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20251023 07:58:38.453725 18142 leader_election.cc:343] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:38.454159 18142 leader_election.cc:304] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10dfae53d0c941f08bded43539841761; no voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9
I20251023 07:58:38.453745 18319 raft_consensus.cc:3060] T c63b5a4dc8eb4b6e918608f281183068 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:38.449280 18390 leader_election.cc:290] T c63b5a4dc8eb4b6e918608f281183068 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:58:38.446182 18359 raft_consensus.cc:2804] T 1f539da81d60449b9d96866c7ceee1be P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:58:38.461671 18359 raft_consensus.cc:493] T 1f539da81d60449b9d96866c7ceee1be P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:38.462055 18359 raft_consensus.cc:3060] T 1f539da81d60449b9d96866c7ceee1be P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:38.463636 18400 raft_consensus.cc:493] T c6022ad5a70c4b4f8f34339956122cb7 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:38.464124 18400 raft_consensus.cc:515] T c6022ad5a70c4b4f8f34339956122cb7 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.465870 18400 leader_election.cc:290] T c6022ad5a70c4b4f8f34339956122cb7 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:38.449268 18292 raft_consensus.cc:359] T 25d22e66fcd6444a9b9c469acd781e59 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.466547 18292 raft_consensus.cc:385] T 25d22e66fcd6444a9b9c469acd781e59 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:38.466861 18292 raft_consensus.cc:740] T 25d22e66fcd6444a9b9c469acd781e59 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Initialized, Role: FOLLOWER
I20251023 07:58:38.467761 18319 raft_consensus.cc:515] T c63b5a4dc8eb4b6e918608f281183068 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.449538 18291 consensus_queue.cc:260] T 25d22e66fcd6444a9b9c469acd781e59 P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.471894 18359 raft_consensus.cc:515] T 1f539da81d60449b9d96866c7ceee1be P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.473920 18359 leader_election.cc:290] T 1f539da81d60449b9d96866c7ceee1be P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 election: Requested vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
W20251023 07:58:38.474339 18215 leader_election.cc:343] T c63b5a4dc8eb4b6e918608f281183068 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:38.474560 18102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1f539da81d60449b9d96866c7ceee1be" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
I20251023 07:58:38.474663 18292 consensus_queue.cc:260] T 25d22e66fcd6444a9b9c469acd781e59 P b3a1328f9c8c484fab08292ce2171ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.475207 18102 raft_consensus.cc:3060] T 1f539da81d60449b9d96866c7ceee1be P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:38.476536 18176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1f539da81d60449b9d96866c7ceee1be" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761"
I20251023 07:58:38.477222 18292 ts_tablet_manager.cc:1434] T 25d22e66fcd6444a9b9c469acd781e59 P b3a1328f9c8c484fab08292ce2171ec9: Time spent starting tablet: real 0.030s user 0.004s sys 0.001s
I20251023 07:58:38.471711 18377 raft_consensus.cc:2749] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:58:38.477177 18176 raft_consensus.cc:3060] T 1f539da81d60449b9d96866c7ceee1be P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:38.477849 18173 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c63b5a4dc8eb4b6e918608f281183068" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761"
I20251023 07:58:38.478252 18292 tablet_bootstrap.cc:492] T b19b550093fb4ab181e62957d89460e7 P b3a1328f9c8c484fab08292ce2171ec9: Bootstrap starting.
I20251023 07:58:38.478402 18251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6022ad5a70c4b4f8f34339956122cb7" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:38.471483 18097 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c63b5a4dc8eb4b6e918608f281183068" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
I20251023 07:58:38.479550 18097 raft_consensus.cc:3060] T c63b5a4dc8eb4b6e918608f281183068 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:38.484166 18292 tablet_bootstrap.cc:654] T b19b550093fb4ab181e62957d89460e7 P b3a1328f9c8c484fab08292ce2171ec9: Neither blocks nor log segments found. Creating new log.
W20251023 07:58:38.484735 18067 leader_election.cc:343] T c6022ad5a70c4b4f8f34339956122cb7 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:38.487864 18291 ts_tablet_manager.cc:1434] T 25d22e66fcd6444a9b9c469acd781e59 P 982df35c5b554a8fa64807352c4f34ee: Time spent starting tablet: real 0.051s user 0.004s sys 0.003s
I20251023 07:58:38.485795 18172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6022ad5a70c4b4f8f34339956122cb7" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:38.473271 18319 leader_election.cc:290] T c63b5a4dc8eb4b6e918608f281183068 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 election: Requested vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
W20251023 07:58:38.494124 18215 leader_election.cc:343] T c63b5a4dc8eb4b6e918608f281183068 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:38.490020 18102 raft_consensus.cc:2468] T 1f539da81d60449b9d96866c7ceee1be P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 1.
I20251023 07:58:38.500476 18217 leader_election.cc:304] T 1f539da81d60449b9d96866c7ceee1be P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:58:38.501343 18319 raft_consensus.cc:2804] T 1f539da81d60449b9d96866c7ceee1be P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:58:38.496263 18176 raft_consensus.cc:2468] T 1f539da81d60449b9d96866c7ceee1be P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 1.
I20251023 07:58:38.501974 18319 raft_consensus.cc:697] T 1f539da81d60449b9d96866c7ceee1be P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Becoming Leader. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Running, Role: LEADER
I20251023 07:58:38.497788 18172 raft_consensus.cc:2468] T c6022ad5a70c4b4f8f34339956122cb7 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3a1328f9c8c484fab08292ce2171ec9 in term 0.
I20251023 07:58:38.503158 18292 tablet_bootstrap.cc:492] T b19b550093fb4ab181e62957d89460e7 P b3a1328f9c8c484fab08292ce2171ec9: No bootstrap required, opened a new log
I20251023 07:58:38.497896 18291 tablet_bootstrap.cc:492] T 94cd6588f7824a30ba02f891ae089671 P 982df35c5b554a8fa64807352c4f34ee: Bootstrap starting.
I20251023 07:58:38.502920 18319 consensus_queue.cc:237] T 1f539da81d60449b9d96866c7ceee1be P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.503603 18292 ts_tablet_manager.cc:1403] T b19b550093fb4ab181e62957d89460e7 P b3a1328f9c8c484fab08292ce2171ec9: Time spent bootstrapping tablet: real 0.026s user 0.010s sys 0.013s
I20251023 07:58:38.498840 18293 tablet_bootstrap.cc:654] T b19b550093fb4ab181e62957d89460e7 P 10dfae53d0c941f08bded43539841761: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:38.507014 18066 leader_election.cc:304] T c6022ad5a70c4b4f8f34339956122cb7 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9; no voters: 982df35c5b554a8fa64807352c4f34ee
I20251023 07:58:38.508337 18400 raft_consensus.cc:2804] T c6022ad5a70c4b4f8f34339956122cb7 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:58:38.508841 18400 raft_consensus.cc:493] T c6022ad5a70c4b4f8f34339956122cb7 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:38.509164 18400 raft_consensus.cc:3060] T c6022ad5a70c4b4f8f34339956122cb7 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:38.498509 18097 raft_consensus.cc:2468] T c63b5a4dc8eb4b6e918608f281183068 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 1.
I20251023 07:58:38.515556 18217 leader_election.cc:304] T c63b5a4dc8eb4b6e918608f281183068 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9; no voters: 10dfae53d0c941f08bded43539841761
I20251023 07:58:38.516706 18390 raft_consensus.cc:2804] T c63b5a4dc8eb4b6e918608f281183068 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:58:38.517194 18390 raft_consensus.cc:697] T c63b5a4dc8eb4b6e918608f281183068 P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Becoming Leader. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Running, Role: LEADER
I20251023 07:58:38.518071 18390 consensus_queue.cc:237] T c63b5a4dc8eb4b6e918608f281183068 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.508328 18359 raft_consensus.cc:493] T e99e859ac34a47c4b2859ec2638d17e5 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:38.521181 18359 raft_consensus.cc:515] T e99e859ac34a47c4b2859ec2638d17e5 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.522910 18291 tablet_bootstrap.cc:654] T 94cd6588f7824a30ba02f891ae089671 P 982df35c5b554a8fa64807352c4f34ee: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:38.523066 18359 leader_election.cc:290] T e99e859ac34a47c4b2859ec2638d17e5 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:58:38.527056 18172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e99e859ac34a47c4b2859ec2638d17e5" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:38.528039 18172 raft_consensus.cc:2468] T e99e859ac34a47c4b2859ec2638d17e5 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 0.
I20251023 07:58:38.529647 18215 leader_election.cc:304] T e99e859ac34a47c4b2859ec2638d17e5 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, 982df35c5b554a8fa64807352c4f34ee; no voters:
I20251023 07:58:38.530985 18097 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e99e859ac34a47c4b2859ec2638d17e5" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:38.531651 18097 raft_consensus.cc:2468] T e99e859ac34a47c4b2859ec2638d17e5 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 0.
I20251023 07:58:38.532970 18292 raft_consensus.cc:359] T b19b550093fb4ab181e62957d89460e7 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.533722 18292 raft_consensus.cc:385] T b19b550093fb4ab181e62957d89460e7 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:38.534044 18292 raft_consensus.cc:740] T b19b550093fb4ab181e62957d89460e7 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Initialized, Role: FOLLOWER
I20251023 07:58:38.534696 18292 consensus_queue.cc:260] T b19b550093fb4ab181e62957d89460e7 P b3a1328f9c8c484fab08292ce2171ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.536494 18400 raft_consensus.cc:515] T c6022ad5a70c4b4f8f34339956122cb7 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.536890 18292 ts_tablet_manager.cc:1434] T b19b550093fb4ab181e62957d89460e7 P b3a1328f9c8c484fab08292ce2171ec9: Time spent starting tablet: real 0.033s user 0.004s sys 0.001s
I20251023 07:58:38.540971 18292 tablet_bootstrap.cc:492] T 5f7e006a09224285b1e5df5694ff72ae P b3a1328f9c8c484fab08292ce2171ec9: Bootstrap starting.
I20251023 07:58:38.541210 18172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6022ad5a70c4b4f8f34339956122cb7" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761"
I20251023 07:58:38.542330 18172 raft_consensus.cc:3060] T c6022ad5a70c4b4f8f34339956122cb7 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:38.542358 18251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6022ad5a70c4b4f8f34339956122cb7" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
I20251023 07:58:38.541183 18400 leader_election.cc:290] T c6022ad5a70c4b4f8f34339956122cb7 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 election: Requested vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:38.541379 18390 raft_consensus.cc:2804] T e99e859ac34a47c4b2859ec2638d17e5 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:58:38.543905 18390 raft_consensus.cc:493] T e99e859ac34a47c4b2859ec2638d17e5 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:38.544274 18390 raft_consensus.cc:3060] T e99e859ac34a47c4b2859ec2638d17e5 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Advancing to term 1
W20251023 07:58:38.548324 18067 leader_election.cc:343] T c6022ad5a70c4b4f8f34339956122cb7 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:38.549039 18292 tablet_bootstrap.cc:654] T 5f7e006a09224285b1e5df5694ff72ae P b3a1328f9c8c484fab08292ce2171ec9: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:38.549710 18400 raft_consensus.cc:493] T 3e4d005972f44619b0cf23f4978f51c4 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:38.550163 17997 catalog_manager.cc:5649] T 1f539da81d60449b9d96866c7ceee1be P 982df35c5b554a8fa64807352c4f34ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 982df35c5b554a8fa64807352c4f34ee (127.16.126.3). New cstate: current_term: 1 leader_uuid: "982df35c5b554a8fa64807352c4f34ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: HEALTHY } } }
I20251023 07:58:38.551887 18390 raft_consensus.cc:515] T e99e859ac34a47c4b2859ec2638d17e5 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.550199 18400 raft_consensus.cc:515] T 3e4d005972f44619b0cf23f4978f51c4 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.554638 18293 tablet_bootstrap.cc:492] T b19b550093fb4ab181e62957d89460e7 P 10dfae53d0c941f08bded43539841761: No bootstrap required, opened a new log
I20251023 07:58:38.555106 18293 ts_tablet_manager.cc:1403] T b19b550093fb4ab181e62957d89460e7 P 10dfae53d0c941f08bded43539841761: Time spent bootstrapping tablet: real 0.133s user 0.018s sys 0.020s
I20251023 07:58:38.556612 18172 raft_consensus.cc:2468] T c6022ad5a70c4b4f8f34339956122cb7 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3a1328f9c8c484fab08292ce2171ec9 in term 1.
I20251023 07:58:38.558358 18097 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e99e859ac34a47c4b2859ec2638d17e5" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
I20251023 07:58:38.558725 18390 leader_election.cc:290] T e99e859ac34a47c4b2859ec2638d17e5 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 election: Requested vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:58:38.559106 18097 raft_consensus.cc:3060] T e99e859ac34a47c4b2859ec2638d17e5 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:38.562469 18176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e99e859ac34a47c4b2859ec2638d17e5" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761"
I20251023 07:58:38.563292 18176 raft_consensus.cc:3060] T e99e859ac34a47c4b2859ec2638d17e5 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:38.563712 18293 raft_consensus.cc:359] T b19b550093fb4ab181e62957d89460e7 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.564380 18293 raft_consensus.cc:385] T b19b550093fb4ab181e62957d89460e7 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:38.564662 18293 raft_consensus.cc:740] T b19b550093fb4ab181e62957d89460e7 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Initialized, Role: FOLLOWER
I20251023 07:58:38.567498 18291 tablet_bootstrap.cc:492] T 94cd6588f7824a30ba02f891ae089671 P 982df35c5b554a8fa64807352c4f34ee: No bootstrap required, opened a new log
I20251023 07:58:38.567967 18291 ts_tablet_manager.cc:1403] T 94cd6588f7824a30ba02f891ae089671 P 982df35c5b554a8fa64807352c4f34ee: Time spent bootstrapping tablet: real 0.071s user 0.010s sys 0.001s
I20251023 07:58:38.568953 18292 tablet_bootstrap.cc:492] T 5f7e006a09224285b1e5df5694ff72ae P b3a1328f9c8c484fab08292ce2171ec9: No bootstrap required, opened a new log
I20251023 07:58:38.569465 18292 ts_tablet_manager.cc:1403] T 5f7e006a09224285b1e5df5694ff72ae P b3a1328f9c8c484fab08292ce2171ec9: Time spent bootstrapping tablet: real 0.029s user 0.009s sys 0.015s
I20251023 07:58:38.570175 18291 raft_consensus.cc:359] T 94cd6588f7824a30ba02f891ae089671 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.570808 18291 raft_consensus.cc:385] T 94cd6588f7824a30ba02f891ae089671 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:38.571070 18291 raft_consensus.cc:740] T 94cd6588f7824a30ba02f891ae089671 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Initialized, Role: FOLLOWER
I20251023 07:58:38.569785 17997 catalog_manager.cc:5649] T c63b5a4dc8eb4b6e918608f281183068 P 982df35c5b554a8fa64807352c4f34ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 982df35c5b554a8fa64807352c4f34ee (127.16.126.3). New cstate: current_term: 1 leader_uuid: "982df35c5b554a8fa64807352c4f34ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: HEALTHY } } }
I20251023 07:58:38.571827 18291 consensus_queue.cc:260] T 94cd6588f7824a30ba02f891ae089671 P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.573539 18251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3e4d005972f44619b0cf23f4978f51c4" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:38.574728 18097 raft_consensus.cc:2468] T e99e859ac34a47c4b2859ec2638d17e5 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 1.
W20251023 07:58:38.574936 18067 leader_election.cc:343] T 3e4d005972f44619b0cf23f4978f51c4 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:38.573801 18400 leader_election.cc:290] T 3e4d005972f44619b0cf23f4978f51c4 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:38.575565 18291 ts_tablet_manager.cc:1434] T 94cd6588f7824a30ba02f891ae089671 P 982df35c5b554a8fa64807352c4f34ee: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20251023 07:58:38.575938 18217 leader_election.cc:304] T e99e859ac34a47c4b2859ec2638d17e5 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:58:38.576146 18066 leader_election.cc:304] T c6022ad5a70c4b4f8f34339956122cb7 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9; no voters: 982df35c5b554a8fa64807352c4f34ee
I20251023 07:58:38.576493 18291 tablet_bootstrap.cc:492] T c6022ad5a70c4b4f8f34339956122cb7 P 982df35c5b554a8fa64807352c4f34ee: Bootstrap starting.
I20251023 07:58:38.576771 18390 raft_consensus.cc:2804] T e99e859ac34a47c4b2859ec2638d17e5 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:58:38.577056 18176 raft_consensus.cc:2468] T e99e859ac34a47c4b2859ec2638d17e5 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 1.
I20251023 07:58:38.577354 18390 raft_consensus.cc:697] T e99e859ac34a47c4b2859ec2638d17e5 P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Becoming Leader. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Running, Role: LEADER
I20251023 07:58:38.577612 18400 raft_consensus.cc:2804] T c6022ad5a70c4b4f8f34339956122cb7 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:58:38.578230 18390 consensus_queue.cc:237] T e99e859ac34a47c4b2859ec2638d17e5 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.578982 18400 raft_consensus.cc:697] T c6022ad5a70c4b4f8f34339956122cb7 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Becoming Leader. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Running, Role: LEADER
I20251023 07:58:38.579962 18400 consensus_queue.cc:237] T c6022ad5a70c4b4f8f34339956122cb7 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.572540 18292 raft_consensus.cc:359] T 5f7e006a09224285b1e5df5694ff72ae P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.572808 18173 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3e4d005972f44619b0cf23f4978f51c4" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:38.581825 18292 raft_consensus.cc:385] T 5f7e006a09224285b1e5df5694ff72ae P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:38.582144 18292 raft_consensus.cc:740] T 5f7e006a09224285b1e5df5694ff72ae P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Initialized, Role: FOLLOWER
I20251023 07:58:38.582300 18293 consensus_queue.cc:260] T b19b550093fb4ab181e62957d89460e7 P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.582777 18292 consensus_queue.cc:260] T 5f7e006a09224285b1e5df5694ff72ae P b3a1328f9c8c484fab08292ce2171ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.584513 18293 ts_tablet_manager.cc:1434] T b19b550093fb4ab181e62957d89460e7 P 10dfae53d0c941f08bded43539841761: Time spent starting tablet: real 0.029s user 0.001s sys 0.005s
I20251023 07:58:38.584820 18292 ts_tablet_manager.cc:1434] T 5f7e006a09224285b1e5df5694ff72ae P b3a1328f9c8c484fab08292ce2171ec9: Time spent starting tablet: real 0.015s user 0.002s sys 0.001s
I20251023 07:58:38.585825 18292 tablet_bootstrap.cc:492] T 14e6f2c3d85b437cac3ead436d5494a7 P b3a1328f9c8c484fab08292ce2171ec9: Bootstrap starting.
I20251023 07:58:38.585884 18293 tablet_bootstrap.cc:492] T 94cd6588f7824a30ba02f891ae089671 P 10dfae53d0c941f08bded43539841761: Bootstrap starting.
W20251023 07:58:38.586092 18066 leader_election.cc:343] T 3e4d005972f44619b0cf23f4978f51c4 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:38.586539 18066 leader_election.cc:304] T 3e4d005972f44619b0cf23f4978f51c4 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3a1328f9c8c484fab08292ce2171ec9; no voters: 10dfae53d0c941f08bded43539841761, 982df35c5b554a8fa64807352c4f34ee
I20251023 07:58:38.587881 18344 raft_consensus.cc:2749] T 3e4d005972f44619b0cf23f4978f51c4 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:58:38.592121 18292 tablet_bootstrap.cc:654] T 14e6f2c3d85b437cac3ead436d5494a7 P b3a1328f9c8c484fab08292ce2171ec9: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:38.593420 18291 tablet_bootstrap.cc:654] T c6022ad5a70c4b4f8f34339956122cb7 P 982df35c5b554a8fa64807352c4f34ee: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:38.597723 18293 tablet_bootstrap.cc:654] T 94cd6588f7824a30ba02f891ae089671 P 10dfae53d0c941f08bded43539841761: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:38.601060 17998 catalog_manager.cc:5649] T e99e859ac34a47c4b2859ec2638d17e5 P 982df35c5b554a8fa64807352c4f34ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 982df35c5b554a8fa64807352c4f34ee (127.16.126.3). New cstate: current_term: 1 leader_uuid: "982df35c5b554a8fa64807352c4f34ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: HEALTHY } } }
I20251023 07:58:38.606379 18293 tablet_bootstrap.cc:492] T 94cd6588f7824a30ba02f891ae089671 P 10dfae53d0c941f08bded43539841761: No bootstrap required, opened a new log
I20251023 07:58:38.606871 18293 ts_tablet_manager.cc:1403] T 94cd6588f7824a30ba02f891ae089671 P 10dfae53d0c941f08bded43539841761: Time spent bootstrapping tablet: real 0.021s user 0.004s sys 0.007s
I20251023 07:58:38.613322 18291 tablet_bootstrap.cc:492] T c6022ad5a70c4b4f8f34339956122cb7 P 982df35c5b554a8fa64807352c4f34ee: No bootstrap required, opened a new log
I20251023 07:58:38.613837 18291 ts_tablet_manager.cc:1403] T c6022ad5a70c4b4f8f34339956122cb7 P 982df35c5b554a8fa64807352c4f34ee: Time spent bootstrapping tablet: real 0.038s user 0.010s sys 0.004s
I20251023 07:58:38.615124 18390 consensus_queue.cc:1048] T b9841e711f8e4a019c2d0dec5409474c P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:58:38.618242 18291 raft_consensus.cc:359] T c6022ad5a70c4b4f8f34339956122cb7 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.618928 18291 raft_consensus.cc:385] T c6022ad5a70c4b4f8f34339956122cb7 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:38.619177 18291 raft_consensus.cc:740] T c6022ad5a70c4b4f8f34339956122cb7 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Initialized, Role: FOLLOWER
I20251023 07:58:38.619658 18293 raft_consensus.cc:359] T 94cd6588f7824a30ba02f891ae089671 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.620316 18293 raft_consensus.cc:385] T 94cd6588f7824a30ba02f891ae089671 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:38.620568 18293 raft_consensus.cc:740] T 94cd6588f7824a30ba02f891ae089671 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Initialized, Role: FOLLOWER
I20251023 07:58:38.620712 18300 raft_consensus.cc:493] T b19b550093fb4ab181e62957d89460e7 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:38.621109 18291 consensus_queue.cc:260] T c6022ad5a70c4b4f8f34339956122cb7 P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.622319 18293 consensus_queue.cc:260] T 94cd6588f7824a30ba02f891ae089671 P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.624010 18293 ts_tablet_manager.cc:1434] T 94cd6588f7824a30ba02f891ae089671 P 10dfae53d0c941f08bded43539841761: Time spent starting tablet: real 0.017s user 0.005s sys 0.000s
I20251023 07:58:38.625841 18291 ts_tablet_manager.cc:1434] T c6022ad5a70c4b4f8f34339956122cb7 P 982df35c5b554a8fa64807352c4f34ee: Time spent starting tablet: real 0.012s user 0.006s sys 0.000s
I20251023 07:58:38.627143 18291 tablet_bootstrap.cc:492] T a83dfc7a7d784b52b9c74bbc451ad603 P 982df35c5b554a8fa64807352c4f34ee: Bootstrap starting.
I20251023 07:58:38.628427 18372 consensus_queue.cc:1048] T 7fe190354178418bae8b7cc5abbb74ef P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:58:38.621376 18300 raft_consensus.cc:515] T b19b550093fb4ab181e62957d89460e7 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.634174 18291 tablet_bootstrap.cc:654] T a83dfc7a7d784b52b9c74bbc451ad603 P 982df35c5b554a8fa64807352c4f34ee: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:38.635783 18300 leader_election.cc:290] T b19b550093fb4ab181e62957d89460e7 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:38.636523 18173 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b19b550093fb4ab181e62957d89460e7" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:38.637210 18173 raft_consensus.cc:2468] T b19b550093fb4ab181e62957d89460e7 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3a1328f9c8c484fab08292ce2171ec9 in term 0.
I20251023 07:58:38.638531 18251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b19b550093fb4ab181e62957d89460e7" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:38.639214 18066 leader_election.cc:304] T b19b550093fb4ab181e62957d89460e7 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:58:38.639354 18251 raft_consensus.cc:2468] T b19b550093fb4ab181e62957d89460e7 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3a1328f9c8c484fab08292ce2171ec9 in term 0.
I20251023 07:58:38.640070 18300 raft_consensus.cc:2804] T b19b550093fb4ab181e62957d89460e7 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:58:38.640442 18300 raft_consensus.cc:493] T b19b550093fb4ab181e62957d89460e7 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:38.640763 18300 raft_consensus.cc:3060] T b19b550093fb4ab181e62957d89460e7 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:38.642827 18293 tablet_bootstrap.cc:492] T c63b5a4dc8eb4b6e918608f281183068 P 10dfae53d0c941f08bded43539841761: Bootstrap starting.
I20251023 07:58:38.648955 18293 tablet_bootstrap.cc:654] T c63b5a4dc8eb4b6e918608f281183068 P 10dfae53d0c941f08bded43539841761: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:38.652837 18372 consensus_queue.cc:1048] T 7fe190354178418bae8b7cc5abbb74ef P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:58:38.664806 18293 tablet_bootstrap.cc:492] T c63b5a4dc8eb4b6e918608f281183068 P 10dfae53d0c941f08bded43539841761: No bootstrap required, opened a new log
I20251023 07:58:38.665364 18293 ts_tablet_manager.cc:1403] T c63b5a4dc8eb4b6e918608f281183068 P 10dfae53d0c941f08bded43539841761: Time spent bootstrapping tablet: real 0.023s user 0.007s sys 0.008s
I20251023 07:58:38.665582 18390 consensus_queue.cc:1048] T b9841e711f8e4a019c2d0dec5409474c P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:58:38.668889 18292 tablet_bootstrap.cc:492] T 14e6f2c3d85b437cac3ead436d5494a7 P b3a1328f9c8c484fab08292ce2171ec9: No bootstrap required, opened a new log
I20251023 07:58:38.668560 18293 raft_consensus.cc:359] T c63b5a4dc8eb4b6e918608f281183068 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.669327 18292 ts_tablet_manager.cc:1403] T 14e6f2c3d85b437cac3ead436d5494a7 P b3a1328f9c8c484fab08292ce2171ec9: Time spent bootstrapping tablet: real 0.084s user 0.018s sys 0.034s
I20251023 07:58:38.672613 18292 raft_consensus.cc:359] T 14e6f2c3d85b437cac3ead436d5494a7 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.673262 18292 raft_consensus.cc:385] T 14e6f2c3d85b437cac3ead436d5494a7 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:38.669538 18293 raft_consensus.cc:385] T c63b5a4dc8eb4b6e918608f281183068 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:38.673660 18292 raft_consensus.cc:740] T 14e6f2c3d85b437cac3ead436d5494a7 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Initialized, Role: FOLLOWER
I20251023 07:58:38.673808 18293 raft_consensus.cc:740] T c63b5a4dc8eb4b6e918608f281183068 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Initialized, Role: FOLLOWER
I20251023 07:58:38.675540 18293 consensus_queue.cc:260] T c63b5a4dc8eb4b6e918608f281183068 P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.677002 18292 consensus_queue.cc:260] T 14e6f2c3d85b437cac3ead436d5494a7 P b3a1328f9c8c484fab08292ce2171ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.677791 18293 ts_tablet_manager.cc:1434] T c63b5a4dc8eb4b6e918608f281183068 P 10dfae53d0c941f08bded43539841761: Time spent starting tablet: real 0.012s user 0.007s sys 0.000s
I20251023 07:58:38.679095 18293 tablet_bootstrap.cc:492] T 55de6ceb03f343b09190cb2fb4bbe144 P 10dfae53d0c941f08bded43539841761: Bootstrap starting.
I20251023 07:58:38.679322 18292 ts_tablet_manager.cc:1434] T 14e6f2c3d85b437cac3ead436d5494a7 P b3a1328f9c8c484fab08292ce2171ec9: Time spent starting tablet: real 0.009s user 0.006s sys 0.000s
I20251023 07:58:38.680202 18292 tablet_bootstrap.cc:492] T 1178e2ed919b40f29672fc6233b71cf3 P b3a1328f9c8c484fab08292ce2171ec9: Bootstrap starting.
I20251023 07:58:38.688009 18301 raft_consensus.cc:493] T 94cd6588f7824a30ba02f891ae089671 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:38.690152 18301 raft_consensus.cc:515] T 94cd6588f7824a30ba02f891ae089671 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.690575 18300 raft_consensus.cc:515] T b19b550093fb4ab181e62957d89460e7 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.689020 18344 raft_consensus.cc:493] T 5f7e006a09224285b1e5df5694ff72ae P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:38.692847 18293 tablet_bootstrap.cc:654] T 55de6ceb03f343b09190cb2fb4bbe144 P 10dfae53d0c941f08bded43539841761: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:38.692950 18344 raft_consensus.cc:515] T 5f7e006a09224285b1e5df5694ff72ae P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.693495 18173 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b19b550093fb4ab181e62957d89460e7" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761"
I20251023 07:58:38.694033 18173 raft_consensus.cc:3060] T b19b550093fb4ab181e62957d89460e7 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:38.695098 18344 leader_election.cc:290] T 5f7e006a09224285b1e5df5694ff72ae P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:38.697543 18301 leader_election.cc:290] T 94cd6588f7824a30ba02f891ae089671 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:38.698370 18102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "94cd6588f7824a30ba02f891ae089671" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:38.699038 18102 raft_consensus.cc:2468] T 94cd6588f7824a30ba02f891ae089671 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 0.
I20251023 07:58:38.700215 18143 leader_election.cc:304] T 94cd6588f7824a30ba02f891ae089671 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:58:38.701077 18301 raft_consensus.cc:2804] T 94cd6588f7824a30ba02f891ae089671 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:58:38.701485 18301 raft_consensus.cc:493] T 94cd6588f7824a30ba02f891ae089671 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:38.701846 18301 raft_consensus.cc:3060] T 94cd6588f7824a30ba02f891ae089671 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:38.702194 18176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5f7e006a09224285b1e5df5694ff72ae" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:38.686151 17997 catalog_manager.cc:5649] T c6022ad5a70c4b4f8f34339956122cb7 P b3a1328f9c8c484fab08292ce2171ec9 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1). New cstate: current_term: 1 leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } }
I20251023 07:58:38.706715 18249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "94cd6588f7824a30ba02f891ae089671" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:38.707485 18249 raft_consensus.cc:2468] T 94cd6588f7824a30ba02f891ae089671 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 0.
W20251023 07:58:38.708760 18066 leader_election.cc:343] T 5f7e006a09224285b1e5df5694ff72ae P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:38.709185 18292 tablet_bootstrap.cc:654] T 1178e2ed919b40f29672fc6233b71cf3 P b3a1328f9c8c484fab08292ce2171ec9: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:38.712092 18249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5f7e006a09224285b1e5df5694ff72ae" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:38.712728 18293 tablet_bootstrap.cc:492] T 55de6ceb03f343b09190cb2fb4bbe144 P 10dfae53d0c941f08bded43539841761: No bootstrap required, opened a new log
I20251023 07:58:38.712769 18249 raft_consensus.cc:2468] T 5f7e006a09224285b1e5df5694ff72ae P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3a1328f9c8c484fab08292ce2171ec9 in term 0.
I20251023 07:58:38.713243 18293 ts_tablet_manager.cc:1403] T 55de6ceb03f343b09190cb2fb4bbe144 P 10dfae53d0c941f08bded43539841761: Time spent bootstrapping tablet: real 0.034s user 0.011s sys 0.002s
I20251023 07:58:38.714495 18067 leader_election.cc:304] T 5f7e006a09224285b1e5df5694ff72ae P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9; no voters: 10dfae53d0c941f08bded43539841761
I20251023 07:58:38.715588 18344 raft_consensus.cc:2804] T 5f7e006a09224285b1e5df5694ff72ae P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:58:38.715334 18301 raft_consensus.cc:515] T 94cd6588f7824a30ba02f891ae089671 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.715950 18344 raft_consensus.cc:493] T 5f7e006a09224285b1e5df5694ff72ae P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:38.716290 18344 raft_consensus.cc:3060] T 5f7e006a09224285b1e5df5694ff72ae P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:38.716244 18293 raft_consensus.cc:359] T 55de6ceb03f343b09190cb2fb4bbe144 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.717018 18293 raft_consensus.cc:385] T 55de6ceb03f343b09190cb2fb4bbe144 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:38.717283 18293 raft_consensus.cc:740] T 55de6ceb03f343b09190cb2fb4bbe144 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Initialized, Role: FOLLOWER
I20251023 07:58:38.717892 18293 consensus_queue.cc:260] T 55de6ceb03f343b09190cb2fb4bbe144 P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.718252 18102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "94cd6588f7824a30ba02f891ae089671" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
I20251023 07:58:38.719293 18102 raft_consensus.cc:3060] T 94cd6588f7824a30ba02f891ae089671 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:38.720086 18293 ts_tablet_manager.cc:1434] T 55de6ceb03f343b09190cb2fb4bbe144 P 10dfae53d0c941f08bded43539841761: Time spent starting tablet: real 0.007s user 0.004s sys 0.000s
I20251023 07:58:38.720815 18293 tablet_bootstrap.cc:492] T ce0069d7c0cf4dee84a85731209358f7 P 10dfae53d0c941f08bded43539841761: Bootstrap starting.
I20251023 07:58:38.723790 18291 tablet_bootstrap.cc:492] T a83dfc7a7d784b52b9c74bbc451ad603 P 982df35c5b554a8fa64807352c4f34ee: No bootstrap required, opened a new log
I20251023 07:58:38.724257 18291 ts_tablet_manager.cc:1403] T a83dfc7a7d784b52b9c74bbc451ad603 P 982df35c5b554a8fa64807352c4f34ee: Time spent bootstrapping tablet: real 0.097s user 0.021s sys 0.019s
I20251023 07:58:38.726974 18291 raft_consensus.cc:359] T a83dfc7a7d784b52b9c74bbc451ad603 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.727603 18291 raft_consensus.cc:385] T a83dfc7a7d784b52b9c74bbc451ad603 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:38.727710 18301 leader_election.cc:290] T 94cd6588f7824a30ba02f891ae089671 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 election: Requested vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:38.727982 18291 raft_consensus.cc:740] T a83dfc7a7d784b52b9c74bbc451ad603 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Initialized, Role: FOLLOWER
I20251023 07:58:38.727124 18344 raft_consensus.cc:515] T 5f7e006a09224285b1e5df5694ff72ae P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.734758 18344 leader_election.cc:290] T 5f7e006a09224285b1e5df5694ff72ae P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 election: Requested vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:38.728868 18249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "94cd6588f7824a30ba02f891ae089671" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
I20251023 07:58:38.738859 18249 raft_consensus.cc:3060] T 94cd6588f7824a30ba02f891ae089671 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:38.729574 18291 consensus_queue.cc:260] T a83dfc7a7d784b52b9c74bbc451ad603 P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.746663 18291 ts_tablet_manager.cc:1434] T a83dfc7a7d784b52b9c74bbc451ad603 P 982df35c5b554a8fa64807352c4f34ee: Time spent starting tablet: real 0.022s user 0.007s sys 0.000s
I20251023 07:58:38.748057 18291 tablet_bootstrap.cc:492] T 14e6f2c3d85b437cac3ead436d5494a7 P 982df35c5b554a8fa64807352c4f34ee: Bootstrap starting.
I20251023 07:58:38.751394 18249 raft_consensus.cc:2468] T 94cd6588f7824a30ba02f891ae089671 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 1.
I20251023 07:58:38.727489 18102 raft_consensus.cc:2468] T 94cd6588f7824a30ba02f891ae089671 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 1.
I20251023 07:58:38.735306 18293 tablet_bootstrap.cc:654] T ce0069d7c0cf4dee84a85731209358f7 P 10dfae53d0c941f08bded43539841761: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:38.731988 18300 leader_election.cc:290] T b19b550093fb4ab181e62957d89460e7 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 election: Requested vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:38.736450 18173 raft_consensus.cc:2468] T b19b550093fb4ab181e62957d89460e7 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3a1328f9c8c484fab08292ce2171ec9 in term 1.
I20251023 07:58:38.737762 18176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5f7e006a09224285b1e5df5694ff72ae" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761"
I20251023 07:58:38.752943 18143 leader_election.cc:304] T 94cd6588f7824a30ba02f891ae089671 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:58:38.754861 18301 raft_consensus.cc:2804] T 94cd6588f7824a30ba02f891ae089671 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:58:38.754984 18066 leader_election.cc:304] T b19b550093fb4ab181e62957d89460e7 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:58:38.755371 18301 raft_consensus.cc:697] T 94cd6588f7824a30ba02f891ae089671 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Becoming Leader. State: Replica: 10dfae53d0c941f08bded43539841761, State: Running, Role: LEADER
W20251023 07:58:38.755946 18066 leader_election.cc:343] T 5f7e006a09224285b1e5df5694ff72ae P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:38.757573 18344 raft_consensus.cc:2804] T b19b550093fb4ab181e62957d89460e7 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:58:38.757715 18251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5f7e006a09224285b1e5df5694ff72ae" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
I20251023 07:58:38.756196 18301 consensus_queue.cc:237] T 94cd6588f7824a30ba02f891ae089671 P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.758149 18344 raft_consensus.cc:697] T b19b550093fb4ab181e62957d89460e7 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Becoming Leader. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Running, Role: LEADER
I20251023 07:58:38.758415 18251 raft_consensus.cc:3060] T 5f7e006a09224285b1e5df5694ff72ae P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:38.759198 18344 consensus_queue.cc:237] T b19b550093fb4ab181e62957d89460e7 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.772595 18293 tablet_bootstrap.cc:492] T ce0069d7c0cf4dee84a85731209358f7 P 10dfae53d0c941f08bded43539841761: No bootstrap required, opened a new log
I20251023 07:58:38.772810 18291 tablet_bootstrap.cc:654] T 14e6f2c3d85b437cac3ead436d5494a7 P 982df35c5b554a8fa64807352c4f34ee: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:38.773121 18293 ts_tablet_manager.cc:1403] T ce0069d7c0cf4dee84a85731209358f7 P 10dfae53d0c941f08bded43539841761: Time spent bootstrapping tablet: real 0.052s user 0.006s sys 0.011s
I20251023 07:58:38.767405 18249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b19b550093fb4ab181e62957d89460e7" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
I20251023 07:58:38.775409 18249 raft_consensus.cc:3060] T b19b550093fb4ab181e62957d89460e7 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:38.790308 18359 consensus_queue.cc:1048] T eb40d8c2f73d48868bfc3ef3889bea45 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:38.790769 18251 raft_consensus.cc:2468] T 5f7e006a09224285b1e5df5694ff72ae P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3a1328f9c8c484fab08292ce2171ec9 in term 1.
I20251023 07:58:38.791769 18249 raft_consensus.cc:2468] T b19b550093fb4ab181e62957d89460e7 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3a1328f9c8c484fab08292ce2171ec9 in term 1.
I20251023 07:58:38.798373 18293 raft_consensus.cc:359] T ce0069d7c0cf4dee84a85731209358f7 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.799077 18293 raft_consensus.cc:385] T ce0069d7c0cf4dee84a85731209358f7 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:38.799360 18293 raft_consensus.cc:740] T ce0069d7c0cf4dee84a85731209358f7 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Initialized, Role: FOLLOWER
I20251023 07:58:38.800014 18293 consensus_queue.cc:260] T ce0069d7c0cf4dee84a85731209358f7 P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.802315 18293 ts_tablet_manager.cc:1434] T ce0069d7c0cf4dee84a85731209358f7 P 10dfae53d0c941f08bded43539841761: Time spent starting tablet: real 0.029s user 0.007s sys 0.000s
I20251023 07:58:38.802143 18067 leader_election.cc:304] T 5f7e006a09224285b1e5df5694ff72ae P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9; no voters: 10dfae53d0c941f08bded43539841761
I20251023 07:58:38.803205 18293 tablet_bootstrap.cc:492] T 3e4d005972f44619b0cf23f4978f51c4 P 10dfae53d0c941f08bded43539841761: Bootstrap starting.
I20251023 07:58:38.804138 18359 consensus_queue.cc:1048] T eb40d8c2f73d48868bfc3ef3889bea45 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:38.804877 18344 raft_consensus.cc:2804] T 5f7e006a09224285b1e5df5694ff72ae P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:58:38.806066 18344 raft_consensus.cc:697] T 5f7e006a09224285b1e5df5694ff72ae P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Becoming Leader. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Running, Role: LEADER
I20251023 07:58:38.809496 18293 tablet_bootstrap.cc:654] T 3e4d005972f44619b0cf23f4978f51c4 P 10dfae53d0c941f08bded43539841761: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:38.806552 17997 catalog_manager.cc:5649] T 94cd6588f7824a30ba02f891ae089671 P 10dfae53d0c941f08bded43539841761 reported cstate change: term changed from 0 to 1, leader changed from <none> to 10dfae53d0c941f08bded43539841761 (127.16.126.2). New cstate: current_term: 1 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } }
I20251023 07:58:38.812247 18291 tablet_bootstrap.cc:492] T 14e6f2c3d85b437cac3ead436d5494a7 P 982df35c5b554a8fa64807352c4f34ee: No bootstrap required, opened a new log
I20251023 07:58:38.812701 18291 ts_tablet_manager.cc:1403] T 14e6f2c3d85b437cac3ead436d5494a7 P 982df35c5b554a8fa64807352c4f34ee: Time spent bootstrapping tablet: real 0.065s user 0.003s sys 0.011s
I20251023 07:58:38.809090 18344 consensus_queue.cc:237] T 5f7e006a09224285b1e5df5694ff72ae P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.807137 17998 catalog_manager.cc:5649] T b19b550093fb4ab181e62957d89460e7 P b3a1328f9c8c484fab08292ce2171ec9 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1). New cstate: current_term: 1 leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } }
I20251023 07:58:38.820679 18292 tablet_bootstrap.cc:492] T 1178e2ed919b40f29672fc6233b71cf3 P b3a1328f9c8c484fab08292ce2171ec9: No bootstrap required, opened a new log
I20251023 07:58:38.821152 18292 ts_tablet_manager.cc:1403] T 1178e2ed919b40f29672fc6233b71cf3 P b3a1328f9c8c484fab08292ce2171ec9: Time spent bootstrapping tablet: real 0.141s user 0.006s sys 0.026s
I20251023 07:58:38.822021 18293 tablet_bootstrap.cc:492] T 3e4d005972f44619b0cf23f4978f51c4 P 10dfae53d0c941f08bded43539841761: No bootstrap required, opened a new log
I20251023 07:58:38.822469 18293 ts_tablet_manager.cc:1403] T 3e4d005972f44619b0cf23f4978f51c4 P 10dfae53d0c941f08bded43539841761: Time spent bootstrapping tablet: real 0.019s user 0.015s sys 0.001s
I20251023 07:58:38.825068 18293 raft_consensus.cc:359] T 3e4d005972f44619b0cf23f4978f51c4 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.825716 18293 raft_consensus.cc:385] T 3e4d005972f44619b0cf23f4978f51c4 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:38.825958 18293 raft_consensus.cc:740] T 3e4d005972f44619b0cf23f4978f51c4 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Initialized, Role: FOLLOWER
I20251023 07:58:38.826249 18291 raft_consensus.cc:359] T 14e6f2c3d85b437cac3ead436d5494a7 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.826501 18293 consensus_queue.cc:260] T 3e4d005972f44619b0cf23f4978f51c4 P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.826923 18291 raft_consensus.cc:385] T 14e6f2c3d85b437cac3ead436d5494a7 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:38.828516 18291 raft_consensus.cc:740] T 14e6f2c3d85b437cac3ead436d5494a7 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Initialized, Role: FOLLOWER
I20251023 07:58:38.829216 18291 consensus_queue.cc:260] T 14e6f2c3d85b437cac3ead436d5494a7 P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.831305 18359 raft_consensus.cc:493] T c6022ad5a70c4b4f8f34339956122cb7 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:38.831760 18291 ts_tablet_manager.cc:1434] T 14e6f2c3d85b437cac3ead436d5494a7 P 982df35c5b554a8fa64807352c4f34ee: Time spent starting tablet: real 0.019s user 0.006s sys 0.001s
I20251023 07:58:38.831781 18359 raft_consensus.cc:515] T c6022ad5a70c4b4f8f34339956122cb7 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.832772 18291 tablet_bootstrap.cc:492] T 3e4d005972f44619b0cf23f4978f51c4 P 982df35c5b554a8fa64807352c4f34ee: Bootstrap starting.
I20251023 07:58:38.835700 18359 leader_election.cc:290] T c6022ad5a70c4b4f8f34339956122cb7 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:58:38.836802 18176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6022ad5a70c4b4f8f34339956122cb7" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:38.837978 18176 raft_consensus.cc:2393] T c6022ad5a70c4b4f8f34339956122cb7 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 982df35c5b554a8fa64807352c4f34ee in current term 1: Already voted for candidate b3a1328f9c8c484fab08292ce2171ec9 in this term.
I20251023 07:58:38.837996 18293 ts_tablet_manager.cc:1434] T 3e4d005972f44619b0cf23f4978f51c4 P 10dfae53d0c941f08bded43539841761: Time spent starting tablet: real 0.015s user 0.005s sys 0.001s
I20251023 07:58:38.841758 18293 tablet_bootstrap.cc:492] T 5f7e006a09224285b1e5df5694ff72ae P 10dfae53d0c941f08bded43539841761: Bootstrap starting.
I20251023 07:58:38.846254 18291 tablet_bootstrap.cc:654] T 3e4d005972f44619b0cf23f4978f51c4 P 982df35c5b554a8fa64807352c4f34ee: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:38.848438 18249 raft_consensus.cc:3060] T a83dfc7a7d784b52b9c74bbc451ad603 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:38.849969 18293 tablet_bootstrap.cc:654] T 5f7e006a09224285b1e5df5694ff72ae P 10dfae53d0c941f08bded43539841761: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:38.847709 18102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6022ad5a70c4b4f8f34339956122cb7" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:38.854928 17997 catalog_manager.cc:5649] T 5f7e006a09224285b1e5df5694ff72ae P b3a1328f9c8c484fab08292ce2171ec9 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1). New cstate: current_term: 1 leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } }
I20251023 07:58:38.857450 18217 leader_election.cc:304] T c6022ad5a70c4b4f8f34339956122cb7 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee; no voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9
I20251023 07:58:38.858955 18359 raft_consensus.cc:3060] T c6022ad5a70c4b4f8f34339956122cb7 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:38.865739 18390 raft_consensus.cc:493] T a83dfc7a7d784b52b9c74bbc451ad603 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:38.866209 18390 raft_consensus.cc:515] T a83dfc7a7d784b52b9c74bbc451ad603 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.867784 18344 consensus_queue.cc:1048] T a83dfc7a7d784b52b9c74bbc451ad603 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:38.868213 18390 leader_election.cc:290] T a83dfc7a7d784b52b9c74bbc451ad603 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:58:38.869799 18176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a83dfc7a7d784b52b9c74bbc451ad603" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:38.869675 18292 raft_consensus.cc:359] T 1178e2ed919b40f29672fc6233b71cf3 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.870645 18176 raft_consensus.cc:2468] T a83dfc7a7d784b52b9c74bbc451ad603 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 1.
I20251023 07:58:38.870898 18292 raft_consensus.cc:385] T 1178e2ed919b40f29672fc6233b71cf3 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:38.871310 18292 raft_consensus.cc:740] T 1178e2ed919b40f29672fc6233b71cf3 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Initialized, Role: FOLLOWER
I20251023 07:58:38.872154 18215 leader_election.cc:304] T a83dfc7a7d784b52b9c74bbc451ad603 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, 982df35c5b554a8fa64807352c4f34ee; no voters:
I20251023 07:58:38.872982 18390 raft_consensus.cc:2804] T a83dfc7a7d784b52b9c74bbc451ad603 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251023 07:58:38.874050 18390 raft_consensus.cc:493] T a83dfc7a7d784b52b9c74bbc451ad603 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:38.874366 18390 raft_consensus.cc:3060] T a83dfc7a7d784b52b9c74bbc451ad603 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:58:38.876706 18317 raft_consensus.cc:493] T 25d22e66fcd6444a9b9c469acd781e59 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:38.877238 18317 raft_consensus.cc:515] T 25d22e66fcd6444a9b9c469acd781e59 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.879351 18317 leader_election.cc:290] T 25d22e66fcd6444a9b9c469acd781e59 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:58:38.872165 18292 consensus_queue.cc:260] T 1178e2ed919b40f29672fc6233b71cf3 P b3a1328f9c8c484fab08292ce2171ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.882668 18292 ts_tablet_manager.cc:1434] T 1178e2ed919b40f29672fc6233b71cf3 P b3a1328f9c8c484fab08292ce2171ec9: Time spent starting tablet: real 0.061s user 0.005s sys 0.004s
I20251023 07:58:38.883916 18292 tablet_bootstrap.cc:492] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P b3a1328f9c8c484fab08292ce2171ec9: Bootstrap starting.
I20251023 07:58:38.887564 18176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "25d22e66fcd6444a9b9c469acd781e59" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
W20251023 07:58:38.888840 18215 leader_election.cc:343] T 25d22e66fcd6444a9b9c469acd781e59 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:38.890717 18359 raft_consensus.cc:2749] T c6022ad5a70c4b4f8f34339956122cb7 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:58:38.895226 18344 consensus_queue.cc:1048] T a83dfc7a7d784b52b9c74bbc451ad603 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:38.902423 18102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a83dfc7a7d784b52b9c74bbc451ad603" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:38.903734 18096 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "25d22e66fcd6444a9b9c469acd781e59" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:38.904423 18096 raft_consensus.cc:2468] T 25d22e66fcd6444a9b9c469acd781e59 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 0.
I20251023 07:58:38.905414 18390 raft_consensus.cc:515] T a83dfc7a7d784b52b9c74bbc451ad603 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.906513 18217 leader_election.cc:304] T 25d22e66fcd6444a9b9c469acd781e59 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9; no voters: 10dfae53d0c941f08bded43539841761
I20251023 07:58:38.907459 18359 raft_consensus.cc:2804] T 25d22e66fcd6444a9b9c469acd781e59 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:58:38.907842 18359 raft_consensus.cc:493] T 25d22e66fcd6444a9b9c469acd781e59 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:38.906566 18249 raft_consensus.cc:1240] T a83dfc7a7d784b52b9c74bbc451ad603 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Rejecting Update request from peer b3a1328f9c8c484fab08292ce2171ec9 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20251023 07:58:38.908228 18359 raft_consensus.cc:3060] T 25d22e66fcd6444a9b9c469acd781e59 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:38.908943 18390 leader_election.cc:290] T a83dfc7a7d784b52b9c74bbc451ad603 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 2 election: Requested vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:58:38.911262 18319 consensus_queue.cc:1048] T 1f539da81d60449b9d96866c7ceee1be P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:58:38.912278 18096 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a83dfc7a7d784b52b9c74bbc451ad603" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
I20251023 07:58:38.914211 18173 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a83dfc7a7d784b52b9c74bbc451ad603" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761"
I20251023 07:58:38.919284 18292 tablet_bootstrap.cc:654] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P b3a1328f9c8c484fab08292ce2171ec9: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:38.921813 18293 tablet_bootstrap.cc:492] T 5f7e006a09224285b1e5df5694ff72ae P 10dfae53d0c941f08bded43539841761: No bootstrap required, opened a new log
I20251023 07:58:38.922343 18293 ts_tablet_manager.cc:1403] T 5f7e006a09224285b1e5df5694ff72ae P 10dfae53d0c941f08bded43539841761: Time spent bootstrapping tablet: real 0.081s user 0.026s sys 0.029s
I20251023 07:58:38.927033 18293 raft_consensus.cc:359] T 5f7e006a09224285b1e5df5694ff72ae P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.927801 18293 raft_consensus.cc:385] T 5f7e006a09224285b1e5df5694ff72ae P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:38.928054 18293 raft_consensus.cc:740] T 5f7e006a09224285b1e5df5694ff72ae P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Initialized, Role: FOLLOWER
I20251023 07:58:38.928678 18293 consensus_queue.cc:260] T 5f7e006a09224285b1e5df5694ff72ae P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.929966 18215 leader_election.cc:304] T a83dfc7a7d784b52b9c74bbc451ad603 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee; no voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9
I20251023 07:58:38.930485 18293 ts_tablet_manager.cc:1434] T 5f7e006a09224285b1e5df5694ff72ae P 10dfae53d0c941f08bded43539841761: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20251023 07:58:38.923076 18359 raft_consensus.cc:515] T 25d22e66fcd6444a9b9c469acd781e59 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.931495 18293 tablet_bootstrap.cc:492] T 25d22e66fcd6444a9b9c469acd781e59 P 10dfae53d0c941f08bded43539841761: Bootstrap starting.
I20251023 07:58:38.930733 18390 raft_consensus.cc:2749] T a83dfc7a7d784b52b9c74bbc451ad603 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20251023 07:58:38.933101 18400 consensus_queue.cc:1059] T a83dfc7a7d784b52b9c74bbc451ad603 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:38.934041 18465 raft_consensus.cc:3055] T a83dfc7a7d784b52b9c74bbc451ad603 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Stepping down as leader of term 1
I20251023 07:58:38.933979 18390 consensus_queue.cc:1048] T 1f539da81d60449b9d96866c7ceee1be P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:38.934449 18465 raft_consensus.cc:740] T a83dfc7a7d784b52b9c74bbc451ad603 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Running, Role: LEADER
I20251023 07:58:38.935379 18465 consensus_queue.cc:260] T a83dfc7a7d784b52b9c74bbc451ad603 P b3a1328f9c8c484fab08292ce2171ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.936368 18291 tablet_bootstrap.cc:492] T 3e4d005972f44619b0cf23f4978f51c4 P 982df35c5b554a8fa64807352c4f34ee: No bootstrap required, opened a new log
I20251023 07:58:38.936826 18465 raft_consensus.cc:3060] T a83dfc7a7d784b52b9c74bbc451ad603 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:58:38.937242 18359 leader_election.cc:290] T 25d22e66fcd6444a9b9c469acd781e59 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 election: Requested vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:58:38.936827 18291 ts_tablet_manager.cc:1403] T 3e4d005972f44619b0cf23f4978f51c4 P 982df35c5b554a8fa64807352c4f34ee: Time spent bootstrapping tablet: real 0.104s user 0.019s sys 0.012s
I20251023 07:58:38.937808 18102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "25d22e66fcd6444a9b9c469acd781e59" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
I20251023 07:58:38.938585 18102 raft_consensus.cc:3060] T 25d22e66fcd6444a9b9c469acd781e59 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:38.940284 18174 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "25d22e66fcd6444a9b9c469acd781e59" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761"
I20251023 07:58:38.940308 18291 raft_consensus.cc:359] T 3e4d005972f44619b0cf23f4978f51c4 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.941015 18291 raft_consensus.cc:385] T 3e4d005972f44619b0cf23f4978f51c4 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:38.941287 18291 raft_consensus.cc:740] T 3e4d005972f44619b0cf23f4978f51c4 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Initialized, Role: FOLLOWER
W20251023 07:58:38.941885 18215 leader_election.cc:343] T 25d22e66fcd6444a9b9c469acd781e59 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:38.941973 18291 consensus_queue.cc:260] T 3e4d005972f44619b0cf23f4978f51c4 P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.944367 18291 ts_tablet_manager.cc:1434] T 3e4d005972f44619b0cf23f4978f51c4 P 982df35c5b554a8fa64807352c4f34ee: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20251023 07:58:38.945873 18291 tablet_bootstrap.cc:492] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 982df35c5b554a8fa64807352c4f34ee: Bootstrap starting.
I20251023 07:58:38.952972 18102 raft_consensus.cc:2468] T 25d22e66fcd6444a9b9c469acd781e59 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 1.
I20251023 07:58:38.954941 18217 leader_election.cc:304] T 25d22e66fcd6444a9b9c469acd781e59 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9; no voters: 10dfae53d0c941f08bded43539841761
I20251023 07:58:38.958635 18359 raft_consensus.cc:2804] T 25d22e66fcd6444a9b9c469acd781e59 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:58:38.966071 18359 raft_consensus.cc:697] T 25d22e66fcd6444a9b9c469acd781e59 P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Becoming Leader. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Running, Role: LEADER
I20251023 07:58:38.966877 18359 consensus_queue.cc:237] T 25d22e66fcd6444a9b9c469acd781e59 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:38.984282 18293 tablet_bootstrap.cc:654] T 25d22e66fcd6444a9b9c469acd781e59 P 10dfae53d0c941f08bded43539841761: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:38.987602 18291 tablet_bootstrap.cc:654] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 982df35c5b554a8fa64807352c4f34ee: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:39.008903 18319 consensus_queue.cc:1048] T c63b5a4dc8eb4b6e918608f281183068 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20251023 07:58:39.013396 18292 tablet_bootstrap.cc:492] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P b3a1328f9c8c484fab08292ce2171ec9: No bootstrap required, opened a new log
I20251023 07:58:39.014004 18292 ts_tablet_manager.cc:1403] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P b3a1328f9c8c484fab08292ce2171ec9: Time spent bootstrapping tablet: real 0.130s user 0.025s sys 0.014s
I20251023 07:58:39.016701 18292 raft_consensus.cc:359] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:39.017832 18292 raft_consensus.cc:385] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:39.018203 18292 raft_consensus.cc:740] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Initialized, Role: FOLLOWER
I20251023 07:58:39.018945 18292 consensus_queue.cc:260] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P b3a1328f9c8c484fab08292ce2171ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:39.022346 18293 tablet_bootstrap.cc:492] T 25d22e66fcd6444a9b9c469acd781e59 P 10dfae53d0c941f08bded43539841761: No bootstrap required, opened a new log
I20251023 07:58:39.022822 18293 ts_tablet_manager.cc:1403] T 25d22e66fcd6444a9b9c469acd781e59 P 10dfae53d0c941f08bded43539841761: Time spent bootstrapping tablet: real 0.092s user 0.018s sys 0.003s
I20251023 07:58:39.026749 18292 ts_tablet_manager.cc:1434] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P b3a1328f9c8c484fab08292ce2171ec9: Time spent starting tablet: real 0.012s user 0.006s sys 0.000s
I20251023 07:58:39.026836 18293 raft_consensus.cc:359] T 25d22e66fcd6444a9b9c469acd781e59 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:39.027750 18292 tablet_bootstrap.cc:492] T 55de6ceb03f343b09190cb2fb4bbe144 P b3a1328f9c8c484fab08292ce2171ec9: Bootstrap starting.
I20251023 07:58:39.027963 18293 raft_consensus.cc:385] T 25d22e66fcd6444a9b9c469acd781e59 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:39.028213 18293 raft_consensus.cc:740] T 25d22e66fcd6444a9b9c469acd781e59 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Initialized, Role: FOLLOWER
I20251023 07:58:39.028788 18293 consensus_queue.cc:260] T 25d22e66fcd6444a9b9c469acd781e59 P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:39.030787 18293 ts_tablet_manager.cc:1434] T 25d22e66fcd6444a9b9c469acd781e59 P 10dfae53d0c941f08bded43539841761: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20251023 07:58:39.033068 18319 raft_consensus.cc:493] T 14e6f2c3d85b437cac3ead436d5494a7 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:39.033386 18317 consensus_queue.cc:1048] T e99e859ac34a47c4b2859ec2638d17e5 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:39.033560 18319 raft_consensus.cc:515] T 14e6f2c3d85b437cac3ead436d5494a7 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:39.034775 18293 tablet_bootstrap.cc:492] T 14e6f2c3d85b437cac3ead436d5494a7 P 10dfae53d0c941f08bded43539841761: Bootstrap starting.
I20251023 07:58:39.038432 18319 leader_election.cc:290] T 14e6f2c3d85b437cac3ead436d5494a7 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:58:39.043573 18097 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14e6f2c3d85b437cac3ead436d5494a7" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:39.044205 18400 raft_consensus.cc:493] T 1178e2ed919b40f29672fc6233b71cf3 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:39.044649 18400 raft_consensus.cc:515] T 1178e2ed919b40f29672fc6233b71cf3 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:39.044109 17998 catalog_manager.cc:5649] T 25d22e66fcd6444a9b9c469acd781e59 P 982df35c5b554a8fa64807352c4f34ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 982df35c5b554a8fa64807352c4f34ee (127.16.126.3). New cstate: current_term: 1 leader_uuid: "982df35c5b554a8fa64807352c4f34ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: HEALTHY } } }
I20251023 07:58:39.046532 18400 leader_election.cc:290] T 1178e2ed919b40f29672fc6233b71cf3 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:39.048867 18097 raft_consensus.cc:2468] T 14e6f2c3d85b437cac3ead436d5494a7 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 0.
I20251023 07:58:39.050058 18176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1178e2ed919b40f29672fc6233b71cf3" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:39.050659 18251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1178e2ed919b40f29672fc6233b71cf3" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
W20251023 07:58:39.051434 18066 leader_election.cc:343] T 1178e2ed919b40f29672fc6233b71cf3 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:39.051555 18465 consensus_queue.cc:1048] T c6022ad5a70c4b4f8f34339956122cb7 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:39.053052 18172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14e6f2c3d85b437cac3ead436d5494a7" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
W20251023 07:58:39.053491 18067 leader_election.cc:343] T 1178e2ed919b40f29672fc6233b71cf3 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Illegal state: must be running to vote when last-logged opid is not known
W20251023 07:58:39.054204 18215 leader_election.cc:343] T 14e6f2c3d85b437cac3ead436d5494a7 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:39.061003 18217 leader_election.cc:304] T 14e6f2c3d85b437cac3ead436d5494a7 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9; no voters: 10dfae53d0c941f08bded43539841761
I20251023 07:58:39.061370 18292 tablet_bootstrap.cc:654] T 55de6ceb03f343b09190cb2fb4bbe144 P b3a1328f9c8c484fab08292ce2171ec9: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:39.061893 18319 raft_consensus.cc:2804] T 14e6f2c3d85b437cac3ead436d5494a7 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:58:39.062286 18319 raft_consensus.cc:493] T 14e6f2c3d85b437cac3ead436d5494a7 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:39.065181 18291 tablet_bootstrap.cc:492] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 982df35c5b554a8fa64807352c4f34ee: No bootstrap required, opened a new log
I20251023 07:58:39.069098 18291 ts_tablet_manager.cc:1403] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 982df35c5b554a8fa64807352c4f34ee: Time spent bootstrapping tablet: real 0.123s user 0.014s sys 0.012s
I20251023 07:58:39.069011 18319 raft_consensus.cc:3060] T 14e6f2c3d85b437cac3ead436d5494a7 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:39.080049 18176 raft_consensus.cc:3060] T c63b5a4dc8eb4b6e918608f281183068 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:39.081588 18291 raft_consensus.cc:359] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:39.082242 18291 raft_consensus.cc:385] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:39.082484 18291 raft_consensus.cc:740] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Initialized, Role: FOLLOWER
I20251023 07:58:39.083316 18291 consensus_queue.cc:260] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:39.091341 18319 raft_consensus.cc:515] T 14e6f2c3d85b437cac3ead436d5494a7 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:39.093992 18319 leader_election.cc:290] T 14e6f2c3d85b437cac3ead436d5494a7 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 election: Requested vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:58:39.053941 18067 leader_election.cc:304] T 1178e2ed919b40f29672fc6233b71cf3 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3a1328f9c8c484fab08292ce2171ec9; no voters: 10dfae53d0c941f08bded43539841761, 982df35c5b554a8fa64807352c4f34ee
I20251023 07:58:39.098027 18293 tablet_bootstrap.cc:654] T 14e6f2c3d85b437cac3ead436d5494a7 P 10dfae53d0c941f08bded43539841761: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:39.098388 18300 raft_consensus.cc:2749] T 1178e2ed919b40f29672fc6233b71cf3 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251023 07:58:39.099772 18067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.126.3:46061, user_credentials={real_user=slave}} blocked reactor thread for 46349.1us
I20251023 07:58:39.100252 18173 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14e6f2c3d85b437cac3ead436d5494a7" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761"
W20251023 07:58:39.101411 18215 leader_election.cc:343] T 14e6f2c3d85b437cac3ead436d5494a7 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:39.101866 18096 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14e6f2c3d85b437cac3ead436d5494a7" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
I20251023 07:58:39.102337 18096 raft_consensus.cc:3060] T 14e6f2c3d85b437cac3ead436d5494a7 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:39.102453 18291 ts_tablet_manager.cc:1434] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 982df35c5b554a8fa64807352c4f34ee: Time spent starting tablet: real 0.033s user 0.006s sys 0.000s
I20251023 07:58:39.103451 18291 tablet_bootstrap.cc:492] T 2d81605b8fe7427b94af7f3c481ed765 P 982df35c5b554a8fa64807352c4f34ee: Bootstrap starting.
I20251023 07:58:39.108762 18301 raft_consensus.cc:493] T c63b5a4dc8eb4b6e918608f281183068 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:39.109261 18301 raft_consensus.cc:515] T c63b5a4dc8eb4b6e918608f281183068 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:39.116156 18102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c63b5a4dc8eb4b6e918608f281183068" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:39.116549 18301 leader_election.cc:290] T c63b5a4dc8eb4b6e918608f281183068 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:39.122010 18319 consensus_queue.cc:1048] T c63b5a4dc8eb4b6e918608f281183068 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20251023 07:58:39.117098 18251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c63b5a4dc8eb4b6e918608f281183068" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:39.131191 18377 raft_consensus.cc:493] T 55de6ceb03f343b09190cb2fb4bbe144 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:39.131686 18377 raft_consensus.cc:515] T 55de6ceb03f343b09190cb2fb4bbe144 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:39.132617 18319 consensus_queue.cc:1048] T e99e859ac34a47c4b2859ec2638d17e5 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:39.133709 18377 leader_election.cc:290] T 55de6ceb03f343b09190cb2fb4bbe144 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:39.134846 18142 leader_election.cc:304] T c63b5a4dc8eb4b6e918608f281183068 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10dfae53d0c941f08bded43539841761; no voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9
I20251023 07:58:39.119757 18096 raft_consensus.cc:2468] T 14e6f2c3d85b437cac3ead436d5494a7 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 1.
I20251023 07:58:39.136986 18097 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "55de6ceb03f343b09190cb2fb4bbe144" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:39.137614 18217 leader_election.cc:304] T 14e6f2c3d85b437cac3ead436d5494a7 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9; no voters: 10dfae53d0c941f08bded43539841761
I20251023 07:58:39.141893 18251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "55de6ceb03f343b09190cb2fb4bbe144" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
W20251023 07:58:39.143362 18142 leader_election.cc:343] T 55de6ceb03f343b09190cb2fb4bbe144 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Illegal state: must be running to vote when last-logged opid is not known
W20251023 07:58:39.144268 18143 leader_election.cc:343] T 55de6ceb03f343b09190cb2fb4bbe144 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:39.147388 18143 leader_election.cc:304] T 55de6ceb03f343b09190cb2fb4bbe144 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10dfae53d0c941f08bded43539841761; no voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9
I20251023 07:58:39.148830 18359 raft_consensus.cc:2804] T 14e6f2c3d85b437cac3ead436d5494a7 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:58:39.148885 18344 consensus_queue.cc:1048] T c6022ad5a70c4b4f8f34339956122cb7 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:58:39.141242 18291 tablet_bootstrap.cc:654] T 2d81605b8fe7427b94af7f3c481ed765 P 982df35c5b554a8fa64807352c4f34ee: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:39.149494 18359 raft_consensus.cc:697] T 14e6f2c3d85b437cac3ead436d5494a7 P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Becoming Leader. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Running, Role: LEADER
I20251023 07:58:39.150460 18372 raft_consensus.cc:2749] T 55de6ceb03f343b09190cb2fb4bbe144 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:58:39.150430 18359 consensus_queue.cc:237] T 14e6f2c3d85b437cac3ead436d5494a7 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:39.161317 18377 raft_consensus.cc:493] T 3e4d005972f44619b0cf23f4978f51c4 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:39.162148 18377 raft_consensus.cc:515] T 3e4d005972f44619b0cf23f4978f51c4 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:39.201007 18377 leader_election.cc:290] T 3e4d005972f44619b0cf23f4978f51c4 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:39.202123 18251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3e4d005972f44619b0cf23f4978f51c4" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:39.204166 18251 raft_consensus.cc:2468] T 3e4d005972f44619b0cf23f4978f51c4 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 0.
I20251023 07:58:39.208988 18142 leader_election.cc:304] T 3e4d005972f44619b0cf23f4978f51c4 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, 982df35c5b554a8fa64807352c4f34ee; no voters:
I20251023 07:58:39.211184 18301 raft_consensus.cc:2749] T c63b5a4dc8eb4b6e918608f281183068 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251023 07:58:39.240506 18292 tablet_bootstrap.cc:492] T 55de6ceb03f343b09190cb2fb4bbe144 P b3a1328f9c8c484fab08292ce2171ec9: No bootstrap required, opened a new log
I20251023 07:58:39.240957 18292 ts_tablet_manager.cc:1403] T 55de6ceb03f343b09190cb2fb4bbe144 P b3a1328f9c8c484fab08292ce2171ec9: Time spent bootstrapping tablet: real 0.213s user 0.022s sys 0.007s
I20251023 07:58:39.223652 18102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3e4d005972f44619b0cf23f4978f51c4" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:39.251078 18293 tablet_bootstrap.cc:492] T 14e6f2c3d85b437cac3ead436d5494a7 P 10dfae53d0c941f08bded43539841761: No bootstrap required, opened a new log
I20251023 07:58:39.251575 18293 ts_tablet_manager.cc:1403] T 14e6f2c3d85b437cac3ead436d5494a7 P 10dfae53d0c941f08bded43539841761: Time spent bootstrapping tablet: real 0.220s user 0.022s sys 0.011s
I20251023 07:58:39.267293 18293 raft_consensus.cc:359] T 14e6f2c3d85b437cac3ead436d5494a7 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:39.309981 18293 raft_consensus.cc:385] T 14e6f2c3d85b437cac3ead436d5494a7 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:39.310314 18293 raft_consensus.cc:740] T 14e6f2c3d85b437cac3ead436d5494a7 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Initialized, Role: FOLLOWER
I20251023 07:58:39.245703 18102 raft_consensus.cc:2468] T 3e4d005972f44619b0cf23f4978f51c4 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 0.
I20251023 07:58:39.311023 18293 consensus_queue.cc:260] T 14e6f2c3d85b437cac3ead436d5494a7 P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:39.313287 18292 raft_consensus.cc:359] T 55de6ceb03f343b09190cb2fb4bbe144 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:39.314338 18292 raft_consensus.cc:385] T 55de6ceb03f343b09190cb2fb4bbe144 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:39.314595 18292 raft_consensus.cc:740] T 55de6ceb03f343b09190cb2fb4bbe144 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Initialized, Role: FOLLOWER
I20251023 07:58:39.316293 18494 raft_consensus.cc:2804] T 3e4d005972f44619b0cf23f4978f51c4 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:58:39.316727 18494 raft_consensus.cc:493] T 3e4d005972f44619b0cf23f4978f51c4 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:39.317080 18494 raft_consensus.cc:3060] T 3e4d005972f44619b0cf23f4978f51c4 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:39.315955 18292 consensus_queue.cc:260] T 55de6ceb03f343b09190cb2fb4bbe144 P b3a1328f9c8c484fab08292ce2171ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:39.321084 18293 ts_tablet_manager.cc:1434] T 14e6f2c3d85b437cac3ead436d5494a7 P 10dfae53d0c941f08bded43539841761: Time spent starting tablet: real 0.069s user 0.005s sys 0.006s
I20251023 07:58:39.322005 18293 tablet_bootstrap.cc:492] T 732495dddec64a3aa196110bfda45b37 P 10dfae53d0c941f08bded43539841761: Bootstrap starting.
I20251023 07:58:39.310789 18400 consensus_queue.cc:1048] T b19b550093fb4ab181e62957d89460e7 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20251023 07:58:39.325774 18495 raft_consensus.cc:493] T ce0069d7c0cf4dee84a85731209358f7 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:39.326541 18495 raft_consensus.cc:515] T ce0069d7c0cf4dee84a85731209358f7 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:39.329134 18344 raft_consensus.cc:493] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:39.339192 18292 ts_tablet_manager.cc:1434] T 55de6ceb03f343b09190cb2fb4bbe144 P b3a1328f9c8c484fab08292ce2171ec9: Time spent starting tablet: real 0.098s user 0.008s sys 0.000s
I20251023 07:58:39.339354 18344 raft_consensus.cc:515] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:39.340198 18292 tablet_bootstrap.cc:492] T 1f437560602a470ca62b7a1fa9471026 P b3a1328f9c8c484fab08292ce2171ec9: Bootstrap starting.
I20251023 07:58:39.345381 18301 raft_consensus.cc:493] T 5f7e006a09224285b1e5df5694ff72ae P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:39.345988 18301 raft_consensus.cc:515] T 5f7e006a09224285b1e5df5694ff72ae P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:39.347913 18301 leader_election.cc:290] T 5f7e006a09224285b1e5df5694ff72ae P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:39.348168 18344 leader_election.cc:290] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:39.349571 18494 raft_consensus.cc:515] T 3e4d005972f44619b0cf23f4978f51c4 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:39.363235 18377 consensus_queue.cc:1048] T 94cd6588f7824a30ba02f891ae089671 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20251023 07:58:39.366098 18359 raft_consensus.cc:493] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:39.366662 18359 raft_consensus.cc:515] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:39.369086 18359 leader_election.cc:290] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:58:39.377080 18293 tablet_bootstrap.cc:654] T 732495dddec64a3aa196110bfda45b37 P 10dfae53d0c941f08bded43539841761: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:39.374765 18495 leader_election.cc:290] T ce0069d7c0cf4dee84a85731209358f7 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:39.377283 18171 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "290b1b1fd4ef42cf9f0b285d4bf5ed36" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:39.378661 18292 tablet_bootstrap.cc:654] T 1f437560602a470ca62b7a1fa9471026 P b3a1328f9c8c484fab08292ce2171ec9: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:39.380236 18251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "290b1b1fd4ef42cf9f0b285d4bf5ed36" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:39.382220 18171 raft_consensus.cc:2468] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3a1328f9c8c484fab08292ce2171ec9 in term 0.
I20251023 07:58:39.382534 18251 raft_consensus.cc:2468] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3a1328f9c8c484fab08292ce2171ec9 in term 0.
I20251023 07:58:39.383147 18248 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5f7e006a09224285b1e5df5694ff72ae" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:39.383858 18248 raft_consensus.cc:2393] T 5f7e006a09224285b1e5df5694ff72ae P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10dfae53d0c941f08bded43539841761 in current term 1: Already voted for candidate b3a1328f9c8c484fab08292ce2171ec9 in this term.
I20251023 07:58:39.384567 18096 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "290b1b1fd4ef42cf9f0b285d4bf5ed36" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:39.385177 18096 raft_consensus.cc:2468] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 0.
I20251023 07:58:39.386165 18066 leader_election.cc:304] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:58:39.387545 18097 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce0069d7c0cf4dee84a85731209358f7" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:39.390369 18344 raft_consensus.cc:2804] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:58:39.390892 18097 raft_consensus.cc:2468] T ce0069d7c0cf4dee84a85731209358f7 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 0.
I20251023 07:58:39.391096 18344 raft_consensus.cc:493] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:39.391124 18171 raft_consensus.cc:3060] T 5f7e006a09224285b1e5df5694ff72ae P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:39.394668 18344 raft_consensus.cc:3060] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:39.390232 18465 consensus_queue.cc:1048] T b19b550093fb4ab181e62957d89460e7 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20251023 07:58:39.414661 18217 leader_election.cc:304] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:58:39.413898 18493 consensus_queue.cc:1048] T 94cd6588f7824a30ba02f891ae089671 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20251023 07:58:39.416635 18390 raft_consensus.cc:2804] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:58:39.417013 18390 raft_consensus.cc:493] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:39.418313 18176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "290b1b1fd4ef42cf9f0b285d4bf5ed36" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:39.418974 18176 raft_consensus.cc:2468] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 0.
I20251023 07:58:39.410666 17998 catalog_manager.cc:5649] T 14e6f2c3d85b437cac3ead436d5494a7 P 982df35c5b554a8fa64807352c4f34ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 982df35c5b554a8fa64807352c4f34ee (127.16.126.3). New cstate: current_term: 1 leader_uuid: "982df35c5b554a8fa64807352c4f34ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: HEALTHY } } }
I20251023 07:58:39.398569 18102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5f7e006a09224285b1e5df5694ff72ae" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:39.418283 18494 leader_election.cc:290] T 3e4d005972f44619b0cf23f4978f51c4 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 election: Requested vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:39.408915 18248 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce0069d7c0cf4dee84a85731209358f7" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:39.408540 18143 leader_election.cc:304] T ce0069d7c0cf4dee84a85731209358f7 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:58:39.429804 18251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3e4d005972f44619b0cf23f4978f51c4" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
I20251023 07:58:39.430074 18495 raft_consensus.cc:2804] T ce0069d7c0cf4dee84a85731209358f7 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:58:39.430418 18251 raft_consensus.cc:3060] T 3e4d005972f44619b0cf23f4978f51c4 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:39.430518 18495 raft_consensus.cc:493] T ce0069d7c0cf4dee84a85731209358f7 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:39.430593 18096 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3e4d005972f44619b0cf23f4978f51c4" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
I20251023 07:58:39.431054 18495 raft_consensus.cc:3060] T ce0069d7c0cf4dee84a85731209358f7 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:39.431257 18096 raft_consensus.cc:3060] T 3e4d005972f44619b0cf23f4978f51c4 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:39.417339 18390 raft_consensus.cc:3060] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:39.462786 18291 tablet_bootstrap.cc:492] T 2d81605b8fe7427b94af7f3c481ed765 P 982df35c5b554a8fa64807352c4f34ee: No bootstrap required, opened a new log
I20251023 07:58:39.463331 18291 ts_tablet_manager.cc:1403] T 2d81605b8fe7427b94af7f3c481ed765 P 982df35c5b554a8fa64807352c4f34ee: Time spent bootstrapping tablet: real 0.360s user 0.029s sys 0.015s
W20251023 07:58:39.463652 18048 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20251023 07:58:39.466941 18291 raft_consensus.cc:359] T 2d81605b8fe7427b94af7f3c481ed765 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:39.468240 18291 raft_consensus.cc:385] T 2d81605b8fe7427b94af7f3c481ed765 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:39.468605 18291 raft_consensus.cc:740] T 2d81605b8fe7427b94af7f3c481ed765 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Initialized, Role: FOLLOWER
I20251023 07:58:39.470048 18291 consensus_queue.cc:260] T 2d81605b8fe7427b94af7f3c481ed765 P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
W20251023 07:58:39.456851 18142 leader_election.cc:343] T ce0069d7c0cf4dee84a85731209358f7 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Illegal state: must be running to vote when last-logged opid is not known
W20251023 07:58:39.486743 18067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.3:46061, user_credentials={real_user=slave}} blocked reactor thread for 79508.5us
I20251023 07:58:39.504910 18291 ts_tablet_manager.cc:1434] T 2d81605b8fe7427b94af7f3c481ed765 P 982df35c5b554a8fa64807352c4f34ee: Time spent starting tablet: real 0.041s user 0.006s sys 0.001s
I20251023 07:58:39.506321 18291 tablet_bootstrap.cc:492] T 55de6ceb03f343b09190cb2fb4bbe144 P 982df35c5b554a8fa64807352c4f34ee: Bootstrap starting.
I20251023 07:58:39.508833 18292 tablet_bootstrap.cc:492] T 1f437560602a470ca62b7a1fa9471026 P b3a1328f9c8c484fab08292ce2171ec9: No bootstrap required, opened a new log
I20251023 07:58:39.509522 18292 ts_tablet_manager.cc:1403] T 1f437560602a470ca62b7a1fa9471026 P b3a1328f9c8c484fab08292ce2171ec9: Time spent bootstrapping tablet: real 0.170s user 0.017s sys 0.003s
I20251023 07:58:39.497762 18504 consensus_queue.cc:1048] T 5f7e006a09224285b1e5df5694ff72ae P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20251023 07:58:39.483757 18493 raft_consensus.cc:493] T 25d22e66fcd6444a9b9c469acd781e59 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:39.520196 18291 tablet_bootstrap.cc:654] T 55de6ceb03f343b09190cb2fb4bbe144 P 982df35c5b554a8fa64807352c4f34ee: Neither blocks nor log segments found. Creating new log.
W20251023 07:58:39.514330 18142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.126.3:46061, user_credentials={real_user=slave}} blocked reactor thread for 58846.8us
I20251023 07:58:39.527189 18292 raft_consensus.cc:359] T 1f437560602a470ca62b7a1fa9471026 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:39.528311 18292 raft_consensus.cc:385] T 1f437560602a470ca62b7a1fa9471026 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:39.528566 18292 raft_consensus.cc:740] T 1f437560602a470ca62b7a1fa9471026 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Initialized, Role: FOLLOWER
I20251023 07:58:39.528740 18293 tablet_bootstrap.cc:492] T 732495dddec64a3aa196110bfda45b37 P 10dfae53d0c941f08bded43539841761: No bootstrap required, opened a new log
I20251023 07:58:39.529210 18293 ts_tablet_manager.cc:1403] T 732495dddec64a3aa196110bfda45b37 P 10dfae53d0c941f08bded43539841761: Time spent bootstrapping tablet: real 0.207s user 0.009s sys 0.010s
I20251023 07:58:39.513252 18143 leader_election.cc:304] T 5f7e006a09224285b1e5df5694ff72ae P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10dfae53d0c941f08bded43539841761; no voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9
W20251023 07:58:39.546821 18143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.126.1:44025, user_credentials={real_user=slave}} blocked reactor thread for 54120.2us
I20251023 07:58:39.548502 18403 raft_consensus.cc:2749] T 5f7e006a09224285b1e5df5694ff72ae P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:58:39.523706 18493 raft_consensus.cc:515] T 25d22e66fcd6444a9b9c469acd781e59 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:39.555033 18172 raft_consensus.cc:3060] T 25d22e66fcd6444a9b9c469acd781e59 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:39.556814 18390 raft_consensus.cc:515] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:39.565518 18390 leader_election.cc:290] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 election: Requested vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:58:39.599501 18251 raft_consensus.cc:2468] T 3e4d005972f44619b0cf23f4978f51c4 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 1.
I20251023 07:58:39.565927 18495 raft_consensus.cc:515] T ce0069d7c0cf4dee84a85731209358f7 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:39.623600 18096 raft_consensus.cc:2468] T 3e4d005972f44619b0cf23f4978f51c4 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 1.
I20251023 07:58:39.646525 18293 raft_consensus.cc:359] T 732495dddec64a3aa196110bfda45b37 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:39.647614 18293 raft_consensus.cc:385] T 732495dddec64a3aa196110bfda45b37 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:39.647993 18293 raft_consensus.cc:740] T 732495dddec64a3aa196110bfda45b37 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Initialized, Role: FOLLOWER
I20251023 07:58:39.659016 18493 leader_election.cc:290] T 25d22e66fcd6444a9b9c469acd781e59 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:39.646739 18292 consensus_queue.cc:260] T 1f437560602a470ca62b7a1fa9471026 P b3a1328f9c8c484fab08292ce2171ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:39.648759 18293 consensus_queue.cc:260] T 732495dddec64a3aa196110bfda45b37 P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:39.669667 18291 tablet_bootstrap.cc:492] T 55de6ceb03f343b09190cb2fb4bbe144 P 982df35c5b554a8fa64807352c4f34ee: No bootstrap required, opened a new log
I20251023 07:58:39.670158 18291 ts_tablet_manager.cc:1403] T 55de6ceb03f343b09190cb2fb4bbe144 P 982df35c5b554a8fa64807352c4f34ee: Time spent bootstrapping tablet: real 0.164s user 0.014s sys 0.000s
I20251023 07:58:39.672799 18291 raft_consensus.cc:359] T 55de6ceb03f343b09190cb2fb4bbe144 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:39.673476 18291 raft_consensus.cc:385] T 55de6ceb03f343b09190cb2fb4bbe144 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:39.673753 18291 raft_consensus.cc:740] T 55de6ceb03f343b09190cb2fb4bbe144 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Initialized, Role: FOLLOWER
I20251023 07:58:39.608546 18344 raft_consensus.cc:515] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:39.677951 18293 ts_tablet_manager.cc:1434] T 732495dddec64a3aa196110bfda45b37 P 10dfae53d0c941f08bded43539841761: Time spent starting tablet: real 0.148s user 0.007s sys 0.008s
I20251023 07:58:39.688753 18292 ts_tablet_manager.cc:1434] T 1f437560602a470ca62b7a1fa9471026 P b3a1328f9c8c484fab08292ce2171ec9: Time spent starting tablet: real 0.179s user 0.007s sys 0.001s
I20251023 07:58:39.764285 18293 tablet_bootstrap.cc:492] T c6c529d344cc483a96dbb509ca4c5890 P 10dfae53d0c941f08bded43539841761: Bootstrap starting.
I20251023 07:58:39.766162 18292 tablet_bootstrap.cc:492] T 01f269ca63a8498498956fb3577f35d3 P b3a1328f9c8c484fab08292ce2171ec9: Bootstrap starting.
I20251023 07:58:39.663977 18495 leader_election.cc:290] T ce0069d7c0cf4dee84a85731209358f7 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 election: Requested vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:39.767218 18291 consensus_queue.cc:260] T 55de6ceb03f343b09190cb2fb4bbe144 P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:39.771473 18176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "290b1b1fd4ef42cf9f0b285d4bf5ed36" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761"
I20251023 07:58:39.677973 18100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "25d22e66fcd6444a9b9c469acd781e59" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:39.678274 18096 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce0069d7c0cf4dee84a85731209358f7" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
I20251023 07:58:39.704084 18494 raft_consensus.cc:493] T 732495dddec64a3aa196110bfda45b37 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:39.708673 18359 raft_consensus.cc:493] T 2d81605b8fe7427b94af7f3c481ed765 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:39.727502 18247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "25d22e66fcd6444a9b9c469acd781e59" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:39.772122 18176 raft_consensus.cc:3060] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:39.674484 18143 leader_election.cc:304] T 3e4d005972f44619b0cf23f4978f51c4 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9; no voters:
W20251023 07:58:39.782083 18143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.126.1:44025, user_credentials={real_user=slave}} blocked reactor thread for 116250us
I20251023 07:58:39.782013 18510 consensus_queue.cc:1048] T 25d22e66fcd6444a9b9c469acd781e59 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20251023 07:58:39.786303 18317 consensus_queue.cc:1048] T 25d22e66fcd6444a9b9c469acd781e59 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:39.788368 18301 raft_consensus.cc:493] T 14e6f2c3d85b437cac3ead436d5494a7 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:39.791303 18301 raft_consensus.cc:515] T 14e6f2c3d85b437cac3ead436d5494a7 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:39.782181 18493 raft_consensus.cc:2804] T 3e4d005972f44619b0cf23f4978f51c4 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:58:39.793244 18301 leader_election.cc:290] T 14e6f2c3d85b437cac3ead436d5494a7 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:39.793613 18493 raft_consensus.cc:697] T 3e4d005972f44619b0cf23f4978f51c4 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Becoming Leader. State: Replica: 10dfae53d0c941f08bded43539841761, State: Running, Role: LEADER
I20251023 07:58:39.794442 18493 consensus_queue.cc:237] T 3e4d005972f44619b0cf23f4978f51c4 P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:39.790714 18291 ts_tablet_manager.cc:1434] T 55de6ceb03f343b09190cb2fb4bbe144 P 982df35c5b554a8fa64807352c4f34ee: Time spent starting tablet: real 0.120s user 0.011s sys 0.015s
I20251023 07:58:39.778267 18096 raft_consensus.cc:3060] T ce0069d7c0cf4dee84a85731209358f7 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:39.796562 18291 tablet_bootstrap.cc:492] T 1f437560602a470ca62b7a1fa9471026 P 982df35c5b554a8fa64807352c4f34ee: Bootstrap starting.
I20251023 07:58:39.795603 18505 raft_consensus.cc:493] T 55de6ceb03f343b09190cb2fb4bbe144 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:39.804106 18505 raft_consensus.cc:515] T 55de6ceb03f343b09190cb2fb4bbe144 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
W20251023 07:58:39.804591 18142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.126.3:46061, user_credentials={real_user=slave}} blocked reactor thread for 137598us
I20251023 07:58:39.806105 18505 leader_election.cc:290] T 55de6ceb03f343b09190cb2fb4bbe144 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:39.799049 18100 raft_consensus.cc:2393] T 25d22e66fcd6444a9b9c469acd781e59 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10dfae53d0c941f08bded43539841761 in current term 1: Already voted for candidate 982df35c5b554a8fa64807352c4f34ee in this term.
I20251023 07:58:39.799770 18400 raft_consensus.cc:493] T 1f437560602a470ca62b7a1fa9471026 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:39.815218 18400 raft_consensus.cc:515] T 1f437560602a470ca62b7a1fa9471026 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:39.817080 18400 leader_election.cc:290] T 1f437560602a470ca62b7a1fa9471026 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:39.778244 18494 raft_consensus.cc:515] T 732495dddec64a3aa196110bfda45b37 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:39.778517 18359 raft_consensus.cc:515] T 2d81605b8fe7427b94af7f3c481ed765 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:39.819444 18176 raft_consensus.cc:2468] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 1.
I20251023 07:58:39.824061 18344 leader_election.cc:290] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 election: Requested vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:39.825107 18172 raft_consensus.cc:3060] T 14e6f2c3d85b437cac3ead436d5494a7 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:39.826923 18102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "290b1b1fd4ef42cf9f0b285d4bf5ed36" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
I20251023 07:58:39.828131 18101 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14e6f2c3d85b437cac3ead436d5494a7" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:39.831017 18102 raft_consensus.cc:2393] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 982df35c5b554a8fa64807352c4f34ee in current term 1: Already voted for candidate b3a1328f9c8c484fab08292ce2171ec9 in this term.
I20251023 07:58:39.845914 18101 raft_consensus.cc:2393] T 14e6f2c3d85b437cac3ead436d5494a7 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10dfae53d0c941f08bded43539841761 in current term 1: Already voted for candidate 982df35c5b554a8fa64807352c4f34ee in this term.
I20251023 07:58:39.844988 18465 consensus_queue.cc:1048] T 5f7e006a09224285b1e5df5694ff72ae P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20251023 07:58:39.856050 18143 leader_election.cc:304] T 25d22e66fcd6444a9b9c469acd781e59 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10dfae53d0c941f08bded43539841761; no voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9
I20251023 07:58:39.856873 18495 raft_consensus.cc:2749] T 25d22e66fcd6444a9b9c469acd781e59 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:58:39.860647 18247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1f437560602a470ca62b7a1fa9471026" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:39.861305 18251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "290b1b1fd4ef42cf9f0b285d4bf5ed36" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
I20251023 07:58:39.861670 18249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "55de6ceb03f343b09190cb2fb4bbe144" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:39.862218 18251 raft_consensus.cc:2393] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b3a1328f9c8c484fab08292ce2171ec9 in current term 1: Already voted for candidate 982df35c5b554a8fa64807352c4f34ee in this term.
I20251023 07:58:39.862386 18249 raft_consensus.cc:2468] T 55de6ceb03f343b09190cb2fb4bbe144 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3a1328f9c8c484fab08292ce2171ec9 in term 0.
I20251023 07:58:39.863095 18251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce0069d7c0cf4dee84a85731209358f7" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
I20251023 07:58:39.863564 18293 tablet_bootstrap.cc:654] T c6c529d344cc483a96dbb509ca4c5890 P 10dfae53d0c941f08bded43539841761: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:39.864450 18292 tablet_bootstrap.cc:654] T 01f269ca63a8498498956fb3577f35d3 P b3a1328f9c8c484fab08292ce2171ec9: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:39.867594 18359 leader_election.cc:290] T 2d81605b8fe7427b94af7f3c481ed765 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:58:39.875648 18096 raft_consensus.cc:2468] T ce0069d7c0cf4dee84a85731209358f7 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 1.
I20251023 07:58:39.869663 18249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14e6f2c3d85b437cac3ead436d5494a7" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:39.877758 18515 consensus_queue.cc:1048] T 14e6f2c3d85b437cac3ead436d5494a7 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20251023 07:58:39.880759 18248 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "732495dddec64a3aa196110bfda45b37" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:39.869740 18494 leader_election.cc:290] T 732495dddec64a3aa196110bfda45b37 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
W20251023 07:58:39.882652 18142 leader_election.cc:343] T ce0069d7c0cf4dee84a85731209358f7 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:39.885673 18171 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "55de6ceb03f343b09190cb2fb4bbe144" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:39.886304 18171 raft_consensus.cc:2468] T 55de6ceb03f343b09190cb2fb4bbe144 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3a1328f9c8c484fab08292ce2171ec9 in term 0.
I20251023 07:58:39.886467 18097 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "732495dddec64a3aa196110bfda45b37" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:39.887300 18142 leader_election.cc:304] T 14e6f2c3d85b437cac3ead436d5494a7 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10dfae53d0c941f08bded43539841761; no voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9
W20251023 07:58:39.888724 18142 leader_election.cc:343] T 732495dddec64a3aa196110bfda45b37 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:39.889549 18494 raft_consensus.cc:2749] T 14e6f2c3d85b437cac3ead436d5494a7 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:58:39.890959 18143 leader_election.cc:304] T ce0069d7c0cf4dee84a85731209358f7 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9; no voters: 982df35c5b554a8fa64807352c4f34ee
W20251023 07:58:39.892035 18143 leader_election.cc:343] T 732495dddec64a3aa196110bfda45b37 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:39.892414 18143 leader_election.cc:304] T 732495dddec64a3aa196110bfda45b37 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10dfae53d0c941f08bded43539841761; no voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9
I20251023 07:58:39.894802 18101 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2d81605b8fe7427b94af7f3c481ed765" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:39.895640 18171 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1f437560602a470ca62b7a1fa9471026" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:39.895999 18176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "290b1b1fd4ef42cf9f0b285d4bf5ed36" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761"
I20251023 07:58:39.896764 18176 raft_consensus.cc:2393] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b3a1328f9c8c484fab08292ce2171ec9 in current term 1: Already voted for candidate 982df35c5b554a8fa64807352c4f34ee in this term.
I20251023 07:58:39.897920 18215 leader_election.cc:304] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10dfae53d0c941f08bded43539841761, 982df35c5b554a8fa64807352c4f34ee; no voters: b3a1328f9c8c484fab08292ce2171ec9
I20251023 07:58:39.903203 18496 raft_consensus.cc:2804] T ce0069d7c0cf4dee84a85731209358f7 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:58:39.904194 18514 raft_consensus.cc:2804] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:58:39.904702 18514 raft_consensus.cc:697] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Becoming Leader. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Running, Role: LEADER
I20251023 07:58:39.903395 18291 tablet_bootstrap.cc:654] T 1f437560602a470ca62b7a1fa9471026 P 982df35c5b554a8fa64807352c4f34ee: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:39.906891 18171 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2d81605b8fe7427b94af7f3c481ed765" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:39.918123 17997 catalog_manager.cc:5649] T 3e4d005972f44619b0cf23f4978f51c4 P 10dfae53d0c941f08bded43539841761 reported cstate change: term changed from 0 to 1, leader changed from <none> to 10dfae53d0c941f08bded43539841761 (127.16.126.2). New cstate: current_term: 1 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } }
I20251023 07:58:39.902909 18494 raft_consensus.cc:2749] T 732495dddec64a3aa196110bfda45b37 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:58:39.905635 18496 raft_consensus.cc:697] T ce0069d7c0cf4dee84a85731209358f7 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Becoming Leader. State: Replica: 10dfae53d0c941f08bded43539841761, State: Running, Role: LEADER
I20251023 07:58:39.954910 18292 tablet_bootstrap.cc:492] T 01f269ca63a8498498956fb3577f35d3 P b3a1328f9c8c484fab08292ce2171ec9: No bootstrap required, opened a new log
I20251023 07:58:39.955408 18292 ts_tablet_manager.cc:1403] T 01f269ca63a8498498956fb3577f35d3 P b3a1328f9c8c484fab08292ce2171ec9: Time spent bootstrapping tablet: real 0.189s user 0.007s sys 0.010s
I20251023 07:58:39.956209 18514 consensus_queue.cc:237] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:39.957938 18066 leader_election.cc:304] T 55de6ceb03f343b09190cb2fb4bbe144 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:58:39.959465 18293 tablet_bootstrap.cc:492] T c6c529d344cc483a96dbb509ca4c5890 P 10dfae53d0c941f08bded43539841761: No bootstrap required, opened a new log
I20251023 07:58:39.959903 18293 ts_tablet_manager.cc:1403] T c6c529d344cc483a96dbb509ca4c5890 P 10dfae53d0c941f08bded43539841761: Time spent bootstrapping tablet: real 0.196s user 0.009s sys 0.008s
W20251023 07:58:39.969597 18217 leader_election.cc:343] T 2d81605b8fe7427b94af7f3c481ed765 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:39.973902 18500 consensus_queue.cc:1048] T 14e6f2c3d85b437cac3ead436d5494a7 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20251023 07:58:39.966113 18300 raft_consensus.cc:2804] T 55de6ceb03f343b09190cb2fb4bbe144 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20251023 07:58:39.974769 18066 leader_election.cc:343] T 1f437560602a470ca62b7a1fa9471026 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:39.974933 18300 raft_consensus.cc:493] T 55de6ceb03f343b09190cb2fb4bbe144 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:39.975318 18300 raft_consensus.cc:3060] T 55de6ceb03f343b09190cb2fb4bbe144 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Advancing to term 1
W20251023 07:58:39.978734 18215 leader_election.cc:343] T 2d81605b8fe7427b94af7f3c481ed765 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:39.979210 18215 leader_election.cc:304] T 2d81605b8fe7427b94af7f3c481ed765 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee; no voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9
I20251023 07:58:39.989717 18293 raft_consensus.cc:359] T c6c529d344cc483a96dbb509ca4c5890 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:39.990515 18293 raft_consensus.cc:385] T c6c529d344cc483a96dbb509ca4c5890 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:39.990790 18293 raft_consensus.cc:740] T c6c529d344cc483a96dbb509ca4c5890 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Initialized, Role: FOLLOWER
I20251023 07:58:39.981931 18514 raft_consensus.cc:2749] T 2d81605b8fe7427b94af7f3c481ed765 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:58:39.991410 18293 consensus_queue.cc:260] T c6c529d344cc483a96dbb509ca4c5890 P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.013880 18292 raft_consensus.cc:359] T 01f269ca63a8498498956fb3577f35d3 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.014887 18292 raft_consensus.cc:385] T 01f269ca63a8498498956fb3577f35d3 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:40.015192 18292 raft_consensus.cc:740] T 01f269ca63a8498498956fb3577f35d3 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Initialized, Role: FOLLOWER
I20251023 07:58:40.017634 18292 consensus_queue.cc:260] T 01f269ca63a8498498956fb3577f35d3 P b3a1328f9c8c484fab08292ce2171ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.022679 18292 ts_tablet_manager.cc:1434] T 01f269ca63a8498498956fb3577f35d3 P b3a1328f9c8c484fab08292ce2171ec9: Time spent starting tablet: real 0.067s user 0.005s sys 0.002s
I20251023 07:58:40.024156 18292 tablet_bootstrap.cc:492] T f90cf0955288472898eff5b7e6459195 P b3a1328f9c8c484fab08292ce2171ec9: Bootstrap starting.
I20251023 07:58:39.978447 18496 consensus_queue.cc:237] T ce0069d7c0cf4dee84a85731209358f7 P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.025063 18494 raft_consensus.cc:493] T c6c529d344cc483a96dbb509ca4c5890 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:40.037803 18494 raft_consensus.cc:515] T c6c529d344cc483a96dbb509ca4c5890 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.040318 18494 leader_election.cc:290] T c6c529d344cc483a96dbb509ca4c5890 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
W20251023 07:58:40.041659 18517 log.cc:927] Time spent T 25d22e66fcd6444a9b9c469acd781e59 P b3a1328f9c8c484fab08292ce2171ec9: Append to log took a long time: real 0.091s user 0.000s sys 0.001s
I20251023 07:58:40.043387 18247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6c529d344cc483a96dbb509ca4c5890" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:40.029881 18300 raft_consensus.cc:515] T 55de6ceb03f343b09190cb2fb4bbe144 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.045526 18293 ts_tablet_manager.cc:1434] T c6c529d344cc483a96dbb509ca4c5890 P 10dfae53d0c941f08bded43539841761: Time spent starting tablet: real 0.085s user 0.008s sys 0.011s
I20251023 07:58:40.046797 18293 tablet_bootstrap.cc:492] T 2d81605b8fe7427b94af7f3c481ed765 P 10dfae53d0c941f08bded43539841761: Bootstrap starting.
I20251023 07:58:40.050318 18300 leader_election.cc:290] T 55de6ceb03f343b09190cb2fb4bbe144 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 election: Requested vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:40.087931 18291 tablet_bootstrap.cc:492] T 1f437560602a470ca62b7a1fa9471026 P 982df35c5b554a8fa64807352c4f34ee: No bootstrap required, opened a new log
I20251023 07:58:40.088480 18291 ts_tablet_manager.cc:1403] T 1f437560602a470ca62b7a1fa9471026 P 982df35c5b554a8fa64807352c4f34ee: Time spent bootstrapping tablet: real 0.292s user 0.021s sys 0.021s
I20251023 07:58:40.089519 18293 tablet_bootstrap.cc:654] T 2d81605b8fe7427b94af7f3c481ed765 P 10dfae53d0c941f08bded43539841761: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:40.089686 18292 tablet_bootstrap.cc:654] T f90cf0955288472898eff5b7e6459195 P b3a1328f9c8c484fab08292ce2171ec9: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:40.099982 18291 raft_consensus.cc:359] T 1f437560602a470ca62b7a1fa9471026 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.101135 18291 raft_consensus.cc:385] T 1f437560602a470ca62b7a1fa9471026 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:40.101416 18291 raft_consensus.cc:740] T 1f437560602a470ca62b7a1fa9471026 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Initialized, Role: FOLLOWER
I20251023 07:58:40.101552 18293 tablet_bootstrap.cc:492] T 2d81605b8fe7427b94af7f3c481ed765 P 10dfae53d0c941f08bded43539841761: No bootstrap required, opened a new log
I20251023 07:58:40.102095 18293 ts_tablet_manager.cc:1403] T 2d81605b8fe7427b94af7f3c481ed765 P 10dfae53d0c941f08bded43539841761: Time spent bootstrapping tablet: real 0.056s user 0.017s sys 0.001s
I20251023 07:58:40.102223 18291 consensus_queue.cc:260] T 1f437560602a470ca62b7a1fa9471026 P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.104768 18293 raft_consensus.cc:359] T 2d81605b8fe7427b94af7f3c481ed765 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.105772 18292 tablet_bootstrap.cc:492] T f90cf0955288472898eff5b7e6459195 P b3a1328f9c8c484fab08292ce2171ec9: No bootstrap required, opened a new log
I20251023 07:58:40.106314 18292 ts_tablet_manager.cc:1403] T f90cf0955288472898eff5b7e6459195 P b3a1328f9c8c484fab08292ce2171ec9: Time spent bootstrapping tablet: real 0.082s user 0.005s sys 0.009s
I20251023 07:58:40.107683 18293 raft_consensus.cc:385] T 2d81605b8fe7427b94af7f3c481ed765 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:40.108002 18293 raft_consensus.cc:740] T 2d81605b8fe7427b94af7f3c481ed765 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Initialized, Role: FOLLOWER
I20251023 07:58:40.108600 18293 consensus_queue.cc:260] T 2d81605b8fe7427b94af7f3c481ed765 P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.108984 18292 raft_consensus.cc:359] T f90cf0955288472898eff5b7e6459195 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.109648 18292 raft_consensus.cc:385] T f90cf0955288472898eff5b7e6459195 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:40.109966 18292 raft_consensus.cc:740] T f90cf0955288472898eff5b7e6459195 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Initialized, Role: FOLLOWER
I20251023 07:58:40.110554 18292 consensus_queue.cc:260] T f90cf0955288472898eff5b7e6459195 P b3a1328f9c8c484fab08292ce2171ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.111251 18293 ts_tablet_manager.cc:1434] T 2d81605b8fe7427b94af7f3c481ed765 P 10dfae53d0c941f08bded43539841761: Time spent starting tablet: real 0.009s user 0.005s sys 0.000s
I20251023 07:58:40.112197 18293 tablet_bootstrap.cc:492] T 1178e2ed919b40f29672fc6233b71cf3 P 10dfae53d0c941f08bded43539841761: Bootstrap starting.
I20251023 07:58:40.112742 18292 ts_tablet_manager.cc:1434] T f90cf0955288472898eff5b7e6459195 P b3a1328f9c8c484fab08292ce2171ec9: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20251023 07:58:40.115142 18291 ts_tablet_manager.cc:1434] T 1f437560602a470ca62b7a1fa9471026 P 982df35c5b554a8fa64807352c4f34ee: Time spent starting tablet: real 0.026s user 0.007s sys 0.000s
I20251023 07:58:40.116329 18291 tablet_bootstrap.cc:492] T 1178e2ed919b40f29672fc6233b71cf3 P 982df35c5b554a8fa64807352c4f34ee: Bootstrap starting.
I20251023 07:58:40.118189 18293 tablet_bootstrap.cc:654] T 1178e2ed919b40f29672fc6233b71cf3 P 10dfae53d0c941f08bded43539841761: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:40.121832 18097 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6c529d344cc483a96dbb509ca4c5890" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:40.123725 18291 tablet_bootstrap.cc:654] T 1178e2ed919b40f29672fc6233b71cf3 P 982df35c5b554a8fa64807352c4f34ee: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:40.124147 18293 tablet_bootstrap.cc:492] T 1178e2ed919b40f29672fc6233b71cf3 P 10dfae53d0c941f08bded43539841761: No bootstrap required, opened a new log
I20251023 07:58:40.124677 18293 ts_tablet_manager.cc:1403] T 1178e2ed919b40f29672fc6233b71cf3 P 10dfae53d0c941f08bded43539841761: Time spent bootstrapping tablet: real 0.013s user 0.009s sys 0.000s
I20251023 07:58:40.127058 18292 tablet_bootstrap.cc:492] T 07b28d84c73d42d583d6f80199700309 P b3a1328f9c8c484fab08292ce2171ec9: Bootstrap starting.
I20251023 07:58:40.127535 18293 raft_consensus.cc:359] T 1178e2ed919b40f29672fc6233b71cf3 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.128208 18293 raft_consensus.cc:385] T 1178e2ed919b40f29672fc6233b71cf3 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:40.128444 18293 raft_consensus.cc:740] T 1178e2ed919b40f29672fc6233b71cf3 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Initialized, Role: FOLLOWER
I20251023 07:58:40.129040 18293 consensus_queue.cc:260] T 1178e2ed919b40f29672fc6233b71cf3 P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.131325 18293 ts_tablet_manager.cc:1434] T 1178e2ed919b40f29672fc6233b71cf3 P 10dfae53d0c941f08bded43539841761: Time spent starting tablet: real 0.006s user 0.003s sys 0.004s
I20251023 07:58:40.132242 18293 tablet_bootstrap.cc:492] T 1f437560602a470ca62b7a1fa9471026 P 10dfae53d0c941f08bded43539841761: Bootstrap starting.
I20251023 07:58:40.135815 18292 tablet_bootstrap.cc:654] T 07b28d84c73d42d583d6f80199700309 P b3a1328f9c8c484fab08292ce2171ec9: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:40.138960 18293 tablet_bootstrap.cc:654] T 1f437560602a470ca62b7a1fa9471026 P 10dfae53d0c941f08bded43539841761: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:40.136938 18291 tablet_bootstrap.cc:492] T 1178e2ed919b40f29672fc6233b71cf3 P 982df35c5b554a8fa64807352c4f34ee: No bootstrap required, opened a new log
I20251023 07:58:40.139552 18291 ts_tablet_manager.cc:1403] T 1178e2ed919b40f29672fc6233b71cf3 P 982df35c5b554a8fa64807352c4f34ee: Time spent bootstrapping tablet: real 0.024s user 0.005s sys 0.006s
I20251023 07:58:40.152295 18291 raft_consensus.cc:359] T 1178e2ed919b40f29672fc6233b71cf3 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.154305 18291 raft_consensus.cc:385] T 1178e2ed919b40f29672fc6233b71cf3 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:40.154783 18291 raft_consensus.cc:740] T 1178e2ed919b40f29672fc6233b71cf3 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Initialized, Role: FOLLOWER
I20251023 07:58:40.155838 18291 consensus_queue.cc:260] T 1178e2ed919b40f29672fc6233b71cf3 P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.164341 18291 ts_tablet_manager.cc:1434] T 1178e2ed919b40f29672fc6233b71cf3 P 982df35c5b554a8fa64807352c4f34ee: Time spent starting tablet: real 0.024s user 0.005s sys 0.002s
I20251023 07:58:40.168118 18291 tablet_bootstrap.cc:492] T ce0069d7c0cf4dee84a85731209358f7 P 982df35c5b554a8fa64807352c4f34ee: Bootstrap starting.
I20251023 07:58:40.170734 18292 tablet_bootstrap.cc:492] T 07b28d84c73d42d583d6f80199700309 P b3a1328f9c8c484fab08292ce2171ec9: No bootstrap required, opened a new log
I20251023 07:58:40.171480 18292 ts_tablet_manager.cc:1403] T 07b28d84c73d42d583d6f80199700309 P b3a1328f9c8c484fab08292ce2171ec9: Time spent bootstrapping tablet: real 0.045s user 0.011s sys 0.002s
I20251023 07:58:40.174598 18292 raft_consensus.cc:359] T 07b28d84c73d42d583d6f80199700309 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.175310 18292 raft_consensus.cc:385] T 07b28d84c73d42d583d6f80199700309 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:40.175616 18292 raft_consensus.cc:740] T 07b28d84c73d42d583d6f80199700309 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Initialized, Role: FOLLOWER
I20251023 07:58:40.176115 18293 tablet_bootstrap.cc:492] T 1f437560602a470ca62b7a1fa9471026 P 10dfae53d0c941f08bded43539841761: No bootstrap required, opened a new log
I20251023 07:58:40.176563 18293 ts_tablet_manager.cc:1403] T 1f437560602a470ca62b7a1fa9471026 P 10dfae53d0c941f08bded43539841761: Time spent bootstrapping tablet: real 0.045s user 0.022s sys 0.019s
I20251023 07:58:40.176354 18292 consensus_queue.cc:260] T 07b28d84c73d42d583d6f80199700309 P b3a1328f9c8c484fab08292ce2171ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.178685 18292 ts_tablet_manager.cc:1434] T 07b28d84c73d42d583d6f80199700309 P b3a1328f9c8c484fab08292ce2171ec9: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20251023 07:58:40.178994 18293 raft_consensus.cc:359] T 1f437560602a470ca62b7a1fa9471026 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.179662 18293 raft_consensus.cc:385] T 1f437560602a470ca62b7a1fa9471026 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:40.179785 18291 tablet_bootstrap.cc:654] T ce0069d7c0cf4dee84a85731209358f7 P 982df35c5b554a8fa64807352c4f34ee: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:40.179948 18293 raft_consensus.cc:740] T 1f437560602a470ca62b7a1fa9471026 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Initialized, Role: FOLLOWER
I20251023 07:58:40.180610 18293 consensus_queue.cc:260] T 1f437560602a470ca62b7a1fa9471026 P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.182663 18293 ts_tablet_manager.cc:1434] T 1f437560602a470ca62b7a1fa9471026 P 10dfae53d0c941f08bded43539841761: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20251023 07:58:40.182968 18292 tablet_bootstrap.cc:492] T c6c529d344cc483a96dbb509ca4c5890 P b3a1328f9c8c484fab08292ce2171ec9: Bootstrap starting.
I20251023 07:58:40.183528 18293 tablet_bootstrap.cc:492] T 07b28d84c73d42d583d6f80199700309 P 10dfae53d0c941f08bded43539841761: Bootstrap starting.
W20251023 07:58:40.045111 18142 leader_election.cc:343] T c6c529d344cc483a96dbb509ca4c5890 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Illegal state: must be running to vote when last-logged opid is not known
W20251023 07:58:40.187690 18142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.126.3:46061, user_credentials={real_user=slave}} blocked reactor thread for 142628us
I20251023 07:58:40.189567 18292 tablet_bootstrap.cc:654] T c6c529d344cc483a96dbb509ca4c5890 P b3a1328f9c8c484fab08292ce2171ec9: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:40.189567 18293 tablet_bootstrap.cc:654] T 07b28d84c73d42d583d6f80199700309 P 10dfae53d0c941f08bded43539841761: Neither blocks nor log segments found. Creating new log.
W20251023 07:58:39.978618 18067 leader_election.cc:343] T 1f437560602a470ca62b7a1fa9471026 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:40.190670 18067 leader_election.cc:304] T 1f437560602a470ca62b7a1fa9471026 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3a1328f9c8c484fab08292ce2171ec9; no voters: 10dfae53d0c941f08bded43539841761, 982df35c5b554a8fa64807352c4f34ee
W20251023 07:58:40.191964 18067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.126.3:46061, user_credentials={real_user=slave}} blocked reactor thread for 213872us
I20251023 07:58:40.192983 18067 leader_election.cc:304] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3a1328f9c8c484fab08292ce2171ec9; no voters: 10dfae53d0c941f08bded43539841761, 982df35c5b554a8fa64807352c4f34ee
I20251023 07:58:40.196355 18291 tablet_bootstrap.cc:492] T ce0069d7c0cf4dee84a85731209358f7 P 982df35c5b554a8fa64807352c4f34ee: No bootstrap required, opened a new log
I20251023 07:58:40.197027 18291 ts_tablet_manager.cc:1403] T ce0069d7c0cf4dee84a85731209358f7 P 982df35c5b554a8fa64807352c4f34ee: Time spent bootstrapping tablet: real 0.029s user 0.016s sys 0.006s
I20251023 07:58:40.197118 18300 raft_consensus.cc:2749] T 1f437560602a470ca62b7a1fa9471026 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251023 07:58:40.198361 18143 leader_election.cc:343] T c6c529d344cc483a96dbb509ca4c5890 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:40.200410 18291 raft_consensus.cc:359] T ce0069d7c0cf4dee84a85731209358f7 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.200831 18293 tablet_bootstrap.cc:492] T 07b28d84c73d42d583d6f80199700309 P 10dfae53d0c941f08bded43539841761: No bootstrap required, opened a new log
I20251023 07:58:40.201205 18291 raft_consensus.cc:385] T ce0069d7c0cf4dee84a85731209358f7 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:40.201382 18293 ts_tablet_manager.cc:1403] T 07b28d84c73d42d583d6f80199700309 P 10dfae53d0c941f08bded43539841761: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.012s
I20251023 07:58:40.201588 18291 raft_consensus.cc:740] T ce0069d7c0cf4dee84a85731209358f7 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Initialized, Role: FOLLOWER
I20251023 07:58:40.202350 18291 consensus_queue.cc:260] T ce0069d7c0cf4dee84a85731209358f7 P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.203863 18293 raft_consensus.cc:359] T 07b28d84c73d42d583d6f80199700309 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.204481 18293 raft_consensus.cc:385] T 07b28d84c73d42d583d6f80199700309 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:40.204685 18291 ts_tablet_manager.cc:1434] T ce0069d7c0cf4dee84a85731209358f7 P 982df35c5b554a8fa64807352c4f34ee: Time spent starting tablet: real 0.007s user 0.005s sys 0.001s
I20251023 07:58:40.204751 18293 raft_consensus.cc:740] T 07b28d84c73d42d583d6f80199700309 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Initialized, Role: FOLLOWER
I20251023 07:58:40.206041 18291 tablet_bootstrap.cc:492] T 01f269ca63a8498498956fb3577f35d3 P 982df35c5b554a8fa64807352c4f34ee: Bootstrap starting.
I20251023 07:58:40.206125 18293 consensus_queue.cc:260] T 07b28d84c73d42d583d6f80199700309 P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.208209 18293 ts_tablet_manager.cc:1434] T 07b28d84c73d42d583d6f80199700309 P 10dfae53d0c941f08bded43539841761: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20251023 07:58:40.209057 18293 tablet_bootstrap.cc:492] T 231c8691a471417c859146b4e7b4b440 P 10dfae53d0c941f08bded43539841761: Bootstrap starting.
I20251023 07:58:40.212903 18291 tablet_bootstrap.cc:654] T 01f269ca63a8498498956fb3577f35d3 P 982df35c5b554a8fa64807352c4f34ee: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:40.214888 18293 tablet_bootstrap.cc:654] T 231c8691a471417c859146b4e7b4b440 P 10dfae53d0c941f08bded43539841761: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:40.218114 18143 leader_election.cc:304] T c6c529d344cc483a96dbb509ca4c5890 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10dfae53d0c941f08bded43539841761; no voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9
I20251023 07:58:40.218935 18377 raft_consensus.cc:2749] T c6c529d344cc483a96dbb509ca4c5890 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:58:40.219269 18292 tablet_bootstrap.cc:492] T c6c529d344cc483a96dbb509ca4c5890 P b3a1328f9c8c484fab08292ce2171ec9: No bootstrap required, opened a new log
I20251023 07:58:40.219882 18292 ts_tablet_manager.cc:1403] T c6c529d344cc483a96dbb509ca4c5890 P b3a1328f9c8c484fab08292ce2171ec9: Time spent bootstrapping tablet: real 0.037s user 0.008s sys 0.002s
I20251023 07:58:40.222154 18300 raft_consensus.cc:2749] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20251023 07:58:40.223315 18292 raft_consensus.cc:359] T c6c529d344cc483a96dbb509ca4c5890 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.224084 18292 raft_consensus.cc:385] T c6c529d344cc483a96dbb509ca4c5890 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:40.224359 18292 raft_consensus.cc:740] T c6c529d344cc483a96dbb509ca4c5890 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Initialized, Role: FOLLOWER
I20251023 07:58:40.225065 18292 consensus_queue.cc:260] T c6c529d344cc483a96dbb509ca4c5890 P b3a1328f9c8c484fab08292ce2171ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.233101 18292 ts_tablet_manager.cc:1434] T c6c529d344cc483a96dbb509ca4c5890 P b3a1328f9c8c484fab08292ce2171ec9: Time spent starting tablet: real 0.013s user 0.008s sys 0.001s
I20251023 07:58:40.234476 18292 tablet_bootstrap.cc:492] T a939fd9e853a45d1aa626a4566c14abc P b3a1328f9c8c484fab08292ce2171ec9: Bootstrap starting.
I20251023 07:58:40.237643 18496 raft_consensus.cc:493] T 2d81605b8fe7427b94af7f3c481ed765 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:40.238291 18496 raft_consensus.cc:515] T 2d81605b8fe7427b94af7f3c481ed765 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.240656 18496 leader_election.cc:290] T 2d81605b8fe7427b94af7f3c481ed765 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:40.242542 18292 tablet_bootstrap.cc:654] T a939fd9e853a45d1aa626a4566c14abc P b3a1328f9c8c484fab08292ce2171ec9: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:40.246017 18101 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2d81605b8fe7427b94af7f3c481ed765" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
W20251023 07:58:40.247568 18143 leader_election.cc:343] T 2d81605b8fe7427b94af7f3c481ed765 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:40.254153 18292 tablet_bootstrap.cc:492] T a939fd9e853a45d1aa626a4566c14abc P b3a1328f9c8c484fab08292ce2171ec9: No bootstrap required, opened a new log
I20251023 07:58:40.254860 18292 ts_tablet_manager.cc:1403] T a939fd9e853a45d1aa626a4566c14abc P b3a1328f9c8c484fab08292ce2171ec9: Time spent bootstrapping tablet: real 0.021s user 0.015s sys 0.000s
I20251023 07:58:40.279651 18510 raft_consensus.cc:493] T 1f437560602a470ca62b7a1fa9471026 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:40.280242 18510 raft_consensus.cc:515] T 1f437560602a470ca62b7a1fa9471026 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.217190 17998 catalog_manager.cc:5649] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 982df35c5b554a8fa64807352c4f34ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 982df35c5b554a8fa64807352c4f34ee (127.16.126.3). New cstate: current_term: 1 leader_uuid: "982df35c5b554a8fa64807352c4f34ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: HEALTHY } } }
I20251023 07:58:40.289638 18400 raft_consensus.cc:493] T c6c529d344cc483a96dbb509ca4c5890 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:40.290339 18400 raft_consensus.cc:515] T c6c529d344cc483a96dbb509ca4c5890 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.294793 18400 leader_election.cc:290] T c6c529d344cc483a96dbb509ca4c5890 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:40.299368 18493 raft_consensus.cc:493] T 1178e2ed919b40f29672fc6233b71cf3 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:40.299896 18493 raft_consensus.cc:515] T 1178e2ed919b40f29672fc6233b71cf3 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.301925 18251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2d81605b8fe7427b94af7f3c481ed765" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:40.302601 18251 raft_consensus.cc:2468] T 2d81605b8fe7427b94af7f3c481ed765 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 0.
I20251023 07:58:40.306258 18400 raft_consensus.cc:493] T 07b28d84c73d42d583d6f80199700309 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:40.306521 18174 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "55de6ceb03f343b09190cb2fb4bbe144" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761"
I20251023 07:58:40.307175 18142 leader_election.cc:304] T 2d81605b8fe7427b94af7f3c481ed765 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10dfae53d0c941f08bded43539841761, 982df35c5b554a8fa64807352c4f34ee; no voters: b3a1328f9c8c484fab08292ce2171ec9
I20251023 07:58:40.306946 18400 raft_consensus.cc:515] T 07b28d84c73d42d583d6f80199700309 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.307540 18171 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6c529d344cc483a96dbb509ca4c5890" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:40.308157 18171 raft_consensus.cc:2468] T c6c529d344cc483a96dbb509ca4c5890 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3a1328f9c8c484fab08292ce2171ec9 in term 0.
I20251023 07:58:40.309420 18400 leader_election.cc:290] T 07b28d84c73d42d583d6f80199700309 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:40.314430 18495 raft_consensus.cc:2804] T 2d81605b8fe7427b94af7f3c481ed765 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:58:40.314831 18495 raft_consensus.cc:493] T 2d81605b8fe7427b94af7f3c481ed765 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:40.315232 18495 raft_consensus.cc:3060] T 2d81605b8fe7427b94af7f3c481ed765 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:40.318094 18493 leader_election.cc:290] T 1178e2ed919b40f29672fc6233b71cf3 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:40.319926 18096 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1178e2ed919b40f29672fc6233b71cf3" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:40.321053 18171 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "07b28d84c73d42d583d6f80199700309" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:40.321516 18096 raft_consensus.cc:2468] T 1178e2ed919b40f29672fc6233b71cf3 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 0.
I20251023 07:58:40.321667 18301 raft_consensus.cc:493] T 07b28d84c73d42d583d6f80199700309 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:40.320704 18249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1178e2ed919b40f29672fc6233b71cf3" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:40.307184 18174 raft_consensus.cc:3060] T 55de6ceb03f343b09190cb2fb4bbe144 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:40.323614 18249 raft_consensus.cc:2468] T 1178e2ed919b40f29672fc6233b71cf3 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 0.
I20251023 07:58:40.325398 18292 raft_consensus.cc:359] T a939fd9e853a45d1aa626a4566c14abc P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.326093 18292 raft_consensus.cc:385] T a939fd9e853a45d1aa626a4566c14abc P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:40.326337 18292 raft_consensus.cc:740] T a939fd9e853a45d1aa626a4566c14abc P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Initialized, Role: FOLLOWER
I20251023 07:58:40.327399 18292 consensus_queue.cc:260] T a939fd9e853a45d1aa626a4566c14abc P b3a1328f9c8c484fab08292ce2171ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.328178 18495 raft_consensus.cc:515] T 2d81605b8fe7427b94af7f3c481ed765 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.330425 18495 leader_election.cc:290] T 2d81605b8fe7427b94af7f3c481ed765 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 election: Requested vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:40.330762 18292 ts_tablet_manager.cc:1434] T a939fd9e853a45d1aa626a4566c14abc P b3a1328f9c8c484fab08292ce2171ec9: Time spent starting tablet: real 0.076s user 0.012s sys 0.000s
I20251023 07:58:40.322186 18301 raft_consensus.cc:515] T 07b28d84c73d42d583d6f80199700309 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.331674 18292 tablet_bootstrap.cc:492] T 231c8691a471417c859146b4e7b4b440 P b3a1328f9c8c484fab08292ce2171ec9: Bootstrap starting.
I20251023 07:58:40.331907 18171 raft_consensus.cc:2468] T 07b28d84c73d42d583d6f80199700309 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3a1328f9c8c484fab08292ce2171ec9 in term 0.
I20251023 07:58:40.320663 18066 leader_election.cc:304] T c6c529d344cc483a96dbb509ca4c5890 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:58:40.335892 18300 raft_consensus.cc:2804] T c6c529d344cc483a96dbb509ca4c5890 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:58:40.336133 18066 leader_election.cc:304] T 07b28d84c73d42d583d6f80199700309 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:58:40.336287 18300 raft_consensus.cc:493] T c6c529d344cc483a96dbb509ca4c5890 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:40.336741 18300 raft_consensus.cc:3060] T c6c529d344cc483a96dbb509ca4c5890 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:40.323230 18143 leader_election.cc:304] T 1178e2ed919b40f29672fc6233b71cf3 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:58:40.338745 18292 tablet_bootstrap.cc:654] T 231c8691a471417c859146b4e7b4b440 P b3a1328f9c8c484fab08292ce2171ec9: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:40.339502 18377 raft_consensus.cc:2804] T 1178e2ed919b40f29672fc6233b71cf3 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:58:40.340023 18377 raft_consensus.cc:493] T 1178e2ed919b40f29672fc6233b71cf3 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:40.340374 18377 raft_consensus.cc:3060] T 1178e2ed919b40f29672fc6233b71cf3 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:40.346601 18096 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2d81605b8fe7427b94af7f3c481ed765" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
I20251023 07:58:40.347853 18510 leader_election.cc:290] T 1f437560602a470ca62b7a1fa9471026 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
W20251023 07:58:40.348766 18143 leader_election.cc:343] T 2d81605b8fe7427b94af7f3c481ed765 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:40.350517 18096 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "07b28d84c73d42d583d6f80199700309" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:40.351039 18465 raft_consensus.cc:2804] T 07b28d84c73d42d583d6f80199700309 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:58:40.351580 18465 raft_consensus.cc:493] T 07b28d84c73d42d583d6f80199700309 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:40.352031 18465 raft_consensus.cc:3060] T 07b28d84c73d42d583d6f80199700309 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:40.357837 18171 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1f437560602a470ca62b7a1fa9471026" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:40.359913 18171 raft_consensus.cc:2468] T 1f437560602a470ca62b7a1fa9471026 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 0.
I20251023 07:58:40.361121 18215 leader_election.cc:304] T 1f437560602a470ca62b7a1fa9471026 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, 982df35c5b554a8fa64807352c4f34ee; no voters:
I20251023 07:58:40.364193 18465 raft_consensus.cc:515] T 07b28d84c73d42d583d6f80199700309 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.359053 18301 leader_election.cc:290] T 07b28d84c73d42d583d6f80199700309 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:40.365509 18496 consensus_queue.cc:1048] T 3e4d005972f44619b0cf23f4978f51c4 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:40.370590 18495 consensus_queue.cc:1048] T 3e4d005972f44619b0cf23f4978f51c4 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:58:40.371709 18319 raft_consensus.cc:2804] T 1f437560602a470ca62b7a1fa9471026 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:58:40.372113 18319 raft_consensus.cc:493] T 1f437560602a470ca62b7a1fa9471026 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:40.372478 18319 raft_consensus.cc:3060] T 1f437560602a470ca62b7a1fa9471026 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:40.384500 18247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "07b28d84c73d42d583d6f80199700309" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:40.385826 18248 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "55de6ceb03f343b09190cb2fb4bbe144" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
I20251023 07:58:40.386518 18248 raft_consensus.cc:3060] T 55de6ceb03f343b09190cb2fb4bbe144 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:40.388188 18293 tablet_bootstrap.cc:492] T 231c8691a471417c859146b4e7b4b440 P 10dfae53d0c941f08bded43539841761: No bootstrap required, opened a new log
I20251023 07:58:40.388821 18293 ts_tablet_manager.cc:1403] T 231c8691a471417c859146b4e7b4b440 P 10dfae53d0c941f08bded43539841761: Time spent bootstrapping tablet: real 0.180s user 0.025s sys 0.026s
I20251023 07:58:40.398864 18096 raft_consensus.cc:2393] T 07b28d84c73d42d583d6f80199700309 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10dfae53d0c941f08bded43539841761 in current term 1: Already voted for candidate b3a1328f9c8c484fab08292ce2171ec9 in this term.
I20251023 07:58:40.395606 17999 catalog_manager.cc:5649] T ce0069d7c0cf4dee84a85731209358f7 P 10dfae53d0c941f08bded43539841761 reported cstate change: term changed from 0 to 1, leader changed from <none> to 10dfae53d0c941f08bded43539841761 (127.16.126.2). New cstate: current_term: 1 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } }
I20251023 07:58:40.405584 18400 raft_consensus.cc:493] T f90cf0955288472898eff5b7e6459195 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:40.406086 18400 raft_consensus.cc:515] T f90cf0955288472898eff5b7e6459195 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.406394 18495 raft_consensus.cc:493] T a83dfc7a7d784b52b9c74bbc451ad603 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3a1328f9c8c484fab08292ce2171ec9)
I20251023 07:58:40.406610 18344 raft_consensus.cc:493] T 01f269ca63a8498498956fb3577f35d3 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:40.407090 18495 raft_consensus.cc:515] T a83dfc7a7d784b52b9c74bbc451ad603 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.407991 18400 leader_election.cc:290] T f90cf0955288472898eff5b7e6459195 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:40.407114 18344 raft_consensus.cc:515] T 01f269ca63a8498498956fb3577f35d3 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.411695 18344 leader_election.cc:290] T 01f269ca63a8498498956fb3577f35d3 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:40.415695 18249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2d81605b8fe7427b94af7f3c481ed765" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
I20251023 07:58:40.416302 18249 raft_consensus.cc:3060] T 2d81605b8fe7427b94af7f3c481ed765 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Advancing to term 1
W20251023 07:58:40.417730 18142 leader_election.cc:343] T 07b28d84c73d42d583d6f80199700309 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:40.418196 18142 leader_election.cc:304] T 07b28d84c73d42d583d6f80199700309 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10dfae53d0c941f08bded43539841761; no voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9
I20251023 07:58:40.420387 18377 raft_consensus.cc:515] T 1178e2ed919b40f29672fc6233b71cf3 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.420840 18291 tablet_bootstrap.cc:492] T 01f269ca63a8498498956fb3577f35d3 P 982df35c5b554a8fa64807352c4f34ee: No bootstrap required, opened a new log
I20251023 07:58:40.421339 18291 ts_tablet_manager.cc:1403] T 01f269ca63a8498498956fb3577f35d3 P 982df35c5b554a8fa64807352c4f34ee: Time spent bootstrapping tablet: real 0.216s user 0.045s sys 0.058s
I20251023 07:58:40.367621 18300 raft_consensus.cc:515] T c6c529d344cc483a96dbb509ca4c5890 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.429816 18377 leader_election.cc:290] T 1178e2ed919b40f29672fc6233b71cf3 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 election: Requested vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:40.430238 18291 raft_consensus.cc:359] T 01f269ca63a8498498956fb3577f35d3 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.430915 18291 raft_consensus.cc:385] T 01f269ca63a8498498956fb3577f35d3 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:40.431195 18291 raft_consensus.cc:740] T 01f269ca63a8498498956fb3577f35d3 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Initialized, Role: FOLLOWER
I20251023 07:58:40.431711 18098 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1178e2ed919b40f29672fc6233b71cf3" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
I20251023 07:58:40.431860 18291 consensus_queue.cc:260] T 01f269ca63a8498498956fb3577f35d3 P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.432317 18098 raft_consensus.cc:3060] T 1178e2ed919b40f29672fc6233b71cf3 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:40.423177 18496 raft_consensus.cc:3060] T 07b28d84c73d42d583d6f80199700309 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:40.392879 18174 raft_consensus.cc:2468] T 55de6ceb03f343b09190cb2fb4bbe144 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3a1328f9c8c484fab08292ce2171ec9 in term 1.
I20251023 07:58:40.441975 18172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f90cf0955288472898eff5b7e6459195" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:40.444039 18100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a83dfc7a7d784b52b9c74bbc451ad603" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:40.444746 18100 raft_consensus.cc:2468] T a83dfc7a7d784b52b9c74bbc451ad603 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 2.
I20251023 07:58:40.445827 18143 leader_election.cc:304] T a83dfc7a7d784b52b9c74bbc451ad603 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:58:40.503681 18293 raft_consensus.cc:359] T 231c8691a471417c859146b4e7b4b440 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.504890 18293 raft_consensus.cc:385] T 231c8691a471417c859146b4e7b4b440 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:40.505280 18293 raft_consensus.cc:740] T 231c8691a471417c859146b4e7b4b440 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Initialized, Role: FOLLOWER
I20251023 07:58:40.506346 18293 consensus_queue.cc:260] T 231c8691a471417c859146b4e7b4b440 P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.460855 18300 leader_election.cc:290] T c6c529d344cc483a96dbb509ca4c5890 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 election: Requested vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:40.530035 18291 ts_tablet_manager.cc:1434] T 01f269ca63a8498498956fb3577f35d3 P 982df35c5b554a8fa64807352c4f34ee: Time spent starting tablet: real 0.108s user 0.009s sys 0.000s
I20251023 07:58:40.531534 18291 tablet_bootstrap.cc:492] T 231c8691a471417c859146b4e7b4b440 P 982df35c5b554a8fa64807352c4f34ee: Bootstrap starting.
I20251023 07:58:40.447271 18465 leader_election.cc:290] T 07b28d84c73d42d583d6f80199700309 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 election: Requested vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:40.446666 18377 raft_consensus.cc:2804] T a83dfc7a7d784b52b9c74bbc451ad603 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251023 07:58:40.465034 18100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1f437560602a470ca62b7a1fa9471026" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:40.469885 18250 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a83dfc7a7d784b52b9c74bbc451ad603" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:40.449205 18390 consensus_queue.cc:1048] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.088s
I20251023 07:58:40.539045 18377 raft_consensus.cc:493] T a83dfc7a7d784b52b9c74bbc451ad603 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b3a1328f9c8c484fab08292ce2171ec9)
I20251023 07:58:40.539523 18377 raft_consensus.cc:3060] T a83dfc7a7d784b52b9c74bbc451ad603 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:58:40.541790 18100 raft_consensus.cc:2468] T 1f437560602a470ca62b7a1fa9471026 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 0.
I20251023 07:58:40.455230 18249 raft_consensus.cc:2468] T 2d81605b8fe7427b94af7f3c481ed765 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 1.
I20251023 07:58:40.542009 18250 raft_consensus.cc:2393] T a83dfc7a7d784b52b9c74bbc451ad603 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10dfae53d0c941f08bded43539841761 in current term 2: Already voted for candidate 982df35c5b554a8fa64807352c4f34ee in this term.
I20251023 07:58:40.543524 18292 tablet_bootstrap.cc:492] T 231c8691a471417c859146b4e7b4b440 P b3a1328f9c8c484fab08292ce2171ec9: No bootstrap required, opened a new log
I20251023 07:58:40.544071 18292 ts_tablet_manager.cc:1403] T 231c8691a471417c859146b4e7b4b440 P b3a1328f9c8c484fab08292ce2171ec9: Time spent bootstrapping tablet: real 0.213s user 0.041s sys 0.048s
I20251023 07:58:40.456871 18496 raft_consensus.cc:2749] T 07b28d84c73d42d583d6f80199700309 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251023 07:58:40.446648 18066 leader_election.cc:343] T f90cf0955288472898eff5b7e6459195 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:40.481312 18510 raft_consensus.cc:493] T ce0069d7c0cf4dee84a85731209358f7 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:40.498543 18248 raft_consensus.cc:2468] T 55de6ceb03f343b09190cb2fb4bbe144 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3a1328f9c8c484fab08292ce2171ec9 in term 1.
I20251023 07:58:40.452725 18495 leader_election.cc:290] T a83dfc7a7d784b52b9c74bbc451ad603 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:40.465035 18098 raft_consensus.cc:2468] T 1178e2ed919b40f29672fc6233b71cf3 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 1.
I20251023 07:58:40.562749 18143 leader_election.cc:304] T 1178e2ed919b40f29672fc6233b71cf3 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:58:40.546711 18142 leader_election.cc:304] T 2d81605b8fe7427b94af7f3c481ed765 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10dfae53d0c941f08bded43539841761, 982df35c5b554a8fa64807352c4f34ee; no voters: b3a1328f9c8c484fab08292ce2171ec9
I20251023 07:58:40.564034 18494 raft_consensus.cc:2804] T 1178e2ed919b40f29672fc6233b71cf3 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:58:40.564532 18494 raft_consensus.cc:697] T 1178e2ed919b40f29672fc6233b71cf3 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Becoming Leader. State: Replica: 10dfae53d0c941f08bded43539841761, State: Running, Role: LEADER
I20251023 07:58:40.564652 18301 raft_consensus.cc:2804] T 2d81605b8fe7427b94af7f3c481ed765 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:58:40.565128 18301 raft_consensus.cc:697] T 2d81605b8fe7427b94af7f3c481ed765 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Becoming Leader. State: Replica: 10dfae53d0c941f08bded43539841761, State: Running, Role: LEADER
I20251023 07:58:40.550704 18250 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6c529d344cc483a96dbb509ca4c5890" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
W20251023 07:58:40.557950 18066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.126.2:45799, user_credentials={real_user=slave}} blocked reactor thread for 111320us
I20251023 07:58:40.483500 18319 raft_consensus.cc:515] T 1f437560602a470ca62b7a1fa9471026 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.559545 18249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "07b28d84c73d42d583d6f80199700309" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:40.560140 18496 raft_consensus.cc:493] T 231c8691a471417c859146b4e7b4b440 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:40.564265 18292 raft_consensus.cc:359] T 231c8691a471417c859146b4e7b4b440 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.577937 18292 raft_consensus.cc:385] T 231c8691a471417c859146b4e7b4b440 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:40.578244 18292 raft_consensus.cc:740] T 231c8691a471417c859146b4e7b4b440 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Initialized, Role: FOLLOWER
I20251023 07:58:40.460094 18251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1178e2ed919b40f29672fc6233b71cf3" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
I20251023 07:58:40.561699 18293 ts_tablet_manager.cc:1434] T 231c8691a471417c859146b4e7b4b440 P 10dfae53d0c941f08bded43539841761: Time spent starting tablet: real 0.173s user 0.003s sys 0.028s
I20251023 07:58:40.566470 18510 raft_consensus.cc:515] T ce0069d7c0cf4dee84a85731209358f7 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.566915 18301 consensus_queue.cc:237] T 2d81605b8fe7427b94af7f3c481ed765 P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.565454 18494 consensus_queue.cc:237] T 1178e2ed919b40f29672fc6233b71cf3 P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.570201 18465 raft_consensus.cc:493] T a939fd9e853a45d1aa626a4566c14abc P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20251023 07:58:40.574690 18048 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20251023 07:58:40.578851 18292 consensus_queue.cc:260] T 231c8691a471417c859146b4e7b4b440 P b3a1328f9c8c484fab08292ce2171ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.590137 18293 tablet_bootstrap.cc:492] T c8b2781a072e401dba80e2879748e681 P 10dfae53d0c941f08bded43539841761: Bootstrap starting.
I20251023 07:58:40.590843 18251 raft_consensus.cc:3060] T 1178e2ed919b40f29672fc6233b71cf3 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:40.568209 18377 raft_consensus.cc:515] T a83dfc7a7d784b52b9c74bbc451ad603 P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.589205 18496 raft_consensus.cc:515] T 231c8691a471417c859146b4e7b4b440 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.593377 18246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f90cf0955288472898eff5b7e6459195" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:40.608078 18377 leader_election.cc:290] T a83dfc7a7d784b52b9c74bbc451ad603 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 2 election: Requested vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:40.613107 18098 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a83dfc7a7d784b52b9c74bbc451ad603" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
I20251023 07:58:40.593492 18465 raft_consensus.cc:515] T a939fd9e853a45d1aa626a4566c14abc P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.614675 18067 leader_election.cc:304] T 55de6ceb03f343b09190cb2fb4bbe144 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:58:40.615465 18292 ts_tablet_manager.cc:1434] T 231c8691a471417c859146b4e7b4b440 P b3a1328f9c8c484fab08292ce2171ec9: Time spent starting tablet: real 0.071s user 0.009s sys 0.007s
I20251023 07:58:40.615680 18465 leader_election.cc:290] T a939fd9e853a45d1aa626a4566c14abc P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:40.616429 18292 tablet_bootstrap.cc:492] T 732495dddec64a3aa196110bfda45b37 P b3a1328f9c8c484fab08292ce2171ec9: Bootstrap starting.
I20251023 07:58:40.618382 18251 raft_consensus.cc:2468] T 1178e2ed919b40f29672fc6233b71cf3 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 1.
I20251023 07:58:40.620117 18300 raft_consensus.cc:2804] T 55de6ceb03f343b09190cb2fb4bbe144 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:58:40.620173 18248 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "07b28d84c73d42d583d6f80199700309" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
I20251023 07:58:40.620738 18300 raft_consensus.cc:697] T 55de6ceb03f343b09190cb2fb4bbe144 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Becoming Leader. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Running, Role: LEADER
I20251023 07:58:40.632110 18291 tablet_bootstrap.cc:654] T 231c8691a471417c859146b4e7b4b440 P 982df35c5b554a8fa64807352c4f34ee: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:40.621027 18510 leader_election.cc:290] T ce0069d7c0cf4dee84a85731209358f7 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:58:40.628360 18246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01f269ca63a8498498956fb3577f35d3" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:40.642477 18246 raft_consensus.cc:2468] T 01f269ca63a8498498956fb3577f35d3 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3a1328f9c8c484fab08292ce2171ec9 in term 0.
I20251023 07:58:40.628036 18248 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a83dfc7a7d784b52b9c74bbc451ad603" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
I20251023 07:58:40.646138 18248 raft_consensus.cc:2393] T a83dfc7a7d784b52b9c74bbc451ad603 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 10dfae53d0c941f08bded43539841761 in current term 2: Already voted for candidate 982df35c5b554a8fa64807352c4f34ee in this term.
I20251023 07:58:40.646906 18300 consensus_queue.cc:237] T 55de6ceb03f343b09190cb2fb4bbe144 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.649945 18247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6c529d344cc483a96dbb509ca4c5890" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
W20251023 07:58:40.643246 18067 leader_election.cc:343] T 07b28d84c73d42d583d6f80199700309 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Illegal state: must be running to vote when last-logged opid is not known
W20251023 07:58:40.655859 18067 leader_election.cc:343] T c6c529d344cc483a96dbb509ca4c5890 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:40.658973 18319 leader_election.cc:290] T 1f437560602a470ca62b7a1fa9471026 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 election: Requested vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:58:40.662726 18098 raft_consensus.cc:2468] T a83dfc7a7d784b52b9c74bbc451ad603 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 2.
I20251023 07:58:40.664783 18143 leader_election.cc:304] T a83dfc7a7d784b52b9c74bbc451ad603 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9; no voters: 982df35c5b554a8fa64807352c4f34ee
I20251023 07:58:40.666157 18495 raft_consensus.cc:2804] T a83dfc7a7d784b52b9c74bbc451ad603 P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:58:40.672437 18495 raft_consensus.cc:697] T a83dfc7a7d784b52b9c74bbc451ad603 P 10dfae53d0c941f08bded43539841761 [term 2 LEADER]: Becoming Leader. State: Replica: 10dfae53d0c941f08bded43539841761, State: Running, Role: LEADER
W20251023 07:58:40.673821 18067 leader_election.cc:343] T f90cf0955288472898eff5b7e6459195 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:40.673651 18495 consensus_queue.cc:237] T a83dfc7a7d784b52b9c74bbc451ad603 P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.674265 18067 leader_election.cc:304] T f90cf0955288472898eff5b7e6459195 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3a1328f9c8c484fab08292ce2171ec9; no voters: 10dfae53d0c941f08bded43539841761, 982df35c5b554a8fa64807352c4f34ee
I20251023 07:58:40.674923 18545 raft_consensus.cc:2749] T f90cf0955288472898eff5b7e6459195 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251023 07:58:40.675933 18067 leader_election.cc:343] T 07b28d84c73d42d583d6f80199700309 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:40.677579 18067 leader_election.cc:304] T 01f269ca63a8498498956fb3577f35d3 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9; no voters:
W20251023 07:58:40.681277 18067 leader_election.cc:343] T c6c529d344cc483a96dbb509ca4c5890 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:40.682842 18247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a939fd9e853a45d1aa626a4566c14abc" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:40.685117 18545 raft_consensus.cc:2804] T 01f269ca63a8498498956fb3577f35d3 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:58:40.691967 18100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce0069d7c0cf4dee84a85731209358f7" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:40.693107 18100 raft_consensus.cc:2393] T ce0069d7c0cf4dee84a85731209358f7 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 982df35c5b554a8fa64807352c4f34ee in current term 1: Already voted for candidate 10dfae53d0c941f08bded43539841761 in this term.
I20251023 07:58:40.685681 18545 raft_consensus.cc:493] T 01f269ca63a8498498956fb3577f35d3 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:40.694363 18545 raft_consensus.cc:3060] T 01f269ca63a8498498956fb3577f35d3 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Advancing to term 1
W20251023 07:58:40.697369 18067 leader_election.cc:343] T a939fd9e853a45d1aa626a4566c14abc P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:40.689126 18496 leader_election.cc:290] T 231c8691a471417c859146b4e7b4b440 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:40.697636 18100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "231c8691a471417c859146b4e7b4b440" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:40.702759 18101 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1f437560602a470ca62b7a1fa9471026" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
I20251023 07:58:40.702852 18100 raft_consensus.cc:2468] T 231c8691a471417c859146b4e7b4b440 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 0.
I20251023 07:58:40.703464 18101 raft_consensus.cc:3060] T 1f437560602a470ca62b7a1fa9471026 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:40.704034 18143 leader_election.cc:304] T 231c8691a471417c859146b4e7b4b440 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:58:40.710829 18247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "231c8691a471417c859146b4e7b4b440" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:40.711993 18174 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01f269ca63a8498498956fb3577f35d3" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
W20251023 07:58:40.712200 18142 leader_election.cc:343] T 231c8691a471417c859146b4e7b4b440 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:40.719463 18292 tablet_bootstrap.cc:654] T 732495dddec64a3aa196110bfda45b37 P b3a1328f9c8c484fab08292ce2171ec9: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:40.721684 18319 consensus_queue.cc:1048] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:40.723148 18291 tablet_bootstrap.cc:492] T 231c8691a471417c859146b4e7b4b440 P 982df35c5b554a8fa64807352c4f34ee: No bootstrap required, opened a new log
I20251023 07:58:40.720732 17999 catalog_manager.cc:5649] T 55de6ceb03f343b09190cb2fb4bbe144 P b3a1328f9c8c484fab08292ce2171ec9 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1). New cstate: current_term: 1 leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } }
I20251023 07:58:40.723615 18291 ts_tablet_manager.cc:1403] T 231c8691a471417c859146b4e7b4b440 P 982df35c5b554a8fa64807352c4f34ee: Time spent bootstrapping tablet: real 0.192s user 0.015s sys 0.028s
I20251023 07:58:40.706849 18496 raft_consensus.cc:2804] T 231c8691a471417c859146b4e7b4b440 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:58:40.730836 18319 raft_consensus.cc:493] T a83dfc7a7d784b52b9c74bbc451ad603 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:40.731314 18319 raft_consensus.cc:515] T a83dfc7a7d784b52b9c74bbc451ad603 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.727777 18496 raft_consensus.cc:493] T 231c8691a471417c859146b4e7b4b440 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:40.735069 18100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a83dfc7a7d784b52b9c74bbc451ad603" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:40.744475 18101 raft_consensus.cc:2468] T 1f437560602a470ca62b7a1fa9471026 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 1.
I20251023 07:58:40.749550 18217 leader_election.cc:304] T 1f437560602a470ca62b7a1fa9471026 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:58:40.750350 18515 raft_consensus.cc:2804] T 1f437560602a470ca62b7a1fa9471026 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:58:40.750653 18494 consensus_queue.cc:1048] T ce0069d7c0cf4dee84a85731209358f7 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:40.750859 18515 raft_consensus.cc:697] T 1f437560602a470ca62b7a1fa9471026 P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Becoming Leader. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Running, Role: LEADER
I20251023 07:58:40.752660 18293 tablet_bootstrap.cc:654] T c8b2781a072e401dba80e2879748e681 P 10dfae53d0c941f08bded43539841761: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:40.734133 18319 leader_election.cc:290] T a83dfc7a7d784b52b9c74bbc451ad603 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:58:40.751953 18515 consensus_queue.cc:237] T 1f437560602a470ca62b7a1fa9471026 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.757732 18247 raft_consensus.cc:3060] T ce0069d7c0cf4dee84a85731209358f7 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Advancing to term 1
W20251023 07:58:40.735615 18066 leader_election.cc:343] T 01f269ca63a8498498956fb3577f35d3 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:40.759410 18100 raft_consensus.cc:2410] T a83dfc7a7d784b52b9c74bbc451ad603 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 982df35c5b554a8fa64807352c4f34ee for term 3 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20251023 07:58:40.761096 18291 raft_consensus.cc:359] T 231c8691a471417c859146b4e7b4b440 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.770088 18291 raft_consensus.cc:385] T 231c8691a471417c859146b4e7b4b440 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:40.771118 18175 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce0069d7c0cf4dee84a85731209358f7" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:40.770421 18291 raft_consensus.cc:740] T 231c8691a471417c859146b4e7b4b440 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Initialized, Role: FOLLOWER
I20251023 07:58:40.752589 18496 raft_consensus.cc:3060] T 231c8691a471417c859146b4e7b4b440 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:40.776222 18291 consensus_queue.cc:260] T 231c8691a471417c859146b4e7b4b440 P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.784405 18291 ts_tablet_manager.cc:1434] T 231c8691a471417c859146b4e7b4b440 P 982df35c5b554a8fa64807352c4f34ee: Time spent starting tablet: real 0.060s user 0.005s sys 0.001s
I20251023 07:58:40.790361 18172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1f437560602a470ca62b7a1fa9471026" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761"
I20251023 07:58:40.791134 18172 raft_consensus.cc:3060] T 1f437560602a470ca62b7a1fa9471026 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Advancing to term 1
W20251023 07:58:40.788625 18066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.126.2:45799, user_credentials={real_user=slave}} blocked reactor thread for 52534.2us
I20251023 07:58:40.795568 18494 consensus_queue.cc:1048] T ce0069d7c0cf4dee84a85731209358f7 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:58:40.798409 18172 raft_consensus.cc:2468] T 1f437560602a470ca62b7a1fa9471026 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 1.
I20251023 07:58:40.742367 18545 raft_consensus.cc:515] T 01f269ca63a8498498956fb3577f35d3 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.802155 18291 tablet_bootstrap.cc:492] T 07b28d84c73d42d583d6f80199700309 P 982df35c5b554a8fa64807352c4f34ee: Bootstrap starting.
I20251023 07:58:40.806175 18177 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a83dfc7a7d784b52b9c74bbc451ad603" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:40.806633 18496 raft_consensus.cc:515] T 231c8691a471417c859146b4e7b4b440 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.804955 18510 raft_consensus.cc:493] T 231c8691a471417c859146b4e7b4b440 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:40.809252 18172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "07b28d84c73d42d583d6f80199700309" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761"
I20251023 07:58:40.809244 18510 raft_consensus.cc:515] T 231c8691a471417c859146b4e7b4b440 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.811264 18510 leader_election.cc:290] T 231c8691a471417c859146b4e7b4b440 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:58:40.812285 18100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "231c8691a471417c859146b4e7b4b440" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:40.812975 18100 raft_consensus.cc:2468] T 231c8691a471417c859146b4e7b4b440 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 0.
I20251023 07:58:40.818554 18217 leader_election.cc:304] T 231c8691a471417c859146b4e7b4b440 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:58:40.819422 18500 raft_consensus.cc:2804] T 231c8691a471417c859146b4e7b4b440 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:58:40.819607 18246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01f269ca63a8498498956fb3577f35d3" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
I20251023 07:58:40.820231 18246 raft_consensus.cc:3060] T 01f269ca63a8498498956fb3577f35d3 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:40.819794 18500 raft_consensus.cc:493] T 231c8691a471417c859146b4e7b4b440 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:40.825795 18500 raft_consensus.cc:3060] T 231c8691a471417c859146b4e7b4b440 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:40.828229 18293 tablet_bootstrap.cc:492] T c8b2781a072e401dba80e2879748e681 P 10dfae53d0c941f08bded43539841761: No bootstrap required, opened a new log
I20251023 07:58:40.829260 18293 ts_tablet_manager.cc:1403] T c8b2781a072e401dba80e2879748e681 P 10dfae53d0c941f08bded43539841761: Time spent bootstrapping tablet: real 0.240s user 0.018s sys 0.004s
I20251023 07:58:40.830452 18292 tablet_bootstrap.cc:492] T 732495dddec64a3aa196110bfda45b37 P b3a1328f9c8c484fab08292ce2171ec9: No bootstrap required, opened a new log
I20251023 07:58:40.830825 18292 ts_tablet_manager.cc:1403] T 732495dddec64a3aa196110bfda45b37 P b3a1328f9c8c484fab08292ce2171ec9: Time spent bootstrapping tablet: real 0.215s user 0.003s sys 0.014s
I20251023 07:58:40.835642 18176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6c529d344cc483a96dbb509ca4c5890" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761"
I20251023 07:58:40.836302 18176 raft_consensus.cc:3060] T c6c529d344cc483a96dbb509ca4c5890 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:40.842449 18172 raft_consensus.cc:2468] T 07b28d84c73d42d583d6f80199700309 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3a1328f9c8c484fab08292ce2171ec9 in term 1.
I20251023 07:58:40.827365 18545 leader_election.cc:290] T 01f269ca63a8498498956fb3577f35d3 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 election: Requested vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:40.843722 18292 raft_consensus.cc:359] T 732495dddec64a3aa196110bfda45b37 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.845113 18292 raft_consensus.cc:385] T 732495dddec64a3aa196110bfda45b37 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:40.845403 18292 raft_consensus.cc:740] T 732495dddec64a3aa196110bfda45b37 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Initialized, Role: FOLLOWER
I20251023 07:58:40.846207 18292 consensus_queue.cc:260] T 732495dddec64a3aa196110bfda45b37 P b3a1328f9c8c484fab08292ce2171ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.848747 18292 ts_tablet_manager.cc:1434] T 732495dddec64a3aa196110bfda45b37 P b3a1328f9c8c484fab08292ce2171ec9: Time spent starting tablet: real 0.018s user 0.006s sys 0.000s
I20251023 07:58:40.849699 18292 tablet_bootstrap.cc:492] T 2d81605b8fe7427b94af7f3c481ed765 P b3a1328f9c8c484fab08292ce2171ec9: Bootstrap starting.
I20251023 07:58:40.849843 18098 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "231c8691a471417c859146b4e7b4b440" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
I20251023 07:58:40.850423 18098 raft_consensus.cc:3060] T 231c8691a471417c859146b4e7b4b440 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:40.850562 18177 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a939fd9e853a45d1aa626a4566c14abc" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:40.851656 18000 catalog_manager.cc:5649] T 1f437560602a470ca62b7a1fa9471026 P 982df35c5b554a8fa64807352c4f34ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 982df35c5b554a8fa64807352c4f34ee (127.16.126.3). New cstate: current_term: 1 leader_uuid: "982df35c5b554a8fa64807352c4f34ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: HEALTHY } } }
I20251023 07:58:40.855340 18248 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "231c8691a471417c859146b4e7b4b440" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
I20251023 07:58:40.855542 18215 leader_election.cc:304] T ce0069d7c0cf4dee84a85731209358f7 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee; no voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9
I20251023 07:58:40.858424 18496 leader_election.cc:290] T 231c8691a471417c859146b4e7b4b440 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 election: Requested vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:40.858665 18171 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "231c8691a471417c859146b4e7b4b440" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:40.859462 18171 raft_consensus.cc:2393] T 231c8691a471417c859146b4e7b4b440 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 982df35c5b554a8fa64807352c4f34ee in current term 1: Already voted for candidate 10dfae53d0c941f08bded43539841761 in this term.
I20251023 07:58:40.859331 18066 leader_election.cc:304] T 07b28d84c73d42d583d6f80199700309 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9; no voters: 982df35c5b554a8fa64807352c4f34ee
I20251023 07:58:40.860705 18300 raft_consensus.cc:2804] T 07b28d84c73d42d583d6f80199700309 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:58:40.866402 18098 raft_consensus.cc:2468] T 231c8691a471417c859146b4e7b4b440 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 1.
I20251023 07:58:40.868773 18143 leader_election.cc:304] T 231c8691a471417c859146b4e7b4b440 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:58:40.862437 18300 raft_consensus.cc:697] T 07b28d84c73d42d583d6f80199700309 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Becoming Leader. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Running, Role: LEADER
I20251023 07:58:40.869671 18493 raft_consensus.cc:2804] T 231c8691a471417c859146b4e7b4b440 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:58:40.870013 18293 raft_consensus.cc:359] T c8b2781a072e401dba80e2879748e681 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.870138 18300 consensus_queue.cc:237] T 07b28d84c73d42d583d6f80199700309 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.870815 18293 raft_consensus.cc:385] T c8b2781a072e401dba80e2879748e681 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20251023 07:58:40.870956 18066 leader_election.cc:343] T a939fd9e853a45d1aa626a4566c14abc P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:40.871250 18293 raft_consensus.cc:740] T c8b2781a072e401dba80e2879748e681 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Initialized, Role: FOLLOWER
I20251023 07:58:40.871426 18066 leader_election.cc:304] T a939fd9e853a45d1aa626a4566c14abc P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3a1328f9c8c484fab08292ce2171ec9; no voters: 10dfae53d0c941f08bded43539841761, 982df35c5b554a8fa64807352c4f34ee
I20251023 07:58:40.872084 18293 consensus_queue.cc:260] T c8b2781a072e401dba80e2879748e681 P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.874818 18505 raft_consensus.cc:2749] T a939fd9e853a45d1aa626a4566c14abc P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:58:40.870159 18493 raft_consensus.cc:697] T 231c8691a471417c859146b4e7b4b440 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Becoming Leader. State: Replica: 10dfae53d0c941f08bded43539841761, State: Running, Role: LEADER
I20251023 07:58:40.875849 18172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01f269ca63a8498498956fb3577f35d3" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761"
I20251023 07:58:40.877231 18215 leader_election.cc:304] T a83dfc7a7d784b52b9c74bbc451ad603 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee; no voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9
I20251023 07:58:40.878309 18246 raft_consensus.cc:2468] T 01f269ca63a8498498956fb3577f35d3 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3a1328f9c8c484fab08292ce2171ec9 in term 1.
I20251023 07:58:40.876215 18493 consensus_queue.cc:237] T 231c8691a471417c859146b4e7b4b440 P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.879914 18500 raft_consensus.cc:515] T 231c8691a471417c859146b4e7b4b440 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.880362 18510 raft_consensus.cc:2749] T a83dfc7a7d784b52b9c74bbc451ad603 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251023 07:58:40.884848 18248 raft_consensus.cc:2393] T 231c8691a471417c859146b4e7b4b440 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 10dfae53d0c941f08bded43539841761 in current term 1: Already voted for candidate 982df35c5b554a8fa64807352c4f34ee in this term.
I20251023 07:58:40.889566 18098 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "231c8691a471417c859146b4e7b4b440" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
I20251023 07:58:40.890558 18098 raft_consensus.cc:2393] T 231c8691a471417c859146b4e7b4b440 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 982df35c5b554a8fa64807352c4f34ee in current term 1: Already voted for candidate 10dfae53d0c941f08bded43539841761 in this term.
I20251023 07:58:40.896945 18500 leader_election.cc:290] T 231c8691a471417c859146b4e7b4b440 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 election: Requested vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
W20251023 07:58:40.898101 18066 leader_election.cc:343] T 01f269ca63a8498498956fb3577f35d3 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:40.899459 18293 ts_tablet_manager.cc:1434] T c8b2781a072e401dba80e2879748e681 P 10dfae53d0c941f08bded43539841761: Time spent starting tablet: real 0.070s user 0.005s sys 0.002s
I20251023 07:58:40.900292 18293 tablet_bootstrap.cc:492] T 7a0f3569fcc34ba8b721d4ca9f31b6fa P 10dfae53d0c941f08bded43539841761: Bootstrap starting.
I20251023 07:58:40.901181 18390 raft_consensus.cc:2749] T ce0069d7c0cf4dee84a85731209358f7 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:58:40.902536 18067 leader_election.cc:304] T 01f269ca63a8498498956fb3577f35d3 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9; no voters: 10dfae53d0c941f08bded43539841761
I20251023 07:58:40.903590 18545 raft_consensus.cc:2804] T 01f269ca63a8498498956fb3577f35d3 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:58:40.904047 18545 raft_consensus.cc:697] T 01f269ca63a8498498956fb3577f35d3 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Becoming Leader. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Running, Role: LEADER
I20251023 07:58:40.904598 18291 tablet_bootstrap.cc:654] T 07b28d84c73d42d583d6f80199700309 P 982df35c5b554a8fa64807352c4f34ee: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:40.904866 18545 consensus_queue.cc:237] T 01f269ca63a8498498956fb3577f35d3 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.920632 18171 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "231c8691a471417c859146b4e7b4b440" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761"
I20251023 07:58:40.923056 18215 leader_election.cc:304] T 231c8691a471417c859146b4e7b4b440 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee; no voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9
I20251023 07:58:40.924757 18390 raft_consensus.cc:2749] T 231c8691a471417c859146b4e7b4b440 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20251023 07:58:40.934129 18000 catalog_manager.cc:5649] T 1178e2ed919b40f29672fc6233b71cf3 P 10dfae53d0c941f08bded43539841761 reported cstate change: term changed from 0 to 1, leader changed from <none> to 10dfae53d0c941f08bded43539841761 (127.16.126.2). New cstate: current_term: 1 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } }
I20251023 07:58:40.935838 18000 catalog_manager.cc:5649] T 2d81605b8fe7427b94af7f3c481ed765 P 10dfae53d0c941f08bded43539841761 reported cstate change: term changed from 0 to 1, leader changed from <none> to 10dfae53d0c941f08bded43539841761 (127.16.126.2). New cstate: current_term: 1 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } }
I20251023 07:58:40.937054 18292 tablet_bootstrap.cc:654] T 2d81605b8fe7427b94af7f3c481ed765 P b3a1328f9c8c484fab08292ce2171ec9: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:40.937554 18000 catalog_manager.cc:5649] T a83dfc7a7d784b52b9c74bbc451ad603 P 10dfae53d0c941f08bded43539841761 reported cstate change: term changed from 1 to 2, leader changed from b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1) to 10dfae53d0c941f08bded43539841761 (127.16.126.2). New cstate: current_term: 2 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } }
I20251023 07:58:40.940564 17998 catalog_manager.cc:5649] T 07b28d84c73d42d583d6f80199700309 P b3a1328f9c8c484fab08292ce2171ec9 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1). New cstate: current_term: 1 leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } }
I20251023 07:58:40.942162 18291 tablet_bootstrap.cc:492] T 07b28d84c73d42d583d6f80199700309 P 982df35c5b554a8fa64807352c4f34ee: No bootstrap required, opened a new log
I20251023 07:58:40.942546 18291 ts_tablet_manager.cc:1403] T 07b28d84c73d42d583d6f80199700309 P 982df35c5b554a8fa64807352c4f34ee: Time spent bootstrapping tablet: real 0.157s user 0.009s sys 0.003s
I20251023 07:58:40.932840 18176 raft_consensus.cc:2468] T c6c529d344cc483a96dbb509ca4c5890 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3a1328f9c8c484fab08292ce2171ec9 in term 1.
I20251023 07:58:40.953369 18293 tablet_bootstrap.cc:654] T 7a0f3569fcc34ba8b721d4ca9f31b6fa P 10dfae53d0c941f08bded43539841761: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:40.953701 18066 leader_election.cc:304] T c6c529d344cc483a96dbb509ca4c5890 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9; no voters: 982df35c5b554a8fa64807352c4f34ee
I20251023 07:58:40.959473 18545 raft_consensus.cc:2804] T c6c529d344cc483a96dbb509ca4c5890 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:58:40.960021 18545 raft_consensus.cc:697] T c6c529d344cc483a96dbb509ca4c5890 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Becoming Leader. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Running, Role: LEADER
I20251023 07:58:40.960907 18545 consensus_queue.cc:237] T c6c529d344cc483a96dbb509ca4c5890 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.980865 18293 tablet_bootstrap.cc:492] T 7a0f3569fcc34ba8b721d4ca9f31b6fa P 10dfae53d0c941f08bded43539841761: No bootstrap required, opened a new log
I20251023 07:58:40.981381 18293 ts_tablet_manager.cc:1403] T 7a0f3569fcc34ba8b721d4ca9f31b6fa P 10dfae53d0c941f08bded43539841761: Time spent bootstrapping tablet: real 0.081s user 0.009s sys 0.003s
I20251023 07:58:40.984004 18293 raft_consensus.cc:359] T 7a0f3569fcc34ba8b721d4ca9f31b6fa P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.984511 18293 raft_consensus.cc:385] T 7a0f3569fcc34ba8b721d4ca9f31b6fa P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:40.984732 18293 raft_consensus.cc:740] T 7a0f3569fcc34ba8b721d4ca9f31b6fa P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Initialized, Role: FOLLOWER
I20251023 07:58:40.985284 18293 consensus_queue.cc:260] T 7a0f3569fcc34ba8b721d4ca9f31b6fa P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.986974 18293 ts_tablet_manager.cc:1434] T 7a0f3569fcc34ba8b721d4ca9f31b6fa P 10dfae53d0c941f08bded43539841761: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20251023 07:58:40.986591 18291 raft_consensus.cc:359] T 07b28d84c73d42d583d6f80199700309 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.987290 18291 raft_consensus.cc:385] T 07b28d84c73d42d583d6f80199700309 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:40.987505 18291 raft_consensus.cc:740] T 07b28d84c73d42d583d6f80199700309 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Initialized, Role: FOLLOWER
I20251023 07:58:40.987391 17998 catalog_manager.cc:5649] T 231c8691a471417c859146b4e7b4b440 P 10dfae53d0c941f08bded43539841761 reported cstate change: term changed from 0 to 1, leader changed from <none> to 10dfae53d0c941f08bded43539841761 (127.16.126.2). New cstate: current_term: 1 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } }
I20251023 07:58:40.989543 18293 tablet_bootstrap.cc:492] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P 10dfae53d0c941f08bded43539841761: Bootstrap starting.
I20251023 07:58:40.990092 18291 consensus_queue.cc:260] T 07b28d84c73d42d583d6f80199700309 P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:40.996603 18291 ts_tablet_manager.cc:1434] T 07b28d84c73d42d583d6f80199700309 P 982df35c5b554a8fa64807352c4f34ee: Time spent starting tablet: real 0.054s user 0.005s sys 0.002s
W20251023 07:58:40.997315 18143 consensus_peers.cc:597] T 2d81605b8fe7427b94af7f3c481ed765 P 10dfae53d0c941f08bded43539841761 -> Peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): Couldn't send request to peer b3a1328f9c8c484fab08292ce2171ec9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:58:40.998708 18496 consensus_queue.cc:1048] T 2d81605b8fe7427b94af7f3c481ed765 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:41.001355 18291 tablet_bootstrap.cc:492] T c6c529d344cc483a96dbb509ca4c5890 P 982df35c5b554a8fa64807352c4f34ee: Bootstrap starting.
I20251023 07:58:41.011097 18292 tablet_bootstrap.cc:492] T 2d81605b8fe7427b94af7f3c481ed765 P b3a1328f9c8c484fab08292ce2171ec9: No bootstrap required, opened a new log
I20251023 07:58:41.011682 18292 ts_tablet_manager.cc:1403] T 2d81605b8fe7427b94af7f3c481ed765 P b3a1328f9c8c484fab08292ce2171ec9: Time spent bootstrapping tablet: real 0.162s user 0.006s sys 0.011s
I20251023 07:58:41.014784 18292 raft_consensus.cc:359] T 2d81605b8fe7427b94af7f3c481ed765 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:41.015519 18292 raft_consensus.cc:385] T 2d81605b8fe7427b94af7f3c481ed765 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:41.015810 18292 raft_consensus.cc:740] T 2d81605b8fe7427b94af7f3c481ed765 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Initialized, Role: FOLLOWER
I20251023 07:58:41.016494 18292 consensus_queue.cc:260] T 2d81605b8fe7427b94af7f3c481ed765 P b3a1328f9c8c484fab08292ce2171ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:41.018842 18292 ts_tablet_manager.cc:1434] T 2d81605b8fe7427b94af7f3c481ed765 P b3a1328f9c8c484fab08292ce2171ec9: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20251023 07:58:41.021796 18293 tablet_bootstrap.cc:654] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P 10dfae53d0c941f08bded43539841761: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:41.022094 18291 tablet_bootstrap.cc:654] T c6c529d344cc483a96dbb509ca4c5890 P 982df35c5b554a8fa64807352c4f34ee: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:41.022377 18292 tablet_bootstrap.cc:492] T e25fd146cb564be69022d0f53010bbfa P b3a1328f9c8c484fab08292ce2171ec9: Bootstrap starting.
I20251023 07:58:41.025141 17999 catalog_manager.cc:5649] T 01f269ca63a8498498956fb3577f35d3 P b3a1328f9c8c484fab08292ce2171ec9 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1). New cstate: current_term: 1 leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } }
I20251023 07:58:41.036034 17999 catalog_manager.cc:5649] T c6c529d344cc483a96dbb509ca4c5890 P b3a1328f9c8c484fab08292ce2171ec9 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1). New cstate: current_term: 1 leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } }
I20251023 07:58:41.045578 18496 raft_consensus.cc:493] T c8b2781a072e401dba80e2879748e681 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:41.046129 18496 raft_consensus.cc:515] T c8b2781a072e401dba80e2879748e681 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:41.048098 18496 leader_election.cc:290] T c8b2781a072e401dba80e2879748e681 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:41.048584 18496 consensus_queue.cc:1048] T 1178e2ed919b40f29672fc6233b71cf3 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:41.050909 18100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c8b2781a072e401dba80e2879748e681" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:41.051926 18292 tablet_bootstrap.cc:654] T e25fd146cb564be69022d0f53010bbfa P b3a1328f9c8c484fab08292ce2171ec9: Neither blocks nor log segments found. Creating new log.
W20251023 07:58:41.052946 18143 leader_election.cc:343] T c8b2781a072e401dba80e2879748e681 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:41.055575 18247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c8b2781a072e401dba80e2879748e681" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
W20251023 07:58:41.060287 18142 leader_election.cc:343] T c8b2781a072e401dba80e2879748e681 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:41.060771 18142 leader_election.cc:304] T c8b2781a072e401dba80e2879748e681 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10dfae53d0c941f08bded43539841761; no voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9
I20251023 07:58:41.063758 18293 tablet_bootstrap.cc:492] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P 10dfae53d0c941f08bded43539841761: No bootstrap required, opened a new log
I20251023 07:58:41.064429 18293 ts_tablet_manager.cc:1403] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P 10dfae53d0c941f08bded43539841761: Time spent bootstrapping tablet: real 0.075s user 0.012s sys 0.005s
I20251023 07:58:41.065071 18496 raft_consensus.cc:2749] T c8b2781a072e401dba80e2879748e681 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:58:41.069190 18291 tablet_bootstrap.cc:492] T c6c529d344cc483a96dbb509ca4c5890 P 982df35c5b554a8fa64807352c4f34ee: No bootstrap required, opened a new log
I20251023 07:58:41.068408 18293 raft_consensus.cc:359] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:41.074239 18293 raft_consensus.cc:385] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:41.074652 18293 raft_consensus.cc:740] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Initialized, Role: FOLLOWER
I20251023 07:58:41.069703 18291 ts_tablet_manager.cc:1403] T c6c529d344cc483a96dbb509ca4c5890 P 982df35c5b554a8fa64807352c4f34ee: Time spent bootstrapping tablet: real 0.069s user 0.023s sys 0.004s
I20251023 07:58:41.077760 18293 consensus_queue.cc:260] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:41.080459 18293 ts_tablet_manager.cc:1434] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P 10dfae53d0c941f08bded43539841761: Time spent starting tablet: real 0.016s user 0.005s sys 0.003s
I20251023 07:58:41.081370 18291 raft_consensus.cc:359] T c6c529d344cc483a96dbb509ca4c5890 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:41.082305 18291 raft_consensus.cc:385] T c6c529d344cc483a96dbb509ca4c5890 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:41.082615 18291 raft_consensus.cc:740] T c6c529d344cc483a96dbb509ca4c5890 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Initialized, Role: FOLLOWER
I20251023 07:58:41.084143 18291 consensus_queue.cc:260] T c6c529d344cc483a96dbb509ca4c5890 P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:41.084765 18377 consensus_queue.cc:1048] T 1178e2ed919b40f29672fc6233b71cf3 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:41.083530 18293 tablet_bootstrap.cc:492] T 33ee36de303b458e88fa6bad4587c0e6 P 10dfae53d0c941f08bded43539841761: Bootstrap starting.
I20251023 07:58:41.091820 18293 tablet_bootstrap.cc:654] T 33ee36de303b458e88fa6bad4587c0e6 P 10dfae53d0c941f08bded43539841761: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:41.093056 18291 ts_tablet_manager.cc:1434] T c6c529d344cc483a96dbb509ca4c5890 P 982df35c5b554a8fa64807352c4f34ee: Time spent starting tablet: real 0.018s user 0.000s sys 0.006s
I20251023 07:58:41.094159 18291 tablet_bootstrap.cc:492] T 33ee36de303b458e88fa6bad4587c0e6 P 982df35c5b554a8fa64807352c4f34ee: Bootstrap starting.
I20251023 07:58:41.101850 18390 raft_consensus.cc:493] T c6c529d344cc483a96dbb509ca4c5890 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:41.102502 18390 raft_consensus.cc:515] T c6c529d344cc483a96dbb509ca4c5890 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:41.105708 18098 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6c529d344cc483a96dbb509ca4c5890" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:41.107013 18291 tablet_bootstrap.cc:654] T 33ee36de303b458e88fa6bad4587c0e6 P 982df35c5b554a8fa64807352c4f34ee: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:41.110355 18390 leader_election.cc:290] T c6c529d344cc483a96dbb509ca4c5890 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:58:41.114945 18545 consensus_queue.cc:1048] T 55de6ceb03f343b09190cb2fb4bbe144 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:58:41.117086 18292 tablet_bootstrap.cc:492] T e25fd146cb564be69022d0f53010bbfa P b3a1328f9c8c484fab08292ce2171ec9: No bootstrap required, opened a new log
I20251023 07:58:41.117632 18292 ts_tablet_manager.cc:1403] T e25fd146cb564be69022d0f53010bbfa P b3a1328f9c8c484fab08292ce2171ec9: Time spent bootstrapping tablet: real 0.095s user 0.006s sys 0.012s
I20251023 07:58:41.116794 18172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6c529d344cc483a96dbb509ca4c5890" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:41.120996 18172 raft_consensus.cc:2393] T c6c529d344cc483a96dbb509ca4c5890 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 982df35c5b554a8fa64807352c4f34ee in current term 1: Already voted for candidate b3a1328f9c8c484fab08292ce2171ec9 in this term.
I20251023 07:58:41.122299 18215 leader_election.cc:304] T c6c529d344cc483a96dbb509ca4c5890 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee; no voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9
I20251023 07:58:41.123620 18390 raft_consensus.cc:3060] T c6c529d344cc483a96dbb509ca4c5890 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:41.132365 18292 raft_consensus.cc:359] T e25fd146cb564be69022d0f53010bbfa P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:41.133071 18293 tablet_bootstrap.cc:492] T 33ee36de303b458e88fa6bad4587c0e6 P 10dfae53d0c941f08bded43539841761: No bootstrap required, opened a new log
I20251023 07:58:41.133811 18293 ts_tablet_manager.cc:1403] T 33ee36de303b458e88fa6bad4587c0e6 P 10dfae53d0c941f08bded43539841761: Time spent bootstrapping tablet: real 0.050s user 0.015s sys 0.000s
I20251023 07:58:41.133078 18292 raft_consensus.cc:385] T e25fd146cb564be69022d0f53010bbfa P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:41.134768 18292 raft_consensus.cc:740] T e25fd146cb564be69022d0f53010bbfa P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Initialized, Role: FOLLOWER
I20251023 07:58:41.140344 18390 raft_consensus.cc:2749] T c6c529d344cc483a96dbb509ca4c5890 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:58:41.158938 18291 tablet_bootstrap.cc:492] T 33ee36de303b458e88fa6bad4587c0e6 P 982df35c5b554a8fa64807352c4f34ee: No bootstrap required, opened a new log
I20251023 07:58:41.159447 18291 ts_tablet_manager.cc:1403] T 33ee36de303b458e88fa6bad4587c0e6 P 982df35c5b554a8fa64807352c4f34ee: Time spent bootstrapping tablet: real 0.065s user 0.012s sys 0.015s
I20251023 07:58:41.158967 18293 raft_consensus.cc:359] T 33ee36de303b458e88fa6bad4587c0e6 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:41.161562 18293 raft_consensus.cc:385] T 33ee36de303b458e88fa6bad4587c0e6 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:41.161118 18292 consensus_queue.cc:260] T e25fd146cb564be69022d0f53010bbfa P b3a1328f9c8c484fab08292ce2171ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:41.165573 18291 raft_consensus.cc:359] T 33ee36de303b458e88fa6bad4587c0e6 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:41.168184 18291 raft_consensus.cc:385] T 33ee36de303b458e88fa6bad4587c0e6 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:41.168511 18291 raft_consensus.cc:740] T 33ee36de303b458e88fa6bad4587c0e6 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Initialized, Role: FOLLOWER
I20251023 07:58:41.169312 18291 consensus_queue.cc:260] T 33ee36de303b458e88fa6bad4587c0e6 P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:41.172533 18246 raft_consensus.cc:1275] T a83dfc7a7d784b52b9c74bbc451ad603 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:58:41.174336 18291 ts_tablet_manager.cc:1434] T 33ee36de303b458e88fa6bad4587c0e6 P 982df35c5b554a8fa64807352c4f34ee: Time spent starting tablet: real 0.015s user 0.009s sys 0.000s
I20251023 07:58:41.176285 18292 ts_tablet_manager.cc:1434] T e25fd146cb564be69022d0f53010bbfa P b3a1328f9c8c484fab08292ce2171ec9: Time spent starting tablet: real 0.058s user 0.004s sys 0.003s
I20251023 07:58:41.177214 18292 tablet_bootstrap.cc:492] T 7a0f3569fcc34ba8b721d4ca9f31b6fa P b3a1328f9c8c484fab08292ce2171ec9: Bootstrap starting.
I20251023 07:58:41.178068 18377 consensus_queue.cc:1048] T a83dfc7a7d784b52b9c74bbc451ad603 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:41.180914 18545 consensus_queue.cc:1048] T 55de6ceb03f343b09190cb2fb4bbe144 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:41.182866 18545 raft_consensus.cc:493] T 2d81605b8fe7427b94af7f3c481ed765 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:41.183305 18545 raft_consensus.cc:515] T 2d81605b8fe7427b94af7f3c481ed765 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:41.183881 18292 tablet_bootstrap.cc:654] T 7a0f3569fcc34ba8b721d4ca9f31b6fa P b3a1328f9c8c484fab08292ce2171ec9: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:41.185930 18172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2d81605b8fe7427b94af7f3c481ed765" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:41.187500 18291 tablet_bootstrap.cc:492] T 732495dddec64a3aa196110bfda45b37 P 982df35c5b554a8fa64807352c4f34ee: Bootstrap starting.
I20251023 07:58:41.192431 18098 raft_consensus.cc:1275] T a83dfc7a7d784b52b9c74bbc451ad603 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:58:41.194438 18496 consensus_queue.cc:1048] T a83dfc7a7d784b52b9c74bbc451ad603 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:41.161859 18293 raft_consensus.cc:740] T 33ee36de303b458e88fa6bad4587c0e6 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Initialized, Role: FOLLOWER
I20251023 07:58:41.197456 18545 leader_election.cc:290] T 2d81605b8fe7427b94af7f3c481ed765 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:41.198081 18293 consensus_queue.cc:260] T 33ee36de303b458e88fa6bad4587c0e6 P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:41.202065 18248 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2d81605b8fe7427b94af7f3c481ed765" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:41.203708 18545 raft_consensus.cc:493] T 732495dddec64a3aa196110bfda45b37 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:41.203802 18067 leader_election.cc:304] T 2d81605b8fe7427b94af7f3c481ed765 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3a1328f9c8c484fab08292ce2171ec9; no voters: 10dfae53d0c941f08bded43539841761, 982df35c5b554a8fa64807352c4f34ee
I20251023 07:58:41.204227 18545 raft_consensus.cc:515] T 732495dddec64a3aa196110bfda45b37 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:41.204577 18465 raft_consensus.cc:2749] T 2d81605b8fe7427b94af7f3c481ed765 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:58:41.207820 18172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "732495dddec64a3aa196110bfda45b37" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:41.208472 18172 raft_consensus.cc:2468] T 732495dddec64a3aa196110bfda45b37 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3a1328f9c8c484fab08292ce2171ec9 in term 0.
I20251023 07:58:41.210121 18066 leader_election.cc:304] T 732495dddec64a3aa196110bfda45b37 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:58:41.210672 18293 ts_tablet_manager.cc:1434] T 33ee36de303b458e88fa6bad4587c0e6 P 10dfae53d0c941f08bded43539841761: Time spent starting tablet: real 0.077s user 0.014s sys 0.000s
I20251023 07:58:41.211006 18300 raft_consensus.cc:2804] T 732495dddec64a3aa196110bfda45b37 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:58:41.211375 18300 raft_consensus.cc:493] T 732495dddec64a3aa196110bfda45b37 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:41.211702 18300 raft_consensus.cc:3060] T 732495dddec64a3aa196110bfda45b37 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:41.215999 18545 leader_election.cc:290] T 732495dddec64a3aa196110bfda45b37 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:41.217087 18248 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "732495dddec64a3aa196110bfda45b37" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
W20251023 07:58:41.218823 18067 leader_election.cc:343] T 732495dddec64a3aa196110bfda45b37 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:41.222003 18300 raft_consensus.cc:515] T 732495dddec64a3aa196110bfda45b37 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:41.224535 18176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "732495dddec64a3aa196110bfda45b37" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761"
I20251023 07:58:41.225095 18176 raft_consensus.cc:3060] T 732495dddec64a3aa196110bfda45b37 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:41.226584 18292 tablet_bootstrap.cc:492] T 7a0f3569fcc34ba8b721d4ca9f31b6fa P b3a1328f9c8c484fab08292ce2171ec9: No bootstrap required, opened a new log
I20251023 07:58:41.227065 18292 ts_tablet_manager.cc:1403] T 7a0f3569fcc34ba8b721d4ca9f31b6fa P b3a1328f9c8c484fab08292ce2171ec9: Time spent bootstrapping tablet: real 0.050s user 0.011s sys 0.007s
I20251023 07:58:41.229609 18292 raft_consensus.cc:359] T 7a0f3569fcc34ba8b721d4ca9f31b6fa P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:41.230279 18292 raft_consensus.cc:385] T 7a0f3569fcc34ba8b721d4ca9f31b6fa P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:41.230552 18292 raft_consensus.cc:740] T 7a0f3569fcc34ba8b721d4ca9f31b6fa P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Initialized, Role: FOLLOWER
I20251023 07:58:41.231249 18292 consensus_queue.cc:260] T 7a0f3569fcc34ba8b721d4ca9f31b6fa P b3a1328f9c8c484fab08292ce2171ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:41.232821 18292 ts_tablet_manager.cc:1434] T 7a0f3569fcc34ba8b721d4ca9f31b6fa P b3a1328f9c8c484fab08292ce2171ec9: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20251023 07:58:41.237965 18247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "732495dddec64a3aa196110bfda45b37" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
I20251023 07:58:41.238126 18496 raft_consensus.cc:493] T 33ee36de303b458e88fa6bad4587c0e6 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:41.211694 18293 tablet_bootstrap.cc:492] T f90cf0955288472898eff5b7e6459195 P 10dfae53d0c941f08bded43539841761: Bootstrap starting.
I20251023 07:58:41.250895 18291 tablet_bootstrap.cc:654] T 732495dddec64a3aa196110bfda45b37 P 982df35c5b554a8fa64807352c4f34ee: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:41.244954 18176 raft_consensus.cc:2468] T 732495dddec64a3aa196110bfda45b37 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3a1328f9c8c484fab08292ce2171ec9 in term 1.
I20251023 07:58:41.238770 18495 raft_consensus.cc:493] T 7a0f3569fcc34ba8b721d4ca9f31b6fa P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:41.255791 18293 tablet_bootstrap.cc:654] T f90cf0955288472898eff5b7e6459195 P 10dfae53d0c941f08bded43539841761: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:41.266121 18495 raft_consensus.cc:515] T 7a0f3569fcc34ba8b721d4ca9f31b6fa P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:41.238078 18300 leader_election.cc:290] T 732495dddec64a3aa196110bfda45b37 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 election: Requested vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:41.257946 18496 raft_consensus.cc:515] T 33ee36de303b458e88fa6bad4587c0e6 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
W20251023 07:58:41.258275 18067 leader_election.cc:343] T 732495dddec64a3aa196110bfda45b37 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:41.259629 18292 tablet_bootstrap.cc:492] T 063924334ed846f3bd41c36cc4651236 P b3a1328f9c8c484fab08292ce2171ec9: Bootstrap starting.
I20251023 07:58:41.270288 18066 leader_election.cc:304] T 732495dddec64a3aa196110bfda45b37 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9; no voters: 982df35c5b554a8fa64807352c4f34ee
I20251023 07:58:41.271899 18545 raft_consensus.cc:2804] T 732495dddec64a3aa196110bfda45b37 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:58:41.272392 18545 raft_consensus.cc:697] T 732495dddec64a3aa196110bfda45b37 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Becoming Leader. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Running, Role: LEADER
I20251023 07:58:41.273128 18100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7a0f3569fcc34ba8b721d4ca9f31b6fa" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:41.273275 18545 consensus_queue.cc:237] T 732495dddec64a3aa196110bfda45b37 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:41.273984 18100 raft_consensus.cc:2468] T 7a0f3569fcc34ba8b721d4ca9f31b6fa P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 0.
I20251023 07:58:41.275171 18143 leader_election.cc:304] T 7a0f3569fcc34ba8b721d4ca9f31b6fa P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:58:41.272183 18500 consensus_queue.cc:1048] T 1f437560602a470ca62b7a1fa9471026 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:41.277316 18377 raft_consensus.cc:2804] T 7a0f3569fcc34ba8b721d4ca9f31b6fa P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:58:41.277699 18377 raft_consensus.cc:493] T 7a0f3569fcc34ba8b721d4ca9f31b6fa P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:41.278026 18377 raft_consensus.cc:3060] T 7a0f3569fcc34ba8b721d4ca9f31b6fa P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:41.282658 18247 raft_consensus.cc:3060] T 07b28d84c73d42d583d6f80199700309 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:41.288583 18292 tablet_bootstrap.cc:654] T 063924334ed846f3bd41c36cc4651236 P b3a1328f9c8c484fab08292ce2171ec9: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:41.297214 18495 leader_election.cc:290] T 7a0f3569fcc34ba8b721d4ca9f31b6fa P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:41.298122 18494 raft_consensus.cc:493] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:41.298605 18494 raft_consensus.cc:515] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:41.299603 18246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7a0f3569fcc34ba8b721d4ca9f31b6fa" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:41.301116 18494 leader_election.cc:290] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:41.302672 18098 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3e78cdb4b2af4f5a855ec00a07f2cbc9" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
W20251023 07:58:41.304160 18143 leader_election.cc:343] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): Illegal state: must be running to vote when last-logged opid is not known
W20251023 07:58:41.305757 18142 leader_election.cc:343] T 7a0f3569fcc34ba8b721d4ca9f31b6fa P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:41.306461 18246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3e78cdb4b2af4f5a855ec00a07f2cbc9" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:41.308117 18465 consensus_queue.cc:1048] T 01f269ca63a8498498956fb3577f35d3 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251023 07:58:41.308961 18142 leader_election.cc:343] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:41.309420 18142 leader_election.cc:304] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10dfae53d0c941f08bded43539841761; no voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9
W20251023 07:58:41.310405 18198 debug-util.cc:398] Leaking SignalData structure 0x7b0800164f60 after lost signal to thread 16891
W20251023 07:58:41.311391 18198 debug-util.cc:398] Leaking SignalData structure 0x7b080009f640 after lost signal to thread 18034
W20251023 07:58:41.312588 18198 debug-util.cc:398] Leaking SignalData structure 0x7b08000dda00 after lost signal to thread 18126
W20251023 07:58:41.313927 18198 debug-util.cc:398] Leaking SignalData structure 0x7b08001c8fe0 after lost signal to thread 18201
W20251023 07:58:41.315053 18198 debug-util.cc:398] Leaking SignalData structure 0x7b08002332a0 after lost signal to thread 18275
I20251023 07:58:41.320813 18301 raft_consensus.cc:2749] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251023 07:58:41.325871 18066 consensus_peers.cc:597] T 01f269ca63a8498498956fb3577f35d3 P b3a1328f9c8c484fab08292ce2171ec9 -> Peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Couldn't send request to peer 10dfae53d0c941f08bded43539841761. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:58:41.326285 18100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "33ee36de303b458e88fa6bad4587c0e6" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
W20251023 07:58:41.328227 18143 leader_election.cc:343] T 33ee36de303b458e88fa6bad4587c0e6 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:41.330046 18495 consensus_queue.cc:1048] T 231c8691a471417c859146b4e7b4b440 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:41.335175 18377 raft_consensus.cc:515] T 7a0f3569fcc34ba8b721d4ca9f31b6fa P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:41.338613 18494 consensus_queue.cc:1048] T 231c8691a471417c859146b4e7b4b440 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:58:41.341944 18465 consensus_queue.cc:1048] T 07b28d84c73d42d583d6f80199700309 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:41.343499 18248 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "33ee36de303b458e88fa6bad4587c0e6" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:41.344153 18248 raft_consensus.cc:2468] T 33ee36de303b458e88fa6bad4587c0e6 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 0.
I20251023 07:58:41.325465 18496 leader_election.cc:290] T 33ee36de303b458e88fa6bad4587c0e6 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:41.370409 18142 leader_election.cc:304] T 33ee36de303b458e88fa6bad4587c0e6 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10dfae53d0c941f08bded43539841761, 982df35c5b554a8fa64807352c4f34ee; no voters: b3a1328f9c8c484fab08292ce2171ec9
I20251023 07:58:41.372943 18547 raft_consensus.cc:2804] T 33ee36de303b458e88fa6bad4587c0e6 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:58:41.373310 18547 raft_consensus.cc:493] T 33ee36de303b458e88fa6bad4587c0e6 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:41.373667 18547 raft_consensus.cc:3060] T 33ee36de303b458e88fa6bad4587c0e6 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:41.460611 18293 tablet_bootstrap.cc:492] T f90cf0955288472898eff5b7e6459195 P 10dfae53d0c941f08bded43539841761: No bootstrap required, opened a new log
I20251023 07:58:41.461907 18293 ts_tablet_manager.cc:1403] T f90cf0955288472898eff5b7e6459195 P 10dfae53d0c941f08bded43539841761: Time spent bootstrapping tablet: real 0.250s user 0.011s sys 0.007s
I20251023 07:58:41.457938 18545 consensus_queue.cc:1048] T 07b28d84c73d42d583d6f80199700309 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20251023 07:58:41.462142 18589 consensus_queue.cc:1048] T c6c529d344cc483a96dbb509ca4c5890 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20251023 07:58:41.466477 18292 tablet_bootstrap.cc:492] T 063924334ed846f3bd41c36cc4651236 P b3a1328f9c8c484fab08292ce2171ec9: No bootstrap required, opened a new log
I20251023 07:58:41.466997 18292 ts_tablet_manager.cc:1403] T 063924334ed846f3bd41c36cc4651236 P b3a1328f9c8c484fab08292ce2171ec9: Time spent bootstrapping tablet: real 0.208s user 0.015s sys 0.019s
I20251023 07:58:41.467372 18377 leader_election.cc:290] T 7a0f3569fcc34ba8b721d4ca9f31b6fa P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 election: Requested vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:41.443878 18500 consensus_queue.cc:1048] T 1f437560602a470ca62b7a1fa9471026 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20251023 07:58:41.466578 18390 raft_consensus.cc:493] T 07b28d84c73d42d583d6f80199700309 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:41.473450 18292 raft_consensus.cc:359] T 063924334ed846f3bd41c36cc4651236 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:41.478283 18292 raft_consensus.cc:385] T 063924334ed846f3bd41c36cc4651236 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:41.478562 18292 raft_consensus.cc:740] T 063924334ed846f3bd41c36cc4651236 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Initialized, Role: FOLLOWER
I20251023 07:58:41.480440 18100 raft_consensus.cc:3060] T 2d81605b8fe7427b94af7f3c481ed765 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:41.475692 18098 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7a0f3569fcc34ba8b721d4ca9f31b6fa" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
I20251023 07:58:41.485836 18098 raft_consensus.cc:3060] T 7a0f3569fcc34ba8b721d4ca9f31b6fa P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:41.477905 18390 raft_consensus.cc:515] T 07b28d84c73d42d583d6f80199700309 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:41.491850 18390 leader_election.cc:290] T 07b28d84c73d42d583d6f80199700309 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:58:41.492620 18096 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "07b28d84c73d42d583d6f80199700309" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:41.485445 18293 raft_consensus.cc:359] T f90cf0955288472898eff5b7e6459195 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:41.494505 18292 consensus_queue.cc:260] T 063924334ed846f3bd41c36cc4651236 P b3a1328f9c8c484fab08292ce2171ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:41.494946 18293 raft_consensus.cc:385] T f90cf0955288472898eff5b7e6459195 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:41.497967 18293 raft_consensus.cc:740] T f90cf0955288472898eff5b7e6459195 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Initialized, Role: FOLLOWER
I20251023 07:58:41.508455 17999 catalog_manager.cc:5649] T 732495dddec64a3aa196110bfda45b37 P b3a1328f9c8c484fab08292ce2171ec9 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1). New cstate: current_term: 1 leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } }
I20251023 07:58:41.510596 18176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "07b28d84c73d42d583d6f80199700309" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:41.510690 18293 consensus_queue.cc:260] T f90cf0955288472898eff5b7e6459195 P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:41.489104 18547 raft_consensus.cc:515] T 33ee36de303b458e88fa6bad4587c0e6 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:41.514874 18292 ts_tablet_manager.cc:1434] T 063924334ed846f3bd41c36cc4651236 P b3a1328f9c8c484fab08292ce2171ec9: Time spent starting tablet: real 0.048s user 0.007s sys 0.000s
I20251023 07:58:41.515908 18292 tablet_bootstrap.cc:492] T 33ee36de303b458e88fa6bad4587c0e6 P b3a1328f9c8c484fab08292ce2171ec9: Bootstrap starting.
I20251023 07:58:41.515988 18246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7a0f3569fcc34ba8b721d4ca9f31b6fa" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
I20251023 07:58:41.519908 18505 raft_consensus.cc:493] T e25fd146cb564be69022d0f53010bbfa P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:41.520398 18505 raft_consensus.cc:515] T e25fd146cb564be69022d0f53010bbfa P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:41.509806 18098 raft_consensus.cc:2468] T 7a0f3569fcc34ba8b721d4ca9f31b6fa P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 1.
I20251023 07:58:41.525420 18099 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "33ee36de303b458e88fa6bad4587c0e6" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
I20251023 07:58:41.525941 18291 tablet_bootstrap.cc:492] T 732495dddec64a3aa196110bfda45b37 P 982df35c5b554a8fa64807352c4f34ee: No bootstrap required, opened a new log
I20251023 07:58:41.526389 18291 ts_tablet_manager.cc:1403] T 732495dddec64a3aa196110bfda45b37 P 982df35c5b554a8fa64807352c4f34ee: Time spent bootstrapping tablet: real 0.339s user 0.051s sys 0.088s
I20251023 07:58:41.529951 18547 leader_election.cc:290] T 33ee36de303b458e88fa6bad4587c0e6 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 election: Requested vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:41.530066 18215 leader_election.cc:304] T 07b28d84c73d42d583d6f80199700309 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee; no voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9
I20251023 07:58:41.540383 18505 leader_election.cc:290] T e25fd146cb564be69022d0f53010bbfa P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:41.541035 18589 consensus_queue.cc:1048] T c6c529d344cc483a96dbb509ca4c5890 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:58:41.543448 18293 ts_tablet_manager.cc:1434] T f90cf0955288472898eff5b7e6459195 P 10dfae53d0c941f08bded43539841761: Time spent starting tablet: real 0.081s user 0.006s sys 0.000s
W20251023 07:58:41.543830 18143 leader_election.cc:343] T 33ee36de303b458e88fa6bad4587c0e6 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:41.544596 18293 tablet_bootstrap.cc:492] T 063924334ed846f3bd41c36cc4651236 P 10dfae53d0c941f08bded43539841761: Bootstrap starting.
I20251023 07:58:41.544808 18143 leader_election.cc:304] T 7a0f3569fcc34ba8b721d4ca9f31b6fa P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:58:41.547591 18494 raft_consensus.cc:2804] T 7a0f3569fcc34ba8b721d4ca9f31b6fa P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:58:41.548184 18494 raft_consensus.cc:697] T 7a0f3569fcc34ba8b721d4ca9f31b6fa P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Becoming Leader. State: Replica: 10dfae53d0c941f08bded43539841761, State: Running, Role: LEADER
I20251023 07:58:41.552984 18291 raft_consensus.cc:359] T 732495dddec64a3aa196110bfda45b37 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:41.553539 18291 raft_consensus.cc:385] T 732495dddec64a3aa196110bfda45b37 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:41.553828 18291 raft_consensus.cc:740] T 732495dddec64a3aa196110bfda45b37 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Initialized, Role: FOLLOWER
I20251023 07:58:41.561391 18494 consensus_queue.cc:237] T 7a0f3569fcc34ba8b721d4ca9f31b6fa P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:41.564834 18176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e25fd146cb564be69022d0f53010bbfa" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:41.557439 18291 consensus_queue.cc:260] T 732495dddec64a3aa196110bfda45b37 P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:41.566161 18251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "33ee36de303b458e88fa6bad4587c0e6" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
I20251023 07:58:41.566727 18251 raft_consensus.cc:3060] T 33ee36de303b458e88fa6bad4587c0e6 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:41.576138 18251 raft_consensus.cc:2468] T 33ee36de303b458e88fa6bad4587c0e6 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 1.
W20251023 07:58:41.570317 18142 leader_election.cc:343] T 7a0f3569fcc34ba8b721d4ca9f31b6fa P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Illegal state: must be running to vote when last-logged opid is not known
W20251023 07:58:41.579232 18066 leader_election.cc:343] T e25fd146cb564be69022d0f53010bbfa P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:41.611275 18291 ts_tablet_manager.cc:1434] T 732495dddec64a3aa196110bfda45b37 P 982df35c5b554a8fa64807352c4f34ee: Time spent starting tablet: real 0.085s user 0.008s sys 0.000s
I20251023 07:58:41.612579 18291 tablet_bootstrap.cc:492] T a939fd9e853a45d1aa626a4566c14abc P 982df35c5b554a8fa64807352c4f34ee: Bootstrap starting.
I20251023 07:58:41.598394 18246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e25fd146cb564be69022d0f53010bbfa" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:41.618770 18142 leader_election.cc:304] T 33ee36de303b458e88fa6bad4587c0e6 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10dfae53d0c941f08bded43539841761, 982df35c5b554a8fa64807352c4f34ee; no voters: b3a1328f9c8c484fab08292ce2171ec9
I20251023 07:58:41.627121 18390 raft_consensus.cc:2749] T 07b28d84c73d42d583d6f80199700309 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251023 07:58:41.642396 18300 raft_consensus.cc:493] T 063924334ed846f3bd41c36cc4651236 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:41.642915 18300 raft_consensus.cc:515] T 063924334ed846f3bd41c36cc4651236 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:41.644887 18300 leader_election.cc:290] T 063924334ed846f3bd41c36cc4651236 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
W20251023 07:58:41.646349 18067 leader_election.cc:343] T e25fd146cb564be69022d0f53010bbfa P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:41.646816 18067 leader_election.cc:304] T e25fd146cb564be69022d0f53010bbfa P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3a1328f9c8c484fab08292ce2171ec9; no voters: 10dfae53d0c941f08bded43539841761, 982df35c5b554a8fa64807352c4f34ee
I20251023 07:58:41.648077 18589 raft_consensus.cc:2749] T e25fd146cb564be69022d0f53010bbfa P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:58:41.653523 18248 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "063924334ed846f3bd41c36cc4651236" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:41.654402 18493 raft_consensus.cc:2804] T 33ee36de303b458e88fa6bad4587c0e6 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:58:41.654932 18493 raft_consensus.cc:697] T 33ee36de303b458e88fa6bad4587c0e6 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Becoming Leader. State: Replica: 10dfae53d0c941f08bded43539841761, State: Running, Role: LEADER
I20251023 07:58:41.655764 18493 consensus_queue.cc:237] T 33ee36de303b458e88fa6bad4587c0e6 P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
W20251023 07:58:41.661056 18067 leader_election.cc:343] T 063924334ed846f3bd41c36cc4651236 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:41.670096 18292 tablet_bootstrap.cc:654] T 33ee36de303b458e88fa6bad4587c0e6 P b3a1328f9c8c484fab08292ce2171ec9: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:41.670883 18171 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "063924334ed846f3bd41c36cc4651236" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
W20251023 07:58:41.687151 18066 leader_election.cc:343] T 063924334ed846f3bd41c36cc4651236 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:41.695729 18066 leader_election.cc:304] T 063924334ed846f3bd41c36cc4651236 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3a1328f9c8c484fab08292ce2171ec9; no voters: 10dfae53d0c941f08bded43539841761, 982df35c5b554a8fa64807352c4f34ee
I20251023 07:58:41.697697 18291 tablet_bootstrap.cc:654] T a939fd9e853a45d1aa626a4566c14abc P 982df35c5b554a8fa64807352c4f34ee: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:41.697743 18505 raft_consensus.cc:2749] T 063924334ed846f3bd41c36cc4651236 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:58:41.699064 18495 raft_consensus.cc:493] T f90cf0955288472898eff5b7e6459195 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:41.709064 18495 raft_consensus.cc:515] T f90cf0955288472898eff5b7e6459195 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:41.715312 18495 leader_election.cc:290] T f90cf0955288472898eff5b7e6459195 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:41.716573 18246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f90cf0955288472898eff5b7e6459195" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:41.716727 18100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f90cf0955288472898eff5b7e6459195" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:41.718318 18100 raft_consensus.cc:2468] T f90cf0955288472898eff5b7e6459195 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 0.
W20251023 07:58:41.718406 18142 leader_election.cc:343] T f90cf0955288472898eff5b7e6459195 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:41.717397 17997 catalog_manager.cc:5649] T 7a0f3569fcc34ba8b721d4ca9f31b6fa P 10dfae53d0c941f08bded43539841761 reported cstate change: term changed from 0 to 1, leader changed from <none> to 10dfae53d0c941f08bded43539841761 (127.16.126.2). New cstate: current_term: 1 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } }
I20251023 07:58:41.719916 18143 leader_election.cc:304] T f90cf0955288472898eff5b7e6459195 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9; no voters: 982df35c5b554a8fa64807352c4f34ee
I20251023 07:58:41.721024 18495 raft_consensus.cc:2804] T f90cf0955288472898eff5b7e6459195 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:58:41.721390 18495 raft_consensus.cc:493] T f90cf0955288472898eff5b7e6459195 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:41.721810 18495 raft_consensus.cc:3060] T f90cf0955288472898eff5b7e6459195 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Advancing to term 1
W20251023 07:58:41.721889 18595 log.cc:927] Time spent T 07b28d84c73d42d583d6f80199700309 P 982df35c5b554a8fa64807352c4f34ee: Append to log took a long time: real 0.061s user 0.000s sys 0.000s
I20251023 07:58:41.728639 18292 tablet_bootstrap.cc:492] T 33ee36de303b458e88fa6bad4587c0e6 P b3a1328f9c8c484fab08292ce2171ec9: No bootstrap required, opened a new log
I20251023 07:58:41.729161 18292 ts_tablet_manager.cc:1403] T 33ee36de303b458e88fa6bad4587c0e6 P b3a1328f9c8c484fab08292ce2171ec9: Time spent bootstrapping tablet: real 0.213s user 0.012s sys 0.002s
I20251023 07:58:41.733201 18293 tablet_bootstrap.cc:654] T 063924334ed846f3bd41c36cc4651236 P 10dfae53d0c941f08bded43539841761: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:41.735023 18292 raft_consensus.cc:359] T 33ee36de303b458e88fa6bad4587c0e6 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:41.735735 18292 raft_consensus.cc:385] T 33ee36de303b458e88fa6bad4587c0e6 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:41.736002 18292 raft_consensus.cc:740] T 33ee36de303b458e88fa6bad4587c0e6 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Initialized, Role: FOLLOWER
I20251023 07:58:41.736703 18292 consensus_queue.cc:260] T 33ee36de303b458e88fa6bad4587c0e6 P b3a1328f9c8c484fab08292ce2171ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:41.738245 18495 raft_consensus.cc:515] T f90cf0955288472898eff5b7e6459195 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:41.739289 18292 ts_tablet_manager.cc:1434] T 33ee36de303b458e88fa6bad4587c0e6 P b3a1328f9c8c484fab08292ce2171ec9: Time spent starting tablet: real 0.010s user 0.001s sys 0.004s
I20251023 07:58:41.740245 18292 tablet_bootstrap.cc:492] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P b3a1328f9c8c484fab08292ce2171ec9: Bootstrap starting.
I20251023 07:58:41.741110 18100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f90cf0955288472898eff5b7e6459195" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
I20251023 07:58:41.741707 18100 raft_consensus.cc:3060] T f90cf0955288472898eff5b7e6459195 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:41.741739 18246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f90cf0955288472898eff5b7e6459195" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
I20251023 07:58:41.743309 18495 leader_election.cc:290] T f90cf0955288472898eff5b7e6459195 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 election: Requested vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
W20251023 07:58:41.743495 18142 leader_election.cc:343] T f90cf0955288472898eff5b7e6459195 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:41.755141 18100 raft_consensus.cc:2468] T f90cf0955288472898eff5b7e6459195 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 1.
I20251023 07:58:41.756948 18143 leader_election.cc:304] T f90cf0955288472898eff5b7e6459195 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9; no voters: 982df35c5b554a8fa64807352c4f34ee
I20251023 07:58:41.758922 18292 tablet_bootstrap.cc:654] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P b3a1328f9c8c484fab08292ce2171ec9: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:41.759891 18495 raft_consensus.cc:2804] T f90cf0955288472898eff5b7e6459195 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:58:41.766167 18293 tablet_bootstrap.cc:492] T 063924334ed846f3bd41c36cc4651236 P 10dfae53d0c941f08bded43539841761: No bootstrap required, opened a new log
I20251023 07:58:41.766631 18293 ts_tablet_manager.cc:1403] T 063924334ed846f3bd41c36cc4651236 P 10dfae53d0c941f08bded43539841761: Time spent bootstrapping tablet: real 0.222s user 0.001s sys 0.012s
I20251023 07:58:41.766780 18495 raft_consensus.cc:697] T f90cf0955288472898eff5b7e6459195 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Becoming Leader. State: Replica: 10dfae53d0c941f08bded43539841761, State: Running, Role: LEADER
I20251023 07:58:41.767884 18000 catalog_manager.cc:5649] T 33ee36de303b458e88fa6bad4587c0e6 P 10dfae53d0c941f08bded43539841761 reported cstate change: term changed from 0 to 1, leader changed from <none> to 10dfae53d0c941f08bded43539841761 (127.16.126.2). New cstate: current_term: 1 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } }
I20251023 07:58:41.768327 18495 consensus_queue.cc:237] T f90cf0955288472898eff5b7e6459195 P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:41.769721 18293 raft_consensus.cc:359] T 063924334ed846f3bd41c36cc4651236 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:41.770394 18293 raft_consensus.cc:385] T 063924334ed846f3bd41c36cc4651236 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:41.770661 18293 raft_consensus.cc:740] T 063924334ed846f3bd41c36cc4651236 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Initialized, Role: FOLLOWER
I20251023 07:58:41.771281 18293 consensus_queue.cc:260] T 063924334ed846f3bd41c36cc4651236 P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:41.786372 18291 tablet_bootstrap.cc:492] T a939fd9e853a45d1aa626a4566c14abc P 982df35c5b554a8fa64807352c4f34ee: No bootstrap required, opened a new log
I20251023 07:58:41.786983 18291 ts_tablet_manager.cc:1403] T a939fd9e853a45d1aa626a4566c14abc P 982df35c5b554a8fa64807352c4f34ee: Time spent bootstrapping tablet: real 0.175s user 0.010s sys 0.010s
I20251023 07:58:41.787210 18300 consensus_queue.cc:1048] T 732495dddec64a3aa196110bfda45b37 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:41.789237 18293 ts_tablet_manager.cc:1434] T 063924334ed846f3bd41c36cc4651236 P 10dfae53d0c941f08bded43539841761: Time spent starting tablet: real 0.022s user 0.008s sys 0.000s
I20251023 07:58:41.790669 18293 tablet_bootstrap.cc:492] T e25fd146cb564be69022d0f53010bbfa P 10dfae53d0c941f08bded43539841761: Bootstrap starting.
I20251023 07:58:41.794359 18291 raft_consensus.cc:359] T a939fd9e853a45d1aa626a4566c14abc P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:41.794801 18500 raft_consensus.cc:493] T 732495dddec64a3aa196110bfda45b37 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:41.795411 18500 raft_consensus.cc:515] T 732495dddec64a3aa196110bfda45b37 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:41.796308 18291 raft_consensus.cc:385] T a939fd9e853a45d1aa626a4566c14abc P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:41.796653 18291 raft_consensus.cc:740] T a939fd9e853a45d1aa626a4566c14abc P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Initialized, Role: FOLLOWER
I20251023 07:58:41.797250 18291 consensus_queue.cc:260] T a939fd9e853a45d1aa626a4566c14abc P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:41.799607 18500 leader_election.cc:290] T 732495dddec64a3aa196110bfda45b37 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:58:41.802084 18174 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "732495dddec64a3aa196110bfda45b37" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:41.803527 18100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "732495dddec64a3aa196110bfda45b37" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:41.806687 18215 leader_election.cc:304] T 732495dddec64a3aa196110bfda45b37 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee; no voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9
I20251023 07:58:41.809870 18500 raft_consensus.cc:2749] T 732495dddec64a3aa196110bfda45b37 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:58:41.811991 18291 ts_tablet_manager.cc:1434] T a939fd9e853a45d1aa626a4566c14abc P 982df35c5b554a8fa64807352c4f34ee: Time spent starting tablet: real 0.023s user 0.006s sys 0.000s
I20251023 07:58:41.813731 18292 tablet_bootstrap.cc:492] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P b3a1328f9c8c484fab08292ce2171ec9: No bootstrap required, opened a new log
I20251023 07:58:41.814350 18292 ts_tablet_manager.cc:1403] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P b3a1328f9c8c484fab08292ce2171ec9: Time spent bootstrapping tablet: real 0.074s user 0.010s sys 0.003s
I20251023 07:58:41.819072 18291 tablet_bootstrap.cc:492] T e25fd146cb564be69022d0f53010bbfa P 982df35c5b554a8fa64807352c4f34ee: Bootstrap starting.
I20251023 07:58:41.822294 18293 tablet_bootstrap.cc:654] T e25fd146cb564be69022d0f53010bbfa P 10dfae53d0c941f08bded43539841761: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:41.818305 18292 raft_consensus.cc:359] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:41.825644 18292 raft_consensus.cc:385] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:41.825924 18292 raft_consensus.cc:740] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Initialized, Role: FOLLOWER
I20251023 07:58:41.827064 18292 consensus_queue.cc:260] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P b3a1328f9c8c484fab08292ce2171ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:41.830433 18292 ts_tablet_manager.cc:1434] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P b3a1328f9c8c484fab08292ce2171ec9: Time spent starting tablet: real 0.016s user 0.003s sys 0.002s
I20251023 07:58:41.831383 18292 tablet_bootstrap.cc:492] T 85799f6eb6ae41fa9620accb877d8708 P b3a1328f9c8c484fab08292ce2171ec9: Bootstrap starting.
I20251023 07:58:41.841545 18246 raft_consensus.cc:3060] T 732495dddec64a3aa196110bfda45b37 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:41.842653 18545 raft_consensus.cc:493] T 33ee36de303b458e88fa6bad4587c0e6 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:41.843180 18545 raft_consensus.cc:515] T 33ee36de303b458e88fa6bad4587c0e6 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:41.844941 18545 leader_election.cc:290] T 33ee36de303b458e88fa6bad4587c0e6 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:41.850139 18247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "33ee36de303b458e88fa6bad4587c0e6" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:41.850992 18247 raft_consensus.cc:2393] T 33ee36de303b458e88fa6bad4587c0e6 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3a1328f9c8c484fab08292ce2171ec9 in current term 1: Already voted for candidate 10dfae53d0c941f08bded43539841761 in this term.
I20251023 07:58:41.852969 18171 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "33ee36de303b458e88fa6bad4587c0e6" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:41.854575 18066 leader_election.cc:304] T 33ee36de303b458e88fa6bad4587c0e6 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3a1328f9c8c484fab08292ce2171ec9; no voters: 10dfae53d0c941f08bded43539841761, 982df35c5b554a8fa64807352c4f34ee
I20251023 07:58:41.855911 18505 raft_consensus.cc:3060] T 33ee36de303b458e88fa6bad4587c0e6 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:41.857872 18000 catalog_manager.cc:5649] T f90cf0955288472898eff5b7e6459195 P 10dfae53d0c941f08bded43539841761 reported cstate change: term changed from 0 to 1, leader changed from <none> to 10dfae53d0c941f08bded43539841761 (127.16.126.2). New cstate: current_term: 1 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } }
I20251023 07:58:41.858495 18545 consensus_queue.cc:1048] T 732495dddec64a3aa196110bfda45b37 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:41.872956 18291 tablet_bootstrap.cc:654] T e25fd146cb564be69022d0f53010bbfa P 982df35c5b554a8fa64807352c4f34ee: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:41.880205 18293 tablet_bootstrap.cc:492] T e25fd146cb564be69022d0f53010bbfa P 10dfae53d0c941f08bded43539841761: No bootstrap required, opened a new log
I20251023 07:58:41.881223 18293 ts_tablet_manager.cc:1403] T e25fd146cb564be69022d0f53010bbfa P 10dfae53d0c941f08bded43539841761: Time spent bootstrapping tablet: real 0.091s user 0.024s sys 0.004s
I20251023 07:58:41.883677 18292 tablet_bootstrap.cc:654] T 85799f6eb6ae41fa9620accb877d8708 P b3a1328f9c8c484fab08292ce2171ec9: Neither blocks nor log segments found. Creating new log.
W20251023 07:58:41.889576 18048 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20251023 07:58:41.900307 18505 raft_consensus.cc:2749] T 33ee36de303b458e88fa6bad4587c0e6 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:58:41.904207 18293 raft_consensus.cc:359] T e25fd146cb564be69022d0f53010bbfa P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:41.905073 18293 raft_consensus.cc:385] T e25fd146cb564be69022d0f53010bbfa P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:41.905359 18293 raft_consensus.cc:740] T e25fd146cb564be69022d0f53010bbfa P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Initialized, Role: FOLLOWER
I20251023 07:58:41.906003 18293 consensus_queue.cc:260] T e25fd146cb564be69022d0f53010bbfa P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:41.907627 18293 ts_tablet_manager.cc:1434] T e25fd146cb564be69022d0f53010bbfa P 10dfae53d0c941f08bded43539841761: Time spent starting tablet: real 0.026s user 0.005s sys 0.000s
I20251023 07:58:41.908506 18293 tablet_bootstrap.cc:492] T 01f269ca63a8498498956fb3577f35d3 P 10dfae53d0c941f08bded43539841761: Bootstrap starting.
I20251023 07:58:41.912170 18292 tablet_bootstrap.cc:492] T 85799f6eb6ae41fa9620accb877d8708 P b3a1328f9c8c484fab08292ce2171ec9: No bootstrap required, opened a new log
I20251023 07:58:41.912688 18291 tablet_bootstrap.cc:492] T e25fd146cb564be69022d0f53010bbfa P 982df35c5b554a8fa64807352c4f34ee: No bootstrap required, opened a new log
I20251023 07:58:41.912710 18292 ts_tablet_manager.cc:1403] T 85799f6eb6ae41fa9620accb877d8708 P b3a1328f9c8c484fab08292ce2171ec9: Time spent bootstrapping tablet: real 0.082s user 0.013s sys 0.001s
I20251023 07:58:41.913144 18291 ts_tablet_manager.cc:1403] T e25fd146cb564be69022d0f53010bbfa P 982df35c5b554a8fa64807352c4f34ee: Time spent bootstrapping tablet: real 0.094s user 0.008s sys 0.003s
I20251023 07:58:41.915529 18292 raft_consensus.cc:359] T 85799f6eb6ae41fa9620accb877d8708 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:41.921343 18292 raft_consensus.cc:385] T 85799f6eb6ae41fa9620accb877d8708 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:41.921783 18292 raft_consensus.cc:740] T 85799f6eb6ae41fa9620accb877d8708 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Initialized, Role: FOLLOWER
I20251023 07:58:41.917351 18291 raft_consensus.cc:359] T e25fd146cb564be69022d0f53010bbfa P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:41.922268 18291 raft_consensus.cc:385] T e25fd146cb564be69022d0f53010bbfa P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:41.922643 18291 raft_consensus.cc:740] T e25fd146cb564be69022d0f53010bbfa P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Initialized, Role: FOLLOWER
I20251023 07:58:41.922653 18292 consensus_queue.cc:260] T 85799f6eb6ae41fa9620accb877d8708 P b3a1328f9c8c484fab08292ce2171ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:41.923556 18291 consensus_queue.cc:260] T e25fd146cb564be69022d0f53010bbfa P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:41.925927 18291 ts_tablet_manager.cc:1434] T e25fd146cb564be69022d0f53010bbfa P 982df35c5b554a8fa64807352c4f34ee: Time spent starting tablet: real 0.013s user 0.008s sys 0.000s
I20251023 07:58:41.929932 18292 ts_tablet_manager.cc:1434] T 85799f6eb6ae41fa9620accb877d8708 P b3a1328f9c8c484fab08292ce2171ec9: Time spent starting tablet: real 0.017s user 0.006s sys 0.000s
I20251023 07:58:41.931140 18292 tablet_bootstrap.cc:492] T e85adbfd669946ce9f939c02865fea6a P b3a1328f9c8c484fab08292ce2171ec9: Bootstrap starting.
I20251023 07:58:41.937285 18292 tablet_bootstrap.cc:654] T e85adbfd669946ce9f939c02865fea6a P b3a1328f9c8c484fab08292ce2171ec9: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:41.938869 18293 tablet_bootstrap.cc:654] T 01f269ca63a8498498956fb3577f35d3 P 10dfae53d0c941f08bded43539841761: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:41.961557 18291 tablet_bootstrap.cc:492] T 7a0f3569fcc34ba8b721d4ca9f31b6fa P 982df35c5b554a8fa64807352c4f34ee: Bootstrap starting.
I20251023 07:58:41.968364 18495 raft_consensus.cc:493] T 063924334ed846f3bd41c36cc4651236 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:41.969012 18495 raft_consensus.cc:515] T 063924334ed846f3bd41c36cc4651236 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:41.969936 18291 tablet_bootstrap.cc:654] T 7a0f3569fcc34ba8b721d4ca9f31b6fa P 982df35c5b554a8fa64807352c4f34ee: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:41.972666 18100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "063924334ed846f3bd41c36cc4651236" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:41.973450 18100 raft_consensus.cc:2468] T 063924334ed846f3bd41c36cc4651236 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 0.
I20251023 07:58:41.972718 18495 leader_election.cc:290] T 063924334ed846f3bd41c36cc4651236 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:41.974730 18143 leader_election.cc:304] T 063924334ed846f3bd41c36cc4651236 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:58:41.974684 18247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "063924334ed846f3bd41c36cc4651236" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
W20251023 07:58:41.975692 18142 consensus_peers.cc:597] T 7a0f3569fcc34ba8b721d4ca9f31b6fa P 10dfae53d0c941f08bded43539841761 -> Peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Couldn't send request to peer 982df35c5b554a8fa64807352c4f34ee. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:58:41.976677 18292 tablet_bootstrap.cc:492] T e85adbfd669946ce9f939c02865fea6a P b3a1328f9c8c484fab08292ce2171ec9: No bootstrap required, opened a new log
W20251023 07:58:41.976634 18142 leader_election.cc:343] T 063924334ed846f3bd41c36cc4651236 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:41.977463 18292 ts_tablet_manager.cc:1403] T e85adbfd669946ce9f939c02865fea6a P b3a1328f9c8c484fab08292ce2171ec9: Time spent bootstrapping tablet: real 0.047s user 0.019s sys 0.023s
I20251023 07:58:41.976750 18495 raft_consensus.cc:2804] T 063924334ed846f3bd41c36cc4651236 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:58:41.978619 18495 raft_consensus.cc:493] T 063924334ed846f3bd41c36cc4651236 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:41.978973 18495 raft_consensus.cc:3060] T 063924334ed846f3bd41c36cc4651236 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:41.980346 18292 raft_consensus.cc:359] T e85adbfd669946ce9f939c02865fea6a P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:41.981079 18292 raft_consensus.cc:385] T e85adbfd669946ce9f939c02865fea6a P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:41.981391 18292 raft_consensus.cc:740] T e85adbfd669946ce9f939c02865fea6a P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Initialized, Role: FOLLOWER
I20251023 07:58:41.982133 18292 consensus_queue.cc:260] T e85adbfd669946ce9f939c02865fea6a P b3a1328f9c8c484fab08292ce2171ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:41.984418 18292 ts_tablet_manager.cc:1434] T e85adbfd669946ce9f939c02865fea6a P b3a1328f9c8c484fab08292ce2171ec9: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20251023 07:58:41.985877 18292 tablet_bootstrap.cc:492] T 931f55bec99140c69a4b5654b691c861 P b3a1328f9c8c484fab08292ce2171ec9: Bootstrap starting.
I20251023 07:58:41.986981 18495 raft_consensus.cc:515] T 063924334ed846f3bd41c36cc4651236 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:41.991468 18514 raft_consensus.cc:493] T e25fd146cb564be69022d0f53010bbfa P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:41.991613 18100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "063924334ed846f3bd41c36cc4651236" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
I20251023 07:58:41.991904 18292 tablet_bootstrap.cc:654] T 931f55bec99140c69a4b5654b691c861 P b3a1328f9c8c484fab08292ce2171ec9: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:41.992314 18100 raft_consensus.cc:3060] T 063924334ed846f3bd41c36cc4651236 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:41.992013 18514 raft_consensus.cc:515] T e25fd146cb564be69022d0f53010bbfa P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:41.999078 18514 leader_election.cc:290] T e25fd146cb564be69022d0f53010bbfa P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:58:42.000151 18099 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e25fd146cb564be69022d0f53010bbfa" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:42.000844 18172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e25fd146cb564be69022d0f53010bbfa" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:42.001650 18172 raft_consensus.cc:2468] T e25fd146cb564be69022d0f53010bbfa P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 0.
I20251023 07:58:42.002943 18215 leader_election.cc:304] T e25fd146cb564be69022d0f53010bbfa P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, 982df35c5b554a8fa64807352c4f34ee; no voters:
I20251023 07:58:42.003558 18292 tablet_bootstrap.cc:492] T 931f55bec99140c69a4b5654b691c861 P b3a1328f9c8c484fab08292ce2171ec9: No bootstrap required, opened a new log
I20251023 07:58:42.004135 18292 ts_tablet_manager.cc:1403] T 931f55bec99140c69a4b5654b691c861 P b3a1328f9c8c484fab08292ce2171ec9: Time spent bootstrapping tablet: real 0.018s user 0.010s sys 0.006s
I20251023 07:58:42.004091 18500 raft_consensus.cc:2804] T e25fd146cb564be69022d0f53010bbfa P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:58:42.004608 18500 raft_consensus.cc:493] T e25fd146cb564be69022d0f53010bbfa P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:42.004949 18500 raft_consensus.cc:3060] T e25fd146cb564be69022d0f53010bbfa P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:42.000984 18099 raft_consensus.cc:2468] T e25fd146cb564be69022d0f53010bbfa P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 0.
I20251023 07:58:42.011672 18500 raft_consensus.cc:515] T e25fd146cb564be69022d0f53010bbfa P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:42.017591 18099 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e25fd146cb564be69022d0f53010bbfa" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
I20251023 07:58:42.018189 18099 raft_consensus.cc:3060] T e25fd146cb564be69022d0f53010bbfa P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:42.018309 18500 leader_election.cc:290] T e25fd146cb564be69022d0f53010bbfa P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 election: Requested vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:58:42.015141 18292 raft_consensus.cc:359] T 931f55bec99140c69a4b5654b691c861 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:42.019104 18292 raft_consensus.cc:385] T 931f55bec99140c69a4b5654b691c861 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:42.019441 18292 raft_consensus.cc:740] T 931f55bec99140c69a4b5654b691c861 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Initialized, Role: FOLLOWER
I20251023 07:58:42.020151 18292 consensus_queue.cc:260] T 931f55bec99140c69a4b5654b691c861 P b3a1328f9c8c484fab08292ce2171ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:42.021190 18172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e25fd146cb564be69022d0f53010bbfa" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761"
I20251023 07:58:42.021963 18172 raft_consensus.cc:3060] T e25fd146cb564be69022d0f53010bbfa P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:42.023665 18293 tablet_bootstrap.cc:492] T 01f269ca63a8498498956fb3577f35d3 P 10dfae53d0c941f08bded43539841761: No bootstrap required, opened a new log
I20251023 07:58:42.024121 18293 ts_tablet_manager.cc:1403] T 01f269ca63a8498498956fb3577f35d3 P 10dfae53d0c941f08bded43539841761: Time spent bootstrapping tablet: real 0.116s user 0.010s sys 0.019s
I20251023 07:58:42.024176 18292 ts_tablet_manager.cc:1434] T 931f55bec99140c69a4b5654b691c861 P b3a1328f9c8c484fab08292ce2171ec9: Time spent starting tablet: real 0.012s user 0.005s sys 0.003s
I20251023 07:58:42.025291 18292 tablet_bootstrap.cc:492] T ce0cc368c5054eef9dca968072a2d4fd P b3a1328f9c8c484fab08292ce2171ec9: Bootstrap starting.
I20251023 07:58:42.026753 18293 raft_consensus.cc:359] T 01f269ca63a8498498956fb3577f35d3 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:42.027415 18293 raft_consensus.cc:385] T 01f269ca63a8498498956fb3577f35d3 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:42.027676 18293 raft_consensus.cc:740] T 01f269ca63a8498498956fb3577f35d3 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Initialized, Role: FOLLOWER
I20251023 07:58:42.028395 18293 consensus_queue.cc:260] T 01f269ca63a8498498956fb3577f35d3 P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:42.030625 18293 ts_tablet_manager.cc:1434] T 01f269ca63a8498498956fb3577f35d3 P 10dfae53d0c941f08bded43539841761: Time spent starting tablet: real 0.006s user 0.007s sys 0.001s
I20251023 07:58:42.032136 18292 tablet_bootstrap.cc:654] T ce0cc368c5054eef9dca968072a2d4fd P b3a1328f9c8c484fab08292ce2171ec9: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:42.032666 18293 tablet_bootstrap.cc:492] T a939fd9e853a45d1aa626a4566c14abc P 10dfae53d0c941f08bded43539841761: Bootstrap starting.
I20251023 07:58:42.048729 18293 tablet_bootstrap.cc:654] T a939fd9e853a45d1aa626a4566c14abc P 10dfae53d0c941f08bded43539841761: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:42.053138 18493 consensus_queue.cc:1048] T 33ee36de303b458e88fa6bad4587c0e6 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:42.063971 18172 raft_consensus.cc:2468] T e25fd146cb564be69022d0f53010bbfa P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 1.
I20251023 07:58:42.065554 18215 leader_election.cc:304] T e25fd146cb564be69022d0f53010bbfa P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, 982df35c5b554a8fa64807352c4f34ee; no voters:
I20251023 07:58:42.066489 18500 raft_consensus.cc:2804] T e25fd146cb564be69022d0f53010bbfa P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:58:42.067067 18500 raft_consensus.cc:697] T e25fd146cb564be69022d0f53010bbfa P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Becoming Leader. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Running, Role: LEADER
I20251023 07:58:42.068094 18500 consensus_queue.cc:237] T e25fd146cb564be69022d0f53010bbfa P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:42.074182 18300 raft_consensus.cc:493] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:42.074693 18300 raft_consensus.cc:515] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:42.076418 18300 leader_election.cc:290] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:42.077919 18174 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3e78cdb4b2af4f5a855ec00a07f2cbc9" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:42.078611 18174 raft_consensus.cc:2468] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3a1328f9c8c484fab08292ce2171ec9 in term 0.
I20251023 07:58:42.080193 18066 leader_election.cc:304] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:58:42.081189 18545 raft_consensus.cc:2804] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:58:42.081535 18545 raft_consensus.cc:493] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:42.081840 18545 raft_consensus.cc:3060] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:42.086071 18292 tablet_bootstrap.cc:492] T ce0cc368c5054eef9dca968072a2d4fd P b3a1328f9c8c484fab08292ce2171ec9: No bootstrap required, opened a new log
I20251023 07:58:42.086593 18292 ts_tablet_manager.cc:1403] T ce0cc368c5054eef9dca968072a2d4fd P b3a1328f9c8c484fab08292ce2171ec9: Time spent bootstrapping tablet: real 0.061s user 0.011s sys 0.028s
I20251023 07:58:42.093328 18247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3e78cdb4b2af4f5a855ec00a07f2cbc9" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:42.095184 18496 consensus_queue.cc:1048] T 33ee36de303b458e88fa6bad4587c0e6 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:58:42.101270 18292 raft_consensus.cc:359] T ce0cc368c5054eef9dca968072a2d4fd P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:42.102087 18292 raft_consensus.cc:385] T ce0cc368c5054eef9dca968072a2d4fd P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:42.102375 18292 raft_consensus.cc:740] T ce0cc368c5054eef9dca968072a2d4fd P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Initialized, Role: FOLLOWER
I20251023 07:58:42.102799 18100 raft_consensus.cc:2468] T 063924334ed846f3bd41c36cc4651236 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 1.
I20251023 07:58:42.103024 18292 consensus_queue.cc:260] T ce0cc368c5054eef9dca968072a2d4fd P b3a1328f9c8c484fab08292ce2171ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:42.105396 18291 tablet_bootstrap.cc:492] T 7a0f3569fcc34ba8b721d4ca9f31b6fa P 982df35c5b554a8fa64807352c4f34ee: No bootstrap required, opened a new log
I20251023 07:58:42.106020 18291 ts_tablet_manager.cc:1403] T 7a0f3569fcc34ba8b721d4ca9f31b6fa P 982df35c5b554a8fa64807352c4f34ee: Time spent bootstrapping tablet: real 0.145s user 0.019s sys 0.000s
I20251023 07:58:42.109047 18291 raft_consensus.cc:359] T 7a0f3569fcc34ba8b721d4ca9f31b6fa P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:42.112366 18291 raft_consensus.cc:385] T 7a0f3569fcc34ba8b721d4ca9f31b6fa P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:42.110458 18292 ts_tablet_manager.cc:1434] T ce0cc368c5054eef9dca968072a2d4fd P b3a1328f9c8c484fab08292ce2171ec9: Time spent starting tablet: real 0.024s user 0.007s sys 0.001s
I20251023 07:58:42.113111 18545 raft_consensus.cc:515] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:42.113992 18292 tablet_bootstrap.cc:492] T 714c3ef74ecc47419a20ab7e23217e5e P b3a1328f9c8c484fab08292ce2171ec9: Bootstrap starting.
I20251023 07:58:42.115011 18545 leader_election.cc:290] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 election: Requested vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:42.117620 18291 raft_consensus.cc:740] T 7a0f3569fcc34ba8b721d4ca9f31b6fa P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Initialized, Role: FOLLOWER
I20251023 07:58:42.121512 18495 leader_election.cc:290] T 063924334ed846f3bd41c36cc4651236 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 election: Requested vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:42.118492 18291 consensus_queue.cc:260] T 7a0f3569fcc34ba8b721d4ca9f31b6fa P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:42.126819 18292 tablet_bootstrap.cc:654] T 714c3ef74ecc47419a20ab7e23217e5e P b3a1328f9c8c484fab08292ce2171ec9: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:42.127133 18291 ts_tablet_manager.cc:1434] T 7a0f3569fcc34ba8b721d4ca9f31b6fa P 982df35c5b554a8fa64807352c4f34ee: Time spent starting tablet: real 0.021s user 0.006s sys 0.000s
I20251023 07:58:42.128106 18291 tablet_bootstrap.cc:492] T f90cf0955288472898eff5b7e6459195 P 982df35c5b554a8fa64807352c4f34ee: Bootstrap starting.
I20251023 07:58:42.164916 18099 raft_consensus.cc:2468] T e25fd146cb564be69022d0f53010bbfa P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 1.
W20251023 07:58:42.172864 18067 leader_election.cc:343] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:42.184544 18143 leader_election.cc:304] T 063924334ed846f3bd41c36cc4651236 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:58:42.191325 18246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3e78cdb4b2af4f5a855ec00a07f2cbc9" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
I20251023 07:58:42.195063 18293 tablet_bootstrap.cc:492] T a939fd9e853a45d1aa626a4566c14abc P 10dfae53d0c941f08bded43539841761: No bootstrap required, opened a new log
I20251023 07:58:42.196215 18514 raft_consensus.cc:493] T a939fd9e853a45d1aa626a4566c14abc P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:42.197866 18293 ts_tablet_manager.cc:1403] T a939fd9e853a45d1aa626a4566c14abc P 10dfae53d0c941f08bded43539841761: Time spent bootstrapping tablet: real 0.165s user 0.024s sys 0.012s
I20251023 07:58:42.197782 18514 raft_consensus.cc:515] T a939fd9e853a45d1aa626a4566c14abc P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:42.206466 18247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "063924334ed846f3bd41c36cc4651236" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
I20251023 07:58:42.180675 17997 catalog_manager.cc:5649] T e25fd146cb564be69022d0f53010bbfa P 982df35c5b554a8fa64807352c4f34ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 982df35c5b554a8fa64807352c4f34ee (127.16.126.3). New cstate: current_term: 1 leader_uuid: "982df35c5b554a8fa64807352c4f34ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: HEALTHY } } }
I20251023 07:58:42.208515 18291 tablet_bootstrap.cc:654] T f90cf0955288472898eff5b7e6459195 P 982df35c5b554a8fa64807352c4f34ee: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:42.210966 18171 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a939fd9e853a45d1aa626a4566c14abc" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:42.214237 18496 consensus_queue.cc:1048] T 7a0f3569fcc34ba8b721d4ca9f31b6fa P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:58:42.216928 18495 raft_consensus.cc:2804] T 063924334ed846f3bd41c36cc4651236 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Leader election won for term 1
W20251023 07:58:42.218500 18067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.126.3:46061, user_credentials={real_user=slave}} blocked reactor thread for 45925.1us
I20251023 07:58:42.218812 18495 raft_consensus.cc:697] T 063924334ed846f3bd41c36cc4651236 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Becoming Leader. State: Replica: 10dfae53d0c941f08bded43539841761, State: Running, Role: LEADER
I20251023 07:58:42.220733 18495 consensus_queue.cc:237] T 063924334ed846f3bd41c36cc4651236 P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:42.223871 18172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3e78cdb4b2af4f5a855ec00a07f2cbc9" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761"
I20251023 07:58:42.224704 18172 raft_consensus.cc:3060] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:42.224303 18300 raft_consensus.cc:493] T 931f55bec99140c69a4b5654b691c861 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:42.227360 18377 raft_consensus.cc:493] T 01f269ca63a8498498956fb3577f35d3 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:42.227311 18300 raft_consensus.cc:515] T 931f55bec99140c69a4b5654b691c861 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:42.228277 18377 raft_consensus.cc:515] T 01f269ca63a8498498956fb3577f35d3 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
W20251023 07:58:42.228826 18142 leader_election.cc:343] T 063924334ed846f3bd41c36cc4651236 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:42.230861 18377 leader_election.cc:290] T 01f269ca63a8498498956fb3577f35d3 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:42.230938 18547 consensus_queue.cc:1048] T f90cf0955288472898eff5b7e6459195 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:58:42.232254 18100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01f269ca63a8498498956fb3577f35d3" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:42.201342 18514 leader_election.cc:290] T a939fd9e853a45d1aa626a4566c14abc P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:58:42.242698 18101 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a939fd9e853a45d1aa626a4566c14abc" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:42.243748 18101 raft_consensus.cc:2468] T a939fd9e853a45d1aa626a4566c14abc P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 0.
I20251023 07:58:42.245468 18300 leader_election.cc:290] T 931f55bec99140c69a4b5654b691c861 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:42.274024 18171 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "931f55bec99140c69a4b5654b691c861" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
W20251023 07:58:42.277662 18067 leader_election.cc:343] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:42.278194 18300 raft_consensus.cc:493] T ce0cc368c5054eef9dca968072a2d4fd P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20251023 07:58:42.280735 18066 leader_election.cc:343] T 931f55bec99140c69a4b5654b691c861 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:42.286275 18292 tablet_bootstrap.cc:492] T 714c3ef74ecc47419a20ab7e23217e5e P b3a1328f9c8c484fab08292ce2171ec9: No bootstrap required, opened a new log
I20251023 07:58:42.286995 18292 ts_tablet_manager.cc:1403] T 714c3ef74ecc47419a20ab7e23217e5e P b3a1328f9c8c484fab08292ce2171ec9: Time spent bootstrapping tablet: real 0.173s user 0.006s sys 0.005s
I20251023 07:58:42.287240 18300 raft_consensus.cc:515] T ce0cc368c5054eef9dca968072a2d4fd P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:42.291096 18505 raft_consensus.cc:493] T e85adbfd669946ce9f939c02865fea6a P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:42.291725 18505 raft_consensus.cc:515] T e85adbfd669946ce9f939c02865fea6a P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:42.294037 18505 leader_election.cc:290] T e85adbfd669946ce9f939c02865fea6a P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:42.293977 17997 catalog_manager.cc:5649] T 063924334ed846f3bd41c36cc4651236 P 10dfae53d0c941f08bded43539841761 reported cstate change: term changed from 0 to 1, leader changed from <none> to 10dfae53d0c941f08bded43539841761 (127.16.126.2). New cstate: current_term: 1 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } }
I20251023 07:58:42.295816 18172 raft_consensus.cc:2468] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3a1328f9c8c484fab08292ce2171ec9 in term 1.
I20251023 07:58:42.295910 18174 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e85adbfd669946ce9f939c02865fea6a" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:42.294040 18291 tablet_bootstrap.cc:492] T f90cf0955288472898eff5b7e6459195 P 982df35c5b554a8fa64807352c4f34ee: No bootstrap required, opened a new log
I20251023 07:58:42.296900 18291 ts_tablet_manager.cc:1403] T f90cf0955288472898eff5b7e6459195 P 982df35c5b554a8fa64807352c4f34ee: Time spent bootstrapping tablet: real 0.169s user 0.017s sys 0.000s
W20251023 07:58:42.288360 18215 leader_election.cc:343] T a939fd9e853a45d1aa626a4566c14abc P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:42.297726 18066 leader_election.cc:304] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9; no voters: 982df35c5b554a8fa64807352c4f34ee
I20251023 07:58:42.298549 18300 leader_election.cc:290] T ce0cc368c5054eef9dca968072a2d4fd P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:42.299082 18300 raft_consensus.cc:2804] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:58:42.300784 18174 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce0cc368c5054eef9dca968072a2d4fd" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:42.301192 18300 raft_consensus.cc:697] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Becoming Leader. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Running, Role: LEADER
I20251023 07:58:42.301520 18293 raft_consensus.cc:359] T a939fd9e853a45d1aa626a4566c14abc P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
W20251023 07:58:42.299209 18066 leader_election.cc:343] T e85adbfd669946ce9f939c02865fea6a P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:42.302340 18300 consensus_queue.cc:237] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
W20251023 07:58:42.302903 18066 leader_election.cc:343] T ce0cc368c5054eef9dca968072a2d4fd P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Illegal state: must be running to vote when last-logged opid is not known
W20251023 07:58:42.303018 18215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.126.2:45799, user_credentials={real_user=slave}} blocked reactor thread for 64986.5us
I20251023 07:58:42.304314 18251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01f269ca63a8498498956fb3577f35d3" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:42.302912 18292 raft_consensus.cc:359] T 714c3ef74ecc47419a20ab7e23217e5e P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:42.306288 18292 raft_consensus.cc:385] T 714c3ef74ecc47419a20ab7e23217e5e P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:42.306605 18292 raft_consensus.cc:740] T 714c3ef74ecc47419a20ab7e23217e5e P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Initialized, Role: FOLLOWER
I20251023 07:58:42.302312 18293 raft_consensus.cc:385] T a939fd9e853a45d1aa626a4566c14abc P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:42.307425 18292 consensus_queue.cc:260] T 714c3ef74ecc47419a20ab7e23217e5e P b3a1328f9c8c484fab08292ce2171ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:42.311862 18217 leader_election.cc:304] T a939fd9e853a45d1aa626a4566c14abc P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9; no voters: 10dfae53d0c941f08bded43539841761
I20251023 07:58:42.313107 18514 raft_consensus.cc:2804] T a939fd9e853a45d1aa626a4566c14abc P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:58:42.307438 18293 raft_consensus.cc:740] T a939fd9e853a45d1aa626a4566c14abc P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Initialized, Role: FOLLOWER
I20251023 07:58:42.313539 18514 raft_consensus.cc:493] T a939fd9e853a45d1aa626a4566c14abc P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:42.313920 18514 raft_consensus.cc:3060] T a939fd9e853a45d1aa626a4566c14abc P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:42.314018 18293 consensus_queue.cc:260] T a939fd9e853a45d1aa626a4566c14abc P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:42.320209 18291 raft_consensus.cc:359] T f90cf0955288472898eff5b7e6459195 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:42.320768 18291 raft_consensus.cc:385] T f90cf0955288472898eff5b7e6459195 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:42.321003 18291 raft_consensus.cc:740] T f90cf0955288472898eff5b7e6459195 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Initialized, Role: FOLLOWER
I20251023 07:58:42.321728 18291 consensus_queue.cc:260] T f90cf0955288472898eff5b7e6459195 P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
W20251023 07:58:42.321944 18217 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.126.1:44025, user_credentials={real_user=slave}} blocked reactor thread for 49753.2us
I20251023 07:58:42.323565 18291 ts_tablet_manager.cc:1434] T f90cf0955288472898eff5b7e6459195 P 982df35c5b554a8fa64807352c4f34ee: Time spent starting tablet: real 0.026s user 0.005s sys 0.000s
I20251023 07:58:42.326627 18292 ts_tablet_manager.cc:1434] T 714c3ef74ecc47419a20ab7e23217e5e P b3a1328f9c8c484fab08292ce2171ec9: Time spent starting tablet: real 0.039s user 0.003s sys 0.007s
I20251023 07:58:42.327618 18545 raft_consensus.cc:493] T 85799f6eb6ae41fa9620accb877d8708 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:42.328083 18514 raft_consensus.cc:515] T a939fd9e853a45d1aa626a4566c14abc P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:42.328310 18545 raft_consensus.cc:515] T 85799f6eb6ae41fa9620accb877d8708 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:42.330746 18545 leader_election.cc:290] T 85799f6eb6ae41fa9620accb877d8708 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:42.335707 18248 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "931f55bec99140c69a4b5654b691c861" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:42.335819 18172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85799f6eb6ae41fa9620accb877d8708" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:42.328282 18292 tablet_bootstrap.cc:492] T 9bc482083f3b4c9ba97b8769ece194ad P b3a1328f9c8c484fab08292ce2171ec9: Bootstrap starting.
I20251023 07:58:42.342104 18291 tablet_bootstrap.cc:492] T e85adbfd669946ce9f939c02865fea6a P 982df35c5b554a8fa64807352c4f34ee: Bootstrap starting.
I20251023 07:58:42.356226 18293 ts_tablet_manager.cc:1434] T a939fd9e853a45d1aa626a4566c14abc P 10dfae53d0c941f08bded43539841761: Time spent starting tablet: real 0.158s user 0.011s sys 0.002s
I20251023 07:58:42.357244 18597 raft_consensus.cc:493] T f90cf0955288472898eff5b7e6459195 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:42.357878 18597 raft_consensus.cc:515] T f90cf0955288472898eff5b7e6459195 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
W20251023 07:58:42.355190 18066 leader_election.cc:343] T 85799f6eb6ae41fa9620accb877d8708 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:42.362068 18597 leader_election.cc:290] T f90cf0955288472898eff5b7e6459195 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:58:42.375385 18174 raft_consensus.cc:3060] T 01f269ca63a8498498956fb3577f35d3 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:42.378764 18099 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f90cf0955288472898eff5b7e6459195" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:42.380095 18251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e85adbfd669946ce9f939c02865fea6a" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
W20251023 07:58:42.368902 18143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.1:44025, user_credentials={real_user=slave}} blocked reactor thread for 50784.5us
I20251023 07:58:42.380864 18293 tablet_bootstrap.cc:492] T 9bc482083f3b4c9ba97b8769ece194ad P 10dfae53d0c941f08bded43539841761: Bootstrap starting.
I20251023 07:58:42.384684 18292 tablet_bootstrap.cc:654] T 9bc482083f3b4c9ba97b8769ece194ad P b3a1328f9c8c484fab08292ce2171ec9: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:42.385412 18250 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce0cc368c5054eef9dca968072a2d4fd" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:42.392529 18291 tablet_bootstrap.cc:654] T e85adbfd669946ce9f939c02865fea6a P 982df35c5b554a8fa64807352c4f34ee: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:42.406111 18099 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a939fd9e853a45d1aa626a4566c14abc" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
I20251023 07:58:42.406843 18099 raft_consensus.cc:3060] T a939fd9e853a45d1aa626a4566c14abc P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Advancing to term 1
W20251023 07:58:42.411240 18067 leader_election.cc:343] T 931f55bec99140c69a4b5654b691c861 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:42.411594 18067 leader_election.cc:304] T 931f55bec99140c69a4b5654b691c861 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3a1328f9c8c484fab08292ce2171ec9; no voters: 10dfae53d0c941f08bded43539841761, 982df35c5b554a8fa64807352c4f34ee
I20251023 07:58:42.412755 18250 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85799f6eb6ae41fa9620accb877d8708" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:42.423058 18142 leader_election.cc:304] T 01f269ca63a8498498956fb3577f35d3 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10dfae53d0c941f08bded43539841761; no voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9
I20251023 07:58:42.429420 18514 leader_election.cc:290] T a939fd9e853a45d1aa626a4566c14abc P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 election: Requested vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:58:42.439797 18300 raft_consensus.cc:2749] T 931f55bec99140c69a4b5654b691c861 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:58:42.461690 18099 raft_consensus.cc:2468] T a939fd9e853a45d1aa626a4566c14abc P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 1.
I20251023 07:58:42.492703 17997 catalog_manager.cc:5649] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P b3a1328f9c8c484fab08292ce2171ec9 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1). New cstate: current_term: 1 leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } }
I20251023 07:58:42.501737 18390 raft_consensus.cc:493] T 7a0f3569fcc34ba8b721d4ca9f31b6fa P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:42.502343 18390 raft_consensus.cc:515] T 7a0f3569fcc34ba8b721d4ca9f31b6fa P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
W20251023 07:58:42.480837 18143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.1:44025, user_credentials={real_user=slave}} blocked reactor thread for 65746.1us
I20251023 07:58:42.504467 18390 leader_election.cc:290] T 7a0f3569fcc34ba8b721d4ca9f31b6fa P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:58:42.509121 18171 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f90cf0955288472898eff5b7e6459195" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
W20251023 07:58:42.496061 18217 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.1:44025, user_credentials={real_user=slave}} blocked reactor thread for 64530.2us
I20251023 07:58:42.525722 18215 leader_election.cc:304] T f90cf0955288472898eff5b7e6459195 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee; no voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9
I20251023 07:58:42.529721 18500 raft_consensus.cc:2749] T f90cf0955288472898eff5b7e6459195 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251023 07:58:42.527256 18142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.3:46061, user_credentials={real_user=slave}} blocked reactor thread for 64655.6us
I20251023 07:58:42.557267 18251 raft_consensus.cc:3060] T f90cf0955288472898eff5b7e6459195 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Advancing to term 1
W20251023 07:58:42.569999 18067 leader_election.cc:343] T ce0cc368c5054eef9dca968072a2d4fd P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:42.570904 18067 leader_election.cc:304] T ce0cc368c5054eef9dca968072a2d4fd P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3a1328f9c8c484fab08292ce2171ec9; no voters: 10dfae53d0c941f08bded43539841761, 982df35c5b554a8fa64807352c4f34ee
I20251023 07:58:42.573648 18292 tablet_bootstrap.cc:492] T 9bc482083f3b4c9ba97b8769ece194ad P b3a1328f9c8c484fab08292ce2171ec9: No bootstrap required, opened a new log
I20251023 07:58:42.574144 18292 ts_tablet_manager.cc:1403] T 9bc482083f3b4c9ba97b8769ece194ad P b3a1328f9c8c484fab08292ce2171ec9: Time spent bootstrapping tablet: real 0.246s user 0.011s sys 0.009s
I20251023 07:58:42.577086 18172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a939fd9e853a45d1aa626a4566c14abc" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761"
W20251023 07:58:42.577517 18067 leader_election.cc:343] T e85adbfd669946ce9f939c02865fea6a P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:42.577685 18172 raft_consensus.cc:3060] T a939fd9e853a45d1aa626a4566c14abc P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:42.577955 18067 leader_election.cc:304] T e85adbfd669946ce9f939c02865fea6a P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3a1328f9c8c484fab08292ce2171ec9; no voters: 10dfae53d0c941f08bded43539841761, 982df35c5b554a8fa64807352c4f34ee
W20251023 07:58:42.579588 18067 leader_election.cc:343] T 85799f6eb6ae41fa9620accb877d8708 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:42.579903 18067 leader_election.cc:304] T 85799f6eb6ae41fa9620accb877d8708 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3a1328f9c8c484fab08292ce2171ec9; no voters: 10dfae53d0c941f08bded43539841761, 982df35c5b554a8fa64807352c4f34ee
I20251023 07:58:42.576722 18248 raft_consensus.cc:3060] T 7a0f3569fcc34ba8b721d4ca9f31b6fa P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:42.567963 18217 leader_election.cc:304] T a939fd9e853a45d1aa626a4566c14abc P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:58:42.584889 18630 raft_consensus.cc:2749] T ce0cc368c5054eef9dca968072a2d4fd P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:58:42.585162 18293 tablet_bootstrap.cc:654] T 9bc482083f3b4c9ba97b8769ece194ad P 10dfae53d0c941f08bded43539841761: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:42.590008 18632 raft_consensus.cc:2749] T 85799f6eb6ae41fa9620accb877d8708 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:58:42.584139 18545 raft_consensus.cc:2749] T e85adbfd669946ce9f939c02865fea6a P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:58:42.599841 18292 raft_consensus.cc:359] T 9bc482083f3b4c9ba97b8769ece194ad P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:42.600353 18292 raft_consensus.cc:385] T 9bc482083f3b4c9ba97b8769ece194ad P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:42.600570 18292 raft_consensus.cc:740] T 9bc482083f3b4c9ba97b8769ece194ad P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Initialized, Role: FOLLOWER
I20251023 07:58:42.601939 18096 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7a0f3569fcc34ba8b721d4ca9f31b6fa" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:42.604564 18291 tablet_bootstrap.cc:492] T e85adbfd669946ce9f939c02865fea6a P 982df35c5b554a8fa64807352c4f34ee: No bootstrap required, opened a new log
I20251023 07:58:42.605010 18291 ts_tablet_manager.cc:1403] T e85adbfd669946ce9f939c02865fea6a P 982df35c5b554a8fa64807352c4f34ee: Time spent bootstrapping tablet: real 0.280s user 0.021s sys 0.033s
I20251023 07:58:42.602744 18292 consensus_queue.cc:260] T 9bc482083f3b4c9ba97b8769ece194ad P b3a1328f9c8c484fab08292ce2171ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:42.594408 18597 raft_consensus.cc:2804] T a939fd9e853a45d1aa626a4566c14abc P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:58:42.608089 18172 raft_consensus.cc:2468] T a939fd9e853a45d1aa626a4566c14abc P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 1.
I20251023 07:58:42.612852 18175 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7a0f3569fcc34ba8b721d4ca9f31b6fa" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:42.617897 18292 ts_tablet_manager.cc:1434] T 9bc482083f3b4c9ba97b8769ece194ad P b3a1328f9c8c484fab08292ce2171ec9: Time spent starting tablet: real 0.043s user 0.006s sys 0.001s
I20251023 07:58:42.619004 18292 tablet_bootstrap.cc:492] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P b3a1328f9c8c484fab08292ce2171ec9: Bootstrap starting.
I20251023 07:58:42.620604 18597 raft_consensus.cc:697] T a939fd9e853a45d1aa626a4566c14abc P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Becoming Leader. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Running, Role: LEADER
I20251023 07:58:42.643862 18291 raft_consensus.cc:359] T e85adbfd669946ce9f939c02865fea6a P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:42.644873 18291 raft_consensus.cc:385] T e85adbfd669946ce9f939c02865fea6a P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:42.645138 18291 raft_consensus.cc:740] T e85adbfd669946ce9f939c02865fea6a P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Initialized, Role: FOLLOWER
I20251023 07:58:42.648788 18495 consensus_queue.cc:1048] T f90cf0955288472898eff5b7e6459195 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:42.661113 18291 consensus_queue.cc:260] T e85adbfd669946ce9f939c02865fea6a P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:42.638630 18496 raft_consensus.cc:2749] T 01f269ca63a8498498956fb3577f35d3 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:58:42.636502 18217 leader_election.cc:304] T 7a0f3569fcc34ba8b721d4ca9f31b6fa P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee; no voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9
I20251023 07:58:42.659600 18597 consensus_queue.cc:237] T a939fd9e853a45d1aa626a4566c14abc P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:42.689054 18390 consensus_queue.cc:1048] T e25fd146cb564be69022d0f53010bbfa P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:58:42.693599 18291 ts_tablet_manager.cc:1434] T e85adbfd669946ce9f939c02865fea6a P 982df35c5b554a8fa64807352c4f34ee: Time spent starting tablet: real 0.088s user 0.003s sys 0.006s
I20251023 07:58:42.694990 18291 tablet_bootstrap.cc:492] T c8b2781a072e401dba80e2879748e681 P 982df35c5b554a8fa64807352c4f34ee: Bootstrap starting.
W20251023 07:58:42.712349 18215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.2:45799, user_credentials={real_user=slave}} blocked reactor thread for 84101.1us
I20251023 07:58:42.711083 18496 consensus_queue.cc:1048] T 063924334ed846f3bd41c36cc4651236 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20251023 07:58:42.728135 18636 consensus_queue.cc:1048] T e25fd146cb564be69022d0f53010bbfa P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20251023 07:58:42.728641 18496 raft_consensus.cc:493] T c8b2781a072e401dba80e2879748e681 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:42.729293 18496 raft_consensus.cc:515] T c8b2781a072e401dba80e2879748e681 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:42.736922 18293 tablet_bootstrap.cc:492] T 9bc482083f3b4c9ba97b8769ece194ad P 10dfae53d0c941f08bded43539841761: No bootstrap required, opened a new log
I20251023 07:58:42.737421 18293 ts_tablet_manager.cc:1403] T 9bc482083f3b4c9ba97b8769ece194ad P 10dfae53d0c941f08bded43539841761: Time spent bootstrapping tablet: real 0.378s user 0.054s sys 0.022s
I20251023 07:58:42.744174 18496 leader_election.cc:290] T c8b2781a072e401dba80e2879748e681 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:42.746912 18589 consensus_queue.cc:1048] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:58:42.798041 18293 raft_consensus.cc:359] T 9bc482083f3b4c9ba97b8769ece194ad P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:42.798768 18293 raft_consensus.cc:385] T 9bc482083f3b4c9ba97b8769ece194ad P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:42.799072 18293 raft_consensus.cc:740] T 9bc482083f3b4c9ba97b8769ece194ad P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Initialized, Role: FOLLOWER
I20251023 07:58:42.780328 18505 raft_consensus.cc:493] T 714c3ef74ecc47419a20ab7e23217e5e P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:42.800329 18291 tablet_bootstrap.cc:654] T c8b2781a072e401dba80e2879748e681 P 982df35c5b554a8fa64807352c4f34ee: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:42.809852 18244 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c8b2781a072e401dba80e2879748e681" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:42.810714 18293 consensus_queue.cc:260] T 9bc482083f3b4c9ba97b8769ece194ad P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:42.815690 18293 ts_tablet_manager.cc:1434] T 9bc482083f3b4c9ba97b8769ece194ad P 10dfae53d0c941f08bded43539841761: Time spent starting tablet: real 0.078s user 0.004s sys 0.004s
I20251023 07:58:42.822556 18292 tablet_bootstrap.cc:654] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P b3a1328f9c8c484fab08292ce2171ec9: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:42.826407 18631 raft_consensus.cc:2749] T 7a0f3569fcc34ba8b721d4ca9f31b6fa P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:58:42.805507 18099 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c8b2781a072e401dba80e2879748e681" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:42.844277 18293 tablet_bootstrap.cc:492] T 3c5c040d6ebe40e5a5be6be47de5a7bc P 10dfae53d0c941f08bded43539841761: Bootstrap starting.
W20251023 07:58:42.844408 18639 log.cc:927] Time spent T e25fd146cb564be69022d0f53010bbfa P b3a1328f9c8c484fab08292ce2171ec9: Append to log took a long time: real 0.050s user 0.001s sys 0.000s
I20251023 07:58:42.827114 18505 raft_consensus.cc:515] T 714c3ef74ecc47419a20ab7e23217e5e P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:42.842136 18514 raft_consensus.cc:493] T e85adbfd669946ce9f939c02865fea6a P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:42.850277 18514 raft_consensus.cc:515] T e85adbfd669946ce9f939c02865fea6a P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:42.852451 18514 leader_election.cc:290] T e85adbfd669946ce9f939c02865fea6a P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:58:42.854939 18505 leader_election.cc:290] T 714c3ef74ecc47419a20ab7e23217e5e P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:42.858660 18173 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "714c3ef74ecc47419a20ab7e23217e5e" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:42.862418 18630 raft_consensus.cc:493] T 9bc482083f3b4c9ba97b8769ece194ad P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:42.862972 18630 raft_consensus.cc:515] T 9bc482083f3b4c9ba97b8769ece194ad P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:42.865058 18630 leader_election.cc:290] T 9bc482083f3b4c9ba97b8769ece194ad P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:42.866808 18102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e85adbfd669946ce9f939c02865fea6a" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:42.867401 18102 raft_consensus.cc:2468] T e85adbfd669946ce9f939c02865fea6a P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 0.
W20251023 07:58:42.867637 18066 leader_election.cc:343] T 714c3ef74ecc47419a20ab7e23217e5e P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:42.870463 18173 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bc482083f3b4c9ba97b8769ece194ad" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:42.871174 18173 raft_consensus.cc:2468] T 9bc482083f3b4c9ba97b8769ece194ad P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3a1328f9c8c484fab08292ce2171ec9 in term 0.
I20251023 07:58:42.873577 18066 leader_election.cc:304] T 9bc482083f3b4c9ba97b8769ece194ad P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9; no voters:
W20251023 07:58:42.874238 18143 leader_election.cc:343] T c8b2781a072e401dba80e2879748e681 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:42.875532 18300 raft_consensus.cc:2804] T 9bc482083f3b4c9ba97b8769ece194ad P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:58:42.875897 18300 raft_consensus.cc:493] T 9bc482083f3b4c9ba97b8769ece194ad P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:42.876247 18300 raft_consensus.cc:3060] T 9bc482083f3b4c9ba97b8769ece194ad P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:42.881086 18217 leader_election.cc:304] T e85adbfd669946ce9f939c02865fea6a P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:58:42.887214 18244 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "714c3ef74ecc47419a20ab7e23217e5e" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:42.888128 18631 raft_consensus.cc:2804] T e85adbfd669946ce9f939c02865fea6a P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:58:42.888577 18631 raft_consensus.cc:493] T e85adbfd669946ce9f939c02865fea6a P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:42.888955 18631 raft_consensus.cc:3060] T e85adbfd669946ce9f939c02865fea6a P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:42.890588 18291 tablet_bootstrap.cc:492] T c8b2781a072e401dba80e2879748e681 P 982df35c5b554a8fa64807352c4f34ee: No bootstrap required, opened a new log
I20251023 07:58:42.891093 18291 ts_tablet_manager.cc:1403] T c8b2781a072e401dba80e2879748e681 P 982df35c5b554a8fa64807352c4f34ee: Time spent bootstrapping tablet: real 0.196s user 0.012s sys 0.008s
I20251023 07:58:42.893216 18300 raft_consensus.cc:515] T 9bc482083f3b4c9ba97b8769ece194ad P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:42.893697 18291 raft_consensus.cc:359] T c8b2781a072e401dba80e2879748e681 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:42.888321 18292 tablet_bootstrap.cc:492] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P b3a1328f9c8c484fab08292ce2171ec9: No bootstrap required, opened a new log
W20251023 07:58:42.894511 18142 leader_election.cc:343] T c8b2781a072e401dba80e2879748e681 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:42.896037 18292 ts_tablet_manager.cc:1403] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P b3a1328f9c8c484fab08292ce2171ec9: Time spent bootstrapping tablet: real 0.277s user 0.010s sys 0.011s
I20251023 07:58:42.896265 18291 raft_consensus.cc:385] T c8b2781a072e401dba80e2879748e681 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:42.898875 18291 raft_consensus.cc:740] T c8b2781a072e401dba80e2879748e681 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Initialized, Role: FOLLOWER
I20251023 07:58:42.900900 18300 leader_election.cc:290] T 9bc482083f3b4c9ba97b8769ece194ad P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 election: Requested vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:42.905659 18244 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bc482083f3b4c9ba97b8769ece194ad" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:42.908497 18173 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e85adbfd669946ce9f939c02865fea6a" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:42.910442 18142 leader_election.cc:304] T c8b2781a072e401dba80e2879748e681 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10dfae53d0c941f08bded43539841761; no voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9
I20251023 07:58:42.911625 18495 raft_consensus.cc:2749] T c8b2781a072e401dba80e2879748e681 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:58:42.922833 18291 consensus_queue.cc:260] T c8b2781a072e401dba80e2879748e681 P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:42.929172 18251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bc482083f3b4c9ba97b8769ece194ad" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
I20251023 07:58:42.940745 18292 raft_consensus.cc:359] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:42.941807 18292 raft_consensus.cc:385] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:42.941929 18631 raft_consensus.cc:515] T e85adbfd669946ce9f939c02865fea6a P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:42.942214 18292 raft_consensus.cc:740] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Initialized, Role: FOLLOWER
I20251023 07:58:42.943316 18292 consensus_queue.cc:260] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P b3a1328f9c8c484fab08292ce2171ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:42.944049 18631 leader_election.cc:290] T e85adbfd669946ce9f939c02865fea6a P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 election: Requested vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:58:42.948930 18101 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e85adbfd669946ce9f939c02865fea6a" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
I20251023 07:58:42.949604 18101 raft_consensus.cc:3060] T e85adbfd669946ce9f939c02865fea6a P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:42.955155 18291 ts_tablet_manager.cc:1434] T c8b2781a072e401dba80e2879748e681 P 982df35c5b554a8fa64807352c4f34ee: Time spent starting tablet: real 0.064s user 0.008s sys 0.001s
I20251023 07:58:42.955842 18174 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bc482083f3b4c9ba97b8769ece194ad" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761"
I20251023 07:58:42.956208 18291 tablet_bootstrap.cc:492] T 063924334ed846f3bd41c36cc4651236 P 982df35c5b554a8fa64807352c4f34ee: Bootstrap starting.
I20251023 07:58:42.959578 18101 raft_consensus.cc:2468] T e85adbfd669946ce9f939c02865fea6a P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 1.
I20251023 07:58:42.961158 18292 ts_tablet_manager.cc:1434] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P b3a1328f9c8c484fab08292ce2171ec9: Time spent starting tablet: real 0.063s user 0.007s sys 0.001s
I20251023 07:58:42.962426 18174 raft_consensus.cc:3060] T 9bc482083f3b4c9ba97b8769ece194ad P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:42.956408 18293 tablet_bootstrap.cc:654] T 3c5c040d6ebe40e5a5be6be47de5a7bc P 10dfae53d0c941f08bded43539841761: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:42.963325 18292 tablet_bootstrap.cc:492] T 3c5c040d6ebe40e5a5be6be47de5a7bc P b3a1328f9c8c484fab08292ce2171ec9: Bootstrap starting.
I20251023 07:58:42.965664 18217 leader_election.cc:304] T e85adbfd669946ce9f939c02865fea6a P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:58:42.967609 18300 raft_consensus.cc:493] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:42.967976 18300 raft_consensus.cc:515] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:42.969565 18300 leader_election.cc:290] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:42.970661 18645 raft_consensus.cc:2804] T e85adbfd669946ce9f939c02865fea6a P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:58:42.971256 18500 raft_consensus.cc:493] T c8b2781a072e401dba80e2879748e681 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:42.971746 18176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d6dd28a0f414e8e93fe9cf4c98ce4a2" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:42.971704 18500 raft_consensus.cc:515] T c8b2781a072e401dba80e2879748e681 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:42.973489 18645 raft_consensus.cc:697] T e85adbfd669946ce9f939c02865fea6a P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Becoming Leader. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Running, Role: LEADER
W20251023 07:58:42.973973 18066 leader_election.cc:343] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:42.974174 18500 leader_election.cc:290] T c8b2781a072e401dba80e2879748e681 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:58:42.974687 18645 consensus_queue.cc:237] T e85adbfd669946ce9f939c02865fea6a P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:42.977361 18097 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c8b2781a072e401dba80e2879748e681" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
W20251023 07:58:42.980882 18217 leader_election.cc:343] T c8b2781a072e401dba80e2879748e681 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:42.991655 18291 tablet_bootstrap.cc:654] T 063924334ed846f3bd41c36cc4651236 P 982df35c5b554a8fa64807352c4f34ee: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:42.994844 18174 raft_consensus.cc:2468] T 9bc482083f3b4c9ba97b8769ece194ad P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3a1328f9c8c484fab08292ce2171ec9 in term 1.
I20251023 07:58:42.996433 18066 leader_election.cc:304] T 9bc482083f3b4c9ba97b8769ece194ad P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:58:42.997526 18300 raft_consensus.cc:2804] T 9bc482083f3b4c9ba97b8769ece194ad P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:58:42.998080 18300 raft_consensus.cc:697] T 9bc482083f3b4c9ba97b8769ece194ad P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Becoming Leader. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Running, Role: LEADER
I20251023 07:58:42.998998 18300 consensus_queue.cc:237] T 9bc482083f3b4c9ba97b8769ece194ad P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.006942 18292 tablet_bootstrap.cc:654] T 3c5c040d6ebe40e5a5be6be47de5a7bc P b3a1328f9c8c484fab08292ce2171ec9: Neither blocks nor log segments found. Creating new log.
W20251023 07:58:43.017755 18067 leader_election.cc:343] T 714c3ef74ecc47419a20ab7e23217e5e P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:43.018251 18067 leader_election.cc:304] T 714c3ef74ecc47419a20ab7e23217e5e P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3a1328f9c8c484fab08292ce2171ec9; no voters: 10dfae53d0c941f08bded43539841761, 982df35c5b554a8fa64807352c4f34ee
W20251023 07:58:43.019344 18067 leader_election.cc:343] T 9bc482083f3b4c9ba97b8769ece194ad P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:43.021790 18505 raft_consensus.cc:2749] T 714c3ef74ecc47419a20ab7e23217e5e P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251023 07:58:43.023487 18067 consensus_peers.cc:597] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P b3a1328f9c8c484fab08292ce2171ec9 -> Peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Couldn't send request to peer 982df35c5b554a8fa64807352c4f34ee. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:58:43.023566 18174 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e85adbfd669946ce9f939c02865fea6a" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761"
W20251023 07:58:43.026649 18067 leader_election.cc:343] T 9bc482083f3b4c9ba97b8769ece194ad P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:43.025897 18176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c8b2781a072e401dba80e2879748e681" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:43.027881 18176 raft_consensus.cc:2468] T c8b2781a072e401dba80e2879748e681 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 0.
W20251023 07:58:43.024145 18142 consensus_peers.cc:597] T 063924334ed846f3bd41c36cc4651236 P 10dfae53d0c941f08bded43539841761 -> Peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Couldn't send request to peer 982df35c5b554a8fa64807352c4f34ee. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:58:43.032588 18291 tablet_bootstrap.cc:492] T 063924334ed846f3bd41c36cc4651236 P 982df35c5b554a8fa64807352c4f34ee: No bootstrap required, opened a new log
W20251023 07:58:43.032580 18215 leader_election.cc:343] T e85adbfd669946ce9f939c02865fea6a P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:43.033187 18291 ts_tablet_manager.cc:1403] T 063924334ed846f3bd41c36cc4651236 P 982df35c5b554a8fa64807352c4f34ee: Time spent bootstrapping tablet: real 0.077s user 0.009s sys 0.006s
W20251023 07:58:43.035574 18215 leader_election.cc:343] T e85adbfd669946ce9f939c02865fea6a P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:43.036548 18215 leader_election.cc:304] T c8b2781a072e401dba80e2879748e681 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10dfae53d0c941f08bded43539841761, 982df35c5b554a8fa64807352c4f34ee; no voters: b3a1328f9c8c484fab08292ce2171ec9
I20251023 07:58:43.036136 17997 catalog_manager.cc:5649] T a939fd9e853a45d1aa626a4566c14abc P 982df35c5b554a8fa64807352c4f34ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 982df35c5b554a8fa64807352c4f34ee (127.16.126.3). New cstate: current_term: 1 leader_uuid: "982df35c5b554a8fa64807352c4f34ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: HEALTHY } } }
I20251023 07:58:43.037343 18291 raft_consensus.cc:359] T 063924334ed846f3bd41c36cc4651236 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.038058 18291 raft_consensus.cc:385] T 063924334ed846f3bd41c36cc4651236 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:43.038316 18291 raft_consensus.cc:740] T 063924334ed846f3bd41c36cc4651236 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Initialized, Role: FOLLOWER
I20251023 07:58:43.038520 18246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d6dd28a0f414e8e93fe9cf4c98ce4a2" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:43.038929 18291 consensus_queue.cc:260] T 063924334ed846f3bd41c36cc4651236 P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.040957 18293 tablet_bootstrap.cc:492] T 3c5c040d6ebe40e5a5be6be47de5a7bc P 10dfae53d0c941f08bded43539841761: No bootstrap required, opened a new log
I20251023 07:58:43.041538 18293 ts_tablet_manager.cc:1403] T 3c5c040d6ebe40e5a5be6be47de5a7bc P 10dfae53d0c941f08bded43539841761: Time spent bootstrapping tablet: real 0.198s user 0.012s sys 0.019s
I20251023 07:58:43.041038 18000 catalog_manager.cc:5649] T 9bc482083f3b4c9ba97b8769ece194ad P b3a1328f9c8c484fab08292ce2171ec9 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1). New cstate: current_term: 1 leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } }
I20251023 07:58:43.043360 18631 raft_consensus.cc:2804] T c8b2781a072e401dba80e2879748e681 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:58:43.043799 18631 raft_consensus.cc:493] T c8b2781a072e401dba80e2879748e681 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:43.044153 18631 raft_consensus.cc:3060] T c8b2781a072e401dba80e2879748e681 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Advancing to term 1
W20251023 07:58:43.044526 18067 leader_election.cc:343] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:43.044986 18067 leader_election.cc:304] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3a1328f9c8c484fab08292ce2171ec9; no voters: 10dfae53d0c941f08bded43539841761, 982df35c5b554a8fa64807352c4f34ee
I20251023 07:58:43.045675 18630 raft_consensus.cc:2749] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:58:43.049288 18293 raft_consensus.cc:359] T 3c5c040d6ebe40e5a5be6be47de5a7bc P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.050249 18293 raft_consensus.cc:385] T 3c5c040d6ebe40e5a5be6be47de5a7bc P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:43.050573 18293 raft_consensus.cc:740] T 3c5c040d6ebe40e5a5be6be47de5a7bc P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Initialized, Role: FOLLOWER
I20251023 07:58:43.051374 18293 consensus_queue.cc:260] T 3c5c040d6ebe40e5a5be6be47de5a7bc P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.059486 18293 ts_tablet_manager.cc:1434] T 3c5c040d6ebe40e5a5be6be47de5a7bc P 10dfae53d0c941f08bded43539841761: Time spent starting tablet: real 0.018s user 0.008s sys 0.000s
I20251023 07:58:43.064188 18293 tablet_bootstrap.cc:492] T 931f55bec99140c69a4b5654b691c861 P 10dfae53d0c941f08bded43539841761: Bootstrap starting.
I20251023 07:58:43.073925 18631 raft_consensus.cc:515] T c8b2781a072e401dba80e2879748e681 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.084141 18099 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c8b2781a072e401dba80e2879748e681" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
W20251023 07:58:43.088267 18217 leader_election.cc:343] T c8b2781a072e401dba80e2879748e681 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:43.095232 18292 tablet_bootstrap.cc:492] T 3c5c040d6ebe40e5a5be6be47de5a7bc P b3a1328f9c8c484fab08292ce2171ec9: No bootstrap required, opened a new log
I20251023 07:58:43.096796 18292 ts_tablet_manager.cc:1403] T 3c5c040d6ebe40e5a5be6be47de5a7bc P b3a1328f9c8c484fab08292ce2171ec9: Time spent bootstrapping tablet: real 0.134s user 0.010s sys 0.012s
I20251023 07:58:43.097584 18631 leader_election.cc:290] T c8b2781a072e401dba80e2879748e681 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 election: Requested vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:58:43.097747 18291 ts_tablet_manager.cc:1434] T 063924334ed846f3bd41c36cc4651236 P 982df35c5b554a8fa64807352c4f34ee: Time spent starting tablet: real 0.064s user 0.007s sys 0.000s
I20251023 07:58:43.099403 18291 tablet_bootstrap.cc:492] T 3c5c040d6ebe40e5a5be6be47de5a7bc P 982df35c5b554a8fa64807352c4f34ee: Bootstrap starting.
W20251023 07:58:43.102384 18048 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20251023 07:58:43.103478 18293 tablet_bootstrap.cc:654] T 931f55bec99140c69a4b5654b691c861 P 10dfae53d0c941f08bded43539841761: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:43.104506 18645 raft_consensus.cc:493] T 063924334ed846f3bd41c36cc4651236 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:43.107115 18645 raft_consensus.cc:515] T 063924334ed846f3bd41c36cc4651236 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.109021 18292 raft_consensus.cc:359] T 3c5c040d6ebe40e5a5be6be47de5a7bc P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.108155 18176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c8b2781a072e401dba80e2879748e681" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761"
I20251023 07:58:43.110024 18176 raft_consensus.cc:3060] T c8b2781a072e401dba80e2879748e681 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:43.110877 18645 leader_election.cc:290] T 063924334ed846f3bd41c36cc4651236 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:58:43.109555 18292 raft_consensus.cc:385] T 3c5c040d6ebe40e5a5be6be47de5a7bc P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:43.112591 18292 raft_consensus.cc:740] T 3c5c040d6ebe40e5a5be6be47de5a7bc P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Initialized, Role: FOLLOWER
I20251023 07:58:43.114431 18099 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "063924334ed846f3bd41c36cc4651236" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:43.119223 18170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "063924334ed846f3bd41c36cc4651236" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:43.120112 18176 raft_consensus.cc:2468] T c8b2781a072e401dba80e2879748e681 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 1.
I20251023 07:58:43.119716 18292 consensus_queue.cc:260] T 3c5c040d6ebe40e5a5be6be47de5a7bc P b3a1328f9c8c484fab08292ce2171ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.122222 18631 consensus_queue.cc:1048] T a939fd9e853a45d1aa626a4566c14abc P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20251023 07:58:43.124351 18292 ts_tablet_manager.cc:1434] T 3c5c040d6ebe40e5a5be6be47de5a7bc P b3a1328f9c8c484fab08292ce2171ec9: Time spent starting tablet: real 0.027s user 0.004s sys 0.001s
I20251023 07:58:43.125468 18292 tablet_bootstrap.cc:492] T dad81a56e87946cbb2a7f3e33c2e2bd4 P b3a1328f9c8c484fab08292ce2171ec9: Bootstrap starting.
I20251023 07:58:43.129483 18215 leader_election.cc:304] T 063924334ed846f3bd41c36cc4651236 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee; no voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9
I20251023 07:58:43.132556 18215 leader_election.cc:304] T c8b2781a072e401dba80e2879748e681 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10dfae53d0c941f08bded43539841761, 982df35c5b554a8fa64807352c4f34ee; no voters: b3a1328f9c8c484fab08292ce2171ec9
I20251023 07:58:43.132344 18645 raft_consensus.cc:2749] T 063924334ed846f3bd41c36cc4651236 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:58:43.162925 18645 raft_consensus.cc:2804] T c8b2781a072e401dba80e2879748e681 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:58:43.171123 18645 raft_consensus.cc:697] T c8b2781a072e401dba80e2879748e681 P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Becoming Leader. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Running, Role: LEADER
I20251023 07:58:43.173030 18291 tablet_bootstrap.cc:654] T 3c5c040d6ebe40e5a5be6be47de5a7bc P 982df35c5b554a8fa64807352c4f34ee: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:43.172022 18645 consensus_queue.cc:237] T c8b2781a072e401dba80e2879748e681 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.182243 18293 tablet_bootstrap.cc:492] T 931f55bec99140c69a4b5654b691c861 P 10dfae53d0c941f08bded43539841761: No bootstrap required, opened a new log
I20251023 07:58:43.183843 18293 ts_tablet_manager.cc:1403] T 931f55bec99140c69a4b5654b691c861 P 10dfae53d0c941f08bded43539841761: Time spent bootstrapping tablet: real 0.120s user 0.024s sys 0.028s
I20251023 07:58:43.185607 18292 tablet_bootstrap.cc:654] T dad81a56e87946cbb2a7f3e33c2e2bd4 P b3a1328f9c8c484fab08292ce2171ec9: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:43.196271 18644 consensus_queue.cc:1048] T a939fd9e853a45d1aa626a4566c14abc P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20251023 07:58:43.206662 18293 raft_consensus.cc:359] T 931f55bec99140c69a4b5654b691c861 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.207587 18293 raft_consensus.cc:385] T 931f55bec99140c69a4b5654b691c861 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:43.207866 18293 raft_consensus.cc:740] T 931f55bec99140c69a4b5654b691c861 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Initialized, Role: FOLLOWER
I20251023 07:58:43.209631 18293 consensus_queue.cc:260] T 931f55bec99140c69a4b5654b691c861 P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.211402 18293 ts_tablet_manager.cc:1434] T 931f55bec99140c69a4b5654b691c861 P 10dfae53d0c941f08bded43539841761: Time spent starting tablet: real 0.027s user 0.002s sys 0.004s
I20251023 07:58:43.216362 18293 tablet_bootstrap.cc:492] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 10dfae53d0c941f08bded43539841761: Bootstrap starting.
I20251023 07:58:43.220921 18000 catalog_manager.cc:5649] T c8b2781a072e401dba80e2879748e681 P 982df35c5b554a8fa64807352c4f34ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 982df35c5b554a8fa64807352c4f34ee (127.16.126.3). New cstate: current_term: 1 leader_uuid: "982df35c5b554a8fa64807352c4f34ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: HEALTHY } } }
I20251023 07:58:43.246937 18000 catalog_manager.cc:5649] T e85adbfd669946ce9f939c02865fea6a P 982df35c5b554a8fa64807352c4f34ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 982df35c5b554a8fa64807352c4f34ee (127.16.126.3). New cstate: current_term: 1 leader_uuid: "982df35c5b554a8fa64807352c4f34ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: HEALTHY } } }
I20251023 07:58:43.250226 18292 tablet_bootstrap.cc:492] T dad81a56e87946cbb2a7f3e33c2e2bd4 P b3a1328f9c8c484fab08292ce2171ec9: No bootstrap required, opened a new log
I20251023 07:58:43.251000 18292 ts_tablet_manager.cc:1403] T dad81a56e87946cbb2a7f3e33c2e2bd4 P b3a1328f9c8c484fab08292ce2171ec9: Time spent bootstrapping tablet: real 0.126s user 0.011s sys 0.011s
I20251023 07:58:43.255935 18505 raft_consensus.cc:493] T 3c5c040d6ebe40e5a5be6be47de5a7bc P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:43.257890 18505 raft_consensus.cc:515] T 3c5c040d6ebe40e5a5be6be47de5a7bc P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.260602 18505 leader_election.cc:290] T 3c5c040d6ebe40e5a5be6be47de5a7bc P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:43.263303 18292 raft_consensus.cc:359] T dad81a56e87946cbb2a7f3e33c2e2bd4 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.264056 18292 raft_consensus.cc:385] T dad81a56e87946cbb2a7f3e33c2e2bd4 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:43.264317 18292 raft_consensus.cc:740] T dad81a56e87946cbb2a7f3e33c2e2bd4 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Initialized, Role: FOLLOWER
I20251023 07:58:43.268834 18251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3c5c040d6ebe40e5a5be6be47de5a7bc" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
W20251023 07:58:43.274164 18067 leader_election.cc:343] T 3c5c040d6ebe40e5a5be6be47de5a7bc P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:43.274729 18174 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3c5c040d6ebe40e5a5be6be47de5a7bc" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:43.268519 18292 consensus_queue.cc:260] T dad81a56e87946cbb2a7f3e33c2e2bd4 P b3a1328f9c8c484fab08292ce2171ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.276639 18291 tablet_bootstrap.cc:492] T 3c5c040d6ebe40e5a5be6be47de5a7bc P 982df35c5b554a8fa64807352c4f34ee: No bootstrap required, opened a new log
I20251023 07:58:43.277168 18291 ts_tablet_manager.cc:1403] T 3c5c040d6ebe40e5a5be6be47de5a7bc P 982df35c5b554a8fa64807352c4f34ee: Time spent bootstrapping tablet: real 0.178s user 0.016s sys 0.011s
I20251023 07:58:43.275416 18174 raft_consensus.cc:2468] T 3c5c040d6ebe40e5a5be6be47de5a7bc P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3a1328f9c8c484fab08292ce2171ec9 in term 0.
I20251023 07:58:43.279738 18066 leader_election.cc:304] T 3c5c040d6ebe40e5a5be6be47de5a7bc P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9; no voters: 982df35c5b554a8fa64807352c4f34ee
I20251023 07:58:43.281193 18505 raft_consensus.cc:2804] T 3c5c040d6ebe40e5a5be6be47de5a7bc P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:58:43.281677 18505 raft_consensus.cc:493] T 3c5c040d6ebe40e5a5be6be47de5a7bc P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:43.282028 18505 raft_consensus.cc:3060] T 3c5c040d6ebe40e5a5be6be47de5a7bc P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:43.286540 18291 raft_consensus.cc:359] T 3c5c040d6ebe40e5a5be6be47de5a7bc P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.287091 18291 raft_consensus.cc:385] T 3c5c040d6ebe40e5a5be6be47de5a7bc P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:43.287302 18291 raft_consensus.cc:740] T 3c5c040d6ebe40e5a5be6be47de5a7bc P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Initialized, Role: FOLLOWER
I20251023 07:58:43.287810 18291 consensus_queue.cc:260] T 3c5c040d6ebe40e5a5be6be47de5a7bc P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.289494 18291 ts_tablet_manager.cc:1434] T 3c5c040d6ebe40e5a5be6be47de5a7bc P 982df35c5b554a8fa64807352c4f34ee: Time spent starting tablet: real 0.012s user 0.006s sys 0.000s
I20251023 07:58:43.290522 18291 tablet_bootstrap.cc:492] T ce0cc368c5054eef9dca968072a2d4fd P 982df35c5b554a8fa64807352c4f34ee: Bootstrap starting.
I20251023 07:58:43.295835 18292 ts_tablet_manager.cc:1434] T dad81a56e87946cbb2a7f3e33c2e2bd4 P b3a1328f9c8c484fab08292ce2171ec9: Time spent starting tablet: real 0.044s user 0.005s sys 0.003s
I20251023 07:58:43.296851 18292 tablet_bootstrap.cc:492] T c8b2781a072e401dba80e2879748e681 P b3a1328f9c8c484fab08292ce2171ec9: Bootstrap starting.
I20251023 07:58:43.306748 18292 tablet_bootstrap.cc:654] T c8b2781a072e401dba80e2879748e681 P b3a1328f9c8c484fab08292ce2171ec9: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:43.315058 18293 tablet_bootstrap.cc:654] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 10dfae53d0c941f08bded43539841761: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:43.317391 18291 tablet_bootstrap.cc:654] T ce0cc368c5054eef9dca968072a2d4fd P 982df35c5b554a8fa64807352c4f34ee: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:43.320205 18505 raft_consensus.cc:515] T 3c5c040d6ebe40e5a5be6be47de5a7bc P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.328665 18174 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3c5c040d6ebe40e5a5be6be47de5a7bc" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761"
I20251023 07:58:43.329396 18174 raft_consensus.cc:3060] T 3c5c040d6ebe40e5a5be6be47de5a7bc P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:43.343123 18251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3c5c040d6ebe40e5a5be6be47de5a7bc" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
I20251023 07:58:43.343726 18251 raft_consensus.cc:3060] T 3c5c040d6ebe40e5a5be6be47de5a7bc P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:43.343884 18174 raft_consensus.cc:2468] T 3c5c040d6ebe40e5a5be6be47de5a7bc P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3a1328f9c8c484fab08292ce2171ec9 in term 1.
I20251023 07:58:43.344744 18505 leader_election.cc:290] T 3c5c040d6ebe40e5a5be6be47de5a7bc P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 election: Requested vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:43.346846 18066 leader_election.cc:304] T 3c5c040d6ebe40e5a5be6be47de5a7bc P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:58:43.348003 18293 tablet_bootstrap.cc:492] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 10dfae53d0c941f08bded43539841761: No bootstrap required, opened a new log
I20251023 07:58:43.348469 18293 ts_tablet_manager.cc:1403] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 10dfae53d0c941f08bded43539841761: Time spent bootstrapping tablet: real 0.132s user 0.016s sys 0.020s
I20251023 07:58:43.349215 18630 raft_consensus.cc:2804] T 3c5c040d6ebe40e5a5be6be47de5a7bc P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:58:43.349771 18630 raft_consensus.cc:697] T 3c5c040d6ebe40e5a5be6be47de5a7bc P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Becoming Leader. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Running, Role: LEADER
I20251023 07:58:43.350608 18630 consensus_queue.cc:237] T 3c5c040d6ebe40e5a5be6be47de5a7bc P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.352047 18292 tablet_bootstrap.cc:492] T c8b2781a072e401dba80e2879748e681 P b3a1328f9c8c484fab08292ce2171ec9: No bootstrap required, opened a new log
I20251023 07:58:43.352480 18292 ts_tablet_manager.cc:1403] T c8b2781a072e401dba80e2879748e681 P b3a1328f9c8c484fab08292ce2171ec9: Time spent bootstrapping tablet: real 0.056s user 0.009s sys 0.002s
I20251023 07:58:43.352687 18293 raft_consensus.cc:359] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.353343 18293 raft_consensus.cc:385] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:43.353641 18293 raft_consensus.cc:740] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Initialized, Role: FOLLOWER
I20251023 07:58:43.353998 18251 raft_consensus.cc:2468] T 3c5c040d6ebe40e5a5be6be47de5a7bc P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3a1328f9c8c484fab08292ce2171ec9 in term 1.
I20251023 07:58:43.354245 18293 consensus_queue.cc:260] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.356549 18293 ts_tablet_manager.cc:1434] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 10dfae53d0c941f08bded43539841761: Time spent starting tablet: real 0.008s user 0.005s sys 0.000s
I20251023 07:58:43.356969 18291 tablet_bootstrap.cc:492] T ce0cc368c5054eef9dca968072a2d4fd P 982df35c5b554a8fa64807352c4f34ee: No bootstrap required, opened a new log
I20251023 07:58:43.357875 18291 ts_tablet_manager.cc:1403] T ce0cc368c5054eef9dca968072a2d4fd P 982df35c5b554a8fa64807352c4f34ee: Time spent bootstrapping tablet: real 0.068s user 0.010s sys 0.020s
I20251023 07:58:43.360563 18291 raft_consensus.cc:359] T ce0cc368c5054eef9dca968072a2d4fd P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.361356 18291 raft_consensus.cc:385] T ce0cc368c5054eef9dca968072a2d4fd P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:43.355123 18292 raft_consensus.cc:359] T c8b2781a072e401dba80e2879748e681 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.361757 18291 raft_consensus.cc:740] T ce0cc368c5054eef9dca968072a2d4fd P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Initialized, Role: FOLLOWER
I20251023 07:58:43.361955 18292 raft_consensus.cc:385] T c8b2781a072e401dba80e2879748e681 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:43.362239 18292 raft_consensus.cc:740] T c8b2781a072e401dba80e2879748e681 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Initialized, Role: FOLLOWER
I20251023 07:58:43.362488 18291 consensus_queue.cc:260] T ce0cc368c5054eef9dca968072a2d4fd P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.364976 18291 ts_tablet_manager.cc:1434] T ce0cc368c5054eef9dca968072a2d4fd P 982df35c5b554a8fa64807352c4f34ee: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20251023 07:58:43.366370 18293 tablet_bootstrap.cc:492] T e85adbfd669946ce9f939c02865fea6a P 10dfae53d0c941f08bded43539841761: Bootstrap starting.
I20251023 07:58:43.366410 18291 tablet_bootstrap.cc:492] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P 982df35c5b554a8fa64807352c4f34ee: Bootstrap starting.
I20251023 07:58:43.370309 18292 consensus_queue.cc:260] T c8b2781a072e401dba80e2879748e681 P b3a1328f9c8c484fab08292ce2171ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.372270 18291 tablet_bootstrap.cc:654] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P 982df35c5b554a8fa64807352c4f34ee: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:43.372522 18292 ts_tablet_manager.cc:1434] T c8b2781a072e401dba80e2879748e681 P b3a1328f9c8c484fab08292ce2171ec9: Time spent starting tablet: real 0.020s user 0.006s sys 0.000s
I20251023 07:58:43.373420 18292 tablet_bootstrap.cc:492] T 5939b6a960ea4b0581b61ccdcdfa7c37 P b3a1328f9c8c484fab08292ce2171ec9: Bootstrap starting.
I20251023 07:58:43.384178 18291 tablet_bootstrap.cc:492] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P 982df35c5b554a8fa64807352c4f34ee: No bootstrap required, opened a new log
I20251023 07:58:43.385203 18291 ts_tablet_manager.cc:1403] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P 982df35c5b554a8fa64807352c4f34ee: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.013s
I20251023 07:58:43.388412 18293 tablet_bootstrap.cc:654] T e85adbfd669946ce9f939c02865fea6a P 10dfae53d0c941f08bded43539841761: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:43.390771 18291 raft_consensus.cc:359] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.391469 18291 raft_consensus.cc:385] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:43.391749 18291 raft_consensus.cc:740] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Initialized, Role: FOLLOWER
I20251023 07:58:43.392396 18291 consensus_queue.cc:260] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.393812 18292 tablet_bootstrap.cc:654] T 5939b6a960ea4b0581b61ccdcdfa7c37 P b3a1328f9c8c484fab08292ce2171ec9: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:43.394678 18291 ts_tablet_manager.cc:1434] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P 982df35c5b554a8fa64807352c4f34ee: Time spent starting tablet: real 0.009s user 0.006s sys 0.000s
I20251023 07:58:43.395728 18291 tablet_bootstrap.cc:492] T 85799f6eb6ae41fa9620accb877d8708 P 982df35c5b554a8fa64807352c4f34ee: Bootstrap starting.
I20251023 07:58:43.396983 18246 raft_consensus.cc:3060] T 063924334ed846f3bd41c36cc4651236 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:43.401762 18291 tablet_bootstrap.cc:654] T 85799f6eb6ae41fa9620accb877d8708 P 982df35c5b554a8fa64807352c4f34ee: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:43.404003 18293 tablet_bootstrap.cc:492] T e85adbfd669946ce9f939c02865fea6a P 10dfae53d0c941f08bded43539841761: No bootstrap required, opened a new log
I20251023 07:58:43.404577 18293 ts_tablet_manager.cc:1403] T e85adbfd669946ce9f939c02865fea6a P 10dfae53d0c941f08bded43539841761: Time spent bootstrapping tablet: real 0.038s user 0.008s sys 0.003s
I20251023 07:58:43.407722 18293 raft_consensus.cc:359] T e85adbfd669946ce9f939c02865fea6a P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.408355 18293 raft_consensus.cc:385] T e85adbfd669946ce9f939c02865fea6a P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:43.408690 18293 raft_consensus.cc:740] T e85adbfd669946ce9f939c02865fea6a P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Initialized, Role: FOLLOWER
I20251023 07:58:43.415923 18292 tablet_bootstrap.cc:492] T 5939b6a960ea4b0581b61ccdcdfa7c37 P b3a1328f9c8c484fab08292ce2171ec9: No bootstrap required, opened a new log
I20251023 07:58:43.416558 18292 ts_tablet_manager.cc:1403] T 5939b6a960ea4b0581b61ccdcdfa7c37 P b3a1328f9c8c484fab08292ce2171ec9: Time spent bootstrapping tablet: real 0.043s user 0.009s sys 0.000s
I20251023 07:58:43.418517 18000 catalog_manager.cc:5649] T 3c5c040d6ebe40e5a5be6be47de5a7bc P b3a1328f9c8c484fab08292ce2171ec9 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1). New cstate: current_term: 1 leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } }
I20251023 07:58:43.419924 18292 raft_consensus.cc:359] T 5939b6a960ea4b0581b61ccdcdfa7c37 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.420833 18292 raft_consensus.cc:385] T 5939b6a960ea4b0581b61ccdcdfa7c37 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:43.421541 18293 consensus_queue.cc:260] T e85adbfd669946ce9f939c02865fea6a P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.424883 18293 ts_tablet_manager.cc:1434] T e85adbfd669946ce9f939c02865fea6a P 10dfae53d0c941f08bded43539841761: Time spent starting tablet: real 0.020s user 0.006s sys 0.000s
I20251023 07:58:43.426378 18644 consensus_queue.cc:1048] T e85adbfd669946ce9f939c02865fea6a P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:43.421203 18292 raft_consensus.cc:740] T 5939b6a960ea4b0581b61ccdcdfa7c37 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Initialized, Role: FOLLOWER
I20251023 07:58:43.435122 18293 tablet_bootstrap.cc:492] T 85799f6eb6ae41fa9620accb877d8708 P 10dfae53d0c941f08bded43539841761: Bootstrap starting.
I20251023 07:58:43.440364 18656 raft_consensus.cc:493] T 931f55bec99140c69a4b5654b691c861 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:43.440265 18292 consensus_queue.cc:260] T 5939b6a960ea4b0581b61ccdcdfa7c37 P b3a1328f9c8c484fab08292ce2171ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.441095 18656 raft_consensus.cc:515] T 931f55bec99140c69a4b5654b691c861 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.444345 18292 ts_tablet_manager.cc:1434] T 5939b6a960ea4b0581b61ccdcdfa7c37 P b3a1328f9c8c484fab08292ce2171ec9: Time spent starting tablet: real 0.027s user 0.008s sys 0.002s
I20251023 07:58:43.445421 18292 tablet_bootstrap.cc:492] T d3b72ceda32a4ebc8de6e7a7992498aa P b3a1328f9c8c484fab08292ce2171ec9: Bootstrap starting.
I20251023 07:58:43.445628 18291 tablet_bootstrap.cc:492] T 85799f6eb6ae41fa9620accb877d8708 P 982df35c5b554a8fa64807352c4f34ee: No bootstrap required, opened a new log
I20251023 07:58:43.446084 18291 ts_tablet_manager.cc:1403] T 85799f6eb6ae41fa9620accb877d8708 P 982df35c5b554a8fa64807352c4f34ee: Time spent bootstrapping tablet: real 0.051s user 0.032s sys 0.015s
I20251023 07:58:43.448268 18630 raft_consensus.cc:493] T 5939b6a960ea4b0581b61ccdcdfa7c37 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:43.448271 18097 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "931f55bec99140c69a4b5654b691c861" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:43.450039 18247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "931f55bec99140c69a4b5654b691c861" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:43.450197 18097 raft_consensus.cc:2468] T 931f55bec99140c69a4b5654b691c861 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 0.
I20251023 07:58:43.449286 18630 raft_consensus.cc:515] T 5939b6a960ea4b0581b61ccdcdfa7c37 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.451256 18143 leader_election.cc:304] T 931f55bec99140c69a4b5654b691c861 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:58:43.451949 18496 raft_consensus.cc:2804] T 931f55bec99140c69a4b5654b691c861 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:58:43.452312 18496 raft_consensus.cc:493] T 931f55bec99140c69a4b5654b691c861 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:43.452625 18496 raft_consensus.cc:3060] T 931f55bec99140c69a4b5654b691c861 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Advancing to term 1
W20251023 07:58:43.455353 18142 leader_election.cc:343] T 931f55bec99140c69a4b5654b691c861 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:43.465740 18176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5939b6a960ea4b0581b61ccdcdfa7c37" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:43.466377 18176 raft_consensus.cc:2468] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3a1328f9c8c484fab08292ce2171ec9 in term 0.
I20251023 07:58:43.448647 18656 leader_election.cc:290] T 931f55bec99140c69a4b5654b691c861 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:43.466779 18174 raft_consensus.cc:3060] T e85adbfd669946ce9f939c02865fea6a P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:43.471019 18066 leader_election.cc:304] T 5939b6a960ea4b0581b61ccdcdfa7c37 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:58:43.472625 18300 raft_consensus.cc:2804] T 5939b6a960ea4b0581b61ccdcdfa7c37 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:58:43.472965 18300 raft_consensus.cc:493] T 5939b6a960ea4b0581b61ccdcdfa7c37 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:43.473244 18300 raft_consensus.cc:3060] T 5939b6a960ea4b0581b61ccdcdfa7c37 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:43.475925 18293 tablet_bootstrap.cc:654] T 85799f6eb6ae41fa9620accb877d8708 P 10dfae53d0c941f08bded43539841761: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:43.481218 18292 tablet_bootstrap.cc:654] T d3b72ceda32a4ebc8de6e7a7992498aa P b3a1328f9c8c484fab08292ce2171ec9: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:43.482764 18251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5939b6a960ea4b0581b61ccdcdfa7c37" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:43.478047 18630 leader_election.cc:290] T 5939b6a960ea4b0581b61ccdcdfa7c37 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:43.496747 18496 raft_consensus.cc:515] T 931f55bec99140c69a4b5654b691c861 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.499145 18291 raft_consensus.cc:359] T 85799f6eb6ae41fa9620accb877d8708 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.499866 18291 raft_consensus.cc:385] T 85799f6eb6ae41fa9620accb877d8708 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:43.500121 18099 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "931f55bec99140c69a4b5654b691c861" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
I20251023 07:58:43.500720 18099 raft_consensus.cc:3060] T 931f55bec99140c69a4b5654b691c861 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:43.495018 18300 raft_consensus.cc:515] T 5939b6a960ea4b0581b61ccdcdfa7c37 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.509683 18099 raft_consensus.cc:2468] T 931f55bec99140c69a4b5654b691c861 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 1.
I20251023 07:58:43.510829 18143 leader_election.cc:304] T 931f55bec99140c69a4b5654b691c861 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:58:43.511710 18496 leader_election.cc:290] T 931f55bec99140c69a4b5654b691c861 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 election: Requested vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
W20251023 07:58:43.508800 18067 leader_election.cc:343] T 5939b6a960ea4b0581b61ccdcdfa7c37 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:43.511718 18656 raft_consensus.cc:2804] T 931f55bec99140c69a4b5654b691c861 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:58:43.514258 18656 raft_consensus.cc:697] T 931f55bec99140c69a4b5654b691c861 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Becoming Leader. State: Replica: 10dfae53d0c941f08bded43539841761, State: Running, Role: LEADER
I20251023 07:58:43.519680 18300 leader_election.cc:290] T 5939b6a960ea4b0581b61ccdcdfa7c37 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 election: Requested vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:43.519999 18247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "931f55bec99140c69a4b5654b691c861" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
I20251023 07:58:43.500139 18291 raft_consensus.cc:740] T 85799f6eb6ae41fa9620accb877d8708 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Initialized, Role: FOLLOWER
I20251023 07:58:43.521166 18291 consensus_queue.cc:260] T 85799f6eb6ae41fa9620accb877d8708 P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
W20251023 07:58:43.521523 18142 leader_election.cc:343] T 931f55bec99140c69a4b5654b691c861 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:43.522744 18176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5939b6a960ea4b0581b61ccdcdfa7c37" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761"
I20251023 07:58:43.523707 18176 raft_consensus.cc:3060] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:43.523893 18291 ts_tablet_manager.cc:1434] T 85799f6eb6ae41fa9620accb877d8708 P 982df35c5b554a8fa64807352c4f34ee: Time spent starting tablet: real 0.078s user 0.006s sys 0.000s
I20251023 07:58:43.529093 18293 tablet_bootstrap.cc:492] T 85799f6eb6ae41fa9620accb877d8708 P 10dfae53d0c941f08bded43539841761: No bootstrap required, opened a new log
I20251023 07:58:43.529644 18293 ts_tablet_manager.cc:1403] T 85799f6eb6ae41fa9620accb877d8708 P 10dfae53d0c941f08bded43539841761: Time spent bootstrapping tablet: real 0.095s user 0.011s sys 0.010s
I20251023 07:58:43.530452 18247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5939b6a960ea4b0581b61ccdcdfa7c37" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
I20251023 07:58:43.531845 18292 tablet_bootstrap.cc:492] T d3b72ceda32a4ebc8de6e7a7992498aa P b3a1328f9c8c484fab08292ce2171ec9: No bootstrap required, opened a new log
I20251023 07:58:43.532354 18292 ts_tablet_manager.cc:1403] T d3b72ceda32a4ebc8de6e7a7992498aa P b3a1328f9c8c484fab08292ce2171ec9: Time spent bootstrapping tablet: real 0.087s user 0.008s sys 0.009s
I20251023 07:58:43.533892 18597 consensus_queue.cc:1048] T e85adbfd669946ce9f939c02865fea6a P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:58:43.533811 18293 raft_consensus.cc:359] T 85799f6eb6ae41fa9620accb877d8708 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.534821 18293 raft_consensus.cc:385] T 85799f6eb6ae41fa9620accb877d8708 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:43.535171 18293 raft_consensus.cc:740] T 85799f6eb6ae41fa9620accb877d8708 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Initialized, Role: FOLLOWER
I20251023 07:58:43.536650 18291 tablet_bootstrap.cc:492] T dad81a56e87946cbb2a7f3e33c2e2bd4 P 982df35c5b554a8fa64807352c4f34ee: Bootstrap starting.
I20251023 07:58:43.537464 18292 raft_consensus.cc:359] T d3b72ceda32a4ebc8de6e7a7992498aa P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.541680 18292 raft_consensus.cc:385] T d3b72ceda32a4ebc8de6e7a7992498aa P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20251023 07:58:43.539116 18067 leader_election.cc:343] T 5939b6a960ea4b0581b61ccdcdfa7c37 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:43.544554 18291 tablet_bootstrap.cc:654] T dad81a56e87946cbb2a7f3e33c2e2bd4 P 982df35c5b554a8fa64807352c4f34ee: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:43.542209 18292 raft_consensus.cc:740] T d3b72ceda32a4ebc8de6e7a7992498aa P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Initialized, Role: FOLLOWER
I20251023 07:58:43.546121 18292 consensus_queue.cc:260] T d3b72ceda32a4ebc8de6e7a7992498aa P b3a1328f9c8c484fab08292ce2171ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.548951 18292 ts_tablet_manager.cc:1434] T d3b72ceda32a4ebc8de6e7a7992498aa P b3a1328f9c8c484fab08292ce2171ec9: Time spent starting tablet: real 0.016s user 0.006s sys 0.000s
I20251023 07:58:43.549549 18656 consensus_queue.cc:237] T 931f55bec99140c69a4b5654b691c861 P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.550248 18292 tablet_bootstrap.cc:492] T 8f25975c7ab4439c9975a5e5604727dc P b3a1328f9c8c484fab08292ce2171ec9: Bootstrap starting.
I20251023 07:58:43.542786 18293 consensus_queue.cc:260] T 85799f6eb6ae41fa9620accb877d8708 P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.552358 18293 ts_tablet_manager.cc:1434] T 85799f6eb6ae41fa9620accb877d8708 P 10dfae53d0c941f08bded43539841761: Time spent starting tablet: real 0.022s user 0.005s sys 0.000s
I20251023 07:58:43.553311 18293 tablet_bootstrap.cc:492] T d3b72ceda32a4ebc8de6e7a7992498aa P 10dfae53d0c941f08bded43539841761: Bootstrap starting.
I20251023 07:58:43.553364 18176 raft_consensus.cc:2468] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3a1328f9c8c484fab08292ce2171ec9 in term 1.
I20251023 07:58:43.562042 18292 tablet_bootstrap.cc:654] T 8f25975c7ab4439c9975a5e5604727dc P b3a1328f9c8c484fab08292ce2171ec9: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:43.568709 18066 leader_election.cc:304] T 5939b6a960ea4b0581b61ccdcdfa7c37 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9; no voters: 982df35c5b554a8fa64807352c4f34ee
I20251023 07:58:43.570302 18505 raft_consensus.cc:2804] T 5939b6a960ea4b0581b61ccdcdfa7c37 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:58:43.570967 18505 raft_consensus.cc:697] T 5939b6a960ea4b0581b61ccdcdfa7c37 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Becoming Leader. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Running, Role: LEADER
I20251023 07:58:43.572124 18505 consensus_queue.cc:237] T 5939b6a960ea4b0581b61ccdcdfa7c37 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.577062 17997 catalog_manager.cc:5649] T 931f55bec99140c69a4b5654b691c861 P 10dfae53d0c941f08bded43539841761 reported cstate change: term changed from 0 to 1, leader changed from <none> to 10dfae53d0c941f08bded43539841761 (127.16.126.2). New cstate: current_term: 1 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } }
W20251023 07:58:43.584726 18067 consensus_peers.cc:597] T 9bc482083f3b4c9ba97b8769ece194ad P b3a1328f9c8c484fab08292ce2171ec9 -> Peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Couldn't send request to peer 982df35c5b554a8fa64807352c4f34ee. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:58:43.595098 18300 consensus_queue.cc:1048] T 9bc482083f3b4c9ba97b8769ece194ad P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:43.599654 18293 tablet_bootstrap.cc:654] T d3b72ceda32a4ebc8de6e7a7992498aa P 10dfae53d0c941f08bded43539841761: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:43.612850 17997 catalog_manager.cc:5649] T 5939b6a960ea4b0581b61ccdcdfa7c37 P b3a1328f9c8c484fab08292ce2171ec9 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1). New cstate: current_term: 1 leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } }
I20251023 07:58:43.622606 18291 tablet_bootstrap.cc:492] T dad81a56e87946cbb2a7f3e33c2e2bd4 P 982df35c5b554a8fa64807352c4f34ee: No bootstrap required, opened a new log
I20251023 07:58:43.623121 18291 ts_tablet_manager.cc:1403] T dad81a56e87946cbb2a7f3e33c2e2bd4 P 982df35c5b554a8fa64807352c4f34ee: Time spent bootstrapping tablet: real 0.087s user 0.011s sys 0.003s
I20251023 07:58:43.630362 18291 raft_consensus.cc:359] T dad81a56e87946cbb2a7f3e33c2e2bd4 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.631053 18291 raft_consensus.cc:385] T dad81a56e87946cbb2a7f3e33c2e2bd4 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:43.631316 18291 raft_consensus.cc:740] T dad81a56e87946cbb2a7f3e33c2e2bd4 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Initialized, Role: FOLLOWER
I20251023 07:58:43.631922 18291 consensus_queue.cc:260] T dad81a56e87946cbb2a7f3e33c2e2bd4 P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.634138 18631 raft_consensus.cc:493] T ce0cc368c5054eef9dca968072a2d4fd P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:43.634605 18631 raft_consensus.cc:515] T ce0cc368c5054eef9dca968072a2d4fd P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.636498 18631 leader_election.cc:290] T ce0cc368c5054eef9dca968072a2d4fd P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:58:43.637015 18631 consensus_queue.cc:1048] T c8b2781a072e401dba80e2879748e681 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:43.639521 18101 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce0cc368c5054eef9dca968072a2d4fd" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:43.640221 18101 raft_consensus.cc:2468] T ce0cc368c5054eef9dca968072a2d4fd P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 0.
I20251023 07:58:43.641523 18217 leader_election.cc:304] T ce0cc368c5054eef9dca968072a2d4fd P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:58:43.642365 18631 raft_consensus.cc:2804] T ce0cc368c5054eef9dca968072a2d4fd P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:58:43.642845 18631 raft_consensus.cc:493] T ce0cc368c5054eef9dca968072a2d4fd P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:43.643227 18631 raft_consensus.cc:3060] T ce0cc368c5054eef9dca968072a2d4fd P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:43.645473 18291 ts_tablet_manager.cc:1434] T dad81a56e87946cbb2a7f3e33c2e2bd4 P 982df35c5b554a8fa64807352c4f34ee: Time spent starting tablet: real 0.022s user 0.005s sys 0.000s
I20251023 07:58:43.646564 18291 tablet_bootstrap.cc:492] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P 982df35c5b554a8fa64807352c4f34ee: Bootstrap starting.
I20251023 07:58:43.649808 18173 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce0cc368c5054eef9dca968072a2d4fd" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:43.650899 18293 tablet_bootstrap.cc:492] T d3b72ceda32a4ebc8de6e7a7992498aa P 10dfae53d0c941f08bded43539841761: No bootstrap required, opened a new log
I20251023 07:58:43.651192 18632 raft_consensus.cc:493] T dad81a56e87946cbb2a7f3e33c2e2bd4 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:43.651348 18293 ts_tablet_manager.cc:1403] T d3b72ceda32a4ebc8de6e7a7992498aa P 10dfae53d0c941f08bded43539841761: Time spent bootstrapping tablet: real 0.098s user 0.009s sys 0.002s
I20251023 07:58:43.651679 18632 raft_consensus.cc:515] T dad81a56e87946cbb2a7f3e33c2e2bd4 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.653012 18631 raft_consensus.cc:515] T ce0cc368c5054eef9dca968072a2d4fd P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.653724 18632 leader_election.cc:290] T dad81a56e87946cbb2a7f3e33c2e2bd4 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:43.654004 18293 raft_consensus.cc:359] T d3b72ceda32a4ebc8de6e7a7992498aa P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.654699 18247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dad81a56e87946cbb2a7f3e33c2e2bd4" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:43.657817 18293 raft_consensus.cc:385] T d3b72ceda32a4ebc8de6e7a7992498aa P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:43.658015 18247 raft_consensus.cc:2468] T dad81a56e87946cbb2a7f3e33c2e2bd4 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3a1328f9c8c484fab08292ce2171ec9 in term 0.
W20251023 07:58:43.655516 18215 leader_election.cc:343] T ce0cc368c5054eef9dca968072a2d4fd P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:43.659674 18631 leader_election.cc:290] T ce0cc368c5054eef9dca968072a2d4fd P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 election: Requested vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:58:43.659843 18291 tablet_bootstrap.cc:654] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P 982df35c5b554a8fa64807352c4f34ee: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:43.660681 18067 leader_election.cc:304] T dad81a56e87946cbb2a7f3e33c2e2bd4 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:58:43.661227 18632 raft_consensus.cc:2804] T dad81a56e87946cbb2a7f3e33c2e2bd4 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:58:43.661624 18632 raft_consensus.cc:493] T dad81a56e87946cbb2a7f3e33c2e2bd4 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:43.661986 18632 raft_consensus.cc:3060] T dad81a56e87946cbb2a7f3e33c2e2bd4 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:43.657277 18173 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dad81a56e87946cbb2a7f3e33c2e2bd4" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:43.661836 18101 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce0cc368c5054eef9dca968072a2d4fd" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
I20251023 07:58:43.663498 18101 raft_consensus.cc:3060] T ce0cc368c5054eef9dca968072a2d4fd P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:43.658142 18293 raft_consensus.cc:740] T d3b72ceda32a4ebc8de6e7a7992498aa P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Initialized, Role: FOLLOWER
I20251023 07:58:43.664510 18293 consensus_queue.cc:260] T d3b72ceda32a4ebc8de6e7a7992498aa P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.667289 18293 ts_tablet_manager.cc:1434] T d3b72ceda32a4ebc8de6e7a7992498aa P 10dfae53d0c941f08bded43539841761: Time spent starting tablet: real 0.016s user 0.006s sys 0.001s
W20251023 07:58:43.668113 18066 leader_election.cc:343] T dad81a56e87946cbb2a7f3e33c2e2bd4 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:43.668736 18293 tablet_bootstrap.cc:492] T ce0cc368c5054eef9dca968072a2d4fd P 10dfae53d0c941f08bded43539841761: Bootstrap starting.
I20251023 07:58:43.672719 18292 tablet_bootstrap.cc:492] T 8f25975c7ab4439c9975a5e5604727dc P b3a1328f9c8c484fab08292ce2171ec9: No bootstrap required, opened a new log
I20251023 07:58:43.673195 18292 ts_tablet_manager.cc:1403] T 8f25975c7ab4439c9975a5e5604727dc P b3a1328f9c8c484fab08292ce2171ec9: Time spent bootstrapping tablet: real 0.123s user 0.036s sys 0.022s
I20251023 07:58:43.674932 18293 tablet_bootstrap.cc:654] T ce0cc368c5054eef9dca968072a2d4fd P 10dfae53d0c941f08bded43539841761: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:43.675658 18292 raft_consensus.cc:359] T 8f25975c7ab4439c9975a5e5604727dc P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.676385 18292 raft_consensus.cc:385] T 8f25975c7ab4439c9975a5e5604727dc P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:43.676677 18292 raft_consensus.cc:740] T 8f25975c7ab4439c9975a5e5604727dc P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Initialized, Role: FOLLOWER
I20251023 07:58:43.678066 18173 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce0cc368c5054eef9dca968072a2d4fd" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761"
I20251023 07:58:43.680495 18291 tablet_bootstrap.cc:492] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P 982df35c5b554a8fa64807352c4f34ee: No bootstrap required, opened a new log
I20251023 07:58:43.681000 18291 ts_tablet_manager.cc:1403] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P 982df35c5b554a8fa64807352c4f34ee: Time spent bootstrapping tablet: real 0.035s user 0.010s sys 0.005s
I20251023 07:58:43.680737 18632 raft_consensus.cc:515] T dad81a56e87946cbb2a7f3e33c2e2bd4 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.683125 18632 leader_election.cc:290] T dad81a56e87946cbb2a7f3e33c2e2bd4 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 election: Requested vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:43.677265 18292 consensus_queue.cc:260] T 8f25975c7ab4439c9975a5e5604727dc P b3a1328f9c8c484fab08292ce2171ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.684690 18291 raft_consensus.cc:359] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.691422 18291 raft_consensus.cc:385] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:43.691501 18247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dad81a56e87946cbb2a7f3e33c2e2bd4" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
I20251023 07:58:43.691820 18291 raft_consensus.cc:740] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Initialized, Role: FOLLOWER
I20251023 07:58:43.692132 18247 raft_consensus.cc:3060] T dad81a56e87946cbb2a7f3e33c2e2bd4 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Advancing to term 1
W20251023 07:58:43.692795 18215 leader_election.cc:343] T ce0cc368c5054eef9dca968072a2d4fd P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:43.692487 18291 consensus_queue.cc:260] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.695284 18291 ts_tablet_manager.cc:1434] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P 982df35c5b554a8fa64807352c4f34ee: Time spent starting tablet: real 0.014s user 0.008s sys 0.000s
I20251023 07:58:43.687772 18292 ts_tablet_manager.cc:1434] T 8f25975c7ab4439c9975a5e5604727dc P b3a1328f9c8c484fab08292ce2171ec9: Time spent starting tablet: real 0.014s user 0.007s sys 0.000s
I20251023 07:58:43.695890 18173 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dad81a56e87946cbb2a7f3e33c2e2bd4" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761"
I20251023 07:58:43.696533 18292 tablet_bootstrap.cc:492] T ae4437d151054b59a0e93ca01a9609c7 P b3a1328f9c8c484fab08292ce2171ec9: Bootstrap starting.
W20251023 07:58:43.698451 18066 leader_election.cc:343] T dad81a56e87946cbb2a7f3e33c2e2bd4 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:43.704155 18291 tablet_bootstrap.cc:492] T 714c3ef74ecc47419a20ab7e23217e5e P 982df35c5b554a8fa64807352c4f34ee: Bootstrap starting.
I20251023 07:58:43.713418 18292 tablet_bootstrap.cc:654] T ae4437d151054b59a0e93ca01a9609c7 P b3a1328f9c8c484fab08292ce2171ec9: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:43.725525 18293 tablet_bootstrap.cc:492] T ce0cc368c5054eef9dca968072a2d4fd P 10dfae53d0c941f08bded43539841761: No bootstrap required, opened a new log
I20251023 07:58:43.720638 18101 raft_consensus.cc:2468] T ce0cc368c5054eef9dca968072a2d4fd P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 1.
I20251023 07:58:43.726855 18293 ts_tablet_manager.cc:1403] T ce0cc368c5054eef9dca968072a2d4fd P 10dfae53d0c941f08bded43539841761: Time spent bootstrapping tablet: real 0.058s user 0.011s sys 0.000s
I20251023 07:58:43.727576 18217 leader_election.cc:304] T ce0cc368c5054eef9dca968072a2d4fd P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9; no voters: 10dfae53d0c941f08bded43539841761
I20251023 07:58:43.721828 18247 raft_consensus.cc:2468] T dad81a56e87946cbb2a7f3e33c2e2bd4 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3a1328f9c8c484fab08292ce2171ec9 in term 1.
I20251023 07:58:43.726217 18291 tablet_bootstrap.cc:654] T 714c3ef74ecc47419a20ab7e23217e5e P 982df35c5b554a8fa64807352c4f34ee: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:43.743299 18631 raft_consensus.cc:2804] T ce0cc368c5054eef9dca968072a2d4fd P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:58:43.747306 18293 raft_consensus.cc:359] T ce0cc368c5054eef9dca968072a2d4fd P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.748726 18293 raft_consensus.cc:385] T ce0cc368c5054eef9dca968072a2d4fd P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:43.750146 18067 leader_election.cc:304] T dad81a56e87946cbb2a7f3e33c2e2bd4 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9; no voters: 10dfae53d0c941f08bded43539841761
I20251023 07:58:43.750259 18293 raft_consensus.cc:740] T ce0cc368c5054eef9dca968072a2d4fd P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Initialized, Role: FOLLOWER
I20251023 07:58:43.752426 18293 consensus_queue.cc:260] T ce0cc368c5054eef9dca968072a2d4fd P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.751608 18505 raft_consensus.cc:2804] T dad81a56e87946cbb2a7f3e33c2e2bd4 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:58:43.753461 18505 raft_consensus.cc:697] T dad81a56e87946cbb2a7f3e33c2e2bd4 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Becoming Leader. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Running, Role: LEADER
I20251023 07:58:43.747838 18631 raft_consensus.cc:697] T ce0cc368c5054eef9dca968072a2d4fd P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Becoming Leader. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Running, Role: LEADER
I20251023 07:58:43.759011 18101 raft_consensus.cc:3060] T c8b2781a072e401dba80e2879748e681 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:43.754312 18505 consensus_queue.cc:237] T dad81a56e87946cbb2a7f3e33c2e2bd4 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.765550 18291 tablet_bootstrap.cc:492] T 714c3ef74ecc47419a20ab7e23217e5e P 982df35c5b554a8fa64807352c4f34ee: No bootstrap required, opened a new log
I20251023 07:58:43.766124 18291 ts_tablet_manager.cc:1403] T 714c3ef74ecc47419a20ab7e23217e5e P 982df35c5b554a8fa64807352c4f34ee: Time spent bootstrapping tablet: real 0.062s user 0.006s sys 0.007s
I20251023 07:58:43.765671 18631 consensus_queue.cc:237] T ce0cc368c5054eef9dca968072a2d4fd P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.769116 18291 raft_consensus.cc:359] T 714c3ef74ecc47419a20ab7e23217e5e P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.769745 18656 raft_consensus.cc:493] T 85799f6eb6ae41fa9620accb877d8708 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:43.770247 18656 raft_consensus.cc:515] T 85799f6eb6ae41fa9620accb877d8708 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.772082 18656 leader_election.cc:290] T 85799f6eb6ae41fa9620accb877d8708 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:43.769801 18291 raft_consensus.cc:385] T 714c3ef74ecc47419a20ab7e23217e5e P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:43.773121 18291 raft_consensus.cc:740] T 714c3ef74ecc47419a20ab7e23217e5e P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Initialized, Role: FOLLOWER
I20251023 07:58:43.774164 18293 ts_tablet_manager.cc:1434] T ce0cc368c5054eef9dca968072a2d4fd P 10dfae53d0c941f08bded43539841761: Time spent starting tablet: real 0.047s user 0.006s sys 0.001s
I20251023 07:58:43.774530 18097 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85799f6eb6ae41fa9620accb877d8708" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:43.775177 18293 tablet_bootstrap.cc:492] T ae4437d151054b59a0e93ca01a9609c7 P 10dfae53d0c941f08bded43539841761: Bootstrap starting.
I20251023 07:58:43.775911 18291 consensus_queue.cc:260] T 714c3ef74ecc47419a20ab7e23217e5e P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.778097 18247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85799f6eb6ae41fa9620accb877d8708" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:43.778734 18247 raft_consensus.cc:2468] T 85799f6eb6ae41fa9620accb877d8708 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 0.
I20251023 07:58:43.775188 18097 raft_consensus.cc:2468] T 85799f6eb6ae41fa9620accb877d8708 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 0.
I20251023 07:58:43.780067 18291 ts_tablet_manager.cc:1434] T 714c3ef74ecc47419a20ab7e23217e5e P 982df35c5b554a8fa64807352c4f34ee: Time spent starting tablet: real 0.014s user 0.007s sys 0.000s
I20251023 07:58:43.781019 18143 leader_election.cc:304] T 85799f6eb6ae41fa9620accb877d8708 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:58:43.781687 18292 tablet_bootstrap.cc:492] T ae4437d151054b59a0e93ca01a9609c7 P b3a1328f9c8c484fab08292ce2171ec9: No bootstrap required, opened a new log
I20251023 07:58:43.781867 18656 raft_consensus.cc:2804] T 85799f6eb6ae41fa9620accb877d8708 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:58:43.782131 18292 ts_tablet_manager.cc:1403] T ae4437d151054b59a0e93ca01a9609c7 P b3a1328f9c8c484fab08292ce2171ec9: Time spent bootstrapping tablet: real 0.086s user 0.017s sys 0.014s
I20251023 07:58:43.782433 18656 raft_consensus.cc:493] T 85799f6eb6ae41fa9620accb877d8708 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:43.782863 18656 raft_consensus.cc:3060] T 85799f6eb6ae41fa9620accb877d8708 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:43.776573 18632 consensus_queue.cc:1048] T 3c5c040d6ebe40e5a5be6be47de5a7bc P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20251023 07:58:43.786237 18292 raft_consensus.cc:359] T ae4437d151054b59a0e93ca01a9609c7 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.786077 18000 catalog_manager.cc:5649] T dad81a56e87946cbb2a7f3e33c2e2bd4 P b3a1328f9c8c484fab08292ce2171ec9 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1). New cstate: current_term: 1 leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } }
I20251023 07:58:43.786897 18292 raft_consensus.cc:385] T ae4437d151054b59a0e93ca01a9609c7 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:43.787192 18292 raft_consensus.cc:740] T ae4437d151054b59a0e93ca01a9609c7 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Initialized, Role: FOLLOWER
I20251023 07:58:43.787779 18292 consensus_queue.cc:260] T ae4437d151054b59a0e93ca01a9609c7 P b3a1328f9c8c484fab08292ce2171ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.790529 18300 consensus_queue.cc:1048] T 3c5c040d6ebe40e5a5be6be47de5a7bc P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:43.796270 18644 consensus_queue.cc:1048] T c8b2781a072e401dba80e2879748e681 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:43.799654 18300 raft_consensus.cc:493] T c8b2781a072e401dba80e2879748e681 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:43.800140 18300 raft_consensus.cc:515] T c8b2781a072e401dba80e2879748e681 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.802321 18300 leader_election.cc:290] T c8b2781a072e401dba80e2879748e681 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:43.805645 18176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c8b2781a072e401dba80e2879748e681" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:43.806417 18293 tablet_bootstrap.cc:654] T ae4437d151054b59a0e93ca01a9609c7 P 10dfae53d0c941f08bded43539841761: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:43.810215 18644 raft_consensus.cc:493] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:43.810716 18644 raft_consensus.cc:515] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.812614 18644 leader_election.cc:290] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:58:43.814731 18100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3e78cdb4b2af4f5a855ec00a07f2cbc9" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:43.822077 18377 raft_consensus.cc:493] T d3b72ceda32a4ebc8de6e7a7992498aa P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:43.822662 18377 raft_consensus.cc:515] T d3b72ceda32a4ebc8de6e7a7992498aa P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.825260 18292 ts_tablet_manager.cc:1434] T ae4437d151054b59a0e93ca01a9609c7 P b3a1328f9c8c484fab08292ce2171ec9: Time spent starting tablet: real 0.043s user 0.007s sys 0.000s
I20251023 07:58:43.825572 18246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c8b2781a072e401dba80e2879748e681" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:43.825909 18176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3e78cdb4b2af4f5a855ec00a07f2cbc9" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:43.826532 18244 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d3b72ceda32a4ebc8de6e7a7992498aa" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:43.827682 18067 leader_election.cc:304] T c8b2781a072e401dba80e2879748e681 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3a1328f9c8c484fab08292ce2171ec9; no voters: 10dfae53d0c941f08bded43539841761, 982df35c5b554a8fa64807352c4f34ee
I20251023 07:58:43.828383 18377 leader_election.cc:290] T d3b72ceda32a4ebc8de6e7a7992498aa P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
W20251023 07:58:43.829411 18142 leader_election.cc:343] T d3b72ceda32a4ebc8de6e7a7992498aa P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:43.830078 18215 leader_election.cc:304] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee; no voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9
I20251023 07:58:43.831153 18597 raft_consensus.cc:2749] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:58:43.846637 18291 tablet_bootstrap.cc:492] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 982df35c5b554a8fa64807352c4f34ee: Bootstrap starting.
I20251023 07:58:43.853415 18632 raft_consensus.cc:2749] T c8b2781a072e401dba80e2879748e681 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251023 07:58:43.850412 18293 tablet_bootstrap.cc:492] T ae4437d151054b59a0e93ca01a9609c7 P 10dfae53d0c941f08bded43539841761: No bootstrap required, opened a new log
I20251023 07:58:43.858714 18293 ts_tablet_manager.cc:1403] T ae4437d151054b59a0e93ca01a9609c7 P 10dfae53d0c941f08bded43539841761: Time spent bootstrapping tablet: real 0.084s user 0.011s sys 0.008s
I20251023 07:58:43.859980 18597 raft_consensus.cc:493] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:43.860603 18597 raft_consensus.cc:515] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.864801 18597 leader_election.cc:290] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:58:43.865739 18097 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d6dd28a0f414e8e93fe9cf4c98ce4a2" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:43.866437 18097 raft_consensus.cc:2468] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 0.
I20251023 07:58:43.867542 18217 leader_election.cc:304] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:58:43.868404 18597 raft_consensus.cc:2804] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:58:43.868806 18597 raft_consensus.cc:493] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:43.869200 18597 raft_consensus.cc:3060] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:43.877336 18170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d6dd28a0f414e8e93fe9cf4c98ce4a2" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
W20251023 07:58:43.880326 18215 leader_election.cc:343] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:43.894953 18656 raft_consensus.cc:515] T 85799f6eb6ae41fa9620accb877d8708 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
W20251023 07:58:43.904878 18143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.1:44025, user_credentials={real_user=slave}} blocked reactor thread for 81337.5us
I20251023 07:58:43.934762 18099 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d3b72ceda32a4ebc8de6e7a7992498aa" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:43.929876 18293 raft_consensus.cc:359] T ae4437d151054b59a0e93ca01a9609c7 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.935427 18099 raft_consensus.cc:2468] T d3b72ceda32a4ebc8de6e7a7992498aa P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 0.
I20251023 07:58:43.935822 18293 raft_consensus.cc:385] T ae4437d151054b59a0e93ca01a9609c7 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:43.936110 18293 raft_consensus.cc:740] T ae4437d151054b59a0e93ca01a9609c7 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Initialized, Role: FOLLOWER
W20251023 07:58:43.932528 18215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.126.2:45799, user_credentials={real_user=slave}} blocked reactor thread for 52250.3us
I20251023 07:58:43.924764 18698 raft_consensus.cc:493] T 8f25975c7ab4439c9975a5e5604727dc P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:43.937019 18698 raft_consensus.cc:515] T 8f25975c7ab4439c9975a5e5604727dc P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.939203 18698 leader_election.cc:290] T 8f25975c7ab4439c9975a5e5604727dc P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:43.911751 18645 raft_consensus.cc:493] T 714c3ef74ecc47419a20ab7e23217e5e P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:43.940584 18645 raft_consensus.cc:515] T 714c3ef74ecc47419a20ab7e23217e5e P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.942068 18293 consensus_queue.cc:260] T ae4437d151054b59a0e93ca01a9609c7 P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.943821 18293 ts_tablet_manager.cc:1434] T ae4437d151054b59a0e93ca01a9609c7 P 10dfae53d0c941f08bded43539841761: Time spent starting tablet: real 0.085s user 0.006s sys 0.008s
I20251023 07:58:43.943905 18645 leader_election.cc:290] T 714c3ef74ecc47419a20ab7e23217e5e P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:58:43.947685 18099 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "714c3ef74ecc47419a20ab7e23217e5e" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:43.948341 18099 raft_consensus.cc:2468] T 714c3ef74ecc47419a20ab7e23217e5e P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 0.
I20251023 07:58:43.951371 18597 raft_consensus.cc:515] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:43.956686 18217 leader_election.cc:304] T 714c3ef74ecc47419a20ab7e23217e5e P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:58:43.959084 18644 raft_consensus.cc:2804] T 714c3ef74ecc47419a20ab7e23217e5e P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:58:43.959829 18644 raft_consensus.cc:493] T 714c3ef74ecc47419a20ab7e23217e5e P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:43.960026 18097 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85799f6eb6ae41fa9620accb877d8708" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
I20251023 07:58:43.961030 18097 raft_consensus.cc:3060] T 85799f6eb6ae41fa9620accb877d8708 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:43.961315 18099 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d6dd28a0f414e8e93fe9cf4c98ce4a2" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
I20251023 07:58:43.962157 18099 raft_consensus.cc:3060] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:43.967324 18293 tablet_bootstrap.cc:492] T 714c3ef74ecc47419a20ab7e23217e5e P 10dfae53d0c941f08bded43539841761: Bootstrap starting.
I20251023 07:58:43.960309 18644 raft_consensus.cc:3060] T 714c3ef74ecc47419a20ab7e23217e5e P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:43.976182 18597 leader_election.cc:290] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 election: Requested vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:58:43.976727 18173 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8f25975c7ab4439c9975a5e5604727dc" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:43.980415 18244 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85799f6eb6ae41fa9620accb877d8708" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
I20251023 07:58:43.987526 18244 raft_consensus.cc:3060] T 85799f6eb6ae41fa9620accb877d8708 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:43.994664 18244 raft_consensus.cc:2468] T 85799f6eb6ae41fa9620accb877d8708 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 1.
I20251023 07:58:43.897161 18656 leader_election.cc:290] T 85799f6eb6ae41fa9620accb877d8708 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 election: Requested vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:44.000960 18291 tablet_bootstrap.cc:654] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 982df35c5b554a8fa64807352c4f34ee: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:44.002226 18293 tablet_bootstrap.cc:654] T 714c3ef74ecc47419a20ab7e23217e5e P 10dfae53d0c941f08bded43539841761: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:44.005270 18099 raft_consensus.cc:2468] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 1.
I20251023 07:58:44.006719 18217 leader_election.cc:304] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:58:44.007517 18631 raft_consensus.cc:2804] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:58:44.009527 18251 raft_consensus.cc:3060] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:44.010281 18631 raft_consensus.cc:697] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Becoming Leader. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Running, Role: LEADER
I20251023 07:58:44.011169 18631 consensus_queue.cc:237] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:44.017843 18143 leader_election.cc:304] T d3b72ceda32a4ebc8de6e7a7992498aa P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9; no voters: 982df35c5b554a8fa64807352c4f34ee
I20251023 07:58:44.020121 18293 tablet_bootstrap.cc:492] T 714c3ef74ecc47419a20ab7e23217e5e P 10dfae53d0c941f08bded43539841761: No bootstrap required, opened a new log
W20251023 07:58:44.018165 18066 leader_election.cc:343] T 8f25975c7ab4439c9975a5e5604727dc P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:44.020656 18697 raft_consensus.cc:2804] T d3b72ceda32a4ebc8de6e7a7992498aa P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:58:44.020725 18293 ts_tablet_manager.cc:1403] T 714c3ef74ecc47419a20ab7e23217e5e P 10dfae53d0c941f08bded43539841761: Time spent bootstrapping tablet: real 0.054s user 0.008s sys 0.004s
I20251023 07:58:44.021641 18697 raft_consensus.cc:493] T d3b72ceda32a4ebc8de6e7a7992498aa P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:44.022051 18697 raft_consensus.cc:3060] T d3b72ceda32a4ebc8de6e7a7992498aa P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:44.023265 18698 consensus_queue.cc:1048] T 5939b6a960ea4b0581b61ccdcdfa7c37 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:44.024408 18293 raft_consensus.cc:359] T 714c3ef74ecc47419a20ab7e23217e5e P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:44.025079 18293 raft_consensus.cc:385] T 714c3ef74ecc47419a20ab7e23217e5e P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:44.025333 18293 raft_consensus.cc:740] T 714c3ef74ecc47419a20ab7e23217e5e P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Initialized, Role: FOLLOWER
I20251023 07:58:44.025952 18293 consensus_queue.cc:260] T 714c3ef74ecc47419a20ab7e23217e5e P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:44.026741 18097 raft_consensus.cc:2468] T 85799f6eb6ae41fa9620accb877d8708 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 1.
I20251023 07:58:44.028328 18293 ts_tablet_manager.cc:1434] T 714c3ef74ecc47419a20ab7e23217e5e P 10dfae53d0c941f08bded43539841761: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20251023 07:58:44.048983 18170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "714c3ef74ecc47419a20ab7e23217e5e" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:44.071205 18170 raft_consensus.cc:2468] T 714c3ef74ecc47419a20ab7e23217e5e P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 0.
I20251023 07:58:44.071990 18293 tablet_bootstrap.cc:492] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P 10dfae53d0c941f08bded43539841761: Bootstrap starting.
I20251023 07:58:44.065361 18176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d6dd28a0f414e8e93fe9cf4c98ce4a2" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761"
I20251023 07:58:44.037945 18244 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8f25975c7ab4439c9975a5e5604727dc" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:44.046110 18143 leader_election.cc:304] T 85799f6eb6ae41fa9620accb877d8708 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:58:44.028074 18698 raft_consensus.cc:493] T ae4437d151054b59a0e93ca01a9609c7 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:44.074450 18698 raft_consensus.cc:515] T ae4437d151054b59a0e93ca01a9609c7 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:44.047461 18644 raft_consensus.cc:515] T 714c3ef74ecc47419a20ab7e23217e5e P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:44.077664 18698 leader_election.cc:290] T ae4437d151054b59a0e93ca01a9609c7 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:44.078531 18656 raft_consensus.cc:2804] T 85799f6eb6ae41fa9620accb877d8708 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:58:44.085975 18656 raft_consensus.cc:697] T 85799f6eb6ae41fa9620accb877d8708 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Becoming Leader. State: Replica: 10dfae53d0c941f08bded43539841761, State: Running, Role: LEADER
I20251023 07:58:44.085597 17997 catalog_manager.cc:5649] T ce0cc368c5054eef9dca968072a2d4fd P 982df35c5b554a8fa64807352c4f34ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 982df35c5b554a8fa64807352c4f34ee (127.16.126.3). New cstate: current_term: 1 leader_uuid: "982df35c5b554a8fa64807352c4f34ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: HEALTHY } } }
I20251023 07:58:44.086959 18656 consensus_queue.cc:237] T 85799f6eb6ae41fa9620accb877d8708 P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:44.080770 18291 tablet_bootstrap.cc:492] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 982df35c5b554a8fa64807352c4f34ee: No bootstrap required, opened a new log
I20251023 07:58:44.088179 18291 ts_tablet_manager.cc:1403] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 982df35c5b554a8fa64807352c4f34ee: Time spent bootstrapping tablet: real 0.280s user 0.013s sys 0.000s
I20251023 07:58:44.092510 18176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ae4437d151054b59a0e93ca01a9609c7" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:44.093112 18176 raft_consensus.cc:2468] T ae4437d151054b59a0e93ca01a9609c7 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3a1328f9c8c484fab08292ce2171ec9 in term 0.
W20251023 07:58:44.095116 18142 consensus_peers.cc:597] T 931f55bec99140c69a4b5654b691c861 P 10dfae53d0c941f08bded43539841761 -> Peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Couldn't send request to peer 982df35c5b554a8fa64807352c4f34ee. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:58:44.096475 18291 raft_consensus.cc:359] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:44.101054 18291 raft_consensus.cc:385] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:44.083213 18097 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "714c3ef74ecc47419a20ab7e23217e5e" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
I20251023 07:58:44.106153 18291 raft_consensus.cc:740] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Initialized, Role: FOLLOWER
I20251023 07:58:44.106277 18097 raft_consensus.cc:3060] T 714c3ef74ecc47419a20ab7e23217e5e P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:44.106997 18291 consensus_queue.cc:260] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:44.081724 18644 leader_election.cc:290] T 714c3ef74ecc47419a20ab7e23217e5e P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 election: Requested vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:58:44.106287 18496 consensus_queue.cc:1048] T 931f55bec99140c69a4b5654b691c861 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20251023 07:58:44.112192 18291 ts_tablet_manager.cc:1434] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 982df35c5b554a8fa64807352c4f34ee: Time spent starting tablet: real 0.024s user 0.005s sys 0.000s
I20251023 07:58:44.101678 18251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ae4437d151054b59a0e93ca01a9609c7" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
W20251023 07:58:44.103497 18215 leader_election.cc:343] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:44.116410 18291 tablet_bootstrap.cc:492] T 8f25975c7ab4439c9975a5e5604727dc P 982df35c5b554a8fa64807352c4f34ee: Bootstrap starting.
I20251023 07:58:44.104357 18066 leader_election.cc:304] T ae4437d151054b59a0e93ca01a9609c7 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9; no voters:
W20251023 07:58:44.097549 18067 leader_election.cc:343] T 8f25975c7ab4439c9975a5e5604727dc P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:44.117700 18067 leader_election.cc:304] T 8f25975c7ab4439c9975a5e5604727dc P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3a1328f9c8c484fab08292ce2171ec9; no voters: 10dfae53d0c941f08bded43539841761, 982df35c5b554a8fa64807352c4f34ee
I20251023 07:58:44.119841 18632 raft_consensus.cc:2749] T 8f25975c7ab4439c9975a5e5604727dc P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251023 07:58:44.122359 18067 leader_election.cc:343] T ae4437d151054b59a0e93ca01a9609c7 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:44.122639 18097 raft_consensus.cc:2468] T 714c3ef74ecc47419a20ab7e23217e5e P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 1.
I20251023 07:58:44.080454 18697 raft_consensus.cc:515] T d3b72ceda32a4ebc8de6e7a7992498aa P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:44.123095 18632 raft_consensus.cc:2804] T ae4437d151054b59a0e93ca01a9609c7 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:58:44.123476 18632 raft_consensus.cc:493] T ae4437d151054b59a0e93ca01a9609c7 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:44.123832 18632 raft_consensus.cc:3060] T ae4437d151054b59a0e93ca01a9609c7 P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:44.124739 18697 leader_election.cc:290] T d3b72ceda32a4ebc8de6e7a7992498aa P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 election: Requested vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:44.127378 18217 leader_election.cc:304] T 714c3ef74ecc47419a20ab7e23217e5e P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:58:44.128213 18631 raft_consensus.cc:2804] T 714c3ef74ecc47419a20ab7e23217e5e P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:58:44.128679 18631 raft_consensus.cc:697] T 714c3ef74ecc47419a20ab7e23217e5e P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Becoming Leader. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Running, Role: LEADER
I20251023 07:58:44.129647 18631 consensus_queue.cc:237] T 714c3ef74ecc47419a20ab7e23217e5e P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:44.131132 18291 tablet_bootstrap.cc:654] T 8f25975c7ab4439c9975a5e5604727dc P 982df35c5b554a8fa64807352c4f34ee: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:44.113667 18293 tablet_bootstrap.cc:654] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P 10dfae53d0c941f08bded43539841761: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:44.132815 18632 raft_consensus.cc:515] T ae4437d151054b59a0e93ca01a9609c7 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:44.144263 18251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ae4437d151054b59a0e93ca01a9609c7" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
W20251023 07:58:44.145699 18067 leader_election.cc:343] T ae4437d151054b59a0e93ca01a9609c7 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:44.148443 18251 raft_consensus.cc:3060] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:44.148819 18173 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "714c3ef74ecc47419a20ab7e23217e5e" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761"
I20251023 07:58:44.149421 18173 raft_consensus.cc:3060] T 714c3ef74ecc47419a20ab7e23217e5e P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:44.150161 18293 tablet_bootstrap.cc:492] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P 10dfae53d0c941f08bded43539841761: No bootstrap required, opened a new log
I20251023 07:58:44.150619 18293 ts_tablet_manager.cc:1403] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P 10dfae53d0c941f08bded43539841761: Time spent bootstrapping tablet: real 0.079s user 0.008s sys 0.003s
I20251023 07:58:44.154928 18291 tablet_bootstrap.cc:492] T 8f25975c7ab4439c9975a5e5604727dc P 982df35c5b554a8fa64807352c4f34ee: No bootstrap required, opened a new log
I20251023 07:58:44.155416 18291 ts_tablet_manager.cc:1403] T 8f25975c7ab4439c9975a5e5604727dc P 982df35c5b554a8fa64807352c4f34ee: Time spent bootstrapping tablet: real 0.039s user 0.013s sys 0.001s
I20251023 07:58:44.156291 18632 leader_election.cc:290] T ae4437d151054b59a0e93ca01a9609c7 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 election: Requested vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:44.158077 18291 raft_consensus.cc:359] T 8f25975c7ab4439c9975a5e5604727dc P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:44.158807 18291 raft_consensus.cc:385] T 8f25975c7ab4439c9975a5e5604727dc P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:44.159075 18291 raft_consensus.cc:740] T 8f25975c7ab4439c9975a5e5604727dc P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Initialized, Role: FOLLOWER
I20251023 07:58:44.159986 18173 raft_consensus.cc:2468] T 714c3ef74ecc47419a20ab7e23217e5e P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 1.
I20251023 07:58:44.152981 18293 raft_consensus.cc:359] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:44.161684 18176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ae4437d151054b59a0e93ca01a9609c7" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761"
I20251023 07:58:44.161890 18293 raft_consensus.cc:385] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:44.162242 18176 raft_consensus.cc:3060] T ae4437d151054b59a0e93ca01a9609c7 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:44.162259 18293 raft_consensus.cc:740] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Initialized, Role: FOLLOWER
I20251023 07:58:44.163383 18293 consensus_queue.cc:260] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:44.165822 18698 consensus_queue.cc:1048] T 5939b6a960ea4b0581b61ccdcdfa7c37 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:44.168465 18291 consensus_queue.cc:260] T 8f25975c7ab4439c9975a5e5604727dc P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:44.173061 18291 ts_tablet_manager.cc:1434] T 8f25975c7ab4439c9975a5e5604727dc P 982df35c5b554a8fa64807352c4f34ee: Time spent starting tablet: real 0.017s user 0.005s sys 0.000s
I20251023 07:58:44.174299 18291 tablet_bootstrap.cc:492] T d3b72ceda32a4ebc8de6e7a7992498aa P 982df35c5b554a8fa64807352c4f34ee: Bootstrap starting.
I20251023 07:58:44.168860 18176 raft_consensus.cc:2468] T ae4437d151054b59a0e93ca01a9609c7 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3a1328f9c8c484fab08292ce2171ec9 in term 1.
I20251023 07:58:44.176476 18631 consensus_queue.cc:1048] T ce0cc368c5054eef9dca968072a2d4fd P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251023 07:58:44.181612 18142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.3:46061, user_credentials={real_user=slave}} blocked reactor thread for 79163.1us
I20251023 07:58:44.184789 18244 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d3b72ceda32a4ebc8de6e7a7992498aa" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
I20251023 07:58:44.186015 17997 catalog_manager.cc:5649] T 85799f6eb6ae41fa9620accb877d8708 P 10dfae53d0c941f08bded43539841761 reported cstate change: term changed from 0 to 1, leader changed from <none> to 10dfae53d0c941f08bded43539841761 (127.16.126.2). New cstate: current_term: 1 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } }
W20251023 07:58:44.193276 18143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.1:44025, user_credentials={real_user=slave}} blocked reactor thread for 87636.5us
I20251023 07:58:44.165848 18293 ts_tablet_manager.cc:1434] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P 10dfae53d0c941f08bded43539841761: Time spent starting tablet: real 0.015s user 0.007s sys 0.000s
W20251023 07:58:44.196669 18142 leader_election.cc:343] T d3b72ceda32a4ebc8de6e7a7992498aa P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:44.200670 18100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d3b72ceda32a4ebc8de6e7a7992498aa" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
I20251023 07:58:44.201253 18100 raft_consensus.cc:3060] T d3b72ceda32a4ebc8de6e7a7992498aa P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:44.204047 18696 raft_consensus.cc:493] T ce0cc368c5054eef9dca968072a2d4fd P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:44.204567 18696 raft_consensus.cc:515] T ce0cc368c5054eef9dca968072a2d4fd P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:44.205826 18066 leader_election.cc:304] T ae4437d151054b59a0e93ca01a9609c7 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9; no voters: 982df35c5b554a8fa64807352c4f34ee
I20251023 07:58:44.207541 18630 raft_consensus.cc:2804] T ae4437d151054b59a0e93ca01a9609c7 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:58:44.208101 18630 raft_consensus.cc:697] T ae4437d151054b59a0e93ca01a9609c7 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Becoming Leader. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Running, Role: LEADER
I20251023 07:58:44.209152 18630 consensus_queue.cc:237] T ae4437d151054b59a0e93ca01a9609c7 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:44.214511 18696 leader_election.cc:290] T ce0cc368c5054eef9dca968072a2d4fd P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:44.218667 18251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce0cc368c5054eef9dca968072a2d4fd" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:44.220860 18102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce0cc368c5054eef9dca968072a2d4fd" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:44.222702 18692 raft_consensus.cc:493] T 8f25975c7ab4439c9975a5e5604727dc P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:44.223174 18692 raft_consensus.cc:515] T 8f25975c7ab4439c9975a5e5604727dc P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:44.225871 18692 leader_election.cc:290] T 8f25975c7ab4439c9975a5e5604727dc P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:58:44.227380 18101 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8f25975c7ab4439c9975a5e5604727dc" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:44.228020 18101 raft_consensus.cc:2468] T 8f25975c7ab4439c9975a5e5604727dc P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 0.
I20251023 07:58:44.227944 18142 leader_election.cc:304] T ce0cc368c5054eef9dca968072a2d4fd P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10dfae53d0c941f08bded43539841761; no voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9
I20251023 07:58:44.224854 18100 raft_consensus.cc:2468] T d3b72ceda32a4ebc8de6e7a7992498aa P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 1.
I20251023 07:58:44.231551 18656 raft_consensus.cc:2749] T ce0cc368c5054eef9dca968072a2d4fd P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:58:44.231853 18143 leader_election.cc:304] T d3b72ceda32a4ebc8de6e7a7992498aa P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9; no voters: 982df35c5b554a8fa64807352c4f34ee
I20251023 07:58:44.233788 18293 tablet_bootstrap.cc:492] T dad81a56e87946cbb2a7f3e33c2e2bd4 P 10dfae53d0c941f08bded43539841761: Bootstrap starting.
I20251023 07:58:44.235519 18708 raft_consensus.cc:2804] T d3b72ceda32a4ebc8de6e7a7992498aa P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:58:44.236088 18708 raft_consensus.cc:697] T d3b72ceda32a4ebc8de6e7a7992498aa P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Becoming Leader. State: Replica: 10dfae53d0c941f08bded43539841761, State: Running, Role: LEADER
I20251023 07:58:44.237004 18174 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8f25975c7ab4439c9975a5e5604727dc" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:44.237021 18708 consensus_queue.cc:237] T d3b72ceda32a4ebc8de6e7a7992498aa P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:44.228528 18291 tablet_bootstrap.cc:654] T d3b72ceda32a4ebc8de6e7a7992498aa P 982df35c5b554a8fa64807352c4f34ee: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:44.229396 18217 leader_election.cc:304] T 8f25975c7ab4439c9975a5e5604727dc P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:58:44.245677 18644 raft_consensus.cc:2804] T 8f25975c7ab4439c9975a5e5604727dc P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:58:44.246078 18644 raft_consensus.cc:493] T 8f25975c7ab4439c9975a5e5604727dc P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:58:44.245496 18000 catalog_manager.cc:5649] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P 982df35c5b554a8fa64807352c4f34ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 982df35c5b554a8fa64807352c4f34ee (127.16.126.3). New cstate: current_term: 1 leader_uuid: "982df35c5b554a8fa64807352c4f34ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: HEALTHY } } }
I20251023 07:58:44.246443 18644 raft_consensus.cc:3060] T 8f25975c7ab4439c9975a5e5604727dc P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Advancing to term 1
W20251023 07:58:44.252481 18215 leader_election.cc:343] T 8f25975c7ab4439c9975a5e5604727dc P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:44.266695 18644 raft_consensus.cc:515] T 8f25975c7ab4439c9975a5e5604727dc P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:44.268769 18644 leader_election.cc:290] T 8f25975c7ab4439c9975a5e5604727dc P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 election: Requested vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:58:44.269804 18174 raft_consensus.cc:3060] T ce0cc368c5054eef9dca968072a2d4fd P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:44.270637 18099 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8f25975c7ab4439c9975a5e5604727dc" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
I20251023 07:58:44.277365 18099 raft_consensus.cc:3060] T 8f25975c7ab4439c9975a5e5604727dc P b3a1328f9c8c484fab08292ce2171ec9 [term 0 FOLLOWER]: Advancing to term 1
W20251023 07:58:44.282038 18066 consensus_peers.cc:597] T dad81a56e87946cbb2a7f3e33c2e2bd4 P b3a1328f9c8c484fab08292ce2171ec9 -> Peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Couldn't send request to peer 10dfae53d0c941f08bded43539841761. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:58:44.285929 18291 tablet_bootstrap.cc:492] T d3b72ceda32a4ebc8de6e7a7992498aa P 982df35c5b554a8fa64807352c4f34ee: No bootstrap required, opened a new log
I20251023 07:58:44.286418 18291 ts_tablet_manager.cc:1403] T d3b72ceda32a4ebc8de6e7a7992498aa P 982df35c5b554a8fa64807352c4f34ee: Time spent bootstrapping tablet: real 0.112s user 0.013s sys 0.009s
I20251023 07:58:44.289631 18173 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8f25975c7ab4439c9975a5e5604727dc" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761"
I20251023 07:58:44.288849 18291 raft_consensus.cc:359] T d3b72ceda32a4ebc8de6e7a7992498aa P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:44.290838 18291 raft_consensus.cc:385] T d3b72ceda32a4ebc8de6e7a7992498aa P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:44.291137 18291 raft_consensus.cc:740] T d3b72ceda32a4ebc8de6e7a7992498aa P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Initialized, Role: FOLLOWER
I20251023 07:58:44.291807 18291 consensus_queue.cc:260] T d3b72ceda32a4ebc8de6e7a7992498aa P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:44.294454 18291 ts_tablet_manager.cc:1434] T d3b72ceda32a4ebc8de6e7a7992498aa P 982df35c5b554a8fa64807352c4f34ee: Time spent starting tablet: real 0.008s user 0.004s sys 0.002s
I20251023 07:58:44.295493 18291 tablet_bootstrap.cc:492] T 9bc482083f3b4c9ba97b8769ece194ad P 982df35c5b554a8fa64807352c4f34ee: Bootstrap starting.
I20251023 07:58:44.293897 18099 raft_consensus.cc:2468] T 8f25975c7ab4439c9975a5e5604727dc P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 1.
I20251023 07:58:44.296660 18217 leader_election.cc:304] T 8f25975c7ab4439c9975a5e5604727dc P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:58:44.299088 18644 raft_consensus.cc:2804] T 8f25975c7ab4439c9975a5e5604727dc P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:58:44.299752 18644 raft_consensus.cc:697] T 8f25975c7ab4439c9975a5e5604727dc P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Becoming Leader. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Running, Role: LEADER
I20251023 07:58:44.300573 18644 consensus_queue.cc:237] T 8f25975c7ab4439c9975a5e5604727dc P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:44.302727 18291 tablet_bootstrap.cc:654] T 9bc482083f3b4c9ba97b8769ece194ad P 982df35c5b554a8fa64807352c4f34ee: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:44.302819 17999 catalog_manager.cc:5649] T ae4437d151054b59a0e93ca01a9609c7 P b3a1328f9c8c484fab08292ce2171ec9 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1). New cstate: current_term: 1 leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } }
I20251023 07:58:44.314157 18291 tablet_bootstrap.cc:492] T 9bc482083f3b4c9ba97b8769ece194ad P 982df35c5b554a8fa64807352c4f34ee: No bootstrap required, opened a new log
I20251023 07:58:44.314639 18291 ts_tablet_manager.cc:1403] T 9bc482083f3b4c9ba97b8769ece194ad P 982df35c5b554a8fa64807352c4f34ee: Time spent bootstrapping tablet: real 0.019s user 0.012s sys 0.005s
I20251023 07:58:44.315129 17997 catalog_manager.cc:5649] T d3b72ceda32a4ebc8de6e7a7992498aa P 10dfae53d0c941f08bded43539841761 reported cstate change: term changed from 0 to 1, leader changed from <none> to 10dfae53d0c941f08bded43539841761 (127.16.126.2). New cstate: current_term: 1 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } }
I20251023 07:58:44.317406 18291 raft_consensus.cc:359] T 9bc482083f3b4c9ba97b8769ece194ad P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:44.318182 18291 raft_consensus.cc:385] T 9bc482083f3b4c9ba97b8769ece194ad P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:44.318456 18291 raft_consensus.cc:740] T 9bc482083f3b4c9ba97b8769ece194ad P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Initialized, Role: FOLLOWER
I20251023 07:58:44.319319 18291 consensus_queue.cc:260] T 9bc482083f3b4c9ba97b8769ece194ad P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:44.322223 18291 ts_tablet_manager.cc:1434] T 9bc482083f3b4c9ba97b8769ece194ad P 982df35c5b554a8fa64807352c4f34ee: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20251023 07:58:44.323235 18291 tablet_bootstrap.cc:492] T 931f55bec99140c69a4b5654b691c861 P 982df35c5b554a8fa64807352c4f34ee: Bootstrap starting.
I20251023 07:58:44.329545 18291 tablet_bootstrap.cc:654] T 931f55bec99140c69a4b5654b691c861 P 982df35c5b554a8fa64807352c4f34ee: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:44.338992 18293 tablet_bootstrap.cc:654] T dad81a56e87946cbb2a7f3e33c2e2bd4 P 10dfae53d0c941f08bded43539841761: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:44.340260 18692 consensus_queue.cc:1048] T ce0cc368c5054eef9dca968072a2d4fd P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20251023 07:58:44.347599 18215 leader_election.cc:343] T 8f25975c7ab4439c9975a5e5604727dc P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:58:44.360749 18291 tablet_bootstrap.cc:492] T 931f55bec99140c69a4b5654b691c861 P 982df35c5b554a8fa64807352c4f34ee: No bootstrap required, opened a new log
I20251023 07:58:44.361285 18291 ts_tablet_manager.cc:1403] T 931f55bec99140c69a4b5654b691c861 P 982df35c5b554a8fa64807352c4f34ee: Time spent bootstrapping tablet: real 0.038s user 0.010s sys 0.003s
I20251023 07:58:44.365732 18291 raft_consensus.cc:359] T 931f55bec99140c69a4b5654b691c861 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:44.366418 18291 raft_consensus.cc:385] T 931f55bec99140c69a4b5654b691c861 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:44.366667 18291 raft_consensus.cc:740] T 931f55bec99140c69a4b5654b691c861 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Initialized, Role: FOLLOWER
I20251023 07:58:44.367295 18291 consensus_queue.cc:260] T 931f55bec99140c69a4b5654b691c861 P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:44.370076 18291 ts_tablet_manager.cc:1434] T 931f55bec99140c69a4b5654b691c861 P 982df35c5b554a8fa64807352c4f34ee: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20251023 07:58:44.371160 18291 tablet_bootstrap.cc:492] T ae4437d151054b59a0e93ca01a9609c7 P 982df35c5b554a8fa64807352c4f34ee: Bootstrap starting.
I20251023 07:58:44.378155 18291 tablet_bootstrap.cc:654] T ae4437d151054b59a0e93ca01a9609c7 P 982df35c5b554a8fa64807352c4f34ee: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:44.380501 18630 consensus_queue.cc:1048] T dad81a56e87946cbb2a7f3e33c2e2bd4 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:44.387189 18248 raft_consensus.cc:3060] T 931f55bec99140c69a4b5654b691c861 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:44.393456 18291 tablet_bootstrap.cc:492] T ae4437d151054b59a0e93ca01a9609c7 P 982df35c5b554a8fa64807352c4f34ee: No bootstrap required, opened a new log
I20251023 07:58:44.394016 18291 ts_tablet_manager.cc:1403] T ae4437d151054b59a0e93ca01a9609c7 P 982df35c5b554a8fa64807352c4f34ee: Time spent bootstrapping tablet: real 0.023s user 0.011s sys 0.006s
I20251023 07:58:44.397650 18291 raft_consensus.cc:359] T ae4437d151054b59a0e93ca01a9609c7 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:44.398320 18291 raft_consensus.cc:385] T ae4437d151054b59a0e93ca01a9609c7 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:44.398587 18293 tablet_bootstrap.cc:492] T dad81a56e87946cbb2a7f3e33c2e2bd4 P 10dfae53d0c941f08bded43539841761: No bootstrap required, opened a new log
I20251023 07:58:44.399066 18293 ts_tablet_manager.cc:1403] T dad81a56e87946cbb2a7f3e33c2e2bd4 P 10dfae53d0c941f08bded43539841761: Time spent bootstrapping tablet: real 0.202s user 0.012s sys 0.001s
I20251023 07:58:44.410802 18293 raft_consensus.cc:359] T dad81a56e87946cbb2a7f3e33c2e2bd4 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:44.411511 18293 raft_consensus.cc:385] T dad81a56e87946cbb2a7f3e33c2e2bd4 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:44.411787 18293 raft_consensus.cc:740] T dad81a56e87946cbb2a7f3e33c2e2bd4 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Initialized, Role: FOLLOWER
I20251023 07:58:44.398577 18291 raft_consensus.cc:740] T ae4437d151054b59a0e93ca01a9609c7 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Initialized, Role: FOLLOWER
I20251023 07:58:44.413553 18291 consensus_queue.cc:260] T ae4437d151054b59a0e93ca01a9609c7 P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:44.415661 18291 ts_tablet_manager.cc:1434] T ae4437d151054b59a0e93ca01a9609c7 P 982df35c5b554a8fa64807352c4f34ee: Time spent starting tablet: real 0.020s user 0.004s sys 0.000s
I20251023 07:58:44.416435 18293 consensus_queue.cc:260] T dad81a56e87946cbb2a7f3e33c2e2bd4 P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:44.420938 18293 ts_tablet_manager.cc:1434] T dad81a56e87946cbb2a7f3e33c2e2bd4 P 10dfae53d0c941f08bded43539841761: Time spent starting tablet: real 0.022s user 0.006s sys 0.001s
I20251023 07:58:44.422098 18293 tablet_bootstrap.cc:492] T 8f25975c7ab4439c9975a5e5604727dc P 10dfae53d0c941f08bded43539841761: Bootstrap starting.
I20251023 07:58:44.428023 18293 tablet_bootstrap.cc:654] T 8f25975c7ab4439c9975a5e5604727dc P 10dfae53d0c941f08bded43539841761: Neither blocks nor log segments found. Creating new log.
I20251023 07:58:44.430950 18000 catalog_manager.cc:5649] T 8f25975c7ab4439c9975a5e5604727dc P 982df35c5b554a8fa64807352c4f34ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 982df35c5b554a8fa64807352c4f34ee (127.16.126.3). New cstate: current_term: 1 leader_uuid: "982df35c5b554a8fa64807352c4f34ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: HEALTHY } } }
I20251023 07:58:44.437135 18000 catalog_manager.cc:5649] T 714c3ef74ecc47419a20ab7e23217e5e P 982df35c5b554a8fa64807352c4f34ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 982df35c5b554a8fa64807352c4f34ee (127.16.126.3). New cstate: current_term: 1 leader_uuid: "982df35c5b554a8fa64807352c4f34ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: HEALTHY } } }
W20251023 07:58:44.462414 18048 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20251023 07:58:44.494467 18293 tablet_bootstrap.cc:492] T 8f25975c7ab4439c9975a5e5604727dc P 10dfae53d0c941f08bded43539841761: No bootstrap required, opened a new log
I20251023 07:58:44.494984 18293 ts_tablet_manager.cc:1403] T 8f25975c7ab4439c9975a5e5604727dc P 10dfae53d0c941f08bded43539841761: Time spent bootstrapping tablet: real 0.073s user 0.031s sys 0.025s
I20251023 07:58:44.498311 18293 raft_consensus.cc:359] T 8f25975c7ab4439c9975a5e5604727dc P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:44.498996 18293 raft_consensus.cc:385] T 8f25975c7ab4439c9975a5e5604727dc P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:58:44.499255 18293 raft_consensus.cc:740] T 8f25975c7ab4439c9975a5e5604727dc P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Initialized, Role: FOLLOWER
I20251023 07:58:44.499851 18293 consensus_queue.cc:260] T 8f25975c7ab4439c9975a5e5604727dc P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:44.502308 18293 ts_tablet_manager.cc:1434] T 8f25975c7ab4439c9975a5e5604727dc P 10dfae53d0c941f08bded43539841761: Time spent starting tablet: real 0.007s user 0.006s sys 0.001s
I20251023 07:58:44.506152 18700 raft_consensus.cc:493] T ae4437d151054b59a0e93ca01a9609c7 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:44.506652 18700 raft_consensus.cc:515] T ae4437d151054b59a0e93ca01a9609c7 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:44.507380 18692 consensus_queue.cc:1048] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:44.508669 18700 leader_election.cc:290] T ae4437d151054b59a0e93ca01a9609c7 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:58:44.511768 18099 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ae4437d151054b59a0e93ca01a9609c7" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:44.515970 18244 raft_consensus.cc:3060] T 9bc482083f3b4c9ba97b8769ece194ad P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:44.517164 18173 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ae4437d151054b59a0e93ca01a9609c7" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10dfae53d0c941f08bded43539841761" is_pre_election: true
I20251023 07:58:44.517990 18173 raft_consensus.cc:2393] T ae4437d151054b59a0e93ca01a9609c7 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 982df35c5b554a8fa64807352c4f34ee in current term 1: Already voted for candidate b3a1328f9c8c484fab08292ce2171ec9 in this term.
I20251023 07:58:44.518636 18174 raft_consensus.cc:3060] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:44.525665 18696 consensus_queue.cc:1048] T 85799f6eb6ae41fa9620accb877d8708 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:44.533849 18644 consensus_queue.cc:1048] T 714c3ef74ecc47419a20ab7e23217e5e P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:44.541621 18217 leader_election.cc:304] T ae4437d151054b59a0e93ca01a9609c7 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee; no voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9
I20251023 07:58:44.544178 18700 raft_consensus.cc:3060] T ae4437d151054b59a0e93ca01a9609c7 P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:44.589145 18597 consensus_queue.cc:1048] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:58:44.618410 18700 raft_consensus.cc:2749] T ae4437d151054b59a0e93ca01a9609c7 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:58:44.625582 18644 consensus_queue.cc:1048] T 714c3ef74ecc47419a20ab7e23217e5e P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:44.629328 18696 consensus_queue.cc:1048] T 85799f6eb6ae41fa9620accb877d8708 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:44.657490 18708 consensus_queue.cc:1048] T d3b72ceda32a4ebc8de6e7a7992498aa P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:58:44.698930 18246 raft_consensus.cc:3060] T d3b72ceda32a4ebc8de6e7a7992498aa P 982df35c5b554a8fa64807352c4f34ee [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:44.703217 18173 raft_consensus.cc:3060] T 8f25975c7ab4439c9975a5e5604727dc P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:58:44.726060 18631 consensus_queue.cc:1048] T 8f25975c7ab4439c9975a5e5604727dc P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:44.728199 18708 consensus_queue.cc:1048] T d3b72ceda32a4ebc8de6e7a7992498aa P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:44.743408 18656 raft_consensus.cc:493] T dad81a56e87946cbb2a7f3e33c2e2bd4 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:58:44.743942 18656 raft_consensus.cc:515] T dad81a56e87946cbb2a7f3e33c2e2bd4 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:58:44.748211 18656 leader_election.cc:290] T dad81a56e87946cbb2a7f3e33c2e2bd4 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:44.749034 18097 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dad81a56e87946cbb2a7f3e33c2e2bd4" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9" is_pre_election: true
I20251023 07:58:44.752871 18251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dad81a56e87946cbb2a7f3e33c2e2bd4" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "982df35c5b554a8fa64807352c4f34ee" is_pre_election: true
I20251023 07:58:44.766315 18142 leader_election.cc:304] T dad81a56e87946cbb2a7f3e33c2e2bd4 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10dfae53d0c941f08bded43539841761; no voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9
I20251023 07:58:44.767670 18656 raft_consensus.cc:2749] T dad81a56e87946cbb2a7f3e33c2e2bd4 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:58:44.775573 18698 consensus_queue.cc:1048] T ae4437d151054b59a0e93ca01a9609c7 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:44.807106 18174 raft_consensus.cc:3060] T dad81a56e87946cbb2a7f3e33c2e2bd4 P 10dfae53d0c941f08bded43539841761 [term 0 FOLLOWER]: Advancing to term 1
W20251023 07:58:44.808578 18217 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.1:44025, user_credentials={real_user=slave}} blocked reactor thread for 83773.4us
I20251023 07:58:44.823385 18631 consensus_queue.cc:1048] T 8f25975c7ab4439c9975a5e5604727dc P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:44.858223 18698 consensus_queue.cc:1048] T ae4437d151054b59a0e93ca01a9609c7 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:58:45.104907 16888 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251023 07:58:45.143488 18743 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251023 07:58:45.150116 18744 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251023 07:58:45.169940 18747 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251023 07:58:45.170429 16888 server_base.cc:1047] running on GCE node
I20251023 07:58:45.172936 16888 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251023 07:58:45.173242 16888 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251023 07:58:45.173467 16888 hybrid_clock.cc:648] HybridClock initialized: now 1761206325173418 us; error 0 us; skew 500 ppm
I20251023 07:58:45.174194 16888 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20251023 07:58:45.197508 16888 webserver.cc:492] Webserver started at http://127.16.126.4:37299/ using document root <none> and password file <none>
I20251023 07:58:45.198361 16888 fs_manager.cc:362] Metadata directory not provided
I20251023 07:58:45.198730 16888 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251023 07:58:45.199219 16888 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251023 07:58:45.201103 16888 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1761206251627710-16888-0/minicluster-data/ts-3-root/instance:
uuid: "d1a8f61d3323447282ee6068aa623216"
format_stamp: "Formatted at 2025-10-23 07:58:45 on dist-test-slave-m488"
I20251023 07:58:45.215335 16888 fs_manager.cc:696] Time spent creating directory manager: real 0.013s user 0.005s sys 0.000s
I20251023 07:58:45.220027 18751 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251023 07:58:45.221213 16888 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20251023 07:58:45.221547 16888 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1761206251627710-16888-0/minicluster-data/ts-3-root
uuid: "d1a8f61d3323447282ee6068aa623216"
format_stamp: "Formatted at 2025-10-23 07:58:45 on dist-test-slave-m488"
I20251023 07:58:45.221832 16888 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1761206251627710-16888-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1761206251627710-16888-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1761206251627710-16888-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251023 07:58:45.252275 16888 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251023 07:58:45.253818 16888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251023 07:58:45.259168 16888 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251023 07:58:45.264920 16888 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251023 07:58:45.265241 16888 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251023 07:58:45.265568 16888 ts_tablet_manager.cc:616] Registered 0 tablets
I20251023 07:58:45.265736 16888 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251023 07:58:45.394048 16888 rpc_server.cc:307] RPC server started. Bound to: 127.16.126.4:33293
I20251023 07:58:45.394119 18813 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.126.4:33293 every 8 connection(s)
I20251023 07:58:45.405275 16888 auto_leader_rebalancer-test.cc:417] add a tserver: d1a8f61d3323447282ee6068aa623216
I20251023 07:58:45.423090 18814 heartbeater.cc:344] Connected to a master server at 127.16.126.62:34671
I20251023 07:58:45.423565 18814 heartbeater.cc:461] Registering TS with master...
I20251023 07:58:45.424441 18814 heartbeater.cc:507] Master 127.16.126.62:34671 requested a full tablet report, sending...
I20251023 07:58:45.426698 18000 ts_manager.cc:194] Registered new tserver with Master: d1a8f61d3323447282ee6068aa623216 (127.16.126.4:33293)
I20251023 07:58:45.428610 18000 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56272
I20251023 07:58:45.567498 18251 consensus_queue.cc:237] T 14e6f2c3d85b437cac3ead436d5494a7 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:58:45.576068 18174 raft_consensus.cc:1275] T 14e6f2c3d85b437cac3ead436d5494a7 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251023 07:58:45.576205 18097 raft_consensus.cc:1275] T 14e6f2c3d85b437cac3ead436d5494a7 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251023 07:58:45.577813 18597 consensus_queue.cc:1048] T 14e6f2c3d85b437cac3ead436d5494a7 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:58:45.578784 18631 consensus_queue.cc:1048] T 14e6f2c3d85b437cac3ead436d5494a7 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:58:45.591414 18631 raft_consensus.cc:2955] T 14e6f2c3d85b437cac3ead436d5494a7 P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
W20251023 07:58:45.607743 18216 consensus_peers.cc:597] T 14e6f2c3d85b437cac3ead436d5494a7 P 982df35c5b554a8fa64807352c4f34ee -> Peer d1a8f61d3323447282ee6068aa623216 (127.16.126.4:33293): Couldn't send request to peer d1a8f61d3323447282ee6068aa623216. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 14e6f2c3d85b437cac3ead436d5494a7. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:58:45.606370 18097 raft_consensus.cc:2955] T 14e6f2c3d85b437cac3ead436d5494a7 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:58:45.618103 18174 raft_consensus.cc:2955] T 14e6f2c3d85b437cac3ead436d5494a7 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:58:45.627205 18000 catalog_manager.cc:5649] T 14e6f2c3d85b437cac3ead436d5494a7 P b3a1328f9c8c484fab08292ce2171ec9 reported cstate change: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New cstate: current_term: 1 leader_uuid: "982df35c5b554a8fa64807352c4f34ee" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:58:45.679176 18097 consensus_queue.cc:237] T 1f184d89e4244f12af7afd690bc7027d P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:58:45.714169 18173 raft_consensus.cc:1275] T 1f184d89e4244f12af7afd690bc7027d P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251023 07:58:45.715839 18698 consensus_queue.cc:1048] T 1f184d89e4244f12af7afd690bc7027d P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:58:45.741739 18698 raft_consensus.cc:2955] T 1f184d89e4244f12af7afd690bc7027d P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:58:45.758455 18246 raft_consensus.cc:1275] T 1f184d89e4244f12af7afd690bc7027d P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251023 07:58:45.760154 18174 raft_consensus.cc:2955] T 1f184d89e4244f12af7afd690bc7027d P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:58:45.762229 18300 consensus_queue.cc:1048] T 1f184d89e4244f12af7afd690bc7027d P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:58:45.806285 18246 raft_consensus.cc:2955] T 1f184d89e4244f12af7afd690bc7027d P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
W20251023 07:58:45.834314 18067 consensus_peers.cc:597] T 1f184d89e4244f12af7afd690bc7027d P b3a1328f9c8c484fab08292ce2171ec9 -> Peer d1a8f61d3323447282ee6068aa623216 (127.16.126.4:33293): Couldn't send request to peer d1a8f61d3323447282ee6068aa623216. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1f184d89e4244f12af7afd690bc7027d. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:58:45.828424 17999 catalog_manager.cc:5649] T 1f184d89e4244f12af7afd690bc7027d P b3a1328f9c8c484fab08292ce2171ec9 reported cstate change: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New cstate: current_term: 1 leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251023 07:58:45.877933 18174 consensus_queue.cc:237] T 7fe190354178418bae8b7cc5abbb74ef P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:58:45.885636 18097 raft_consensus.cc:1275] T 7fe190354178418bae8b7cc5abbb74ef P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251023 07:58:45.887012 18246 raft_consensus.cc:1275] T 7fe190354178418bae8b7cc5abbb74ef P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251023 07:58:45.887359 18836 consensus_queue.cc:1048] T 7fe190354178418bae8b7cc5abbb74ef P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20251023 07:58:45.888355 18708 consensus_queue.cc:1048] T 7fe190354178418bae8b7cc5abbb74ef P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20251023 07:58:45.898092 18142 consensus_peers.cc:597] T 7fe190354178418bae8b7cc5abbb74ef P 10dfae53d0c941f08bded43539841761 -> Peer d1a8f61d3323447282ee6068aa623216 (127.16.126.4:33293): Couldn't send request to peer d1a8f61d3323447282ee6068aa623216. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7fe190354178418bae8b7cc5abbb74ef. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:58:45.905472 18708 raft_consensus.cc:2955] T 7fe190354178418bae8b7cc5abbb74ef P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:58:45.907881 18097 raft_consensus.cc:2955] T 7fe190354178418bae8b7cc5abbb74ef P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:58:45.908756 18246 raft_consensus.cc:2955] T 7fe190354178418bae8b7cc5abbb74ef P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:58:45.924724 17999 catalog_manager.cc:5649] T 7fe190354178418bae8b7cc5abbb74ef P 982df35c5b554a8fa64807352c4f34ee reported cstate change: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New cstate: current_term: 1 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:58:45.934638 18251 consensus_queue.cc:237] T b9841e711f8e4a019c2d0dec5409474c P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
W20251023 07:58:45.965809 18216 consensus_peers.cc:597] T b9841e711f8e4a019c2d0dec5409474c P 982df35c5b554a8fa64807352c4f34ee -> Peer d1a8f61d3323447282ee6068aa623216 (127.16.126.4:33293): Couldn't send request to peer d1a8f61d3323447282ee6068aa623216. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b9841e711f8e4a019c2d0dec5409474c. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:58:45.970220 18100 raft_consensus.cc:1275] T b9841e711f8e4a019c2d0dec5409474c P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251023 07:58:45.970220 18174 raft_consensus.cc:1275] T b9841e711f8e4a019c2d0dec5409474c P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251023 07:58:45.971582 18736 consensus_queue.cc:1048] T b9841e711f8e4a019c2d0dec5409474c P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:58:45.972535 18597 consensus_queue.cc:1048] T b9841e711f8e4a019c2d0dec5409474c P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:58:46.002576 18631 raft_consensus.cc:2955] T b9841e711f8e4a019c2d0dec5409474c P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:58:46.004087 18174 raft_consensus.cc:2955] T b9841e711f8e4a019c2d0dec5409474c P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:58:46.015710 18097 raft_consensus.cc:2955] T b9841e711f8e4a019c2d0dec5409474c P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:58:46.039410 17999 catalog_manager.cc:5649] T b9841e711f8e4a019c2d0dec5409474c P 10dfae53d0c941f08bded43539841761 reported cstate change: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New cstate: current_term: 1 leader_uuid: "982df35c5b554a8fa64807352c4f34ee" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
W20251023 07:58:46.071178 18215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.2:45799, user_credentials={real_user=slave}} blocked reactor thread for 47561.7us
I20251023 07:58:46.149329 18849 ts_tablet_manager.cc:933] T 14e6f2c3d85b437cac3ead436d5494a7 P d1a8f61d3323447282ee6068aa623216: Initiating tablet copy from peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:46.153026 18849 tablet_copy_client.cc:323] T 14e6f2c3d85b437cac3ead436d5494a7 P d1a8f61d3323447282ee6068aa623216: tablet copy: Beginning tablet copy session from remote peer at address 127.16.126.3:46061
I20251023 07:58:46.177198 18261 tablet_copy_service.cc:140] P 982df35c5b554a8fa64807352c4f34ee: Received BeginTabletCopySession request for tablet 14e6f2c3d85b437cac3ead436d5494a7 from peer d1a8f61d3323447282ee6068aa623216 ({username='slave'} at 127.0.0.1:40260)
I20251023 07:58:46.177836 18261 tablet_copy_service.cc:161] P 982df35c5b554a8fa64807352c4f34ee: Beginning new tablet copy session on tablet 14e6f2c3d85b437cac3ead436d5494a7 from peer d1a8f61d3323447282ee6068aa623216 at {username='slave'} at 127.0.0.1:40260: session id = d1a8f61d3323447282ee6068aa623216-14e6f2c3d85b437cac3ead436d5494a7
I20251023 07:58:46.184490 18261 tablet_copy_source_session.cc:215] T 14e6f2c3d85b437cac3ead436d5494a7 P 982df35c5b554a8fa64807352c4f34ee: Tablet Copy: opened 0 blocks and 1 log segments
I20251023 07:58:46.189178 18849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14e6f2c3d85b437cac3ead436d5494a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:46.216724 18849 tablet_copy_client.cc:806] T 14e6f2c3d85b437cac3ead436d5494a7 P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 0 data blocks...
I20251023 07:58:46.217386 18849 tablet_copy_client.cc:670] T 14e6f2c3d85b437cac3ead436d5494a7 P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 1 WAL segments...
I20251023 07:58:46.224195 18849 tablet_copy_client.cc:538] T 14e6f2c3d85b437cac3ead436d5494a7 P d1a8f61d3323447282ee6068aa623216: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251023 07:58:46.232981 18849 tablet_bootstrap.cc:492] T 14e6f2c3d85b437cac3ead436d5494a7 P d1a8f61d3323447282ee6068aa623216: Bootstrap starting.
I20251023 07:58:46.253149 18849 tablet_bootstrap.cc:492] T 14e6f2c3d85b437cac3ead436d5494a7 P d1a8f61d3323447282ee6068aa623216: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:58:46.254000 18849 tablet_bootstrap.cc:492] T 14e6f2c3d85b437cac3ead436d5494a7 P d1a8f61d3323447282ee6068aa623216: Bootstrap complete.
I20251023 07:58:46.254613 18849 ts_tablet_manager.cc:1403] T 14e6f2c3d85b437cac3ead436d5494a7 P d1a8f61d3323447282ee6068aa623216: Time spent bootstrapping tablet: real 0.022s user 0.012s sys 0.011s
I20251023 07:58:46.258136 18849 raft_consensus.cc:359] T 14e6f2c3d85b437cac3ead436d5494a7 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:58:46.258873 18849 raft_consensus.cc:740] T 14e6f2c3d85b437cac3ead436d5494a7 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d1a8f61d3323447282ee6068aa623216, State: Initialized, Role: LEARNER
I20251023 07:58:46.259508 18849 consensus_queue.cc:260] T 14e6f2c3d85b437cac3ead436d5494a7 P d1a8f61d3323447282ee6068aa623216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:58:46.268189 18814 heartbeater.cc:499] Master 127.16.126.62:34671 was elected leader, sending a full tablet report...
I20251023 07:58:46.269282 18849 ts_tablet_manager.cc:1434] T 14e6f2c3d85b437cac3ead436d5494a7 P d1a8f61d3323447282ee6068aa623216: Time spent starting tablet: real 0.014s user 0.009s sys 0.004s
I20251023 07:58:46.272588 18261 tablet_copy_service.cc:342] P 982df35c5b554a8fa64807352c4f34ee: Request end of tablet copy session d1a8f61d3323447282ee6068aa623216-14e6f2c3d85b437cac3ead436d5494a7 received from {username='slave'} at 127.0.0.1:40260
I20251023 07:58:46.273092 18261 tablet_copy_service.cc:434] P 982df35c5b554a8fa64807352c4f34ee: ending tablet copy session d1a8f61d3323447282ee6068aa623216-14e6f2c3d85b437cac3ead436d5494a7 on tablet 14e6f2c3d85b437cac3ead436d5494a7 with peer d1a8f61d3323447282ee6068aa623216
I20251023 07:58:46.297842 18849 ts_tablet_manager.cc:933] T 7fe190354178418bae8b7cc5abbb74ef P d1a8f61d3323447282ee6068aa623216: Initiating tablet copy from peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:58:46.308231 18849 tablet_copy_client.cc:323] T 7fe190354178418bae8b7cc5abbb74ef P d1a8f61d3323447282ee6068aa623216: tablet copy: Beginning tablet copy session from remote peer at address 127.16.126.2:45799
I20251023 07:58:46.322238 18187 tablet_copy_service.cc:140] P 10dfae53d0c941f08bded43539841761: Received BeginTabletCopySession request for tablet 7fe190354178418bae8b7cc5abbb74ef from peer d1a8f61d3323447282ee6068aa623216 ({username='slave'} at 127.0.0.1:50534)
I20251023 07:58:46.322860 18187 tablet_copy_service.cc:161] P 10dfae53d0c941f08bded43539841761: Beginning new tablet copy session on tablet 7fe190354178418bae8b7cc5abbb74ef from peer d1a8f61d3323447282ee6068aa623216 at {username='slave'} at 127.0.0.1:50534: session id = d1a8f61d3323447282ee6068aa623216-7fe190354178418bae8b7cc5abbb74ef
I20251023 07:58:46.342475 18187 tablet_copy_source_session.cc:215] T 7fe190354178418bae8b7cc5abbb74ef P 10dfae53d0c941f08bded43539841761: Tablet Copy: opened 0 blocks and 1 log segments
I20251023 07:58:46.345993 18856 ts_tablet_manager.cc:933] T 1f184d89e4244f12af7afd690bc7027d P d1a8f61d3323447282ee6068aa623216: Initiating tablet copy from peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025)
I20251023 07:58:46.346134 18849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fe190354178418bae8b7cc5abbb74ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:46.356673 18856 tablet_copy_client.cc:323] T 1f184d89e4244f12af7afd690bc7027d P d1a8f61d3323447282ee6068aa623216: tablet copy: Beginning tablet copy session from remote peer at address 127.16.126.1:44025
I20251023 07:58:46.367058 18849 tablet_copy_client.cc:806] T 7fe190354178418bae8b7cc5abbb74ef P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 0 data blocks...
I20251023 07:58:46.368006 18849 tablet_copy_client.cc:670] T 7fe190354178418bae8b7cc5abbb74ef P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 1 WAL segments...
I20251023 07:58:46.373015 18849 tablet_copy_client.cc:538] T 7fe190354178418bae8b7cc5abbb74ef P d1a8f61d3323447282ee6068aa623216: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251023 07:58:46.382576 18849 tablet_bootstrap.cc:492] T 7fe190354178418bae8b7cc5abbb74ef P d1a8f61d3323447282ee6068aa623216: Bootstrap starting.
I20251023 07:58:46.394719 18112 tablet_copy_service.cc:140] P b3a1328f9c8c484fab08292ce2171ec9: Received BeginTabletCopySession request for tablet 1f184d89e4244f12af7afd690bc7027d from peer d1a8f61d3323447282ee6068aa623216 ({username='slave'} at 127.0.0.1:57714)
I20251023 07:58:46.395349 18112 tablet_copy_service.cc:161] P b3a1328f9c8c484fab08292ce2171ec9: Beginning new tablet copy session on tablet 1f184d89e4244f12af7afd690bc7027d from peer d1a8f61d3323447282ee6068aa623216 at {username='slave'} at 127.0.0.1:57714: session id = d1a8f61d3323447282ee6068aa623216-1f184d89e4244f12af7afd690bc7027d
I20251023 07:58:46.404203 18112 tablet_copy_source_session.cc:215] T 1f184d89e4244f12af7afd690bc7027d P b3a1328f9c8c484fab08292ce2171ec9: Tablet Copy: opened 0 blocks and 1 log segments
I20251023 07:58:46.406862 18856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f184d89e4244f12af7afd690bc7027d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:46.440536 18856 tablet_copy_client.cc:806] T 1f184d89e4244f12af7afd690bc7027d P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 0 data blocks...
I20251023 07:58:46.441104 18856 tablet_copy_client.cc:670] T 1f184d89e4244f12af7afd690bc7027d P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 1 WAL segments...
I20251023 07:58:46.442873 18849 tablet_bootstrap.cc:492] T 7fe190354178418bae8b7cc5abbb74ef P d1a8f61d3323447282ee6068aa623216: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:58:46.444068 18849 tablet_bootstrap.cc:492] T 7fe190354178418bae8b7cc5abbb74ef P d1a8f61d3323447282ee6068aa623216: Bootstrap complete.
I20251023 07:58:46.444821 18849 ts_tablet_manager.cc:1403] T 7fe190354178418bae8b7cc5abbb74ef P d1a8f61d3323447282ee6068aa623216: Time spent bootstrapping tablet: real 0.062s user 0.027s sys 0.016s
I20251023 07:58:46.446235 18856 tablet_copy_client.cc:538] T 1f184d89e4244f12af7afd690bc7027d P d1a8f61d3323447282ee6068aa623216: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251023 07:58:46.458019 18856 tablet_bootstrap.cc:492] T 1f184d89e4244f12af7afd690bc7027d P d1a8f61d3323447282ee6068aa623216: Bootstrap starting.
I20251023 07:58:46.448693 18849 raft_consensus.cc:359] T 7fe190354178418bae8b7cc5abbb74ef P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:58:46.459081 18849 raft_consensus.cc:740] T 7fe190354178418bae8b7cc5abbb74ef P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d1a8f61d3323447282ee6068aa623216, State: Initialized, Role: LEARNER
I20251023 07:58:46.461459 18849 consensus_queue.cc:260] T 7fe190354178418bae8b7cc5abbb74ef P d1a8f61d3323447282ee6068aa623216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:58:46.465579 18849 ts_tablet_manager.cc:1434] T 7fe190354178418bae8b7cc5abbb74ef P d1a8f61d3323447282ee6068aa623216: Time spent starting tablet: real 0.020s user 0.007s sys 0.000s
I20251023 07:58:46.467610 18187 tablet_copy_service.cc:342] P 10dfae53d0c941f08bded43539841761: Request end of tablet copy session d1a8f61d3323447282ee6068aa623216-7fe190354178418bae8b7cc5abbb74ef received from {username='slave'} at 127.0.0.1:50534
I20251023 07:58:46.468031 18187 tablet_copy_service.cc:434] P 10dfae53d0c941f08bded43539841761: ending tablet copy session d1a8f61d3323447282ee6068aa623216-7fe190354178418bae8b7cc5abbb74ef on tablet 7fe190354178418bae8b7cc5abbb74ef with peer d1a8f61d3323447282ee6068aa623216
I20251023 07:58:46.484934 18856 tablet_bootstrap.cc:492] T 1f184d89e4244f12af7afd690bc7027d P d1a8f61d3323447282ee6068aa623216: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:58:46.485927 18856 tablet_bootstrap.cc:492] T 1f184d89e4244f12af7afd690bc7027d P d1a8f61d3323447282ee6068aa623216: Bootstrap complete.
I20251023 07:58:46.486779 18856 ts_tablet_manager.cc:1403] T 1f184d89e4244f12af7afd690bc7027d P d1a8f61d3323447282ee6068aa623216: Time spent bootstrapping tablet: real 0.029s user 0.011s sys 0.011s
I20251023 07:58:46.491367 18856 raft_consensus.cc:359] T 1f184d89e4244f12af7afd690bc7027d P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:58:46.492295 18856 raft_consensus.cc:740] T 1f184d89e4244f12af7afd690bc7027d P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d1a8f61d3323447282ee6068aa623216, State: Initialized, Role: LEARNER
I20251023 07:58:46.492983 18856 consensus_queue.cc:260] T 1f184d89e4244f12af7afd690bc7027d P d1a8f61d3323447282ee6068aa623216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:58:46.495201 18856 ts_tablet_manager.cc:1434] T 1f184d89e4244f12af7afd690bc7027d P d1a8f61d3323447282ee6068aa623216: Time spent starting tablet: real 0.006s user 0.004s sys 0.001s
I20251023 07:58:46.496953 18112 tablet_copy_service.cc:342] P b3a1328f9c8c484fab08292ce2171ec9: Request end of tablet copy session d1a8f61d3323447282ee6068aa623216-1f184d89e4244f12af7afd690bc7027d received from {username='slave'} at 127.0.0.1:57714
I20251023 07:58:46.497375 18112 tablet_copy_service.cc:434] P b3a1328f9c8c484fab08292ce2171ec9: ending tablet copy session d1a8f61d3323447282ee6068aa623216-1f184d89e4244f12af7afd690bc7027d on tablet 1f184d89e4244f12af7afd690bc7027d with peer d1a8f61d3323447282ee6068aa623216
I20251023 07:58:46.506422 18849 ts_tablet_manager.cc:933] T b9841e711f8e4a019c2d0dec5409474c P d1a8f61d3323447282ee6068aa623216: Initiating tablet copy from peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:46.516355 18849 tablet_copy_client.cc:323] T b9841e711f8e4a019c2d0dec5409474c P d1a8f61d3323447282ee6068aa623216: tablet copy: Beginning tablet copy session from remote peer at address 127.16.126.3:46061
I20251023 07:58:46.520442 18261 tablet_copy_service.cc:140] P 982df35c5b554a8fa64807352c4f34ee: Received BeginTabletCopySession request for tablet b9841e711f8e4a019c2d0dec5409474c from peer d1a8f61d3323447282ee6068aa623216 ({username='slave'} at 127.0.0.1:40260)
I20251023 07:58:46.521019 18261 tablet_copy_service.cc:161] P 982df35c5b554a8fa64807352c4f34ee: Beginning new tablet copy session on tablet b9841e711f8e4a019c2d0dec5409474c from peer d1a8f61d3323447282ee6068aa623216 at {username='slave'} at 127.0.0.1:40260: session id = d1a8f61d3323447282ee6068aa623216-b9841e711f8e4a019c2d0dec5409474c
I20251023 07:58:46.533025 18261 tablet_copy_source_session.cc:215] T b9841e711f8e4a019c2d0dec5409474c P 982df35c5b554a8fa64807352c4f34ee: Tablet Copy: opened 0 blocks and 1 log segments
I20251023 07:58:46.540328 18849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9841e711f8e4a019c2d0dec5409474c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:46.556471 18849 tablet_copy_client.cc:806] T b9841e711f8e4a019c2d0dec5409474c P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 0 data blocks...
I20251023 07:58:46.557039 18849 tablet_copy_client.cc:670] T b9841e711f8e4a019c2d0dec5409474c P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 1 WAL segments...
I20251023 07:58:46.562227 18849 tablet_copy_client.cc:538] T b9841e711f8e4a019c2d0dec5409474c P d1a8f61d3323447282ee6068aa623216: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251023 07:58:46.569728 18849 tablet_bootstrap.cc:492] T b9841e711f8e4a019c2d0dec5409474c P d1a8f61d3323447282ee6068aa623216: Bootstrap starting.
I20251023 07:58:46.582247 18789 raft_consensus.cc:1217] T 14e6f2c3d85b437cac3ead436d5494a7 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20251023 07:58:46.614835 18849 tablet_bootstrap.cc:492] T b9841e711f8e4a019c2d0dec5409474c P d1a8f61d3323447282ee6068aa623216: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:58:46.615736 18849 tablet_bootstrap.cc:492] T b9841e711f8e4a019c2d0dec5409474c P d1a8f61d3323447282ee6068aa623216: Bootstrap complete.
I20251023 07:58:46.616390 18849 ts_tablet_manager.cc:1403] T b9841e711f8e4a019c2d0dec5409474c P d1a8f61d3323447282ee6068aa623216: Time spent bootstrapping tablet: real 0.047s user 0.015s sys 0.006s
I20251023 07:58:46.619974 18849 raft_consensus.cc:359] T b9841e711f8e4a019c2d0dec5409474c P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:58:46.621230 18849 raft_consensus.cc:740] T b9841e711f8e4a019c2d0dec5409474c P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d1a8f61d3323447282ee6068aa623216, State: Initialized, Role: LEARNER
I20251023 07:58:46.641692 18849 consensus_queue.cc:260] T b9841e711f8e4a019c2d0dec5409474c P d1a8f61d3323447282ee6068aa623216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:58:46.643988 18849 ts_tablet_manager.cc:1434] T b9841e711f8e4a019c2d0dec5409474c P d1a8f61d3323447282ee6068aa623216: Time spent starting tablet: real 0.027s user 0.007s sys 0.000s
I20251023 07:58:46.646361 18261 tablet_copy_service.cc:342] P 982df35c5b554a8fa64807352c4f34ee: Request end of tablet copy session d1a8f61d3323447282ee6068aa623216-b9841e711f8e4a019c2d0dec5409474c received from {username='slave'} at 127.0.0.1:40260
I20251023 07:58:46.646782 18261 tablet_copy_service.cc:434] P 982df35c5b554a8fa64807352c4f34ee: ending tablet copy session d1a8f61d3323447282ee6068aa623216-b9841e711f8e4a019c2d0dec5409474c on tablet b9841e711f8e4a019c2d0dec5409474c with peer d1a8f61d3323447282ee6068aa623216
I20251023 07:58:46.717588 18789 raft_consensus.cc:1217] T 7fe190354178418bae8b7cc5abbb74ef P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20251023 07:58:46.890806 18789 raft_consensus.cc:1217] T 1f184d89e4244f12af7afd690bc7027d P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20251023 07:58:47.007266 18789 raft_consensus.cc:1217] T b9841e711f8e4a019c2d0dec5409474c P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20251023 07:58:47.028574 18847 raft_consensus.cc:1064] T 14e6f2c3d85b437cac3ead436d5494a7 P 982df35c5b554a8fa64807352c4f34ee: attempting to promote NON_VOTER d1a8f61d3323447282ee6068aa623216 to VOTER
I20251023 07:58:47.030709 18847 consensus_queue.cc:237] T 14e6f2c3d85b437cac3ead436d5494a7 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:58:47.047209 18789 raft_consensus.cc:1275] T 14e6f2c3d85b437cac3ead436d5494a7 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:58:47.048758 18847 consensus_queue.cc:1048] T 14e6f2c3d85b437cac3ead436d5494a7 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:58:47.049098 18097 raft_consensus.cc:1275] T 14e6f2c3d85b437cac3ead436d5494a7 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:58:47.050819 18848 consensus_queue.cc:1048] T 14e6f2c3d85b437cac3ead436d5494a7 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:58:47.051836 18170 raft_consensus.cc:1275] T 14e6f2c3d85b437cac3ead436d5494a7 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:58:47.055411 18597 consensus_queue.cc:1048] T 14e6f2c3d85b437cac3ead436d5494a7 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:58:47.082846 18846 raft_consensus.cc:2955] T 14e6f2c3d85b437cac3ead436d5494a7 P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:47.086967 18789 raft_consensus.cc:2955] T 14e6f2c3d85b437cac3ead436d5494a7 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:47.090981 18174 raft_consensus.cc:2955] T 14e6f2c3d85b437cac3ead436d5494a7 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:47.104295 18097 raft_consensus.cc:2955] T 14e6f2c3d85b437cac3ead436d5494a7 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:47.113204 17999 catalog_manager.cc:5649] T 14e6f2c3d85b437cac3ead436d5494a7 P 982df35c5b554a8fa64807352c4f34ee reported cstate change: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "982df35c5b554a8fa64807352c4f34ee" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251023 07:58:47.160553 18248 consensus_queue.cc:237] T 14e6f2c3d85b437cac3ead436d5494a7 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:58:47.169763 18789 raft_consensus.cc:1275] T 14e6f2c3d85b437cac3ead436d5494a7 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251023 07:58:47.170032 18174 raft_consensus.cc:1275] T 14e6f2c3d85b437cac3ead436d5494a7 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251023 07:58:47.173314 18846 consensus_queue.cc:1048] T 14e6f2c3d85b437cac3ead436d5494a7 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:58:47.174705 18597 consensus_queue.cc:1048] T 14e6f2c3d85b437cac3ead436d5494a7 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:58:47.184226 18848 raft_consensus.cc:2955] T 14e6f2c3d85b437cac3ead436d5494a7 P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:47.194615 18708 raft_consensus.cc:1064] T 7fe190354178418bae8b7cc5abbb74ef P 10dfae53d0c941f08bded43539841761: attempting to promote NON_VOTER d1a8f61d3323447282ee6068aa623216 to VOTER
I20251023 07:58:47.186013 18789 raft_consensus.cc:2955] T 14e6f2c3d85b437cac3ead436d5494a7 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:47.217628 18174 raft_consensus.cc:2955] T 14e6f2c3d85b437cac3ead436d5494a7 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:47.235929 17999 catalog_manager.cc:5649] T 14e6f2c3d85b437cac3ead436d5494a7 P d1a8f61d3323447282ee6068aa623216 reported cstate change: config changed from index 3 to 4, VOTER b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1) evicted. New cstate: current_term: 1 leader_uuid: "982df35c5b554a8fa64807352c4f34ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
W20251023 07:58:47.244395 18142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.4:33293, user_credentials={real_user=slave}} blocked reactor thread for 50718.6us
I20251023 07:58:47.249692 17986 catalog_manager.cc:5162] ChangeConfig:REMOVE_PEER RPC for tablet 14e6f2c3d85b437cac3ead436d5494a7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251023 07:58:47.249361 18708 consensus_queue.cc:237] T 7fe190354178418bae8b7cc5abbb74ef P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:58:47.266578 18086 tablet_service.cc:1552] Processing DeleteTablet for tablet 14e6f2c3d85b437cac3ead436d5494a7 with delete_type TABLET_DATA_TOMBSTONED (TS b3a1328f9c8c484fab08292ce2171ec9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53940
I20251023 07:58:47.296454 18096 raft_consensus.cc:1275] T 7fe190354178418bae8b7cc5abbb74ef P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:58:47.299157 18708 consensus_queue.cc:1048] T 7fe190354178418bae8b7cc5abbb74ef P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:58:47.302528 18789 raft_consensus.cc:1275] T 7fe190354178418bae8b7cc5abbb74ef P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:58:47.305855 18871 consensus_queue.cc:1048] T 7fe190354178418bae8b7cc5abbb74ef P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20251023 07:58:47.306300 18874 tablet_replica.cc:333] T 14e6f2c3d85b437cac3ead436d5494a7 P b3a1328f9c8c484fab08292ce2171ec9: stopping tablet replica
I20251023 07:58:47.308495 18874 raft_consensus.cc:2243] T 14e6f2c3d85b437cac3ead436d5494a7 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:58:47.309149 18874 raft_consensus.cc:2272] T 14e6f2c3d85b437cac3ead436d5494a7 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:47.316254 18246 raft_consensus.cc:1275] T 7fe190354178418bae8b7cc5abbb74ef P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:58:47.324482 18874 ts_tablet_manager.cc:1916] T 14e6f2c3d85b437cac3ead436d5494a7 P b3a1328f9c8c484fab08292ce2171ec9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251023 07:58:47.326316 18871 consensus_queue.cc:1048] T 7fe190354178418bae8b7cc5abbb74ef P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20251023 07:58:47.335858 18708 raft_consensus.cc:2955] T 7fe190354178418bae8b7cc5abbb74ef P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:47.349742 18789 raft_consensus.cc:2955] T 7fe190354178418bae8b7cc5abbb74ef P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:47.358351 18096 raft_consensus.cc:2955] T 7fe190354178418bae8b7cc5abbb74ef P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:47.359745 18000 catalog_manager.cc:5649] T 7fe190354178418bae8b7cc5abbb74ef P 10dfae53d0c941f08bded43539841761 reported cstate change: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251023 07:58:47.371371 18874 ts_tablet_manager.cc:1929] T 14e6f2c3d85b437cac3ead436d5494a7 P b3a1328f9c8c484fab08292ce2171ec9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20251023 07:58:47.372294 18874 log.cc:1199] T 14e6f2c3d85b437cac3ead436d5494a7 P b3a1328f9c8c484fab08292ce2171ec9: Deleting WAL directory at /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1761206251627710-16888-0/minicluster-data/ts-0-root/wals/14e6f2c3d85b437cac3ead436d5494a7
I20251023 07:58:47.364171 18244 raft_consensus.cc:2955] T 7fe190354178418bae8b7cc5abbb74ef P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:47.375487 17987 catalog_manager.cc:4985] TS b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): tablet 14e6f2c3d85b437cac3ead436d5494a7 (table test-workload [id=8bb191a5531a4d4fb58a25b13d592213]) successfully deleted
I20251023 07:58:47.384371 18170 consensus_queue.cc:237] T 7fe190354178418bae8b7cc5abbb74ef P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:58:47.392046 18788 raft_consensus.cc:1275] T 7fe190354178418bae8b7cc5abbb74ef P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251023 07:58:47.393669 18708 consensus_queue.cc:1048] T 7fe190354178418bae8b7cc5abbb74ef P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:58:47.400138 18097 raft_consensus.cc:1275] T 7fe190354178418bae8b7cc5abbb74ef P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251023 07:58:47.409895 18708 consensus_queue.cc:1048] T 7fe190354178418bae8b7cc5abbb74ef P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:58:47.411752 18871 raft_consensus.cc:2955] T 7fe190354178418bae8b7cc5abbb74ef P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 982df35c5b554a8fa64807352c4f34ee (127.16.126.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:47.416561 18096 raft_consensus.cc:2955] T 7fe190354178418bae8b7cc5abbb74ef P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 982df35c5b554a8fa64807352c4f34ee (127.16.126.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:47.419879 17985 catalog_manager.cc:5162] ChangeConfig:REMOVE_PEER RPC for tablet 7fe190354178418bae8b7cc5abbb74ef with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251023 07:58:47.426913 18698 raft_consensus.cc:1064] T 1f184d89e4244f12af7afd690bc7027d P b3a1328f9c8c484fab08292ce2171ec9: attempting to promote NON_VOTER d1a8f61d3323447282ee6068aa623216 to VOTER
I20251023 07:58:47.429252 18698 consensus_queue.cc:237] T 1f184d89e4244f12af7afd690bc7027d P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:58:47.432758 18788 raft_consensus.cc:2955] T 7fe190354178418bae8b7cc5abbb74ef P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 982df35c5b554a8fa64807352c4f34ee (127.16.126.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
W20251023 07:58:47.449553 17985 catalog_manager.cc:5172] ChangeConfig:REMOVE_PEER RPC for tablet 7fe190354178418bae8b7cc5abbb74ef with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 3 but the committed config has opid_index of 4
I20251023 07:58:47.457947 18000 catalog_manager.cc:5649] T 7fe190354178418bae8b7cc5abbb74ef P 10dfae53d0c941f08bded43539841761 reported cstate change: config changed from index 3 to 4, VOTER 982df35c5b554a8fa64807352c4f34ee (127.16.126.3) evicted. New cstate: current_term: 1 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251023 07:58:47.495021 18789 raft_consensus.cc:1275] T 1f184d89e4244f12af7afd690bc7027d P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:58:47.498435 18244 raft_consensus.cc:1275] T 1f184d89e4244f12af7afd690bc7027d P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:58:47.500635 18879 consensus_queue.cc:1048] T 1f184d89e4244f12af7afd690bc7027d P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:58:47.502509 18879 consensus_queue.cc:1048] T 1f184d89e4244f12af7afd690bc7027d P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:58:47.504086 18846 raft_consensus.cc:1064] T b9841e711f8e4a019c2d0dec5409474c P 982df35c5b554a8fa64807352c4f34ee: attempting to promote NON_VOTER d1a8f61d3323447282ee6068aa623216 to VOTER
I20251023 07:58:47.505839 18237 tablet_service.cc:1552] Processing DeleteTablet for tablet 7fe190354178418bae8b7cc5abbb74ef with delete_type TABLET_DATA_TOMBSTONED (TS 982df35c5b554a8fa64807352c4f34ee not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49846
I20251023 07:58:47.506916 18846 consensus_queue.cc:237] T b9841e711f8e4a019c2d0dec5409474c P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:58:47.518277 18176 raft_consensus.cc:1275] T 1f184d89e4244f12af7afd690bc7027d P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:58:47.519863 18879 consensus_queue.cc:1048] T 1f184d89e4244f12af7afd690bc7027d P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:58:47.537134 18881 tablet_replica.cc:333] T 7fe190354178418bae8b7cc5abbb74ef P 982df35c5b554a8fa64807352c4f34ee: stopping tablet replica
I20251023 07:58:47.538988 18881 raft_consensus.cc:2243] T 7fe190354178418bae8b7cc5abbb74ef P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:58:47.539885 18881 raft_consensus.cc:2272] T 7fe190354178418bae8b7cc5abbb74ef P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:47.539248 18300 raft_consensus.cc:2955] T 1f184d89e4244f12af7afd690bc7027d P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:47.544014 18881 ts_tablet_manager.cc:1916] T 7fe190354178418bae8b7cc5abbb74ef P 982df35c5b554a8fa64807352c4f34ee: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251023 07:58:47.547207 18246 raft_consensus.cc:2955] T 1f184d89e4244f12af7afd690bc7027d P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:47.555073 18788 raft_consensus.cc:2955] T 1f184d89e4244f12af7afd690bc7027d P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:47.567934 18176 raft_consensus.cc:2955] T 1f184d89e4244f12af7afd690bc7027d P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:47.576696 18000 catalog_manager.cc:5649] T 1f184d89e4244f12af7afd690bc7027d P 982df35c5b554a8fa64807352c4f34ee reported cstate change: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:47.601949 18881 ts_tablet_manager.cc:1929] T 7fe190354178418bae8b7cc5abbb74ef P 982df35c5b554a8fa64807352c4f34ee: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20251023 07:58:47.602425 18881 log.cc:1199] T 7fe190354178418bae8b7cc5abbb74ef P 982df35c5b554a8fa64807352c4f34ee: Deleting WAL directory at /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1761206251627710-16888-0/minicluster-data/ts-2-root/wals/7fe190354178418bae8b7cc5abbb74ef
I20251023 07:58:47.606601 17986 catalog_manager.cc:4985] TS 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): tablet 7fe190354178418bae8b7cc5abbb74ef (table test-workload [id=8bb191a5531a4d4fb58a25b13d592213]) successfully deleted
I20251023 07:58:47.616782 18788 raft_consensus.cc:1275] T b9841e711f8e4a019c2d0dec5409474c P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:58:47.618453 18100 raft_consensus.cc:1275] T b9841e711f8e4a019c2d0dec5409474c P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:58:47.622730 18176 raft_consensus.cc:1275] T b9841e711f8e4a019c2d0dec5409474c P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:58:47.622941 18097 consensus_queue.cc:237] T 1f184d89e4244f12af7afd690bc7027d P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:58:47.620193 18848 consensus_queue.cc:1048] T b9841e711f8e4a019c2d0dec5409474c P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20251023 07:58:47.625329 18873 consensus_queue.cc:1048] T b9841e711f8e4a019c2d0dec5409474c P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:58:47.629951 18873 consensus_queue.cc:1048] T b9841e711f8e4a019c2d0dec5409474c P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:58:47.634776 18789 raft_consensus.cc:1275] T 1f184d89e4244f12af7afd690bc7027d P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251023 07:58:47.635177 18246 raft_consensus.cc:1275] T 1f184d89e4244f12af7afd690bc7027d P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251023 07:58:47.636663 18698 consensus_queue.cc:1048] T 1f184d89e4244f12af7afd690bc7027d P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:58:47.645268 18834 consensus_queue.cc:1048] T 1f184d89e4244f12af7afd690bc7027d P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:58:47.649713 18300 raft_consensus.cc:2955] T 1f184d89e4244f12af7afd690bc7027d P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 10dfae53d0c941f08bded43539841761 (127.16.126.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:47.657269 18789 raft_consensus.cc:2955] T 1f184d89e4244f12af7afd690bc7027d P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 10dfae53d0c941f08bded43539841761 (127.16.126.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:47.665654 17987 catalog_manager.cc:5162] ChangeConfig:REMOVE_PEER RPC for tablet 1f184d89e4244f12af7afd690bc7027d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251023 07:58:47.672652 18848 raft_consensus.cc:2955] T b9841e711f8e4a019c2d0dec5409474c P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:47.674088 18787 raft_consensus.cc:2955] T b9841e711f8e4a019c2d0dec5409474c P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:47.683749 18244 raft_consensus.cc:2955] T 1f184d89e4244f12af7afd690bc7027d P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 10dfae53d0c941f08bded43539841761 (127.16.126.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:47.684885 18000 catalog_manager.cc:5649] T 1f184d89e4244f12af7afd690bc7027d P b3a1328f9c8c484fab08292ce2171ec9 reported cstate change: config changed from index 3 to 4, VOTER 10dfae53d0c941f08bded43539841761 (127.16.126.2) evicted. New cstate: current_term: 1 leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251023 07:58:47.686167 18097 raft_consensus.cc:2955] T b9841e711f8e4a019c2d0dec5409474c P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:47.700918 18163 tablet_service.cc:1552] Processing DeleteTablet for tablet 1f184d89e4244f12af7afd690bc7027d with delete_type TABLET_DATA_TOMBSTONED (TS 10dfae53d0c941f08bded43539841761 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33428
I20251023 07:58:47.708544 18000 catalog_manager.cc:5649] T b9841e711f8e4a019c2d0dec5409474c P d1a8f61d3323447282ee6068aa623216 reported cstate change: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "982df35c5b554a8fa64807352c4f34ee" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:47.709314 18889 tablet_replica.cc:333] T 1f184d89e4244f12af7afd690bc7027d P 10dfae53d0c941f08bded43539841761: stopping tablet replica
I20251023 07:58:47.711294 18889 raft_consensus.cc:2243] T 1f184d89e4244f12af7afd690bc7027d P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:58:47.712209 18889 raft_consensus.cc:2272] T 1f184d89e4244f12af7afd690bc7027d P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:47.715924 18889 ts_tablet_manager.cc:1916] T 1f184d89e4244f12af7afd690bc7027d P 10dfae53d0c941f08bded43539841761: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251023 07:58:47.726449 18176 raft_consensus.cc:2955] T b9841e711f8e4a019c2d0dec5409474c P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:47.747997 18889 ts_tablet_manager.cc:1929] T 1f184d89e4244f12af7afd690bc7027d P 10dfae53d0c941f08bded43539841761: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20251023 07:58:47.748521 18889 log.cc:1199] T 1f184d89e4244f12af7afd690bc7027d P 10dfae53d0c941f08bded43539841761: Deleting WAL directory at /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1761206251627710-16888-0/minicluster-data/ts-1-root/wals/1f184d89e4244f12af7afd690bc7027d
I20251023 07:58:47.757210 17985 catalog_manager.cc:4985] TS 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): tablet 1f184d89e4244f12af7afd690bc7027d (table test-workload [id=8bb191a5531a4d4fb58a25b13d592213]) successfully deleted
I20251023 07:58:47.763054 18244 consensus_queue.cc:237] T b9841e711f8e4a019c2d0dec5409474c P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:58:47.769524 18787 raft_consensus.cc:1275] T b9841e711f8e4a019c2d0dec5409474c P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251023 07:58:47.772842 18597 consensus_queue.cc:1048] T b9841e711f8e4a019c2d0dec5409474c P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:58:47.780845 18097 raft_consensus.cc:1275] T b9841e711f8e4a019c2d0dec5409474c P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251023 07:58:47.784930 18873 consensus_queue.cc:1048] T b9841e711f8e4a019c2d0dec5409474c P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:58:47.792614 18847 raft_consensus.cc:2955] T b9841e711f8e4a019c2d0dec5409474c P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 10dfae53d0c941f08bded43539841761 (127.16.126.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:47.795255 18097 raft_consensus.cc:2955] T b9841e711f8e4a019c2d0dec5409474c P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 10dfae53d0c941f08bded43539841761 (127.16.126.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:47.806572 17986 catalog_manager.cc:5162] ChangeConfig:REMOVE_PEER RPC for tablet b9841e711f8e4a019c2d0dec5409474c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251023 07:58:47.816570 17998 catalog_manager.cc:5649] T b9841e711f8e4a019c2d0dec5409474c P 982df35c5b554a8fa64807352c4f34ee reported cstate change: config changed from index 3 to 4, VOTER 10dfae53d0c941f08bded43539841761 (127.16.126.2) evicted. New cstate: current_term: 1 leader_uuid: "982df35c5b554a8fa64807352c4f34ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20251023 07:58:47.826614 18789 raft_consensus.cc:2955] T b9841e711f8e4a019c2d0dec5409474c P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 10dfae53d0c941f08bded43539841761 (127.16.126.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:47.830976 18163 tablet_service.cc:1552] Processing DeleteTablet for tablet b9841e711f8e4a019c2d0dec5409474c with delete_type TABLET_DATA_TOMBSTONED (TS 10dfae53d0c941f08bded43539841761 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33428
I20251023 07:58:47.831897 18889 tablet_replica.cc:333] T b9841e711f8e4a019c2d0dec5409474c P 10dfae53d0c941f08bded43539841761: stopping tablet replica
I20251023 07:58:47.832935 18889 raft_consensus.cc:2243] T b9841e711f8e4a019c2d0dec5409474c P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:58:47.833604 18889 raft_consensus.cc:2272] T b9841e711f8e4a019c2d0dec5409474c P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:47.837268 18889 ts_tablet_manager.cc:1916] T b9841e711f8e4a019c2d0dec5409474c P 10dfae53d0c941f08bded43539841761: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251023 07:58:47.856020 18889 ts_tablet_manager.cc:1929] T b9841e711f8e4a019c2d0dec5409474c P 10dfae53d0c941f08bded43539841761: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20251023 07:58:47.856506 18889 log.cc:1199] T b9841e711f8e4a019c2d0dec5409474c P 10dfae53d0c941f08bded43539841761: Deleting WAL directory at /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1761206251627710-16888-0/minicluster-data/ts-1-root/wals/b9841e711f8e4a019c2d0dec5409474c
I20251023 07:58:47.858508 17985 catalog_manager.cc:4985] TS 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): tablet b9841e711f8e4a019c2d0dec5409474c (table test-workload [id=8bb191a5531a4d4fb58a25b13d592213]) successfully deleted
I20251023 07:58:48.890867 18097 consensus_queue.cc:237] T 55de6ceb03f343b09190cb2fb4bbe144 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:58:48.896741 18176 raft_consensus.cc:1275] T 55de6ceb03f343b09190cb2fb4bbe144 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251023 07:58:48.897220 18248 raft_consensus.cc:1275] T 55de6ceb03f343b09190cb2fb4bbe144 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251023 07:58:48.897886 18879 consensus_queue.cc:1048] T 55de6ceb03f343b09190cb2fb4bbe144 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20251023 07:58:48.899099 18067 consensus_peers.cc:597] T 55de6ceb03f343b09190cb2fb4bbe144 P b3a1328f9c8c484fab08292ce2171ec9 -> Peer d1a8f61d3323447282ee6068aa623216 (127.16.126.4:33293): Couldn't send request to peer d1a8f61d3323447282ee6068aa623216. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55de6ceb03f343b09190cb2fb4bbe144. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:58:48.900041 18834 consensus_queue.cc:1048] T 55de6ceb03f343b09190cb2fb4bbe144 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:58:48.914695 18834 raft_consensus.cc:2955] T 55de6ceb03f343b09190cb2fb4bbe144 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:58:48.919224 18176 raft_consensus.cc:2955] T 55de6ceb03f343b09190cb2fb4bbe144 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:58:48.918464 18248 raft_consensus.cc:2955] T 55de6ceb03f343b09190cb2fb4bbe144 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:58:48.948374 18000 catalog_manager.cc:5649] T 55de6ceb03f343b09190cb2fb4bbe144 P 10dfae53d0c941f08bded43539841761 reported cstate change: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New cstate: current_term: 1 leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:58:48.978677 18248 consensus_queue.cc:237] T 8f25975c7ab4439c9975a5e5604727dc P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
W20251023 07:58:49.007337 18216 consensus_peers.cc:597] T 8f25975c7ab4439c9975a5e5604727dc P 982df35c5b554a8fa64807352c4f34ee -> Peer d1a8f61d3323447282ee6068aa623216 (127.16.126.4:33293): Couldn't send request to peer d1a8f61d3323447282ee6068aa623216. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8f25975c7ab4439c9975a5e5604727dc. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:58:49.013679 18170 raft_consensus.cc:1275] T 8f25975c7ab4439c9975a5e5604727dc P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251023 07:58:49.020519 18100 raft_consensus.cc:1275] T 8f25975c7ab4439c9975a5e5604727dc P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251023 07:58:49.022254 18846 consensus_queue.cc:1048] T 8f25975c7ab4439c9975a5e5604727dc P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20251023 07:58:49.027405 18847 consensus_queue.cc:1048] T 8f25975c7ab4439c9975a5e5604727dc P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20251023 07:58:49.050670 18846 raft_consensus.cc:2955] T 8f25975c7ab4439c9975a5e5604727dc P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:58:49.054106 18100 raft_consensus.cc:2955] T 8f25975c7ab4439c9975a5e5604727dc P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:58:49.060195 18170 raft_consensus.cc:2955] T 8f25975c7ab4439c9975a5e5604727dc P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:58:49.081714 18100 consensus_queue.cc:237] T ae4437d151054b59a0e93ca01a9609c7 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:58:49.099193 18248 raft_consensus.cc:1275] T ae4437d151054b59a0e93ca01a9609c7 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251023 07:58:49.096612 17998 catalog_manager.cc:5649] T 8f25975c7ab4439c9975a5e5604727dc P 10dfae53d0c941f08bded43539841761 reported cstate change: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New cstate: current_term: 1 leader_uuid: "982df35c5b554a8fa64807352c4f34ee" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:58:49.101590 18834 consensus_queue.cc:1048] T ae4437d151054b59a0e93ca01a9609c7 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20251023 07:58:49.102473 18067 consensus_peers.cc:597] T ae4437d151054b59a0e93ca01a9609c7 P b3a1328f9c8c484fab08292ce2171ec9 -> Peer d1a8f61d3323447282ee6068aa623216 (127.16.126.4:33293): Couldn't send request to peer d1a8f61d3323447282ee6068aa623216. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ae4437d151054b59a0e93ca01a9609c7. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:58:49.105491 18170 raft_consensus.cc:1275] T ae4437d151054b59a0e93ca01a9609c7 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251023 07:58:49.107633 18892 consensus_queue.cc:1048] T ae4437d151054b59a0e93ca01a9609c7 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:58:49.127394 18879 raft_consensus.cc:2955] T ae4437d151054b59a0e93ca01a9609c7 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:58:49.129659 18170 raft_consensus.cc:2955] T ae4437d151054b59a0e93ca01a9609c7 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:58:49.131902 18244 raft_consensus.cc:2955] T ae4437d151054b59a0e93ca01a9609c7 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:58:49.151567 18000 catalog_manager.cc:5649] T ae4437d151054b59a0e93ca01a9609c7 P 10dfae53d0c941f08bded43539841761 reported cstate change: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New cstate: current_term: 1 leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:58:49.151803 18246 consensus_queue.cc:237] T c8b2781a072e401dba80e2879748e681 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
W20251023 07:58:49.174844 18216 consensus_peers.cc:597] T c8b2781a072e401dba80e2879748e681 P 982df35c5b554a8fa64807352c4f34ee -> Peer d1a8f61d3323447282ee6068aa623216 (127.16.126.4:33293): Couldn't send request to peer d1a8f61d3323447282ee6068aa623216. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c8b2781a072e401dba80e2879748e681. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:58:49.175397 18170 raft_consensus.cc:1275] T c8b2781a072e401dba80e2879748e681 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251023 07:58:49.176080 18100 raft_consensus.cc:1275] T c8b2781a072e401dba80e2879748e681 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251023 07:58:49.176458 18846 consensus_queue.cc:1048] T c8b2781a072e401dba80e2879748e681 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:58:49.177964 18846 consensus_queue.cc:1048] T c8b2781a072e401dba80e2879748e681 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:58:49.202270 18847 raft_consensus.cc:2955] T c8b2781a072e401dba80e2879748e681 P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:58:49.204617 18100 raft_consensus.cc:2955] T c8b2781a072e401dba80e2879748e681 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:58:49.211215 18170 raft_consensus.cc:2955] T c8b2781a072e401dba80e2879748e681 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:58:49.241631 17998 catalog_manager.cc:5649] T c8b2781a072e401dba80e2879748e681 P b3a1328f9c8c484fab08292ce2171ec9 reported cstate change: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New cstate: current_term: 1 leader_uuid: "982df35c5b554a8fa64807352c4f34ee" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:58:49.282606 18912 ts_tablet_manager.cc:933] T 55de6ceb03f343b09190cb2fb4bbe144 P d1a8f61d3323447282ee6068aa623216: Initiating tablet copy from peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025)
I20251023 07:58:49.285598 18912 tablet_copy_client.cc:323] T 55de6ceb03f343b09190cb2fb4bbe144 P d1a8f61d3323447282ee6068aa623216: tablet copy: Beginning tablet copy session from remote peer at address 127.16.126.1:44025
I20251023 07:58:49.287546 18112 tablet_copy_service.cc:140] P b3a1328f9c8c484fab08292ce2171ec9: Received BeginTabletCopySession request for tablet 55de6ceb03f343b09190cb2fb4bbe144 from peer d1a8f61d3323447282ee6068aa623216 ({username='slave'} at 127.0.0.1:57714)
I20251023 07:58:49.288064 18112 tablet_copy_service.cc:161] P b3a1328f9c8c484fab08292ce2171ec9: Beginning new tablet copy session on tablet 55de6ceb03f343b09190cb2fb4bbe144 from peer d1a8f61d3323447282ee6068aa623216 at {username='slave'} at 127.0.0.1:57714: session id = d1a8f61d3323447282ee6068aa623216-55de6ceb03f343b09190cb2fb4bbe144
I20251023 07:58:49.294026 18112 tablet_copy_source_session.cc:215] T 55de6ceb03f343b09190cb2fb4bbe144 P b3a1328f9c8c484fab08292ce2171ec9: Tablet Copy: opened 0 blocks and 1 log segments
I20251023 07:58:49.296947 18912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55de6ceb03f343b09190cb2fb4bbe144. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:49.315209 18912 tablet_copy_client.cc:806] T 55de6ceb03f343b09190cb2fb4bbe144 P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 0 data blocks...
I20251023 07:58:49.315850 18912 tablet_copy_client.cc:670] T 55de6ceb03f343b09190cb2fb4bbe144 P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 1 WAL segments...
I20251023 07:58:49.320956 18912 tablet_copy_client.cc:538] T 55de6ceb03f343b09190cb2fb4bbe144 P d1a8f61d3323447282ee6068aa623216: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251023 07:58:49.333191 18912 tablet_bootstrap.cc:492] T 55de6ceb03f343b09190cb2fb4bbe144 P d1a8f61d3323447282ee6068aa623216: Bootstrap starting.
I20251023 07:58:49.360745 18912 tablet_bootstrap.cc:492] T 55de6ceb03f343b09190cb2fb4bbe144 P d1a8f61d3323447282ee6068aa623216: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:58:49.361690 18912 tablet_bootstrap.cc:492] T 55de6ceb03f343b09190cb2fb4bbe144 P d1a8f61d3323447282ee6068aa623216: Bootstrap complete.
I20251023 07:58:49.362380 18912 ts_tablet_manager.cc:1403] T 55de6ceb03f343b09190cb2fb4bbe144 P d1a8f61d3323447282ee6068aa623216: Time spent bootstrapping tablet: real 0.029s user 0.026s sys 0.004s
I20251023 07:58:49.365481 18912 raft_consensus.cc:359] T 55de6ceb03f343b09190cb2fb4bbe144 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:58:49.366344 18912 raft_consensus.cc:740] T 55de6ceb03f343b09190cb2fb4bbe144 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d1a8f61d3323447282ee6068aa623216, State: Initialized, Role: LEARNER
I20251023 07:58:49.367455 18912 consensus_queue.cc:260] T 55de6ceb03f343b09190cb2fb4bbe144 P d1a8f61d3323447282ee6068aa623216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:58:49.377789 18912 ts_tablet_manager.cc:1434] T 55de6ceb03f343b09190cb2fb4bbe144 P d1a8f61d3323447282ee6068aa623216: Time spent starting tablet: real 0.015s user 0.008s sys 0.008s
I20251023 07:58:49.381948 18112 tablet_copy_service.cc:342] P b3a1328f9c8c484fab08292ce2171ec9: Request end of tablet copy session d1a8f61d3323447282ee6068aa623216-55de6ceb03f343b09190cb2fb4bbe144 received from {username='slave'} at 127.0.0.1:57714
I20251023 07:58:49.382400 18112 tablet_copy_service.cc:434] P b3a1328f9c8c484fab08292ce2171ec9: ending tablet copy session d1a8f61d3323447282ee6068aa623216-55de6ceb03f343b09190cb2fb4bbe144 on tablet 55de6ceb03f343b09190cb2fb4bbe144 with peer d1a8f61d3323447282ee6068aa623216
I20251023 07:58:49.390007 18912 ts_tablet_manager.cc:933] T 8f25975c7ab4439c9975a5e5604727dc P d1a8f61d3323447282ee6068aa623216: Initiating tablet copy from peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:49.405154 18912 tablet_copy_client.cc:323] T 8f25975c7ab4439c9975a5e5604727dc P d1a8f61d3323447282ee6068aa623216: tablet copy: Beginning tablet copy session from remote peer at address 127.16.126.3:46061
I20251023 07:58:49.407306 18261 tablet_copy_service.cc:140] P 982df35c5b554a8fa64807352c4f34ee: Received BeginTabletCopySession request for tablet 8f25975c7ab4439c9975a5e5604727dc from peer d1a8f61d3323447282ee6068aa623216 ({username='slave'} at 127.0.0.1:40260)
I20251023 07:58:49.407971 18261 tablet_copy_service.cc:161] P 982df35c5b554a8fa64807352c4f34ee: Beginning new tablet copy session on tablet 8f25975c7ab4439c9975a5e5604727dc from peer d1a8f61d3323447282ee6068aa623216 at {username='slave'} at 127.0.0.1:40260: session id = d1a8f61d3323447282ee6068aa623216-8f25975c7ab4439c9975a5e5604727dc
I20251023 07:58:49.416229 18261 tablet_copy_source_session.cc:215] T 8f25975c7ab4439c9975a5e5604727dc P 982df35c5b554a8fa64807352c4f34ee: Tablet Copy: opened 0 blocks and 1 log segments
I20251023 07:58:49.420877 18912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f25975c7ab4439c9975a5e5604727dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:49.442195 18912 tablet_copy_client.cc:806] T 8f25975c7ab4439c9975a5e5604727dc P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 0 data blocks...
I20251023 07:58:49.442814 18912 tablet_copy_client.cc:670] T 8f25975c7ab4439c9975a5e5604727dc P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 1 WAL segments...
I20251023 07:58:49.451908 18912 tablet_copy_client.cc:538] T 8f25975c7ab4439c9975a5e5604727dc P d1a8f61d3323447282ee6068aa623216: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251023 07:58:49.465906 18912 tablet_bootstrap.cc:492] T 8f25975c7ab4439c9975a5e5604727dc P d1a8f61d3323447282ee6068aa623216: Bootstrap starting.
I20251023 07:58:49.490242 18912 tablet_bootstrap.cc:492] T 8f25975c7ab4439c9975a5e5604727dc P d1a8f61d3323447282ee6068aa623216: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:58:49.491027 18912 tablet_bootstrap.cc:492] T 8f25975c7ab4439c9975a5e5604727dc P d1a8f61d3323447282ee6068aa623216: Bootstrap complete.
I20251023 07:58:49.491685 18912 ts_tablet_manager.cc:1403] T 8f25975c7ab4439c9975a5e5604727dc P d1a8f61d3323447282ee6068aa623216: Time spent bootstrapping tablet: real 0.026s user 0.013s sys 0.008s
I20251023 07:58:49.497915 18912 raft_consensus.cc:359] T 8f25975c7ab4439c9975a5e5604727dc P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:58:49.498929 18912 raft_consensus.cc:740] T 8f25975c7ab4439c9975a5e5604727dc P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d1a8f61d3323447282ee6068aa623216, State: Initialized, Role: LEARNER
I20251023 07:58:49.499550 18912 consensus_queue.cc:260] T 8f25975c7ab4439c9975a5e5604727dc P d1a8f61d3323447282ee6068aa623216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:58:49.503690 18912 ts_tablet_manager.cc:1434] T 8f25975c7ab4439c9975a5e5604727dc P d1a8f61d3323447282ee6068aa623216: Time spent starting tablet: real 0.012s user 0.003s sys 0.004s
I20251023 07:58:49.505336 18261 tablet_copy_service.cc:342] P 982df35c5b554a8fa64807352c4f34ee: Request end of tablet copy session d1a8f61d3323447282ee6068aa623216-8f25975c7ab4439c9975a5e5604727dc received from {username='slave'} at 127.0.0.1:40260
I20251023 07:58:49.505858 18261 tablet_copy_service.cc:434] P 982df35c5b554a8fa64807352c4f34ee: ending tablet copy session d1a8f61d3323447282ee6068aa623216-8f25975c7ab4439c9975a5e5604727dc on tablet 8f25975c7ab4439c9975a5e5604727dc with peer d1a8f61d3323447282ee6068aa623216
I20251023 07:58:49.587453 18912 ts_tablet_manager.cc:933] T c8b2781a072e401dba80e2879748e681 P d1a8f61d3323447282ee6068aa623216: Initiating tablet copy from peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:49.591044 18912 tablet_copy_client.cc:323] T c8b2781a072e401dba80e2879748e681 P d1a8f61d3323447282ee6068aa623216: tablet copy: Beginning tablet copy session from remote peer at address 127.16.126.3:46061
I20251023 07:58:49.592337 18261 tablet_copy_service.cc:140] P 982df35c5b554a8fa64807352c4f34ee: Received BeginTabletCopySession request for tablet c8b2781a072e401dba80e2879748e681 from peer d1a8f61d3323447282ee6068aa623216 ({username='slave'} at 127.0.0.1:40260)
I20251023 07:58:49.592787 18261 tablet_copy_service.cc:161] P 982df35c5b554a8fa64807352c4f34ee: Beginning new tablet copy session on tablet c8b2781a072e401dba80e2879748e681 from peer d1a8f61d3323447282ee6068aa623216 at {username='slave'} at 127.0.0.1:40260: session id = d1a8f61d3323447282ee6068aa623216-c8b2781a072e401dba80e2879748e681
I20251023 07:58:49.599677 18919 ts_tablet_manager.cc:933] T ae4437d151054b59a0e93ca01a9609c7 P d1a8f61d3323447282ee6068aa623216: Initiating tablet copy from peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025)
I20251023 07:58:49.602422 18261 tablet_copy_source_session.cc:215] T c8b2781a072e401dba80e2879748e681 P 982df35c5b554a8fa64807352c4f34ee: Tablet Copy: opened 0 blocks and 1 log segments
I20251023 07:58:49.605726 18912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8b2781a072e401dba80e2879748e681. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:49.608903 18919 tablet_copy_client.cc:323] T ae4437d151054b59a0e93ca01a9609c7 P d1a8f61d3323447282ee6068aa623216: tablet copy: Beginning tablet copy session from remote peer at address 127.16.126.1:44025
I20251023 07:58:49.610643 18112 tablet_copy_service.cc:140] P b3a1328f9c8c484fab08292ce2171ec9: Received BeginTabletCopySession request for tablet ae4437d151054b59a0e93ca01a9609c7 from peer d1a8f61d3323447282ee6068aa623216 ({username='slave'} at 127.0.0.1:57714)
I20251023 07:58:49.611235 18112 tablet_copy_service.cc:161] P b3a1328f9c8c484fab08292ce2171ec9: Beginning new tablet copy session on tablet ae4437d151054b59a0e93ca01a9609c7 from peer d1a8f61d3323447282ee6068aa623216 at {username='slave'} at 127.0.0.1:57714: session id = d1a8f61d3323447282ee6068aa623216-ae4437d151054b59a0e93ca01a9609c7
I20251023 07:58:49.622169 18112 tablet_copy_source_session.cc:215] T ae4437d151054b59a0e93ca01a9609c7 P b3a1328f9c8c484fab08292ce2171ec9: Tablet Copy: opened 0 blocks and 1 log segments
I20251023 07:58:49.622660 18912 tablet_copy_client.cc:806] T c8b2781a072e401dba80e2879748e681 P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 0 data blocks...
I20251023 07:58:49.628074 18912 tablet_copy_client.cc:670] T c8b2781a072e401dba80e2879748e681 P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 1 WAL segments...
I20251023 07:58:49.628840 18919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae4437d151054b59a0e93ca01a9609c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:49.632854 18912 tablet_copy_client.cc:538] T c8b2781a072e401dba80e2879748e681 P d1a8f61d3323447282ee6068aa623216: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251023 07:58:49.647286 18919 tablet_copy_client.cc:806] T ae4437d151054b59a0e93ca01a9609c7 P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 0 data blocks...
I20251023 07:58:49.647853 18919 tablet_copy_client.cc:670] T ae4437d151054b59a0e93ca01a9609c7 P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 1 WAL segments...
I20251023 07:58:49.648180 18912 tablet_bootstrap.cc:492] T c8b2781a072e401dba80e2879748e681 P d1a8f61d3323447282ee6068aa623216: Bootstrap starting.
I20251023 07:58:49.651666 18919 tablet_copy_client.cc:538] T ae4437d151054b59a0e93ca01a9609c7 P d1a8f61d3323447282ee6068aa623216: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251023 07:58:49.662513 18919 tablet_bootstrap.cc:492] T ae4437d151054b59a0e93ca01a9609c7 P d1a8f61d3323447282ee6068aa623216: Bootstrap starting.
I20251023 07:58:49.689641 18912 tablet_bootstrap.cc:492] T c8b2781a072e401dba80e2879748e681 P d1a8f61d3323447282ee6068aa623216: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:58:49.690784 18912 tablet_bootstrap.cc:492] T c8b2781a072e401dba80e2879748e681 P d1a8f61d3323447282ee6068aa623216: Bootstrap complete.
I20251023 07:58:49.691504 18912 ts_tablet_manager.cc:1403] T c8b2781a072e401dba80e2879748e681 P d1a8f61d3323447282ee6068aa623216: Time spent bootstrapping tablet: real 0.044s user 0.022s sys 0.005s
I20251023 07:58:49.694113 18912 raft_consensus.cc:359] T c8b2781a072e401dba80e2879748e681 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:58:49.695087 18912 raft_consensus.cc:740] T c8b2781a072e401dba80e2879748e681 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d1a8f61d3323447282ee6068aa623216, State: Initialized, Role: LEARNER
I20251023 07:58:49.695781 18912 consensus_queue.cc:260] T c8b2781a072e401dba80e2879748e681 P d1a8f61d3323447282ee6068aa623216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:58:49.698122 18912 ts_tablet_manager.cc:1434] T c8b2781a072e401dba80e2879748e681 P d1a8f61d3323447282ee6068aa623216: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20251023 07:58:49.700053 18261 tablet_copy_service.cc:342] P 982df35c5b554a8fa64807352c4f34ee: Request end of tablet copy session d1a8f61d3323447282ee6068aa623216-c8b2781a072e401dba80e2879748e681 received from {username='slave'} at 127.0.0.1:40260
I20251023 07:58:49.700469 18261 tablet_copy_service.cc:434] P 982df35c5b554a8fa64807352c4f34ee: ending tablet copy session d1a8f61d3323447282ee6068aa623216-c8b2781a072e401dba80e2879748e681 on tablet c8b2781a072e401dba80e2879748e681 with peer d1a8f61d3323447282ee6068aa623216
I20251023 07:58:49.760857 18789 raft_consensus.cc:1217] T 55de6ceb03f343b09190cb2fb4bbe144 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20251023 07:58:49.763410 18919 tablet_bootstrap.cc:492] T ae4437d151054b59a0e93ca01a9609c7 P d1a8f61d3323447282ee6068aa623216: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:58:49.764504 18919 tablet_bootstrap.cc:492] T ae4437d151054b59a0e93ca01a9609c7 P d1a8f61d3323447282ee6068aa623216: Bootstrap complete.
I20251023 07:58:49.765271 18919 ts_tablet_manager.cc:1403] T ae4437d151054b59a0e93ca01a9609c7 P d1a8f61d3323447282ee6068aa623216: Time spent bootstrapping tablet: real 0.103s user 0.021s sys 0.019s
I20251023 07:58:49.770624 18919 raft_consensus.cc:359] T ae4437d151054b59a0e93ca01a9609c7 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:58:49.779301 18919 raft_consensus.cc:740] T ae4437d151054b59a0e93ca01a9609c7 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d1a8f61d3323447282ee6068aa623216, State: Initialized, Role: LEARNER
I20251023 07:58:49.780601 18919 consensus_queue.cc:260] T ae4437d151054b59a0e93ca01a9609c7 P d1a8f61d3323447282ee6068aa623216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:58:49.783411 18919 ts_tablet_manager.cc:1434] T ae4437d151054b59a0e93ca01a9609c7 P d1a8f61d3323447282ee6068aa623216: Time spent starting tablet: real 0.018s user 0.004s sys 0.002s
I20251023 07:58:49.786113 18112 tablet_copy_service.cc:342] P b3a1328f9c8c484fab08292ce2171ec9: Request end of tablet copy session d1a8f61d3323447282ee6068aa623216-ae4437d151054b59a0e93ca01a9609c7 received from {username='slave'} at 127.0.0.1:57714
I20251023 07:58:49.786571 18112 tablet_copy_service.cc:434] P b3a1328f9c8c484fab08292ce2171ec9: ending tablet copy session d1a8f61d3323447282ee6068aa623216-ae4437d151054b59a0e93ca01a9609c7 on tablet ae4437d151054b59a0e93ca01a9609c7 with peer d1a8f61d3323447282ee6068aa623216
I20251023 07:58:49.978703 18789 raft_consensus.cc:1217] T 8f25975c7ab4439c9975a5e5604727dc P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20251023 07:58:50.070724 18789 raft_consensus.cc:1217] T c8b2781a072e401dba80e2879748e681 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20251023 07:58:50.151222 18879 raft_consensus.cc:1064] T 55de6ceb03f343b09190cb2fb4bbe144 P b3a1328f9c8c484fab08292ce2171ec9: attempting to promote NON_VOTER d1a8f61d3323447282ee6068aa623216 to VOTER
I20251023 07:58:50.153774 18879 consensus_queue.cc:237] T 55de6ceb03f343b09190cb2fb4bbe144 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:58:50.163925 18248 raft_consensus.cc:1275] T 55de6ceb03f343b09190cb2fb4bbe144 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:58:50.164216 18789 raft_consensus.cc:1275] T 55de6ceb03f343b09190cb2fb4bbe144 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:58:50.166011 18834 consensus_queue.cc:1048] T 55de6ceb03f343b09190cb2fb4bbe144 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:58:50.166494 18174 raft_consensus.cc:1275] T 55de6ceb03f343b09190cb2fb4bbe144 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:58:50.168540 18879 consensus_queue.cc:1048] T 55de6ceb03f343b09190cb2fb4bbe144 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:58:50.169353 18923 consensus_queue.cc:1048] T 55de6ceb03f343b09190cb2fb4bbe144 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:58:50.203307 18787 raft_consensus.cc:1217] T ae4437d151054b59a0e93ca01a9609c7 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20251023 07:58:50.224635 18879 raft_consensus.cc:2955] T 55de6ceb03f343b09190cb2fb4bbe144 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:50.228242 18248 raft_consensus.cc:2955] T 55de6ceb03f343b09190cb2fb4bbe144 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:50.232482 18789 raft_consensus.cc:2955] T 55de6ceb03f343b09190cb2fb4bbe144 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:50.252245 18000 catalog_manager.cc:5649] T 55de6ceb03f343b09190cb2fb4bbe144 P d1a8f61d3323447282ee6068aa623216 reported cstate change: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:50.264767 18174 raft_consensus.cc:2955] T 55de6ceb03f343b09190cb2fb4bbe144 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:50.318806 18097 consensus_queue.cc:237] T 55de6ceb03f343b09190cb2fb4bbe144 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:58:50.331305 18789 raft_consensus.cc:1275] T 55de6ceb03f343b09190cb2fb4bbe144 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251023 07:58:50.333626 18879 consensus_queue.cc:1048] T 55de6ceb03f343b09190cb2fb4bbe144 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:58:50.335029 18170 raft_consensus.cc:1275] T 55de6ceb03f343b09190cb2fb4bbe144 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251023 07:58:50.337714 18879 consensus_queue.cc:1048] T 55de6ceb03f343b09190cb2fb4bbe144 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:58:50.357569 18931 raft_consensus.cc:2955] T 55de6ceb03f343b09190cb2fb4bbe144 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 982df35c5b554a8fa64807352c4f34ee (127.16.126.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:50.360904 18170 raft_consensus.cc:2955] T 55de6ceb03f343b09190cb2fb4bbe144 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 982df35c5b554a8fa64807352c4f34ee (127.16.126.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:50.382117 18789 raft_consensus.cc:2955] T 55de6ceb03f343b09190cb2fb4bbe144 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 982df35c5b554a8fa64807352c4f34ee (127.16.126.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:50.382978 17999 catalog_manager.cc:5649] T 55de6ceb03f343b09190cb2fb4bbe144 P b3a1328f9c8c484fab08292ce2171ec9 reported cstate change: config changed from index 3 to 4, VOTER 982df35c5b554a8fa64807352c4f34ee (127.16.126.3) evicted. New cstate: current_term: 1 leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251023 07:58:50.386222 17987 catalog_manager.cc:5162] ChangeConfig:REMOVE_PEER RPC for tablet 55de6ceb03f343b09190cb2fb4bbe144 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251023 07:58:50.399874 18237 tablet_service.cc:1552] Processing DeleteTablet for tablet 55de6ceb03f343b09190cb2fb4bbe144 with delete_type TABLET_DATA_TOMBSTONED (TS 982df35c5b554a8fa64807352c4f34ee not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49846
I20251023 07:58:50.417943 18935 tablet_replica.cc:333] T 55de6ceb03f343b09190cb2fb4bbe144 P 982df35c5b554a8fa64807352c4f34ee: stopping tablet replica
I20251023 07:58:50.428004 18935 raft_consensus.cc:2243] T 55de6ceb03f343b09190cb2fb4bbe144 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:58:50.428912 18935 raft_consensus.cc:2272] T 55de6ceb03f343b09190cb2fb4bbe144 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:50.432554 18935 ts_tablet_manager.cc:1916] T 55de6ceb03f343b09190cb2fb4bbe144 P 982df35c5b554a8fa64807352c4f34ee: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251023 07:58:50.448765 18935 ts_tablet_manager.cc:1929] T 55de6ceb03f343b09190cb2fb4bbe144 P 982df35c5b554a8fa64807352c4f34ee: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20251023 07:58:50.449139 18935 log.cc:1199] T 55de6ceb03f343b09190cb2fb4bbe144 P 982df35c5b554a8fa64807352c4f34ee: Deleting WAL directory at /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1761206251627710-16888-0/minicluster-data/ts-2-root/wals/55de6ceb03f343b09190cb2fb4bbe144
I20251023 07:58:50.450826 17986 catalog_manager.cc:4985] TS 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): tablet 55de6ceb03f343b09190cb2fb4bbe144 (table test-workload [id=8bb191a5531a4d4fb58a25b13d592213]) successfully deleted
I20251023 07:58:50.588711 18911 raft_consensus.cc:1064] T 8f25975c7ab4439c9975a5e5604727dc P 982df35c5b554a8fa64807352c4f34ee: attempting to promote NON_VOTER d1a8f61d3323447282ee6068aa623216 to VOTER
I20251023 07:58:50.590948 18911 consensus_queue.cc:237] T 8f25975c7ab4439c9975a5e5604727dc P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:58:50.598014 18170 raft_consensus.cc:1275] T 8f25975c7ab4439c9975a5e5604727dc P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:58:50.598184 18789 raft_consensus.cc:1275] T 8f25975c7ab4439c9975a5e5604727dc P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:58:50.599524 18097 raft_consensus.cc:1275] T 8f25975c7ab4439c9975a5e5604727dc P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:58:50.599786 18910 consensus_queue.cc:1048] T 8f25975c7ab4439c9975a5e5604727dc P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:58:50.600927 18848 consensus_queue.cc:1048] T 8f25975c7ab4439c9975a5e5604727dc P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:58:50.602444 18848 consensus_queue.cc:1048] T 8f25975c7ab4439c9975a5e5604727dc P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:58:50.608327 18879 raft_consensus.cc:1064] T ae4437d151054b59a0e93ca01a9609c7 P b3a1328f9c8c484fab08292ce2171ec9: attempting to promote NON_VOTER d1a8f61d3323447282ee6068aa623216 to VOTER
I20251023 07:58:50.610738 18879 consensus_queue.cc:237] T ae4437d151054b59a0e93ca01a9609c7 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:58:50.621129 18787 raft_consensus.cc:1275] T ae4437d151054b59a0e93ca01a9609c7 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:58:50.623265 18923 consensus_queue.cc:1048] T ae4437d151054b59a0e93ca01a9609c7 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:58:50.625077 18248 raft_consensus.cc:1275] T ae4437d151054b59a0e93ca01a9609c7 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:58:50.632669 18931 consensus_queue.cc:1048] T ae4437d151054b59a0e93ca01a9609c7 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20251023 07:58:50.657999 18910 raft_consensus.cc:2955] T 8f25975c7ab4439c9975a5e5604727dc P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:50.659369 18170 raft_consensus.cc:1275] T ae4437d151054b59a0e93ca01a9609c7 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:58:50.667198 18923 consensus_queue.cc:1048] T ae4437d151054b59a0e93ca01a9609c7 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20251023 07:58:50.669093 18097 raft_consensus.cc:2955] T 8f25975c7ab4439c9975a5e5604727dc P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:50.676282 18176 raft_consensus.cc:2955] T 8f25975c7ab4439c9975a5e5604727dc P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:50.692164 18848 raft_consensus.cc:1064] T c8b2781a072e401dba80e2879748e681 P 982df35c5b554a8fa64807352c4f34ee: attempting to promote NON_VOTER d1a8f61d3323447282ee6068aa623216 to VOTER
I20251023 07:58:50.695991 18848 consensus_queue.cc:237] T c8b2781a072e401dba80e2879748e681 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:58:50.697288 17999 catalog_manager.cc:5649] T 8f25975c7ab4439c9975a5e5604727dc P 10dfae53d0c941f08bded43539841761 reported cstate change: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "982df35c5b554a8fa64807352c4f34ee" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:50.707563 18923 raft_consensus.cc:2955] T ae4437d151054b59a0e93ca01a9609c7 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:50.719209 18176 raft_consensus.cc:2955] T ae4437d151054b59a0e93ca01a9609c7 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:50.709357 18248 raft_consensus.cc:2955] T ae4437d151054b59a0e93ca01a9609c7 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:50.733594 18787 raft_consensus.cc:2955] T ae4437d151054b59a0e93ca01a9609c7 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:50.738072 18789 raft_consensus.cc:2955] T 8f25975c7ab4439c9975a5e5604727dc P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:50.742787 18788 raft_consensus.cc:1275] T c8b2781a072e401dba80e2879748e681 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:58:50.742797 18176 raft_consensus.cc:1275] T c8b2781a072e401dba80e2879748e681 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:58:50.744899 18944 consensus_queue.cc:1048] T c8b2781a072e401dba80e2879748e681 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20251023 07:58:50.752460 18099 raft_consensus.cc:1275] T c8b2781a072e401dba80e2879748e681 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:58:50.755040 18944 consensus_queue.cc:1048] T c8b2781a072e401dba80e2879748e681 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:58:50.863099 18950 consensus_queue.cc:1048] T c8b2781a072e401dba80e2879748e681 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:58:50.866333 17999 catalog_manager.cc:5649] T ae4437d151054b59a0e93ca01a9609c7 P 10dfae53d0c941f08bded43539841761 reported cstate change: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:50.915194 18248 consensus_queue.cc:237] T 8f25975c7ab4439c9975a5e5604727dc P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:58:50.922152 18101 consensus_queue.cc:237] T ae4437d151054b59a0e93ca01a9609c7 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:58:50.927453 18911 raft_consensus.cc:2955] T c8b2781a072e401dba80e2879748e681 P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
W20251023 07:58:50.924973 18216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.4:33293, user_credentials={real_user=slave}} blocked reactor thread for 60047.9us
I20251023 07:58:50.926254 18170 raft_consensus.cc:1275] T 8f25975c7ab4439c9975a5e5604727dc P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251023 07:58:50.933702 18170 raft_consensus.cc:1275] T ae4437d151054b59a0e93ca01a9609c7 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251023 07:58:50.934412 18789 raft_consensus.cc:1275] T 8f25975c7ab4439c9975a5e5604727dc P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251023 07:58:50.935467 18787 raft_consensus.cc:2955] T c8b2781a072e401dba80e2879748e681 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:50.938206 18789 raft_consensus.cc:1275] T ae4437d151054b59a0e93ca01a9609c7 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251023 07:58:50.938416 18096 raft_consensus.cc:2955] T c8b2781a072e401dba80e2879748e681 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:50.943163 18879 consensus_queue.cc:1048] T ae4437d151054b59a0e93ca01a9609c7 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:58:50.944936 18950 consensus_queue.cc:1048] T 8f25975c7ab4439c9975a5e5604727dc P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:58:50.948217 18879 consensus_queue.cc:1048] T ae4437d151054b59a0e93ca01a9609c7 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:58:50.951864 18948 raft_consensus.cc:2955] T 8f25975c7ab4439c9975a5e5604727dc P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:50.958159 18174 raft_consensus.cc:2955] T c8b2781a072e401dba80e2879748e681 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:50.959117 18834 raft_consensus.cc:2955] T ae4437d151054b59a0e93ca01a9609c7 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 982df35c5b554a8fa64807352c4f34ee (127.16.126.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:50.963449 18788 raft_consensus.cc:2955] T 8f25975c7ab4439c9975a5e5604727dc P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:50.963735 17999 catalog_manager.cc:5649] T c8b2781a072e401dba80e2879748e681 P d1a8f61d3323447282ee6068aa623216 reported cstate change: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "982df35c5b554a8fa64807352c4f34ee" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:50.973588 18911 consensus_queue.cc:1048] T 8f25975c7ab4439c9975a5e5604727dc P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:58:50.980810 17987 catalog_manager.cc:5162] ChangeConfig:REMOVE_PEER RPC for tablet ae4437d151054b59a0e93ca01a9609c7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251023 07:58:50.976614 18174 raft_consensus.cc:2955] T ae4437d151054b59a0e93ca01a9609c7 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 982df35c5b554a8fa64807352c4f34ee (127.16.126.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:50.986358 18787 raft_consensus.cc:2955] T ae4437d151054b59a0e93ca01a9609c7 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 982df35c5b554a8fa64807352c4f34ee (127.16.126.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:50.995335 18171 raft_consensus.cc:2955] T 8f25975c7ab4439c9975a5e5604727dc P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:51.008862 17986 catalog_manager.cc:5162] ChangeConfig:REMOVE_PEER RPC for tablet 8f25975c7ab4439c9975a5e5604727dc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251023 07:58:51.017654 17999 catalog_manager.cc:5649] T ae4437d151054b59a0e93ca01a9609c7 P b3a1328f9c8c484fab08292ce2171ec9 reported cstate change: config changed from index 3 to 4, VOTER 982df35c5b554a8fa64807352c4f34ee (127.16.126.3) evicted. New cstate: current_term: 1 leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251023 07:58:51.017976 17997 catalog_manager.cc:5649] T 8f25975c7ab4439c9975a5e5604727dc P d1a8f61d3323447282ee6068aa623216 reported cstate change: config changed from index 3 to 4, VOTER b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1) evicted. New cstate: current_term: 1 leader_uuid: "982df35c5b554a8fa64807352c4f34ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:51.027840 18248 consensus_queue.cc:237] T c8b2781a072e401dba80e2879748e681 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:58:51.032542 18086 tablet_service.cc:1552] Processing DeleteTablet for tablet 8f25975c7ab4439c9975a5e5604727dc with delete_type TABLET_DATA_TOMBSTONED (TS b3a1328f9c8c484fab08292ce2171ec9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53940
I20251023 07:58:51.033504 18788 raft_consensus.cc:1275] T c8b2781a072e401dba80e2879748e681 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251023 07:58:51.040408 18948 consensus_queue.cc:1048] T c8b2781a072e401dba80e2879748e681 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:58:51.049751 18954 tablet_replica.cc:333] T 8f25975c7ab4439c9975a5e5604727dc P b3a1328f9c8c484fab08292ce2171ec9: stopping tablet replica
I20251023 07:58:51.049124 18947 raft_consensus.cc:2955] T c8b2781a072e401dba80e2879748e681 P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:51.052827 18954 raft_consensus.cc:2243] T 8f25975c7ab4439c9975a5e5604727dc P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:58:51.050678 18788 raft_consensus.cc:2955] T c8b2781a072e401dba80e2879748e681 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:51.058494 18237 tablet_service.cc:1552] Processing DeleteTablet for tablet ae4437d151054b59a0e93ca01a9609c7 with delete_type TABLET_DATA_TOMBSTONED (TS 982df35c5b554a8fa64807352c4f34ee not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49846
I20251023 07:58:51.050837 18171 raft_consensus.cc:1275] T c8b2781a072e401dba80e2879748e681 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251023 07:58:51.067082 18955 tablet_replica.cc:333] T ae4437d151054b59a0e93ca01a9609c7 P 982df35c5b554a8fa64807352c4f34ee: stopping tablet replica
I20251023 07:58:51.067812 18955 raft_consensus.cc:2243] T ae4437d151054b59a0e93ca01a9609c7 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:58:51.068920 18954 raft_consensus.cc:2272] T 8f25975c7ab4439c9975a5e5604727dc P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:51.069185 17986 catalog_manager.cc:5162] ChangeConfig:REMOVE_PEER RPC for tablet c8b2781a072e401dba80e2879748e681 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251023 07:58:51.073973 18955 raft_consensus.cc:2272] T ae4437d151054b59a0e93ca01a9609c7 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:51.072322 18951 consensus_queue.cc:1048] T c8b2781a072e401dba80e2879748e681 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:58:51.075198 17999 catalog_manager.cc:5649] T c8b2781a072e401dba80e2879748e681 P d1a8f61d3323447282ee6068aa623216 reported cstate change: config changed from index 3 to 4, VOTER b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1) evicted. New cstate: current_term: 1 leader_uuid: "982df35c5b554a8fa64807352c4f34ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:51.079505 18171 raft_consensus.cc:2955] T c8b2781a072e401dba80e2879748e681 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:51.087647 18954 ts_tablet_manager.cc:1916] T 8f25975c7ab4439c9975a5e5604727dc P b3a1328f9c8c484fab08292ce2171ec9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251023 07:58:51.091084 18955 ts_tablet_manager.cc:1916] T ae4437d151054b59a0e93ca01a9609c7 P 982df35c5b554a8fa64807352c4f34ee: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251023 07:58:51.093984 18086 tablet_service.cc:1552] Processing DeleteTablet for tablet c8b2781a072e401dba80e2879748e681 with delete_type TABLET_DATA_TOMBSTONED (TS b3a1328f9c8c484fab08292ce2171ec9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53940
I20251023 07:58:51.104539 18954 ts_tablet_manager.cc:1929] T 8f25975c7ab4439c9975a5e5604727dc P b3a1328f9c8c484fab08292ce2171ec9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20251023 07:58:51.105095 18954 log.cc:1199] T 8f25975c7ab4439c9975a5e5604727dc P b3a1328f9c8c484fab08292ce2171ec9: Deleting WAL directory at /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1761206251627710-16888-0/minicluster-data/ts-0-root/wals/8f25975c7ab4439c9975a5e5604727dc
I20251023 07:58:51.106540 17987 catalog_manager.cc:4985] TS b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): tablet 8f25975c7ab4439c9975a5e5604727dc (table test-workload [id=8bb191a5531a4d4fb58a25b13d592213]) successfully deleted
I20251023 07:58:51.106760 18954 tablet_replica.cc:333] T c8b2781a072e401dba80e2879748e681 P b3a1328f9c8c484fab08292ce2171ec9: stopping tablet replica
I20251023 07:58:51.107806 18954 raft_consensus.cc:2243] T c8b2781a072e401dba80e2879748e681 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:58:51.108531 18954 raft_consensus.cc:2272] T c8b2781a072e401dba80e2879748e681 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:51.108994 18955 ts_tablet_manager.cc:1929] T ae4437d151054b59a0e93ca01a9609c7 P 982df35c5b554a8fa64807352c4f34ee: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20251023 07:58:51.109444 18955 log.cc:1199] T ae4437d151054b59a0e93ca01a9609c7 P 982df35c5b554a8fa64807352c4f34ee: Deleting WAL directory at /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1761206251627710-16888-0/minicluster-data/ts-2-root/wals/ae4437d151054b59a0e93ca01a9609c7
I20251023 07:58:51.111778 18954 ts_tablet_manager.cc:1916] T c8b2781a072e401dba80e2879748e681 P b3a1328f9c8c484fab08292ce2171ec9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251023 07:58:51.112587 17986 catalog_manager.cc:4985] TS 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): tablet ae4437d151054b59a0e93ca01a9609c7 (table test-workload [id=8bb191a5531a4d4fb58a25b13d592213]) successfully deleted
I20251023 07:58:51.123862 18954 ts_tablet_manager.cc:1929] T c8b2781a072e401dba80e2879748e681 P b3a1328f9c8c484fab08292ce2171ec9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20251023 07:58:51.124291 18954 log.cc:1199] T c8b2781a072e401dba80e2879748e681 P b3a1328f9c8c484fab08292ce2171ec9: Deleting WAL directory at /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1761206251627710-16888-0/minicluster-data/ts-0-root/wals/c8b2781a072e401dba80e2879748e681
I20251023 07:58:51.125569 17987 catalog_manager.cc:4985] TS b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): tablet c8b2781a072e401dba80e2879748e681 (table test-workload [id=8bb191a5531a4d4fb58a25b13d592213]) successfully deleted
I20251023 07:58:52.142663 18102 consensus_queue.cc:237] T 9bc482083f3b4c9ba97b8769ece194ad P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:58:52.148629 18248 raft_consensus.cc:1275] T 9bc482083f3b4c9ba97b8769ece194ad P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20251023 07:58:52.149274 18067 consensus_peers.cc:597] T 9bc482083f3b4c9ba97b8769ece194ad P b3a1328f9c8c484fab08292ce2171ec9 -> Peer d1a8f61d3323447282ee6068aa623216 (127.16.126.4:33293): Couldn't send request to peer d1a8f61d3323447282ee6068aa623216. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9bc482083f3b4c9ba97b8769ece194ad. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:58:52.150298 18171 raft_consensus.cc:1275] T 9bc482083f3b4c9ba97b8769ece194ad P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251023 07:58:52.150418 18834 consensus_queue.cc:1048] T 9bc482083f3b4c9ba97b8769ece194ad P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:58:52.151963 18879 consensus_queue.cc:1048] T 9bc482083f3b4c9ba97b8769ece194ad P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:58:52.160235 18957 raft_consensus.cc:2955] T 9bc482083f3b4c9ba97b8769ece194ad P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:58:52.161782 18248 raft_consensus.cc:2955] T 9bc482083f3b4c9ba97b8769ece194ad P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:58:52.163779 18171 raft_consensus.cc:2955] T 9bc482083f3b4c9ba97b8769ece194ad P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:58:52.172029 18102 consensus_queue.cc:237] T dad81a56e87946cbb2a7f3e33c2e2bd4 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:58:52.178750 17999 catalog_manager.cc:5649] T 9bc482083f3b4c9ba97b8769ece194ad P b3a1328f9c8c484fab08292ce2171ec9 reported cstate change: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New cstate: current_term: 1 leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251023 07:58:52.185005 18246 raft_consensus.cc:1275] T dad81a56e87946cbb2a7f3e33c2e2bd4 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20251023 07:58:52.185549 18067 consensus_peers.cc:597] T dad81a56e87946cbb2a7f3e33c2e2bd4 P b3a1328f9c8c484fab08292ce2171ec9 -> Peer d1a8f61d3323447282ee6068aa623216 (127.16.126.4:33293): Couldn't send request to peer d1a8f61d3323447282ee6068aa623216. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dad81a56e87946cbb2a7f3e33c2e2bd4. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:58:52.185817 18171 raft_consensus.cc:1275] T dad81a56e87946cbb2a7f3e33c2e2bd4 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251023 07:58:52.186437 18879 consensus_queue.cc:1048] T dad81a56e87946cbb2a7f3e33c2e2bd4 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:58:52.187371 18834 consensus_queue.cc:1048] T dad81a56e87946cbb2a7f3e33c2e2bd4 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:58:52.195770 18957 raft_consensus.cc:2955] T dad81a56e87946cbb2a7f3e33c2e2bd4 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:58:52.199783 18248 raft_consensus.cc:2955] T dad81a56e87946cbb2a7f3e33c2e2bd4 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:58:52.202111 18174 raft_consensus.cc:2955] T dad81a56e87946cbb2a7f3e33c2e2bd4 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:58:52.220465 18171 consensus_queue.cc:237] T 33ee36de303b458e88fa6bad4587c0e6 P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:58:52.236205 18000 catalog_manager.cc:5649] T dad81a56e87946cbb2a7f3e33c2e2bd4 P 10dfae53d0c941f08bded43539841761 reported cstate change: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New cstate: current_term: 1 leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:58:52.265897 18248 raft_consensus.cc:1275] T 33ee36de303b458e88fa6bad4587c0e6 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20251023 07:58:52.266808 18142 consensus_peers.cc:597] T 33ee36de303b458e88fa6bad4587c0e6 P 10dfae53d0c941f08bded43539841761 -> Peer d1a8f61d3323447282ee6068aa623216 (127.16.126.4:33293): Couldn't send request to peer d1a8f61d3323447282ee6068aa623216. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 33ee36de303b458e88fa6bad4587c0e6. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:58:52.277143 18896 consensus_queue.cc:1048] T 33ee36de303b458e88fa6bad4587c0e6 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:58:52.283947 18102 raft_consensus.cc:1275] T 33ee36de303b458e88fa6bad4587c0e6 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251023 07:58:52.285528 18972 consensus_queue.cc:1048] T 33ee36de303b458e88fa6bad4587c0e6 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20251023 07:58:52.288084 18896 raft_consensus.cc:2955] T 33ee36de303b458e88fa6bad4587c0e6 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:58:52.289743 18246 raft_consensus.cc:2955] T 33ee36de303b458e88fa6bad4587c0e6 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:58:52.403705 17999 catalog_manager.cc:5649] T 33ee36de303b458e88fa6bad4587c0e6 P 982df35c5b554a8fa64807352c4f34ee reported cstate change: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New cstate: current_term: 1 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:58:52.411700 18101 raft_consensus.cc:2955] T 33ee36de303b458e88fa6bad4587c0e6 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:58:52.435456 18246 consensus_queue.cc:237] T 79fcf5e4a38448ba95c62cc1ffe2823a P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
W20251023 07:58:52.536017 18216 consensus_peers.cc:597] T 79fcf5e4a38448ba95c62cc1ffe2823a P 982df35c5b554a8fa64807352c4f34ee -> Peer d1a8f61d3323447282ee6068aa623216 (127.16.126.4:33293): Couldn't send request to peer d1a8f61d3323447282ee6068aa623216. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 79fcf5e4a38448ba95c62cc1ffe2823a. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:58:52.540757 18096 raft_consensus.cc:1275] T 79fcf5e4a38448ba95c62cc1ffe2823a P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251023 07:58:52.544124 18171 raft_consensus.cc:1275] T 79fcf5e4a38448ba95c62cc1ffe2823a P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251023 07:58:52.544363 18978 consensus_queue.cc:1048] T 79fcf5e4a38448ba95c62cc1ffe2823a P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20251023 07:58:52.547705 18978 consensus_queue.cc:1048] T 79fcf5e4a38448ba95c62cc1ffe2823a P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20251023 07:58:52.556090 18971 raft_consensus.cc:2955] T 79fcf5e4a38448ba95c62cc1ffe2823a P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:58:52.558019 18096 raft_consensus.cc:2955] T 79fcf5e4a38448ba95c62cc1ffe2823a P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:58:52.564513 18171 raft_consensus.cc:2955] T 79fcf5e4a38448ba95c62cc1ffe2823a P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:58:52.581483 17998 catalog_manager.cc:5649] T 79fcf5e4a38448ba95c62cc1ffe2823a P b3a1328f9c8c484fab08292ce2171ec9 reported cstate change: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New cstate: current_term: 1 leader_uuid: "982df35c5b554a8fa64807352c4f34ee" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:58:52.619148 18982 ts_tablet_manager.cc:933] T dad81a56e87946cbb2a7f3e33c2e2bd4 P d1a8f61d3323447282ee6068aa623216: Initiating tablet copy from peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025)
I20251023 07:58:52.621735 18982 tablet_copy_client.cc:323] T dad81a56e87946cbb2a7f3e33c2e2bd4 P d1a8f61d3323447282ee6068aa623216: tablet copy: Beginning tablet copy session from remote peer at address 127.16.126.1:44025
I20251023 07:58:52.623929 18112 tablet_copy_service.cc:140] P b3a1328f9c8c484fab08292ce2171ec9: Received BeginTabletCopySession request for tablet dad81a56e87946cbb2a7f3e33c2e2bd4 from peer d1a8f61d3323447282ee6068aa623216 ({username='slave'} at 127.0.0.1:57714)
I20251023 07:58:52.624517 18112 tablet_copy_service.cc:161] P b3a1328f9c8c484fab08292ce2171ec9: Beginning new tablet copy session on tablet dad81a56e87946cbb2a7f3e33c2e2bd4 from peer d1a8f61d3323447282ee6068aa623216 at {username='slave'} at 127.0.0.1:57714: session id = d1a8f61d3323447282ee6068aa623216-dad81a56e87946cbb2a7f3e33c2e2bd4
I20251023 07:58:52.631349 18112 tablet_copy_source_session.cc:215] T dad81a56e87946cbb2a7f3e33c2e2bd4 P b3a1328f9c8c484fab08292ce2171ec9: Tablet Copy: opened 0 blocks and 1 log segments
I20251023 07:58:52.634754 18982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dad81a56e87946cbb2a7f3e33c2e2bd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:52.656221 18982 tablet_copy_client.cc:806] T dad81a56e87946cbb2a7f3e33c2e2bd4 P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 0 data blocks...
I20251023 07:58:52.656914 18982 tablet_copy_client.cc:670] T dad81a56e87946cbb2a7f3e33c2e2bd4 P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 1 WAL segments...
I20251023 07:58:52.660677 18982 tablet_copy_client.cc:538] T dad81a56e87946cbb2a7f3e33c2e2bd4 P d1a8f61d3323447282ee6068aa623216: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251023 07:58:52.679952 18982 tablet_bootstrap.cc:492] T dad81a56e87946cbb2a7f3e33c2e2bd4 P d1a8f61d3323447282ee6068aa623216: Bootstrap starting.
I20251023 07:58:52.697196 18984 ts_tablet_manager.cc:933] T 9bc482083f3b4c9ba97b8769ece194ad P d1a8f61d3323447282ee6068aa623216: Initiating tablet copy from peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025)
I20251023 07:58:52.701531 18984 tablet_copy_client.cc:323] T 9bc482083f3b4c9ba97b8769ece194ad P d1a8f61d3323447282ee6068aa623216: tablet copy: Beginning tablet copy session from remote peer at address 127.16.126.1:44025
I20251023 07:58:52.702476 18982 tablet_bootstrap.cc:492] T dad81a56e87946cbb2a7f3e33c2e2bd4 P d1a8f61d3323447282ee6068aa623216: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:58:52.703052 18112 tablet_copy_service.cc:140] P b3a1328f9c8c484fab08292ce2171ec9: Received BeginTabletCopySession request for tablet 9bc482083f3b4c9ba97b8769ece194ad from peer d1a8f61d3323447282ee6068aa623216 ({username='slave'} at 127.0.0.1:57714)
I20251023 07:58:52.703511 18982 tablet_bootstrap.cc:492] T dad81a56e87946cbb2a7f3e33c2e2bd4 P d1a8f61d3323447282ee6068aa623216: Bootstrap complete.
I20251023 07:58:52.703716 18112 tablet_copy_service.cc:161] P b3a1328f9c8c484fab08292ce2171ec9: Beginning new tablet copy session on tablet 9bc482083f3b4c9ba97b8769ece194ad from peer d1a8f61d3323447282ee6068aa623216 at {username='slave'} at 127.0.0.1:57714: session id = d1a8f61d3323447282ee6068aa623216-9bc482083f3b4c9ba97b8769ece194ad
I20251023 07:58:52.704241 18982 ts_tablet_manager.cc:1403] T dad81a56e87946cbb2a7f3e33c2e2bd4 P d1a8f61d3323447282ee6068aa623216: Time spent bootstrapping tablet: real 0.025s user 0.019s sys 0.001s
I20251023 07:58:52.707530 18982 raft_consensus.cc:359] T dad81a56e87946cbb2a7f3e33c2e2bd4 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:58:52.708340 18982 raft_consensus.cc:740] T dad81a56e87946cbb2a7f3e33c2e2bd4 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d1a8f61d3323447282ee6068aa623216, State: Initialized, Role: LEARNER
I20251023 07:58:52.708982 18982 consensus_queue.cc:260] T dad81a56e87946cbb2a7f3e33c2e2bd4 P d1a8f61d3323447282ee6068aa623216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:58:52.717022 18112 tablet_copy_source_session.cc:215] T 9bc482083f3b4c9ba97b8769ece194ad P b3a1328f9c8c484fab08292ce2171ec9: Tablet Copy: opened 0 blocks and 1 log segments
I20251023 07:58:52.719650 18982 ts_tablet_manager.cc:1434] T dad81a56e87946cbb2a7f3e33c2e2bd4 P d1a8f61d3323447282ee6068aa623216: Time spent starting tablet: real 0.015s user 0.011s sys 0.004s
I20251023 07:58:52.721378 18112 tablet_copy_service.cc:342] P b3a1328f9c8c484fab08292ce2171ec9: Request end of tablet copy session d1a8f61d3323447282ee6068aa623216-dad81a56e87946cbb2a7f3e33c2e2bd4 received from {username='slave'} at 127.0.0.1:57714
I20251023 07:58:52.721928 18112 tablet_copy_service.cc:434] P b3a1328f9c8c484fab08292ce2171ec9: ending tablet copy session d1a8f61d3323447282ee6068aa623216-dad81a56e87946cbb2a7f3e33c2e2bd4 on tablet dad81a56e87946cbb2a7f3e33c2e2bd4 with peer d1a8f61d3323447282ee6068aa623216
I20251023 07:58:52.725878 18984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bc482083f3b4c9ba97b8769ece194ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:52.739183 18984 tablet_copy_client.cc:806] T 9bc482083f3b4c9ba97b8769ece194ad P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 0 data blocks...
I20251023 07:58:52.739835 18984 tablet_copy_client.cc:670] T 9bc482083f3b4c9ba97b8769ece194ad P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 1 WAL segments...
I20251023 07:58:52.745623 18984 tablet_copy_client.cc:538] T 9bc482083f3b4c9ba97b8769ece194ad P d1a8f61d3323447282ee6068aa623216: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251023 07:58:52.756553 18984 tablet_bootstrap.cc:492] T 9bc482083f3b4c9ba97b8769ece194ad P d1a8f61d3323447282ee6068aa623216: Bootstrap starting.
I20251023 07:58:52.776217 18984 tablet_bootstrap.cc:492] T 9bc482083f3b4c9ba97b8769ece194ad P d1a8f61d3323447282ee6068aa623216: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:58:52.777207 18984 tablet_bootstrap.cc:492] T 9bc482083f3b4c9ba97b8769ece194ad P d1a8f61d3323447282ee6068aa623216: Bootstrap complete.
I20251023 07:58:52.778074 18984 ts_tablet_manager.cc:1403] T 9bc482083f3b4c9ba97b8769ece194ad P d1a8f61d3323447282ee6068aa623216: Time spent bootstrapping tablet: real 0.022s user 0.017s sys 0.004s
I20251023 07:58:52.780818 18984 raft_consensus.cc:359] T 9bc482083f3b4c9ba97b8769ece194ad P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:58:52.781776 18984 raft_consensus.cc:740] T 9bc482083f3b4c9ba97b8769ece194ad P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d1a8f61d3323447282ee6068aa623216, State: Initialized, Role: LEARNER
I20251023 07:58:52.782517 18984 consensus_queue.cc:260] T 9bc482083f3b4c9ba97b8769ece194ad P d1a8f61d3323447282ee6068aa623216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:58:52.784873 18984 ts_tablet_manager.cc:1434] T 9bc482083f3b4c9ba97b8769ece194ad P d1a8f61d3323447282ee6068aa623216: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20251023 07:58:52.786999 18112 tablet_copy_service.cc:342] P b3a1328f9c8c484fab08292ce2171ec9: Request end of tablet copy session d1a8f61d3323447282ee6068aa623216-9bc482083f3b4c9ba97b8769ece194ad received from {username='slave'} at 127.0.0.1:57714
I20251023 07:58:52.787436 18112 tablet_copy_service.cc:434] P b3a1328f9c8c484fab08292ce2171ec9: ending tablet copy session d1a8f61d3323447282ee6068aa623216-9bc482083f3b4c9ba97b8769ece194ad on tablet 9bc482083f3b4c9ba97b8769ece194ad with peer d1a8f61d3323447282ee6068aa623216
I20251023 07:58:52.857620 18984 ts_tablet_manager.cc:933] T 33ee36de303b458e88fa6bad4587c0e6 P d1a8f61d3323447282ee6068aa623216: Initiating tablet copy from peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:58:52.859261 18984 tablet_copy_client.cc:323] T 33ee36de303b458e88fa6bad4587c0e6 P d1a8f61d3323447282ee6068aa623216: tablet copy: Beginning tablet copy session from remote peer at address 127.16.126.2:45799
I20251023 07:58:52.860853 18187 tablet_copy_service.cc:140] P 10dfae53d0c941f08bded43539841761: Received BeginTabletCopySession request for tablet 33ee36de303b458e88fa6bad4587c0e6 from peer d1a8f61d3323447282ee6068aa623216 ({username='slave'} at 127.0.0.1:50534)
I20251023 07:58:52.861384 18187 tablet_copy_service.cc:161] P 10dfae53d0c941f08bded43539841761: Beginning new tablet copy session on tablet 33ee36de303b458e88fa6bad4587c0e6 from peer d1a8f61d3323447282ee6068aa623216 at {username='slave'} at 127.0.0.1:50534: session id = d1a8f61d3323447282ee6068aa623216-33ee36de303b458e88fa6bad4587c0e6
I20251023 07:58:52.868350 18187 tablet_copy_source_session.cc:215] T 33ee36de303b458e88fa6bad4587c0e6 P 10dfae53d0c941f08bded43539841761: Tablet Copy: opened 0 blocks and 1 log segments
I20251023 07:58:52.871210 18984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33ee36de303b458e88fa6bad4587c0e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:52.886597 18984 tablet_copy_client.cc:806] T 33ee36de303b458e88fa6bad4587c0e6 P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 0 data blocks...
I20251023 07:58:52.887224 18984 tablet_copy_client.cc:670] T 33ee36de303b458e88fa6bad4587c0e6 P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 1 WAL segments...
I20251023 07:58:52.890571 18984 tablet_copy_client.cc:538] T 33ee36de303b458e88fa6bad4587c0e6 P d1a8f61d3323447282ee6068aa623216: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251023 07:58:52.897958 18984 tablet_bootstrap.cc:492] T 33ee36de303b458e88fa6bad4587c0e6 P d1a8f61d3323447282ee6068aa623216: Bootstrap starting.
I20251023 07:58:52.923687 18984 tablet_bootstrap.cc:492] T 33ee36de303b458e88fa6bad4587c0e6 P d1a8f61d3323447282ee6068aa623216: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:58:52.924512 18984 tablet_bootstrap.cc:492] T 33ee36de303b458e88fa6bad4587c0e6 P d1a8f61d3323447282ee6068aa623216: Bootstrap complete.
I20251023 07:58:52.925150 18984 ts_tablet_manager.cc:1403] T 33ee36de303b458e88fa6bad4587c0e6 P d1a8f61d3323447282ee6068aa623216: Time spent bootstrapping tablet: real 0.027s user 0.022s sys 0.000s
I20251023 07:58:52.927564 18984 raft_consensus.cc:359] T 33ee36de303b458e88fa6bad4587c0e6 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:58:52.928402 18984 raft_consensus.cc:740] T 33ee36de303b458e88fa6bad4587c0e6 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d1a8f61d3323447282ee6068aa623216, State: Initialized, Role: LEARNER
I20251023 07:58:52.928999 18984 consensus_queue.cc:260] T 33ee36de303b458e88fa6bad4587c0e6 P d1a8f61d3323447282ee6068aa623216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:58:52.931308 18984 ts_tablet_manager.cc:1434] T 33ee36de303b458e88fa6bad4587c0e6 P d1a8f61d3323447282ee6068aa623216: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20251023 07:58:52.933307 18187 tablet_copy_service.cc:342] P 10dfae53d0c941f08bded43539841761: Request end of tablet copy session d1a8f61d3323447282ee6068aa623216-33ee36de303b458e88fa6bad4587c0e6 received from {username='slave'} at 127.0.0.1:50534
I20251023 07:58:52.933795 18187 tablet_copy_service.cc:434] P 10dfae53d0c941f08bded43539841761: ending tablet copy session d1a8f61d3323447282ee6068aa623216-33ee36de303b458e88fa6bad4587c0e6 on tablet 33ee36de303b458e88fa6bad4587c0e6 with peer d1a8f61d3323447282ee6068aa623216
I20251023 07:58:53.048103 18984 ts_tablet_manager.cc:933] T 79fcf5e4a38448ba95c62cc1ffe2823a P d1a8f61d3323447282ee6068aa623216: Initiating tablet copy from peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:53.052141 18984 tablet_copy_client.cc:323] T 79fcf5e4a38448ba95c62cc1ffe2823a P d1a8f61d3323447282ee6068aa623216: tablet copy: Beginning tablet copy session from remote peer at address 127.16.126.3:46061
I20251023 07:58:53.053792 18261 tablet_copy_service.cc:140] P 982df35c5b554a8fa64807352c4f34ee: Received BeginTabletCopySession request for tablet 79fcf5e4a38448ba95c62cc1ffe2823a from peer d1a8f61d3323447282ee6068aa623216 ({username='slave'} at 127.0.0.1:40260)
I20251023 07:58:53.054307 18261 tablet_copy_service.cc:161] P 982df35c5b554a8fa64807352c4f34ee: Beginning new tablet copy session on tablet 79fcf5e4a38448ba95c62cc1ffe2823a from peer d1a8f61d3323447282ee6068aa623216 at {username='slave'} at 127.0.0.1:40260: session id = d1a8f61d3323447282ee6068aa623216-79fcf5e4a38448ba95c62cc1ffe2823a
I20251023 07:58:53.064082 18261 tablet_copy_source_session.cc:215] T 79fcf5e4a38448ba95c62cc1ffe2823a P 982df35c5b554a8fa64807352c4f34ee: Tablet Copy: opened 0 blocks and 1 log segments
I20251023 07:58:53.067443 18984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79fcf5e4a38448ba95c62cc1ffe2823a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:53.094864 18787 raft_consensus.cc:1217] T dad81a56e87946cbb2a7f3e33c2e2bd4 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20251023 07:58:53.127651 18984 tablet_copy_client.cc:806] T 79fcf5e4a38448ba95c62cc1ffe2823a P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 0 data blocks...
I20251023 07:58:53.128180 18984 tablet_copy_client.cc:670] T 79fcf5e4a38448ba95c62cc1ffe2823a P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 1 WAL segments...
I20251023 07:58:53.131855 18984 tablet_copy_client.cc:538] T 79fcf5e4a38448ba95c62cc1ffe2823a P d1a8f61d3323447282ee6068aa623216: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251023 07:58:53.138679 18984 tablet_bootstrap.cc:492] T 79fcf5e4a38448ba95c62cc1ffe2823a P d1a8f61d3323447282ee6068aa623216: Bootstrap starting.
I20251023 07:58:53.155911 18787 raft_consensus.cc:1217] T 9bc482083f3b4c9ba97b8769ece194ad P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20251023 07:58:53.158535 18984 tablet_bootstrap.cc:492] T 79fcf5e4a38448ba95c62cc1ffe2823a P d1a8f61d3323447282ee6068aa623216: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:58:53.159441 18984 tablet_bootstrap.cc:492] T 79fcf5e4a38448ba95c62cc1ffe2823a P d1a8f61d3323447282ee6068aa623216: Bootstrap complete.
I20251023 07:58:53.160094 18984 ts_tablet_manager.cc:1403] T 79fcf5e4a38448ba95c62cc1ffe2823a P d1a8f61d3323447282ee6068aa623216: Time spent bootstrapping tablet: real 0.022s user 0.013s sys 0.006s
I20251023 07:58:53.163983 18984 raft_consensus.cc:359] T 79fcf5e4a38448ba95c62cc1ffe2823a P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:58:53.164774 18984 raft_consensus.cc:740] T 79fcf5e4a38448ba95c62cc1ffe2823a P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d1a8f61d3323447282ee6068aa623216, State: Initialized, Role: LEARNER
I20251023 07:58:53.165330 18984 consensus_queue.cc:260] T 79fcf5e4a38448ba95c62cc1ffe2823a P d1a8f61d3323447282ee6068aa623216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:58:53.167585 18984 ts_tablet_manager.cc:1434] T 79fcf5e4a38448ba95c62cc1ffe2823a P d1a8f61d3323447282ee6068aa623216: Time spent starting tablet: real 0.007s user 0.004s sys 0.000s
I20251023 07:58:53.169700 18261 tablet_copy_service.cc:342] P 982df35c5b554a8fa64807352c4f34ee: Request end of tablet copy session d1a8f61d3323447282ee6068aa623216-79fcf5e4a38448ba95c62cc1ffe2823a received from {username='slave'} at 127.0.0.1:40260
I20251023 07:58:53.170051 18261 tablet_copy_service.cc:434] P 982df35c5b554a8fa64807352c4f34ee: ending tablet copy session d1a8f61d3323447282ee6068aa623216-79fcf5e4a38448ba95c62cc1ffe2823a on tablet 79fcf5e4a38448ba95c62cc1ffe2823a with peer d1a8f61d3323447282ee6068aa623216
I20251023 07:58:53.297777 18788 raft_consensus.cc:1217] T 33ee36de303b458e88fa6bad4587c0e6 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20251023 07:58:53.457124 18788 raft_consensus.cc:1217] T 79fcf5e4a38448ba95c62cc1ffe2823a P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20251023 07:58:53.585355 18992 raft_consensus.cc:1064] T dad81a56e87946cbb2a7f3e33c2e2bd4 P b3a1328f9c8c484fab08292ce2171ec9: attempting to promote NON_VOTER d1a8f61d3323447282ee6068aa623216 to VOTER
I20251023 07:58:53.587954 18992 consensus_queue.cc:237] T dad81a56e87946cbb2a7f3e33c2e2bd4 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:58:53.599334 18788 raft_consensus.cc:1275] T dad81a56e87946cbb2a7f3e33c2e2bd4 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:58:53.600505 18246 raft_consensus.cc:1275] T dad81a56e87946cbb2a7f3e33c2e2bd4 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:58:53.602486 18834 consensus_queue.cc:1048] T dad81a56e87946cbb2a7f3e33c2e2bd4 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:58:53.603402 18966 consensus_queue.cc:1048] T dad81a56e87946cbb2a7f3e33c2e2bd4 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:58:53.604683 18174 raft_consensus.cc:1275] T dad81a56e87946cbb2a7f3e33c2e2bd4 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:58:53.606866 18834 consensus_queue.cc:1048] T dad81a56e87946cbb2a7f3e33c2e2bd4 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:58:53.622395 18966 raft_consensus.cc:2955] T dad81a56e87946cbb2a7f3e33c2e2bd4 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:53.625193 18788 raft_consensus.cc:2955] T dad81a56e87946cbb2a7f3e33c2e2bd4 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:53.650815 18000 catalog_manager.cc:5649] T dad81a56e87946cbb2a7f3e33c2e2bd4 P b3a1328f9c8c484fab08292ce2171ec9 reported cstate change: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251023 07:58:53.652911 18174 raft_consensus.cc:2955] T dad81a56e87946cbb2a7f3e33c2e2bd4 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:53.654726 18992 raft_consensus.cc:1064] T 9bc482083f3b4c9ba97b8769ece194ad P b3a1328f9c8c484fab08292ce2171ec9: attempting to promote NON_VOTER d1a8f61d3323447282ee6068aa623216 to VOTER
I20251023 07:58:53.657514 18992 consensus_queue.cc:237] T 9bc482083f3b4c9ba97b8769ece194ad P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:58:53.667310 18246 raft_consensus.cc:2955] T dad81a56e87946cbb2a7f3e33c2e2bd4 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:53.680722 18788 raft_consensus.cc:1275] T 9bc482083f3b4c9ba97b8769ece194ad P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:58:53.682310 18992 consensus_queue.cc:1048] T 9bc482083f3b4c9ba97b8769ece194ad P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:58:53.682974 18174 raft_consensus.cc:1275] T 9bc482083f3b4c9ba97b8769ece194ad P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:58:53.684890 18992 consensus_queue.cc:1048] T 9bc482083f3b4c9ba97b8769ece194ad P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:58:53.685652 18244 raft_consensus.cc:1275] T 9bc482083f3b4c9ba97b8769ece194ad P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:58:53.690358 18992 consensus_queue.cc:1048] T 9bc482083f3b4c9ba97b8769ece194ad P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:58:53.708920 18890 raft_consensus.cc:1064] T 33ee36de303b458e88fa6bad4587c0e6 P 10dfae53d0c941f08bded43539841761: attempting to promote NON_VOTER d1a8f61d3323447282ee6068aa623216 to VOTER
I20251023 07:58:53.716964 18966 raft_consensus.cc:2955] T 9bc482083f3b4c9ba97b8769ece194ad P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:53.720279 18174 raft_consensus.cc:2955] T 9bc482083f3b4c9ba97b8769ece194ad P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:53.728178 18244 raft_consensus.cc:2955] T 9bc482083f3b4c9ba97b8769ece194ad P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:53.729481 18890 consensus_queue.cc:237] T 33ee36de303b458e88fa6bad4587c0e6 P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:58:53.731827 18788 raft_consensus.cc:2955] T 9bc482083f3b4c9ba97b8769ece194ad P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:53.746407 18787 raft_consensus.cc:1275] T 33ee36de303b458e88fa6bad4587c0e6 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:58:53.747650 18099 raft_consensus.cc:1275] T 33ee36de303b458e88fa6bad4587c0e6 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:58:53.747705 18244 raft_consensus.cc:1275] T 33ee36de303b458e88fa6bad4587c0e6 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:58:53.751593 18974 consensus_queue.cc:1048] T 33ee36de303b458e88fa6bad4587c0e6 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20251023 07:58:53.752475 18890 consensus_queue.cc:1048] T 33ee36de303b458e88fa6bad4587c0e6 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:58:53.771626 17998 catalog_manager.cc:5649] T 9bc482083f3b4c9ba97b8769ece194ad P d1a8f61d3323447282ee6068aa623216 reported cstate change: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:53.783635 18975 consensus_queue.cc:1048] T 33ee36de303b458e88fa6bad4587c0e6 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20251023 07:58:53.811470 18101 consensus_queue.cc:237] T dad81a56e87946cbb2a7f3e33c2e2bd4 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:58:53.812443 18102 consensus_queue.cc:237] T 9bc482083f3b4c9ba97b8769ece194ad P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:58:53.819926 18787 raft_consensus.cc:1275] T dad81a56e87946cbb2a7f3e33c2e2bd4 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251023 07:58:53.823448 18171 raft_consensus.cc:1275] T dad81a56e87946cbb2a7f3e33c2e2bd4 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251023 07:58:53.825001 18998 consensus_queue.cc:1048] T dad81a56e87946cbb2a7f3e33c2e2bd4 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20251023 07:58:53.827694 18834 consensus_queue.cc:1048] T dad81a56e87946cbb2a7f3e33c2e2bd4 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:58:53.833485 18789 raft_consensus.cc:1275] T 9bc482083f3b4c9ba97b8769ece194ad P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251023 07:58:53.835515 18998 consensus_queue.cc:1048] T 9bc482083f3b4c9ba97b8769ece194ad P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20251023 07:58:53.837865 18244 raft_consensus.cc:1275] T 9bc482083f3b4c9ba97b8769ece194ad P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251023 07:58:53.841699 18992 consensus_queue.cc:1048] T 9bc482083f3b4c9ba97b8769ece194ad P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:58:53.842056 18787 raft_consensus.cc:2955] T dad81a56e87946cbb2a7f3e33c2e2bd4 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 982df35c5b554a8fa64807352c4f34ee (127.16.126.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:53.840936 18966 raft_consensus.cc:2955] T dad81a56e87946cbb2a7f3e33c2e2bd4 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 982df35c5b554a8fa64807352c4f34ee (127.16.126.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:53.843781 18171 raft_consensus.cc:2955] T dad81a56e87946cbb2a7f3e33c2e2bd4 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 982df35c5b554a8fa64807352c4f34ee (127.16.126.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:53.844574 19011 raft_consensus.cc:2955] T 33ee36de303b458e88fa6bad4587c0e6 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:53.861014 18101 raft_consensus.cc:2955] T 33ee36de303b458e88fa6bad4587c0e6 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:53.863416 17987 catalog_manager.cc:5162] ChangeConfig:REMOVE_PEER RPC for tablet dad81a56e87946cbb2a7f3e33c2e2bd4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251023 07:58:53.868497 18992 raft_consensus.cc:2955] T 9bc482083f3b4c9ba97b8769ece194ad P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 10dfae53d0c941f08bded43539841761 (127.16.126.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:53.871995 18789 raft_consensus.cc:2955] T 9bc482083f3b4c9ba97b8769ece194ad P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 10dfae53d0c941f08bded43539841761 (127.16.126.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:53.861508 18788 raft_consensus.cc:2955] T 33ee36de303b458e88fa6bad4587c0e6 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:53.876631 17999 catalog_manager.cc:5649] T dad81a56e87946cbb2a7f3e33c2e2bd4 P b3a1328f9c8c484fab08292ce2171ec9 reported cstate change: config changed from index 3 to 4, VOTER 982df35c5b554a8fa64807352c4f34ee (127.16.126.3) evicted. New cstate: current_term: 1 leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251023 07:58:53.877259 18248 raft_consensus.cc:2955] T 33ee36de303b458e88fa6bad4587c0e6 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:53.870769 18000 catalog_manager.cc:5649] T 33ee36de303b458e88fa6bad4587c0e6 P 10dfae53d0c941f08bded43539841761 reported cstate change: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251023 07:58:53.883530 17987 catalog_manager.cc:5162] ChangeConfig:REMOVE_PEER RPC for tablet 9bc482083f3b4c9ba97b8769ece194ad with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251023 07:58:53.889683 18248 raft_consensus.cc:2955] T 9bc482083f3b4c9ba97b8769ece194ad P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 10dfae53d0c941f08bded43539841761 (127.16.126.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:53.896277 18171 consensus_queue.cc:237] T 33ee36de303b458e88fa6bad4587c0e6 P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:58:53.903702 18246 raft_consensus.cc:1275] T 33ee36de303b458e88fa6bad4587c0e6 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251023 07:58:53.909806 19011 consensus_queue.cc:1048] T 33ee36de303b458e88fa6bad4587c0e6 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:58:53.928399 18237 tablet_service.cc:1552] Processing DeleteTablet for tablet dad81a56e87946cbb2a7f3e33c2e2bd4 with delete_type TABLET_DATA_TOMBSTONED (TS 982df35c5b554a8fa64807352c4f34ee not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49846
I20251023 07:58:53.939009 19016 tablet_replica.cc:333] T dad81a56e87946cbb2a7f3e33c2e2bd4 P 982df35c5b554a8fa64807352c4f34ee: stopping tablet replica
I20251023 07:58:53.940306 19016 raft_consensus.cc:2243] T dad81a56e87946cbb2a7f3e33c2e2bd4 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:58:53.943080 17999 catalog_manager.cc:5649] T 9bc482083f3b4c9ba97b8769ece194ad P d1a8f61d3323447282ee6068aa623216 reported cstate change: config changed from index 3 to 4, VOTER 10dfae53d0c941f08bded43539841761 (127.16.126.2) evicted. New cstate: current_term: 1 leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:53.950832 18978 raft_consensus.cc:1064] T 79fcf5e4a38448ba95c62cc1ffe2823a P 982df35c5b554a8fa64807352c4f34ee: attempting to promote NON_VOTER d1a8f61d3323447282ee6068aa623216 to VOTER
I20251023 07:58:53.950484 19010 raft_consensus.cc:2955] T 33ee36de303b458e88fa6bad4587c0e6 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:53.958250 18787 raft_consensus.cc:1275] T 33ee36de303b458e88fa6bad4587c0e6 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251023 07:58:53.962383 18248 raft_consensus.cc:2955] T 33ee36de303b458e88fa6bad4587c0e6 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:53.965036 19016 raft_consensus.cc:2272] T dad81a56e87946cbb2a7f3e33c2e2bd4 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:53.962427 18978 consensus_queue.cc:237] T 79fcf5e4a38448ba95c62cc1ffe2823a P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:58:53.966632 18975 consensus_queue.cc:1048] T 33ee36de303b458e88fa6bad4587c0e6 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:58:53.974298 18163 tablet_service.cc:1552] Processing DeleteTablet for tablet 9bc482083f3b4c9ba97b8769ece194ad with delete_type TABLET_DATA_TOMBSTONED (TS 10dfae53d0c941f08bded43539841761 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33428
I20251023 07:58:53.973811 18787 raft_consensus.cc:2955] T 33ee36de303b458e88fa6bad4587c0e6 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:53.985553 17985 catalog_manager.cc:5162] ChangeConfig:REMOVE_PEER RPC for tablet 33ee36de303b458e88fa6bad4587c0e6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251023 07:58:53.997712 17998 catalog_manager.cc:5649] T 33ee36de303b458e88fa6bad4587c0e6 P d1a8f61d3323447282ee6068aa623216 reported cstate change: config changed from index 3 to 4, VOTER b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1) evicted. New cstate: current_term: 1 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:54.004099 19016 ts_tablet_manager.cc:1916] T dad81a56e87946cbb2a7f3e33c2e2bd4 P 982df35c5b554a8fa64807352c4f34ee: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251023 07:58:54.012573 19018 tablet_replica.cc:333] T 9bc482083f3b4c9ba97b8769ece194ad P 10dfae53d0c941f08bded43539841761: stopping tablet replica
I20251023 07:58:54.013737 19018 raft_consensus.cc:2243] T 9bc482083f3b4c9ba97b8769ece194ad P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:58:54.014334 19018 raft_consensus.cc:2272] T 9bc482083f3b4c9ba97b8769ece194ad P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:54.020341 19018 ts_tablet_manager.cc:1916] T 9bc482083f3b4c9ba97b8769ece194ad P 10dfae53d0c941f08bded43539841761: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251023 07:58:54.022401 18787 raft_consensus.cc:1275] T 79fcf5e4a38448ba95c62cc1ffe2823a P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:58:54.024201 18971 consensus_queue.cc:1048] T 79fcf5e4a38448ba95c62cc1ffe2823a P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:58:54.031495 18086 tablet_service.cc:1552] Processing DeleteTablet for tablet 33ee36de303b458e88fa6bad4587c0e6 with delete_type TABLET_DATA_TOMBSTONED (TS b3a1328f9c8c484fab08292ce2171ec9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53940
I20251023 07:58:54.036267 19016 ts_tablet_manager.cc:1929] T dad81a56e87946cbb2a7f3e33c2e2bd4 P 982df35c5b554a8fa64807352c4f34ee: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20251023 07:58:54.036834 19016 log.cc:1199] T dad81a56e87946cbb2a7f3e33c2e2bd4 P 982df35c5b554a8fa64807352c4f34ee: Deleting WAL directory at /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1761206251627710-16888-0/minicluster-data/ts-2-root/wals/dad81a56e87946cbb2a7f3e33c2e2bd4
I20251023 07:58:54.038955 17986 catalog_manager.cc:4985] TS 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): tablet dad81a56e87946cbb2a7f3e33c2e2bd4 (table test-workload [id=8bb191a5531a4d4fb58a25b13d592213]) successfully deleted
I20251023 07:58:54.053344 18174 raft_consensus.cc:1275] T 79fcf5e4a38448ba95c62cc1ffe2823a P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:58:54.054848 18971 consensus_queue.cc:1048] T 79fcf5e4a38448ba95c62cc1ffe2823a P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:58:54.055653 18099 raft_consensus.cc:1275] T 79fcf5e4a38448ba95c62cc1ffe2823a P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:58:54.056854 19017 consensus_queue.cc:1048] T 79fcf5e4a38448ba95c62cc1ffe2823a P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:58:54.058709 19020 tablet_replica.cc:333] T 33ee36de303b458e88fa6bad4587c0e6 P b3a1328f9c8c484fab08292ce2171ec9: stopping tablet replica
I20251023 07:58:54.059823 19020 raft_consensus.cc:2243] T 33ee36de303b458e88fa6bad4587c0e6 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:58:54.060465 19020 raft_consensus.cc:2272] T 33ee36de303b458e88fa6bad4587c0e6 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:54.060896 19018 ts_tablet_manager.cc:1929] T 9bc482083f3b4c9ba97b8769ece194ad P 10dfae53d0c941f08bded43539841761: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20251023 07:58:54.061497 19018 log.cc:1199] T 9bc482083f3b4c9ba97b8769ece194ad P 10dfae53d0c941f08bded43539841761: Deleting WAL directory at /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1761206251627710-16888-0/minicluster-data/ts-1-root/wals/9bc482083f3b4c9ba97b8769ece194ad
I20251023 07:58:54.063112 17985 catalog_manager.cc:4985] TS 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): tablet 9bc482083f3b4c9ba97b8769ece194ad (table test-workload [id=8bb191a5531a4d4fb58a25b13d592213]) successfully deleted
I20251023 07:58:54.065652 19020 ts_tablet_manager.cc:1916] T 33ee36de303b458e88fa6bad4587c0e6 P b3a1328f9c8c484fab08292ce2171ec9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251023 07:58:54.065900 18978 raft_consensus.cc:2955] T 79fcf5e4a38448ba95c62cc1ffe2823a P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:54.067576 18174 raft_consensus.cc:2955] T 79fcf5e4a38448ba95c62cc1ffe2823a P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:54.076121 18787 raft_consensus.cc:2955] T 79fcf5e4a38448ba95c62cc1ffe2823a P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:54.094533 19020 ts_tablet_manager.cc:1929] T 33ee36de303b458e88fa6bad4587c0e6 P b3a1328f9c8c484fab08292ce2171ec9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20251023 07:58:54.094903 19020 log.cc:1199] T 33ee36de303b458e88fa6bad4587c0e6 P b3a1328f9c8c484fab08292ce2171ec9: Deleting WAL directory at /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1761206251627710-16888-0/minicluster-data/ts-0-root/wals/33ee36de303b458e88fa6bad4587c0e6
I20251023 07:58:54.096383 17987 catalog_manager.cc:4985] TS b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): tablet 33ee36de303b458e88fa6bad4587c0e6 (table test-workload [id=8bb191a5531a4d4fb58a25b13d592213]) successfully deleted
I20251023 07:58:54.086714 18099 raft_consensus.cc:2955] T 79fcf5e4a38448ba95c62cc1ffe2823a P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:54.108253 18000 catalog_manager.cc:5649] T 79fcf5e4a38448ba95c62cc1ffe2823a P d1a8f61d3323447282ee6068aa623216 reported cstate change: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "982df35c5b554a8fa64807352c4f34ee" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:54.142441 18248 consensus_queue.cc:237] T 79fcf5e4a38448ba95c62cc1ffe2823a P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:58:54.149005 18787 raft_consensus.cc:1275] T 79fcf5e4a38448ba95c62cc1ffe2823a P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251023 07:58:54.149256 18101 raft_consensus.cc:1275] T 79fcf5e4a38448ba95c62cc1ffe2823a P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251023 07:58:54.150859 18970 consensus_queue.cc:1048] T 79fcf5e4a38448ba95c62cc1ffe2823a P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20251023 07:58:54.152870 19017 consensus_queue.cc:1048] T 79fcf5e4a38448ba95c62cc1ffe2823a P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:58:54.158560 18970 raft_consensus.cc:2955] T 79fcf5e4a38448ba95c62cc1ffe2823a P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 10dfae53d0c941f08bded43539841761 (127.16.126.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:54.160387 18787 raft_consensus.cc:2955] T 79fcf5e4a38448ba95c62cc1ffe2823a P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 10dfae53d0c941f08bded43539841761 (127.16.126.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:54.171748 18099 raft_consensus.cc:2955] T 79fcf5e4a38448ba95c62cc1ffe2823a P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 10dfae53d0c941f08bded43539841761 (127.16.126.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:54.174984 17986 catalog_manager.cc:5162] ChangeConfig:REMOVE_PEER RPC for tablet 79fcf5e4a38448ba95c62cc1ffe2823a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251023 07:58:54.182051 17998 catalog_manager.cc:5649] T 79fcf5e4a38448ba95c62cc1ffe2823a P 982df35c5b554a8fa64807352c4f34ee reported cstate change: config changed from index 3 to 4, VOTER 10dfae53d0c941f08bded43539841761 (127.16.126.2) evicted. New cstate: current_term: 1 leader_uuid: "982df35c5b554a8fa64807352c4f34ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251023 07:58:54.198498 18163 tablet_service.cc:1552] Processing DeleteTablet for tablet 79fcf5e4a38448ba95c62cc1ffe2823a with delete_type TABLET_DATA_TOMBSTONED (TS 10dfae53d0c941f08bded43539841761 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33428
I20251023 07:58:54.199546 19018 tablet_replica.cc:333] T 79fcf5e4a38448ba95c62cc1ffe2823a P 10dfae53d0c941f08bded43539841761: stopping tablet replica
I20251023 07:58:54.214782 19018 raft_consensus.cc:2243] T 79fcf5e4a38448ba95c62cc1ffe2823a P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:58:54.215446 19018 raft_consensus.cc:2272] T 79fcf5e4a38448ba95c62cc1ffe2823a P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:54.218257 19018 ts_tablet_manager.cc:1916] T 79fcf5e4a38448ba95c62cc1ffe2823a P 10dfae53d0c941f08bded43539841761: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251023 07:58:54.231607 19018 ts_tablet_manager.cc:1929] T 79fcf5e4a38448ba95c62cc1ffe2823a P 10dfae53d0c941f08bded43539841761: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20251023 07:58:54.232020 19018 log.cc:1199] T 79fcf5e4a38448ba95c62cc1ffe2823a P 10dfae53d0c941f08bded43539841761: Deleting WAL directory at /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1761206251627710-16888-0/minicluster-data/ts-1-root/wals/79fcf5e4a38448ba95c62cc1ffe2823a
I20251023 07:58:54.233228 17985 catalog_manager.cc:4985] TS 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): tablet 79fcf5e4a38448ba95c62cc1ffe2823a (table test-workload [id=8bb191a5531a4d4fb58a25b13d592213]) successfully deleted
I20251023 07:58:55.277542 18171 consensus_queue.cc:237] T 063924334ed846f3bd41c36cc4651236 P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:58:55.284492 18244 raft_consensus.cc:1275] T 063924334ed846f3bd41c36cc4651236 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251023 07:58:55.284824 18099 raft_consensus.cc:1275] T 063924334ed846f3bd41c36cc4651236 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251023 07:58:55.285996 19028 consensus_queue.cc:1048] T 063924334ed846f3bd41c36cc4651236 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20251023 07:58:55.289121 18142 consensus_peers.cc:597] T 063924334ed846f3bd41c36cc4651236 P 10dfae53d0c941f08bded43539841761 -> Peer d1a8f61d3323447282ee6068aa623216 (127.16.126.4:33293): Couldn't send request to peer d1a8f61d3323447282ee6068aa623216. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 063924334ed846f3bd41c36cc4651236. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:58:55.289562 19011 consensus_queue.cc:1048] T 063924334ed846f3bd41c36cc4651236 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:58:55.294621 19028 raft_consensus.cc:2955] T 063924334ed846f3bd41c36cc4651236 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:58:55.295964 18244 raft_consensus.cc:2955] T 063924334ed846f3bd41c36cc4651236 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:58:55.299252 18099 raft_consensus.cc:2955] T 063924334ed846f3bd41c36cc4651236 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:58:55.313365 18171 consensus_queue.cc:237] T 2d81605b8fe7427b94af7f3c481ed765 P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
W20251023 07:58:55.322705 18142 consensus_peers.cc:597] T 2d81605b8fe7427b94af7f3c481ed765 P 10dfae53d0c941f08bded43539841761 -> Peer d1a8f61d3323447282ee6068aa623216 (127.16.126.4:33293): Couldn't send request to peer d1a8f61d3323447282ee6068aa623216. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2d81605b8fe7427b94af7f3c481ed765. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:58:55.325163 18244 raft_consensus.cc:1275] T 2d81605b8fe7427b94af7f3c481ed765 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251023 07:58:55.325412 18099 raft_consensus.cc:1275] T 2d81605b8fe7427b94af7f3c481ed765 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251023 07:58:55.326728 19011 consensus_queue.cc:1048] T 2d81605b8fe7427b94af7f3c481ed765 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:58:55.331130 19011 consensus_queue.cc:1048] T 2d81605b8fe7427b94af7f3c481ed765 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:58:55.332645 17997 catalog_manager.cc:5649] T 063924334ed846f3bd41c36cc4651236 P 982df35c5b554a8fa64807352c4f34ee reported cstate change: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New cstate: current_term: 1 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:58:55.346253 19010 raft_consensus.cc:2955] T 2d81605b8fe7427b94af7f3c481ed765 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:58:55.347443 18099 raft_consensus.cc:2955] T 2d81605b8fe7427b94af7f3c481ed765 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:58:55.362324 18244 raft_consensus.cc:2955] T 2d81605b8fe7427b94af7f3c481ed765 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:58:55.374754 18099 consensus_queue.cc:237] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
W20251023 07:58:55.390827 18067 consensus_peers.cc:597] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P b3a1328f9c8c484fab08292ce2171ec9 -> Peer d1a8f61d3323447282ee6068aa623216 (127.16.126.4:33293): Couldn't send request to peer d1a8f61d3323447282ee6068aa623216. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3e78cdb4b2af4f5a855ec00a07f2cbc9. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:58:55.394285 18171 raft_consensus.cc:1275] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251023 07:58:55.394626 18244 raft_consensus.cc:1275] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251023 07:58:55.398566 18834 consensus_queue.cc:1048] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:58:55.401871 18834 consensus_queue.cc:1048] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:58:55.400938 17999 catalog_manager.cc:5649] T 2d81605b8fe7427b94af7f3c481ed765 P 10dfae53d0c941f08bded43539841761 reported cstate change: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New cstate: current_term: 1 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251023 07:58:55.415633 18173 raft_consensus.cc:2955] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:58:55.420746 18248 raft_consensus.cc:2955] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:58:55.413254 18834 raft_consensus.cc:2955] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:58:55.440924 17997 catalog_manager.cc:5649] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P 982df35c5b554a8fa64807352c4f34ee reported cstate change: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New cstate: current_term: 1 leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:58:55.456158 18248 consensus_queue.cc:237] T a939fd9e853a45d1aa626a4566c14abc P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
W20251023 07:58:55.471099 18216 consensus_peers.cc:597] T a939fd9e853a45d1aa626a4566c14abc P 982df35c5b554a8fa64807352c4f34ee -> Peer d1a8f61d3323447282ee6068aa623216 (127.16.126.4:33293): Couldn't send request to peer d1a8f61d3323447282ee6068aa623216. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a939fd9e853a45d1aa626a4566c14abc. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:58:55.472358 18099 raft_consensus.cc:1275] T a939fd9e853a45d1aa626a4566c14abc P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251023 07:58:55.473172 18173 raft_consensus.cc:1275] T a939fd9e853a45d1aa626a4566c14abc P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251023 07:58:55.474376 19025 consensus_queue.cc:1048] T a939fd9e853a45d1aa626a4566c14abc P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:58:55.475181 19026 consensus_queue.cc:1048] T a939fd9e853a45d1aa626a4566c14abc P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:58:55.483482 18970 raft_consensus.cc:2955] T a939fd9e853a45d1aa626a4566c14abc P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:58:55.485486 18099 raft_consensus.cc:2955] T a939fd9e853a45d1aa626a4566c14abc P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:58:55.529772 17997 catalog_manager.cc:5649] T a939fd9e853a45d1aa626a4566c14abc P b3a1328f9c8c484fab08292ce2171ec9 reported cstate change: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New cstate: current_term: 1 leader_uuid: "982df35c5b554a8fa64807352c4f34ee" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
W20251023 07:58:55.532282 18215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.2:45799, user_credentials={real_user=slave}} blocked reactor thread for 46476.9us
I20251023 07:58:55.542994 18171 raft_consensus.cc:2955] T a939fd9e853a45d1aa626a4566c14abc P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:58:55.766320 19052 ts_tablet_manager.cc:933] T 063924334ed846f3bd41c36cc4651236 P d1a8f61d3323447282ee6068aa623216: Initiating tablet copy from peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:58:55.768093 19052 tablet_copy_client.cc:323] T 063924334ed846f3bd41c36cc4651236 P d1a8f61d3323447282ee6068aa623216: tablet copy: Beginning tablet copy session from remote peer at address 127.16.126.2:45799
I20251023 07:58:55.769541 18187 tablet_copy_service.cc:140] P 10dfae53d0c941f08bded43539841761: Received BeginTabletCopySession request for tablet 063924334ed846f3bd41c36cc4651236 from peer d1a8f61d3323447282ee6068aa623216 ({username='slave'} at 127.0.0.1:50534)
I20251023 07:58:55.769984 18187 tablet_copy_service.cc:161] P 10dfae53d0c941f08bded43539841761: Beginning new tablet copy session on tablet 063924334ed846f3bd41c36cc4651236 from peer d1a8f61d3323447282ee6068aa623216 at {username='slave'} at 127.0.0.1:50534: session id = d1a8f61d3323447282ee6068aa623216-063924334ed846f3bd41c36cc4651236
I20251023 07:58:55.776407 18187 tablet_copy_source_session.cc:215] T 063924334ed846f3bd41c36cc4651236 P 10dfae53d0c941f08bded43539841761: Tablet Copy: opened 0 blocks and 1 log segments
I20251023 07:58:55.779289 19052 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 063924334ed846f3bd41c36cc4651236. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:55.798594 19052 tablet_copy_client.cc:806] T 063924334ed846f3bd41c36cc4651236 P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 0 data blocks...
I20251023 07:58:55.799317 19052 tablet_copy_client.cc:670] T 063924334ed846f3bd41c36cc4651236 P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 1 WAL segments...
I20251023 07:58:55.807272 19052 tablet_copy_client.cc:538] T 063924334ed846f3bd41c36cc4651236 P d1a8f61d3323447282ee6068aa623216: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251023 07:58:55.817266 19052 tablet_bootstrap.cc:492] T 063924334ed846f3bd41c36cc4651236 P d1a8f61d3323447282ee6068aa623216: Bootstrap starting.
I20251023 07:58:55.840621 19052 tablet_bootstrap.cc:492] T 063924334ed846f3bd41c36cc4651236 P d1a8f61d3323447282ee6068aa623216: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:58:55.841539 19052 tablet_bootstrap.cc:492] T 063924334ed846f3bd41c36cc4651236 P d1a8f61d3323447282ee6068aa623216: Bootstrap complete.
I20251023 07:58:55.842075 19052 ts_tablet_manager.cc:1403] T 063924334ed846f3bd41c36cc4651236 P d1a8f61d3323447282ee6068aa623216: Time spent bootstrapping tablet: real 0.025s user 0.017s sys 0.008s
I20251023 07:58:55.844379 19052 raft_consensus.cc:359] T 063924334ed846f3bd41c36cc4651236 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:58:55.845330 19052 raft_consensus.cc:740] T 063924334ed846f3bd41c36cc4651236 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d1a8f61d3323447282ee6068aa623216, State: Initialized, Role: LEARNER
I20251023 07:58:55.846062 19052 consensus_queue.cc:260] T 063924334ed846f3bd41c36cc4651236 P d1a8f61d3323447282ee6068aa623216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:58:55.849884 19052 ts_tablet_manager.cc:1434] T 063924334ed846f3bd41c36cc4651236 P d1a8f61d3323447282ee6068aa623216: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s
I20251023 07:58:55.851502 18187 tablet_copy_service.cc:342] P 10dfae53d0c941f08bded43539841761: Request end of tablet copy session d1a8f61d3323447282ee6068aa623216-063924334ed846f3bd41c36cc4651236 received from {username='slave'} at 127.0.0.1:50534
I20251023 07:58:55.851888 18187 tablet_copy_service.cc:434] P 10dfae53d0c941f08bded43539841761: ending tablet copy session d1a8f61d3323447282ee6068aa623216-063924334ed846f3bd41c36cc4651236 on tablet 063924334ed846f3bd41c36cc4651236 with peer d1a8f61d3323447282ee6068aa623216
I20251023 07:58:55.866561 19052 ts_tablet_manager.cc:933] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P d1a8f61d3323447282ee6068aa623216: Initiating tablet copy from peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025)
I20251023 07:58:55.868644 19052 tablet_copy_client.cc:323] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P d1a8f61d3323447282ee6068aa623216: tablet copy: Beginning tablet copy session from remote peer at address 127.16.126.1:44025
I20251023 07:58:55.870221 18112 tablet_copy_service.cc:140] P b3a1328f9c8c484fab08292ce2171ec9: Received BeginTabletCopySession request for tablet 3e78cdb4b2af4f5a855ec00a07f2cbc9 from peer d1a8f61d3323447282ee6068aa623216 ({username='slave'} at 127.0.0.1:57714)
I20251023 07:58:55.870765 18112 tablet_copy_service.cc:161] P b3a1328f9c8c484fab08292ce2171ec9: Beginning new tablet copy session on tablet 3e78cdb4b2af4f5a855ec00a07f2cbc9 from peer d1a8f61d3323447282ee6068aa623216 at {username='slave'} at 127.0.0.1:57714: session id = d1a8f61d3323447282ee6068aa623216-3e78cdb4b2af4f5a855ec00a07f2cbc9
I20251023 07:58:55.877727 18112 tablet_copy_source_session.cc:215] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P b3a1328f9c8c484fab08292ce2171ec9: Tablet Copy: opened 0 blocks and 1 log segments
I20251023 07:58:55.880594 19052 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e78cdb4b2af4f5a855ec00a07f2cbc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:55.893520 19052 tablet_copy_client.cc:806] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 0 data blocks...
I20251023 07:58:55.894140 19052 tablet_copy_client.cc:670] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 1 WAL segments...
I20251023 07:58:55.899310 19052 tablet_copy_client.cc:538] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P d1a8f61d3323447282ee6068aa623216: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251023 07:58:55.907848 19052 tablet_bootstrap.cc:492] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P d1a8f61d3323447282ee6068aa623216: Bootstrap starting.
I20251023 07:58:55.929733 19052 tablet_bootstrap.cc:492] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P d1a8f61d3323447282ee6068aa623216: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:58:55.931012 19052 tablet_bootstrap.cc:492] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P d1a8f61d3323447282ee6068aa623216: Bootstrap complete.
I20251023 07:58:55.931826 19052 ts_tablet_manager.cc:1403] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P d1a8f61d3323447282ee6068aa623216: Time spent bootstrapping tablet: real 0.024s user 0.018s sys 0.004s
I20251023 07:58:55.934999 19058 ts_tablet_manager.cc:933] T 2d81605b8fe7427b94af7f3c481ed765 P d1a8f61d3323447282ee6068aa623216: Initiating tablet copy from peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:58:55.937714 19052 raft_consensus.cc:359] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:58:55.938406 19052 raft_consensus.cc:740] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d1a8f61d3323447282ee6068aa623216, State: Initialized, Role: LEARNER
I20251023 07:58:55.938926 19052 consensus_queue.cc:260] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P d1a8f61d3323447282ee6068aa623216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:58:55.941119 19052 ts_tablet_manager.cc:1434] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P d1a8f61d3323447282ee6068aa623216: Time spent starting tablet: real 0.009s user 0.000s sys 0.002s
I20251023 07:58:55.942912 18112 tablet_copy_service.cc:342] P b3a1328f9c8c484fab08292ce2171ec9: Request end of tablet copy session d1a8f61d3323447282ee6068aa623216-3e78cdb4b2af4f5a855ec00a07f2cbc9 received from {username='slave'} at 127.0.0.1:57714
I20251023 07:58:55.943410 18112 tablet_copy_service.cc:434] P b3a1328f9c8c484fab08292ce2171ec9: ending tablet copy session d1a8f61d3323447282ee6068aa623216-3e78cdb4b2af4f5a855ec00a07f2cbc9 on tablet 3e78cdb4b2af4f5a855ec00a07f2cbc9 with peer d1a8f61d3323447282ee6068aa623216
I20251023 07:58:55.942690 19058 tablet_copy_client.cc:323] T 2d81605b8fe7427b94af7f3c481ed765 P d1a8f61d3323447282ee6068aa623216: tablet copy: Beginning tablet copy session from remote peer at address 127.16.126.2:45799
I20251023 07:58:55.946308 18187 tablet_copy_service.cc:140] P 10dfae53d0c941f08bded43539841761: Received BeginTabletCopySession request for tablet 2d81605b8fe7427b94af7f3c481ed765 from peer d1a8f61d3323447282ee6068aa623216 ({username='slave'} at 127.0.0.1:50534)
I20251023 07:58:55.946771 18187 tablet_copy_service.cc:161] P 10dfae53d0c941f08bded43539841761: Beginning new tablet copy session on tablet 2d81605b8fe7427b94af7f3c481ed765 from peer d1a8f61d3323447282ee6068aa623216 at {username='slave'} at 127.0.0.1:50534: session id = d1a8f61d3323447282ee6068aa623216-2d81605b8fe7427b94af7f3c481ed765
I20251023 07:58:55.959403 18187 tablet_copy_source_session.cc:215] T 2d81605b8fe7427b94af7f3c481ed765 P 10dfae53d0c941f08bded43539841761: Tablet Copy: opened 0 blocks and 1 log segments
I20251023 07:58:55.964320 19058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d81605b8fe7427b94af7f3c481ed765. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:55.981374 19058 tablet_copy_client.cc:806] T 2d81605b8fe7427b94af7f3c481ed765 P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 0 data blocks...
I20251023 07:58:55.981956 19058 tablet_copy_client.cc:670] T 2d81605b8fe7427b94af7f3c481ed765 P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 1 WAL segments...
I20251023 07:58:55.985195 19058 tablet_copy_client.cc:538] T 2d81605b8fe7427b94af7f3c481ed765 P d1a8f61d3323447282ee6068aa623216: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251023 07:58:55.993630 19058 tablet_bootstrap.cc:492] T 2d81605b8fe7427b94af7f3c481ed765 P d1a8f61d3323447282ee6068aa623216: Bootstrap starting.
I20251023 07:58:56.011924 19058 tablet_bootstrap.cc:492] T 2d81605b8fe7427b94af7f3c481ed765 P d1a8f61d3323447282ee6068aa623216: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:58:56.012714 19058 tablet_bootstrap.cc:492] T 2d81605b8fe7427b94af7f3c481ed765 P d1a8f61d3323447282ee6068aa623216: Bootstrap complete.
I20251023 07:58:56.013334 19058 ts_tablet_manager.cc:1403] T 2d81605b8fe7427b94af7f3c481ed765 P d1a8f61d3323447282ee6068aa623216: Time spent bootstrapping tablet: real 0.020s user 0.016s sys 0.003s
I20251023 07:58:56.015990 19058 raft_consensus.cc:359] T 2d81605b8fe7427b94af7f3c481ed765 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:58:56.016786 19058 raft_consensus.cc:740] T 2d81605b8fe7427b94af7f3c481ed765 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d1a8f61d3323447282ee6068aa623216, State: Initialized, Role: LEARNER
I20251023 07:58:56.017529 19058 consensus_queue.cc:260] T 2d81605b8fe7427b94af7f3c481ed765 P d1a8f61d3323447282ee6068aa623216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:58:56.019840 19058 ts_tablet_manager.cc:1434] T 2d81605b8fe7427b94af7f3c481ed765 P d1a8f61d3323447282ee6068aa623216: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20251023 07:58:56.022114 18187 tablet_copy_service.cc:342] P 10dfae53d0c941f08bded43539841761: Request end of tablet copy session d1a8f61d3323447282ee6068aa623216-2d81605b8fe7427b94af7f3c481ed765 received from {username='slave'} at 127.0.0.1:50534
I20251023 07:58:56.022529 18187 tablet_copy_service.cc:434] P 10dfae53d0c941f08bded43539841761: ending tablet copy session d1a8f61d3323447282ee6068aa623216-2d81605b8fe7427b94af7f3c481ed765 on tablet 2d81605b8fe7427b94af7f3c481ed765 with peer d1a8f61d3323447282ee6068aa623216
I20251023 07:58:56.063743 19058 ts_tablet_manager.cc:933] T a939fd9e853a45d1aa626a4566c14abc P d1a8f61d3323447282ee6068aa623216: Initiating tablet copy from peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:56.081061 19058 tablet_copy_client.cc:323] T a939fd9e853a45d1aa626a4566c14abc P d1a8f61d3323447282ee6068aa623216: tablet copy: Beginning tablet copy session from remote peer at address 127.16.126.3:46061
I20251023 07:58:56.082538 18261 tablet_copy_service.cc:140] P 982df35c5b554a8fa64807352c4f34ee: Received BeginTabletCopySession request for tablet a939fd9e853a45d1aa626a4566c14abc from peer d1a8f61d3323447282ee6068aa623216 ({username='slave'} at 127.0.0.1:40260)
I20251023 07:58:56.083081 18261 tablet_copy_service.cc:161] P 982df35c5b554a8fa64807352c4f34ee: Beginning new tablet copy session on tablet a939fd9e853a45d1aa626a4566c14abc from peer d1a8f61d3323447282ee6068aa623216 at {username='slave'} at 127.0.0.1:40260: session id = d1a8f61d3323447282ee6068aa623216-a939fd9e853a45d1aa626a4566c14abc
I20251023 07:58:56.090759 18261 tablet_copy_source_session.cc:215] T a939fd9e853a45d1aa626a4566c14abc P 982df35c5b554a8fa64807352c4f34ee: Tablet Copy: opened 0 blocks and 1 log segments
I20251023 07:58:56.097792 19058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a939fd9e853a45d1aa626a4566c14abc. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:56.112643 19058 tablet_copy_client.cc:806] T a939fd9e853a45d1aa626a4566c14abc P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 0 data blocks...
I20251023 07:58:56.113370 19058 tablet_copy_client.cc:670] T a939fd9e853a45d1aa626a4566c14abc P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 1 WAL segments...
I20251023 07:58:56.116413 19058 tablet_copy_client.cc:538] T a939fd9e853a45d1aa626a4566c14abc P d1a8f61d3323447282ee6068aa623216: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251023 07:58:56.124378 19058 tablet_bootstrap.cc:492] T a939fd9e853a45d1aa626a4566c14abc P d1a8f61d3323447282ee6068aa623216: Bootstrap starting.
I20251023 07:58:56.141973 19058 tablet_bootstrap.cc:492] T a939fd9e853a45d1aa626a4566c14abc P d1a8f61d3323447282ee6068aa623216: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:58:56.142766 19058 tablet_bootstrap.cc:492] T a939fd9e853a45d1aa626a4566c14abc P d1a8f61d3323447282ee6068aa623216: Bootstrap complete.
I20251023 07:58:56.143468 19058 ts_tablet_manager.cc:1403] T a939fd9e853a45d1aa626a4566c14abc P d1a8f61d3323447282ee6068aa623216: Time spent bootstrapping tablet: real 0.019s user 0.010s sys 0.008s
I20251023 07:58:56.146117 19058 raft_consensus.cc:359] T a939fd9e853a45d1aa626a4566c14abc P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:58:56.146883 19058 raft_consensus.cc:740] T a939fd9e853a45d1aa626a4566c14abc P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d1a8f61d3323447282ee6068aa623216, State: Initialized, Role: LEARNER
I20251023 07:58:56.147388 19058 consensus_queue.cc:260] T a939fd9e853a45d1aa626a4566c14abc P d1a8f61d3323447282ee6068aa623216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:58:56.149572 19058 ts_tablet_manager.cc:1434] T a939fd9e853a45d1aa626a4566c14abc P d1a8f61d3323447282ee6068aa623216: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20251023 07:58:56.152029 18261 tablet_copy_service.cc:342] P 982df35c5b554a8fa64807352c4f34ee: Request end of tablet copy session d1a8f61d3323447282ee6068aa623216-a939fd9e853a45d1aa626a4566c14abc received from {username='slave'} at 127.0.0.1:40260
I20251023 07:58:56.152459 18261 tablet_copy_service.cc:434] P 982df35c5b554a8fa64807352c4f34ee: ending tablet copy session d1a8f61d3323447282ee6068aa623216-a939fd9e853a45d1aa626a4566c14abc on tablet a939fd9e853a45d1aa626a4566c14abc with peer d1a8f61d3323447282ee6068aa623216
I20251023 07:58:56.180699 18787 raft_consensus.cc:1217] T 063924334ed846f3bd41c36cc4651236 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20251023 07:58:56.403708 18788 raft_consensus.cc:1217] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20251023 07:58:56.422334 18788 raft_consensus.cc:1217] T 2d81605b8fe7427b94af7f3c481ed765 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20251023 07:58:56.448498 18788 raft_consensus.cc:1217] T a939fd9e853a45d1aa626a4566c14abc P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20251023 07:58:56.697386 19010 raft_consensus.cc:1064] T 063924334ed846f3bd41c36cc4651236 P 10dfae53d0c941f08bded43539841761: attempting to promote NON_VOTER d1a8f61d3323447282ee6068aa623216 to VOTER
I20251023 07:58:56.699406 19010 consensus_queue.cc:237] T 063924334ed846f3bd41c36cc4651236 P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:58:56.705509 18788 raft_consensus.cc:1275] T 063924334ed846f3bd41c36cc4651236 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:58:56.707398 18101 raft_consensus.cc:1275] T 063924334ed846f3bd41c36cc4651236 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:58:56.707180 19028 consensus_queue.cc:1048] T 063924334ed846f3bd41c36cc4651236 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:58:56.708858 18248 raft_consensus.cc:1275] T 063924334ed846f3bd41c36cc4651236 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:58:56.708985 19037 consensus_queue.cc:1048] T 063924334ed846f3bd41c36cc4651236 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20251023 07:58:56.711354 19037 consensus_queue.cc:1048] T 063924334ed846f3bd41c36cc4651236 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:58:56.727967 18101 raft_consensus.cc:2955] T 063924334ed846f3bd41c36cc4651236 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:56.732304 18247 raft_consensus.cc:2955] T 063924334ed846f3bd41c36cc4651236 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:56.725487 19010 raft_consensus.cc:2955] T 063924334ed846f3bd41c36cc4651236 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:56.762035 18788 raft_consensus.cc:2955] T 063924334ed846f3bd41c36cc4651236 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:56.775528 17997 catalog_manager.cc:5649] T 063924334ed846f3bd41c36cc4651236 P d1a8f61d3323447282ee6068aa623216 reported cstate change: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:56.816263 18174 consensus_queue.cc:237] T 063924334ed846f3bd41c36cc4651236 P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:58:56.823375 18788 raft_consensus.cc:1275] T 063924334ed846f3bd41c36cc4651236 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251023 07:58:56.824856 19028 consensus_queue.cc:1048] T 063924334ed846f3bd41c36cc4651236 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:58:56.825698 18247 raft_consensus.cc:1275] T 063924334ed846f3bd41c36cc4651236 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251023 07:58:56.830423 19028 consensus_queue.cc:1048] T 063924334ed846f3bd41c36cc4651236 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:58:56.833149 19068 raft_consensus.cc:2955] T 063924334ed846f3bd41c36cc4651236 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:56.836079 18788 raft_consensus.cc:2955] T 063924334ed846f3bd41c36cc4651236 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:56.842759 18834 raft_consensus.cc:1064] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P b3a1328f9c8c484fab08292ce2171ec9: attempting to promote NON_VOTER d1a8f61d3323447282ee6068aa623216 to VOTER
I20251023 07:58:56.844926 18834 consensus_queue.cc:237] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:58:56.848361 17985 catalog_manager.cc:5162] ChangeConfig:REMOVE_PEER RPC for tablet 063924334ed846f3bd41c36cc4651236 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251023 07:58:56.850802 18247 raft_consensus.cc:2955] T 063924334ed846f3bd41c36cc4651236 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:56.860173 17999 catalog_manager.cc:5649] T 063924334ed846f3bd41c36cc4651236 P 10dfae53d0c941f08bded43539841761 reported cstate change: config changed from index 3 to 4, VOTER b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1) evicted. New cstate: current_term: 1 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251023 07:58:56.869477 19037 raft_consensus.cc:1064] T 2d81605b8fe7427b94af7f3c481ed765 P 10dfae53d0c941f08bded43539841761: attempting to promote NON_VOTER d1a8f61d3323447282ee6068aa623216 to VOTER
I20251023 07:58:56.871924 19037 consensus_queue.cc:237] T 2d81605b8fe7427b94af7f3c481ed765 P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:58:56.877693 18086 tablet_service.cc:1552] Processing DeleteTablet for tablet 063924334ed846f3bd41c36cc4651236 with delete_type TABLET_DATA_TOMBSTONED (TS b3a1328f9c8c484fab08292ce2171ec9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53940
I20251023 07:58:56.881105 19075 tablet_replica.cc:333] T 063924334ed846f3bd41c36cc4651236 P b3a1328f9c8c484fab08292ce2171ec9: stopping tablet replica
I20251023 07:58:56.897291 19075 raft_consensus.cc:2243] T 063924334ed846f3bd41c36cc4651236 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:58:56.898486 19075 raft_consensus.cc:2272] T 063924334ed846f3bd41c36cc4651236 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:56.903538 19075 ts_tablet_manager.cc:1916] T 063924334ed846f3bd41c36cc4651236 P b3a1328f9c8c484fab08292ce2171ec9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251023 07:58:56.910596 18788 raft_consensus.cc:1275] T 2d81605b8fe7427b94af7f3c481ed765 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:58:56.911795 18787 raft_consensus.cc:1275] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:58:56.912274 18247 raft_consensus.cc:1275] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:58:56.912153 19028 consensus_queue.cc:1048] T 2d81605b8fe7427b94af7f3c481ed765 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:58:56.914542 19063 consensus_queue.cc:1048] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:58:56.915134 18173 raft_consensus.cc:1275] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:58:56.916940 18998 consensus_queue.cc:1048] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:58:56.920457 18248 raft_consensus.cc:1275] T 2d81605b8fe7427b94af7f3c481ed765 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:58:56.920783 18101 raft_consensus.cc:1275] T 2d81605b8fe7427b94af7f3c481ed765 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:58:56.922869 19037 consensus_queue.cc:1048] T 2d81605b8fe7427b94af7f3c481ed765 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20251023 07:58:56.923671 19063 consensus_queue.cc:1048] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20251023 07:58:56.927707 19028 consensus_queue.cc:1048] T 2d81605b8fe7427b94af7f3c481ed765 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:58:56.961611 19075 ts_tablet_manager.cc:1929] T 063924334ed846f3bd41c36cc4651236 P b3a1328f9c8c484fab08292ce2171ec9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20251023 07:58:56.963801 19037 raft_consensus.cc:2955] T 2d81605b8fe7427b94af7f3c481ed765 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:56.967319 18173 raft_consensus.cc:2955] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:56.965170 18834 raft_consensus.cc:2955] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:56.962191 19075 log.cc:1199] T 063924334ed846f3bd41c36cc4651236 P b3a1328f9c8c484fab08292ce2171ec9: Deleting WAL directory at /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1761206251627710-16888-0/minicluster-data/ts-0-root/wals/063924334ed846f3bd41c36cc4651236
I20251023 07:58:56.980577 17987 catalog_manager.cc:4985] TS b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): tablet 063924334ed846f3bd41c36cc4651236 (table test-workload [id=8bb191a5531a4d4fb58a25b13d592213]) successfully deleted
I20251023 07:58:56.984251 18247 raft_consensus.cc:2955] T 2d81605b8fe7427b94af7f3c481ed765 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:56.984315 18787 raft_consensus.cc:2955] T 2d81605b8fe7427b94af7f3c481ed765 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:56.993914 18788 raft_consensus.cc:2955] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:56.997900 17999 catalog_manager.cc:5649] T 2d81605b8fe7427b94af7f3c481ed765 P 10dfae53d0c941f08bded43539841761 reported cstate change: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251023 07:58:57.019147 19025 raft_consensus.cc:1064] T a939fd9e853a45d1aa626a4566c14abc P 982df35c5b554a8fa64807352c4f34ee: attempting to promote NON_VOTER d1a8f61d3323447282ee6068aa623216 to VOTER
I20251023 07:58:57.022015 19025 consensus_queue.cc:237] T a939fd9e853a45d1aa626a4566c14abc P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:58:57.027717 17998 catalog_manager.cc:5649] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P b3a1328f9c8c484fab08292ce2171ec9 reported cstate change: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251023 07:58:57.034633 18788 raft_consensus.cc:1275] T a939fd9e853a45d1aa626a4566c14abc P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:58:57.033573 18099 raft_consensus.cc:2955] T 2d81605b8fe7427b94af7f3c481ed765 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:57.036125 18970 consensus_queue.cc:1048] T a939fd9e853a45d1aa626a4566c14abc P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:58:57.042270 18248 raft_consensus.cc:2955] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:57.048853 18101 raft_consensus.cc:1275] T a939fd9e853a45d1aa626a4566c14abc P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:58:57.050349 19025 consensus_queue.cc:1048] T a939fd9e853a45d1aa626a4566c14abc P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:58:57.072042 18171 raft_consensus.cc:1275] T a939fd9e853a45d1aa626a4566c14abc P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:58:57.078742 18102 consensus_queue.cc:237] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:58:57.081990 18970 raft_consensus.cc:2955] T a939fd9e853a45d1aa626a4566c14abc P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:57.085739 18171 consensus_queue.cc:237] T 2d81605b8fe7427b94af7f3c481ed765 P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:58:57.091279 18101 raft_consensus.cc:2955] T a939fd9e853a45d1aa626a4566c14abc P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:57.092330 18789 raft_consensus.cc:1275] T 2d81605b8fe7427b94af7f3c481ed765 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251023 07:58:57.093779 19068 consensus_queue.cc:1048] T 2d81605b8fe7427b94af7f3c481ed765 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:58:57.098522 18788 raft_consensus.cc:1275] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251023 07:58:57.099426 19049 consensus_queue.cc:1048] T a939fd9e853a45d1aa626a4566c14abc P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:58:57.102123 19010 raft_consensus.cc:2955] T 2d81605b8fe7427b94af7f3c481ed765 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 982df35c5b554a8fa64807352c4f34ee (127.16.126.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:57.106261 18248 raft_consensus.cc:1275] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251023 07:58:57.105813 18788 raft_consensus.cc:2955] T a939fd9e853a45d1aa626a4566c14abc P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:57.106846 18834 consensus_queue.cc:1048] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:58:57.109767 18174 raft_consensus.cc:2955] T a939fd9e853a45d1aa626a4566c14abc P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:57.114327 18834 consensus_queue.cc:1048] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:58:57.115949 18787 raft_consensus.cc:2955] T 2d81605b8fe7427b94af7f3c481ed765 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 982df35c5b554a8fa64807352c4f34ee (127.16.126.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:57.116681 19082 raft_consensus.cc:2955] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 10dfae53d0c941f08bded43539841761 (127.16.126.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:57.122044 18786 raft_consensus.cc:2955] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 10dfae53d0c941f08bded43539841761 (127.16.126.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:57.124696 18102 raft_consensus.cc:1275] T 2d81605b8fe7427b94af7f3c481ed765 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251023 07:58:57.126793 19068 consensus_queue.cc:1048] T 2d81605b8fe7427b94af7f3c481ed765 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:58:57.133064 17997 catalog_manager.cc:5649] T a939fd9e853a45d1aa626a4566c14abc P 10dfae53d0c941f08bded43539841761 reported cstate change: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "982df35c5b554a8fa64807352c4f34ee" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:57.166705 18102 raft_consensus.cc:2955] T 2d81605b8fe7427b94af7f3c481ed765 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 982df35c5b554a8fa64807352c4f34ee (127.16.126.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:57.170706 18246 consensus_queue.cc:237] T a939fd9e853a45d1aa626a4566c14abc P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:58:57.171576 17998 catalog_manager.cc:5649] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P d1a8f61d3323447282ee6068aa623216 reported cstate change: config changed from index 3 to 4, VOTER 10dfae53d0c941f08bded43539841761 (127.16.126.2) evicted. New cstate: current_term: 1 leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:57.173506 17985 catalog_manager.cc:5162] ChangeConfig:REMOVE_PEER RPC for tablet 2d81605b8fe7427b94af7f3c481ed765 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251023 07:58:57.190573 18096 raft_consensus.cc:1275] T a939fd9e853a45d1aa626a4566c14abc P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251023 07:58:57.191641 17987 catalog_manager.cc:5162] ChangeConfig:REMOVE_PEER RPC for tablet 3e78cdb4b2af4f5a855ec00a07f2cbc9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251023 07:58:57.196614 18163 tablet_service.cc:1552] Processing DeleteTablet for tablet 3e78cdb4b2af4f5a855ec00a07f2cbc9 with delete_type TABLET_DATA_TOMBSTONED (TS 10dfae53d0c941f08bded43539841761 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33428
I20251023 07:58:57.197422 18970 consensus_queue.cc:1048] T a939fd9e853a45d1aa626a4566c14abc P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:58:57.196691 18000 catalog_manager.cc:5649] T 2d81605b8fe7427b94af7f3c481ed765 P 10dfae53d0c941f08bded43539841761 reported cstate change: config changed from index 3 to 4, VOTER 982df35c5b554a8fa64807352c4f34ee (127.16.126.3) evicted. New cstate: current_term: 1 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251023 07:58:57.204448 18789 raft_consensus.cc:1275] T a939fd9e853a45d1aa626a4566c14abc P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251023 07:58:57.206025 18970 consensus_queue.cc:1048] T a939fd9e853a45d1aa626a4566c14abc P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:58:57.208854 18247 raft_consensus.cc:2955] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 10dfae53d0c941f08bded43539841761 (127.16.126.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:57.213783 19049 raft_consensus.cc:2955] T a939fd9e853a45d1aa626a4566c14abc P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 10dfae53d0c941f08bded43539841761 (127.16.126.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:57.217177 18237 tablet_service.cc:1552] Processing DeleteTablet for tablet 2d81605b8fe7427b94af7f3c481ed765 with delete_type TABLET_DATA_TOMBSTONED (TS 982df35c5b554a8fa64807352c4f34ee not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49846
I20251023 07:58:57.219144 19091 tablet_replica.cc:333] T 2d81605b8fe7427b94af7f3c481ed765 P 982df35c5b554a8fa64807352c4f34ee: stopping tablet replica
I20251023 07:58:57.220096 19091 raft_consensus.cc:2243] T 2d81605b8fe7427b94af7f3c481ed765 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:58:57.220886 19091 raft_consensus.cc:2272] T 2d81605b8fe7427b94af7f3c481ed765 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:57.215227 18102 raft_consensus.cc:2955] T a939fd9e853a45d1aa626a4566c14abc P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 10dfae53d0c941f08bded43539841761 (127.16.126.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:57.224995 19091 ts_tablet_manager.cc:1916] T 2d81605b8fe7427b94af7f3c481ed765 P 982df35c5b554a8fa64807352c4f34ee: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251023 07:58:57.227257 19090 tablet_replica.cc:333] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P 10dfae53d0c941f08bded43539841761: stopping tablet replica
I20251023 07:58:57.232646 19090 raft_consensus.cc:2243] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:58:57.233361 19090 raft_consensus.cc:2272] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:57.238922 19090 ts_tablet_manager.cc:1916] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P 10dfae53d0c941f08bded43539841761: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251023 07:58:57.242765 19091 ts_tablet_manager.cc:1929] T 2d81605b8fe7427b94af7f3c481ed765 P 982df35c5b554a8fa64807352c4f34ee: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20251023 07:58:57.243346 19091 log.cc:1199] T 2d81605b8fe7427b94af7f3c481ed765 P 982df35c5b554a8fa64807352c4f34ee: Deleting WAL directory at /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1761206251627710-16888-0/minicluster-data/ts-2-root/wals/2d81605b8fe7427b94af7f3c481ed765
I20251023 07:58:57.246879 18786 raft_consensus.cc:2955] T a939fd9e853a45d1aa626a4566c14abc P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 10dfae53d0c941f08bded43539841761 (127.16.126.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:57.254427 17998 catalog_manager.cc:5649] T a939fd9e853a45d1aa626a4566c14abc P b3a1328f9c8c484fab08292ce2171ec9 reported cstate change: config changed from index 3 to 4, VOTER 10dfae53d0c941f08bded43539841761 (127.16.126.2) evicted. New cstate: current_term: 1 leader_uuid: "982df35c5b554a8fa64807352c4f34ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:57.266119 17986 catalog_manager.cc:4985] TS 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): tablet 2d81605b8fe7427b94af7f3c481ed765 (table test-workload [id=8bb191a5531a4d4fb58a25b13d592213]) successfully deleted
I20251023 07:58:57.268666 17986 catalog_manager.cc:5162] ChangeConfig:REMOVE_PEER RPC for tablet a939fd9e853a45d1aa626a4566c14abc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251023 07:58:57.280191 19090 ts_tablet_manager.cc:1929] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P 10dfae53d0c941f08bded43539841761: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20251023 07:58:57.280822 19090 log.cc:1199] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P 10dfae53d0c941f08bded43539841761: Deleting WAL directory at /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1761206251627710-16888-0/minicluster-data/ts-1-root/wals/3e78cdb4b2af4f5a855ec00a07f2cbc9
I20251023 07:58:57.284530 17985 catalog_manager.cc:4985] TS 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): tablet 3e78cdb4b2af4f5a855ec00a07f2cbc9 (table test-workload [id=8bb191a5531a4d4fb58a25b13d592213]) successfully deleted
I20251023 07:58:57.291358 18163 tablet_service.cc:1552] Processing DeleteTablet for tablet a939fd9e853a45d1aa626a4566c14abc with delete_type TABLET_DATA_TOMBSTONED (TS 10dfae53d0c941f08bded43539841761 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33428
I20251023 07:58:57.292984 19090 tablet_replica.cc:333] T a939fd9e853a45d1aa626a4566c14abc P 10dfae53d0c941f08bded43539841761: stopping tablet replica
I20251023 07:58:57.293951 19090 raft_consensus.cc:2243] T a939fd9e853a45d1aa626a4566c14abc P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:58:57.294508 19090 raft_consensus.cc:2272] T a939fd9e853a45d1aa626a4566c14abc P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:57.297180 19090 ts_tablet_manager.cc:1916] T a939fd9e853a45d1aa626a4566c14abc P 10dfae53d0c941f08bded43539841761: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251023 07:58:57.310103 19090 ts_tablet_manager.cc:1929] T a939fd9e853a45d1aa626a4566c14abc P 10dfae53d0c941f08bded43539841761: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20251023 07:58:57.310425 19090 log.cc:1199] T a939fd9e853a45d1aa626a4566c14abc P 10dfae53d0c941f08bded43539841761: Deleting WAL directory at /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1761206251627710-16888-0/minicluster-data/ts-1-root/wals/a939fd9e853a45d1aa626a4566c14abc
I20251023 07:58:57.311586 17985 catalog_manager.cc:4985] TS 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): tablet a939fd9e853a45d1aa626a4566c14abc (table test-workload [id=8bb191a5531a4d4fb58a25b13d592213]) successfully deleted
I20251023 07:58:58.340497 18173 consensus_queue.cc:237] T f90cf0955288472898eff5b7e6459195 P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:58:58.346289 18247 raft_consensus.cc:1275] T f90cf0955288472898eff5b7e6459195 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251023 07:58:58.346720 18101 raft_consensus.cc:1275] T f90cf0955288472898eff5b7e6459195 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20251023 07:58:58.346836 18142 consensus_peers.cc:597] T f90cf0955288472898eff5b7e6459195 P 10dfae53d0c941f08bded43539841761 -> Peer d1a8f61d3323447282ee6068aa623216 (127.16.126.4:33293): Couldn't send request to peer d1a8f61d3323447282ee6068aa623216. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f90cf0955288472898eff5b7e6459195. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:58:58.347975 19068 consensus_queue.cc:1048] T f90cf0955288472898eff5b7e6459195 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20251023 07:58:58.349061 19096 consensus_queue.cc:1048] T f90cf0955288472898eff5b7e6459195 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:58:58.358315 19096 raft_consensus.cc:2955] T f90cf0955288472898eff5b7e6459195 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:58:58.359930 18101 raft_consensus.cc:2955] T f90cf0955288472898eff5b7e6459195 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:58:58.363400 18247 raft_consensus.cc:2955] T f90cf0955288472898eff5b7e6459195 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:58:58.377900 18173 consensus_queue.cc:237] T eeadb773c7dc416581b44225256a4c3b P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:58:58.383750 17998 catalog_manager.cc:5649] T f90cf0955288472898eff5b7e6459195 P 10dfae53d0c941f08bded43539841761 reported cstate change: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New cstate: current_term: 1 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251023 07:58:58.394025 18247 raft_consensus.cc:1275] T eeadb773c7dc416581b44225256a4c3b P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251023 07:58:58.394603 18101 raft_consensus.cc:1275] T eeadb773c7dc416581b44225256a4c3b P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20251023 07:58:58.395506 18142 consensus_peers.cc:597] T eeadb773c7dc416581b44225256a4c3b P 10dfae53d0c941f08bded43539841761 -> Peer d1a8f61d3323447282ee6068aa623216 (127.16.126.4:33293): Couldn't send request to peer d1a8f61d3323447282ee6068aa623216. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: eeadb773c7dc416581b44225256a4c3b. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:58:58.396145 19094 consensus_queue.cc:1048] T eeadb773c7dc416581b44225256a4c3b P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20251023 07:58:58.404459 19094 consensus_queue.cc:1048] T eeadb773c7dc416581b44225256a4c3b P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:58:58.408730 19068 raft_consensus.cc:2955] T eeadb773c7dc416581b44225256a4c3b P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:58:58.420367 18101 raft_consensus.cc:2955] T eeadb773c7dc416581b44225256a4c3b P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:58:58.428985 18246 raft_consensus.cc:2955] T eeadb773c7dc416581b44225256a4c3b P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:58:58.444399 18101 consensus_queue.cc:237] T 3c5c040d6ebe40e5a5be6be47de5a7bc P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:58:58.454118 18173 raft_consensus.cc:1275] T 3c5c040d6ebe40e5a5be6be47de5a7bc P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251023 07:58:58.456296 18246 raft_consensus.cc:1275] T 3c5c040d6ebe40e5a5be6be47de5a7bc P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251023 07:58:58.456194 19089 consensus_queue.cc:1048] T 3c5c040d6ebe40e5a5be6be47de5a7bc P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20251023 07:58:58.457526 18067 consensus_peers.cc:597] T 3c5c040d6ebe40e5a5be6be47de5a7bc P b3a1328f9c8c484fab08292ce2171ec9 -> Peer d1a8f61d3323447282ee6068aa623216 (127.16.126.4:33293): Couldn't send request to peer d1a8f61d3323447282ee6068aa623216. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3c5c040d6ebe40e5a5be6be47de5a7bc. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:58:58.458293 19082 consensus_queue.cc:1048] T 3c5c040d6ebe40e5a5be6be47de5a7bc P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:58:58.454986 17999 catalog_manager.cc:5649] T eeadb773c7dc416581b44225256a4c3b P 10dfae53d0c941f08bded43539841761 reported cstate change: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New cstate: current_term: 1 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251023 07:58:58.465996 19089 raft_consensus.cc:2955] T 3c5c040d6ebe40e5a5be6be47de5a7bc P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:58:58.479146 18173 raft_consensus.cc:2955] T 3c5c040d6ebe40e5a5be6be47de5a7bc P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:58:58.479166 18246 raft_consensus.cc:2955] T 3c5c040d6ebe40e5a5be6be47de5a7bc P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:58:58.487855 18248 consensus_queue.cc:237] T 1f437560602a470ca62b7a1fa9471026 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:58:58.494324 17998 catalog_manager.cc:5649] T 3c5c040d6ebe40e5a5be6be47de5a7bc P b3a1328f9c8c484fab08292ce2171ec9 reported cstate change: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New cstate: current_term: 1 leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20251023 07:58:58.516481 18216 consensus_peers.cc:597] T 1f437560602a470ca62b7a1fa9471026 P 982df35c5b554a8fa64807352c4f34ee -> Peer d1a8f61d3323447282ee6068aa623216 (127.16.126.4:33293): Couldn't send request to peer d1a8f61d3323447282ee6068aa623216. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1f437560602a470ca62b7a1fa9471026. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:58:58.522215 18173 raft_consensus.cc:1275] T 1f437560602a470ca62b7a1fa9471026 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251023 07:58:58.524593 18101 raft_consensus.cc:1275] T 1f437560602a470ca62b7a1fa9471026 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251023 07:58:58.524070 19087 consensus_queue.cc:1048] T 1f437560602a470ca62b7a1fa9471026 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20251023 07:58:58.528059 19113 consensus_queue.cc:1048] T 1f437560602a470ca62b7a1fa9471026 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:58:58.538817 19114 raft_consensus.cc:2955] T 1f437560602a470ca62b7a1fa9471026 P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:58:58.539914 18173 raft_consensus.cc:2955] T 1f437560602a470ca62b7a1fa9471026 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:58:58.540484 18101 raft_consensus.cc:2955] T 1f437560602a470ca62b7a1fa9471026 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:58:58.557476 18000 catalog_manager.cc:5649] T 1f437560602a470ca62b7a1fa9471026 P 10dfae53d0c941f08bded43539841761 reported cstate change: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New cstate: current_term: 1 leader_uuid: "982df35c5b554a8fa64807352c4f34ee" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:58:58.800737 19119 ts_tablet_manager.cc:933] T f90cf0955288472898eff5b7e6459195 P d1a8f61d3323447282ee6068aa623216: Initiating tablet copy from peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:58:58.803133 19119 tablet_copy_client.cc:323] T f90cf0955288472898eff5b7e6459195 P d1a8f61d3323447282ee6068aa623216: tablet copy: Beginning tablet copy session from remote peer at address 127.16.126.2:45799
I20251023 07:58:58.804518 18187 tablet_copy_service.cc:140] P 10dfae53d0c941f08bded43539841761: Received BeginTabletCopySession request for tablet f90cf0955288472898eff5b7e6459195 from peer d1a8f61d3323447282ee6068aa623216 ({username='slave'} at 127.0.0.1:50534)
I20251023 07:58:58.804973 18187 tablet_copy_service.cc:161] P 10dfae53d0c941f08bded43539841761: Beginning new tablet copy session on tablet f90cf0955288472898eff5b7e6459195 from peer d1a8f61d3323447282ee6068aa623216 at {username='slave'} at 127.0.0.1:50534: session id = d1a8f61d3323447282ee6068aa623216-f90cf0955288472898eff5b7e6459195
I20251023 07:58:58.810876 18187 tablet_copy_source_session.cc:215] T f90cf0955288472898eff5b7e6459195 P 10dfae53d0c941f08bded43539841761: Tablet Copy: opened 0 blocks and 1 log segments
I20251023 07:58:58.813827 19119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f90cf0955288472898eff5b7e6459195. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:58.829176 19119 tablet_copy_client.cc:806] T f90cf0955288472898eff5b7e6459195 P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 0 data blocks...
I20251023 07:58:58.829763 19119 tablet_copy_client.cc:670] T f90cf0955288472898eff5b7e6459195 P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 1 WAL segments...
I20251023 07:58:58.833339 19119 tablet_copy_client.cc:538] T f90cf0955288472898eff5b7e6459195 P d1a8f61d3323447282ee6068aa623216: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251023 07:58:58.842012 19119 tablet_bootstrap.cc:492] T f90cf0955288472898eff5b7e6459195 P d1a8f61d3323447282ee6068aa623216: Bootstrap starting.
I20251023 07:58:58.861830 19119 tablet_bootstrap.cc:492] T f90cf0955288472898eff5b7e6459195 P d1a8f61d3323447282ee6068aa623216: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:58:58.862897 19119 tablet_bootstrap.cc:492] T f90cf0955288472898eff5b7e6459195 P d1a8f61d3323447282ee6068aa623216: Bootstrap complete.
I20251023 07:58:58.863688 19119 ts_tablet_manager.cc:1403] T f90cf0955288472898eff5b7e6459195 P d1a8f61d3323447282ee6068aa623216: Time spent bootstrapping tablet: real 0.022s user 0.020s sys 0.000s
I20251023 07:58:58.866474 19119 raft_consensus.cc:359] T f90cf0955288472898eff5b7e6459195 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:58:58.867079 19119 raft_consensus.cc:740] T f90cf0955288472898eff5b7e6459195 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d1a8f61d3323447282ee6068aa623216, State: Initialized, Role: LEARNER
I20251023 07:58:58.867679 19119 consensus_queue.cc:260] T f90cf0955288472898eff5b7e6459195 P d1a8f61d3323447282ee6068aa623216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:58:58.870707 19119 ts_tablet_manager.cc:1434] T f90cf0955288472898eff5b7e6459195 P d1a8f61d3323447282ee6068aa623216: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20251023 07:58:58.872388 18187 tablet_copy_service.cc:342] P 10dfae53d0c941f08bded43539841761: Request end of tablet copy session d1a8f61d3323447282ee6068aa623216-f90cf0955288472898eff5b7e6459195 received from {username='slave'} at 127.0.0.1:50534
I20251023 07:58:58.872752 18187 tablet_copy_service.cc:434] P 10dfae53d0c941f08bded43539841761: ending tablet copy session d1a8f61d3323447282ee6068aa623216-f90cf0955288472898eff5b7e6459195 on tablet f90cf0955288472898eff5b7e6459195 with peer d1a8f61d3323447282ee6068aa623216
I20251023 07:58:58.915449 19119 ts_tablet_manager.cc:933] T eeadb773c7dc416581b44225256a4c3b P d1a8f61d3323447282ee6068aa623216: Initiating tablet copy from peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:58:58.916800 19119 tablet_copy_client.cc:323] T eeadb773c7dc416581b44225256a4c3b P d1a8f61d3323447282ee6068aa623216: tablet copy: Beginning tablet copy session from remote peer at address 127.16.126.2:45799
I20251023 07:58:58.918207 18187 tablet_copy_service.cc:140] P 10dfae53d0c941f08bded43539841761: Received BeginTabletCopySession request for tablet eeadb773c7dc416581b44225256a4c3b from peer d1a8f61d3323447282ee6068aa623216 ({username='slave'} at 127.0.0.1:50534)
I20251023 07:58:58.918720 18187 tablet_copy_service.cc:161] P 10dfae53d0c941f08bded43539841761: Beginning new tablet copy session on tablet eeadb773c7dc416581b44225256a4c3b from peer d1a8f61d3323447282ee6068aa623216 at {username='slave'} at 127.0.0.1:50534: session id = d1a8f61d3323447282ee6068aa623216-eeadb773c7dc416581b44225256a4c3b
I20251023 07:58:58.925719 18187 tablet_copy_source_session.cc:215] T eeadb773c7dc416581b44225256a4c3b P 10dfae53d0c941f08bded43539841761: Tablet Copy: opened 0 blocks and 1 log segments
I20251023 07:58:58.928685 19119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eeadb773c7dc416581b44225256a4c3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:58.954525 19119 tablet_copy_client.cc:806] T eeadb773c7dc416581b44225256a4c3b P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 0 data blocks...
I20251023 07:58:58.955963 19119 tablet_copy_client.cc:670] T eeadb773c7dc416581b44225256a4c3b P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 1 WAL segments...
I20251023 07:58:58.961906 19119 tablet_copy_client.cc:538] T eeadb773c7dc416581b44225256a4c3b P d1a8f61d3323447282ee6068aa623216: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251023 07:58:58.970907 19119 tablet_bootstrap.cc:492] T eeadb773c7dc416581b44225256a4c3b P d1a8f61d3323447282ee6068aa623216: Bootstrap starting.
I20251023 07:58:58.993340 19119 tablet_bootstrap.cc:492] T eeadb773c7dc416581b44225256a4c3b P d1a8f61d3323447282ee6068aa623216: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:58:58.995661 19119 tablet_bootstrap.cc:492] T eeadb773c7dc416581b44225256a4c3b P d1a8f61d3323447282ee6068aa623216: Bootstrap complete.
I20251023 07:58:58.996346 19119 ts_tablet_manager.cc:1403] T eeadb773c7dc416581b44225256a4c3b P d1a8f61d3323447282ee6068aa623216: Time spent bootstrapping tablet: real 0.026s user 0.015s sys 0.008s
I20251023 07:58:58.998935 19119 raft_consensus.cc:359] T eeadb773c7dc416581b44225256a4c3b P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:58:58.999541 19119 raft_consensus.cc:740] T eeadb773c7dc416581b44225256a4c3b P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d1a8f61d3323447282ee6068aa623216, State: Initialized, Role: LEARNER
I20251023 07:58:59.000103 19119 consensus_queue.cc:260] T eeadb773c7dc416581b44225256a4c3b P d1a8f61d3323447282ee6068aa623216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:58:59.002565 19119 ts_tablet_manager.cc:1434] T eeadb773c7dc416581b44225256a4c3b P d1a8f61d3323447282ee6068aa623216: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20251023 07:58:59.004209 18187 tablet_copy_service.cc:342] P 10dfae53d0c941f08bded43539841761: Request end of tablet copy session d1a8f61d3323447282ee6068aa623216-eeadb773c7dc416581b44225256a4c3b received from {username='slave'} at 127.0.0.1:50534
I20251023 07:58:59.004640 18187 tablet_copy_service.cc:434] P 10dfae53d0c941f08bded43539841761: ending tablet copy session d1a8f61d3323447282ee6068aa623216-eeadb773c7dc416581b44225256a4c3b on tablet eeadb773c7dc416581b44225256a4c3b with peer d1a8f61d3323447282ee6068aa623216
I20251023 07:58:59.025589 19119 ts_tablet_manager.cc:933] T 3c5c040d6ebe40e5a5be6be47de5a7bc P d1a8f61d3323447282ee6068aa623216: Initiating tablet copy from peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025)
I20251023 07:58:59.027282 19119 tablet_copy_client.cc:323] T 3c5c040d6ebe40e5a5be6be47de5a7bc P d1a8f61d3323447282ee6068aa623216: tablet copy: Beginning tablet copy session from remote peer at address 127.16.126.1:44025
I20251023 07:58:59.029479 18112 tablet_copy_service.cc:140] P b3a1328f9c8c484fab08292ce2171ec9: Received BeginTabletCopySession request for tablet 3c5c040d6ebe40e5a5be6be47de5a7bc from peer d1a8f61d3323447282ee6068aa623216 ({username='slave'} at 127.0.0.1:57714)
I20251023 07:58:59.030014 18112 tablet_copy_service.cc:161] P b3a1328f9c8c484fab08292ce2171ec9: Beginning new tablet copy session on tablet 3c5c040d6ebe40e5a5be6be47de5a7bc from peer d1a8f61d3323447282ee6068aa623216 at {username='slave'} at 127.0.0.1:57714: session id = d1a8f61d3323447282ee6068aa623216-3c5c040d6ebe40e5a5be6be47de5a7bc
I20251023 07:58:59.038275 18112 tablet_copy_source_session.cc:215] T 3c5c040d6ebe40e5a5be6be47de5a7bc P b3a1328f9c8c484fab08292ce2171ec9: Tablet Copy: opened 0 blocks and 1 log segments
I20251023 07:58:59.041378 19119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c5c040d6ebe40e5a5be6be47de5a7bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:59.057956 19126 ts_tablet_manager.cc:933] T 1f437560602a470ca62b7a1fa9471026 P d1a8f61d3323447282ee6068aa623216: Initiating tablet copy from peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:58:59.058938 19119 tablet_copy_client.cc:806] T 3c5c040d6ebe40e5a5be6be47de5a7bc P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 0 data blocks...
I20251023 07:58:59.059537 19119 tablet_copy_client.cc:670] T 3c5c040d6ebe40e5a5be6be47de5a7bc P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 1 WAL segments...
I20251023 07:58:59.062969 19119 tablet_copy_client.cc:538] T 3c5c040d6ebe40e5a5be6be47de5a7bc P d1a8f61d3323447282ee6068aa623216: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251023 07:58:59.062945 19126 tablet_copy_client.cc:323] T 1f437560602a470ca62b7a1fa9471026 P d1a8f61d3323447282ee6068aa623216: tablet copy: Beginning tablet copy session from remote peer at address 127.16.126.3:46061
I20251023 07:58:59.067448 18261 tablet_copy_service.cc:140] P 982df35c5b554a8fa64807352c4f34ee: Received BeginTabletCopySession request for tablet 1f437560602a470ca62b7a1fa9471026 from peer d1a8f61d3323447282ee6068aa623216 ({username='slave'} at 127.0.0.1:40260)
I20251023 07:58:59.067999 18261 tablet_copy_service.cc:161] P 982df35c5b554a8fa64807352c4f34ee: Beginning new tablet copy session on tablet 1f437560602a470ca62b7a1fa9471026 from peer d1a8f61d3323447282ee6068aa623216 at {username='slave'} at 127.0.0.1:40260: session id = d1a8f61d3323447282ee6068aa623216-1f437560602a470ca62b7a1fa9471026
I20251023 07:58:59.070981 19119 tablet_bootstrap.cc:492] T 3c5c040d6ebe40e5a5be6be47de5a7bc P d1a8f61d3323447282ee6068aa623216: Bootstrap starting.
I20251023 07:58:59.079315 18261 tablet_copy_source_session.cc:215] T 1f437560602a470ca62b7a1fa9471026 P 982df35c5b554a8fa64807352c4f34ee: Tablet Copy: opened 0 blocks and 1 log segments
I20251023 07:58:59.083621 19126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f437560602a470ca62b7a1fa9471026. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:58:59.097615 19119 tablet_bootstrap.cc:492] T 3c5c040d6ebe40e5a5be6be47de5a7bc P d1a8f61d3323447282ee6068aa623216: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:58:59.099200 19119 tablet_bootstrap.cc:492] T 3c5c040d6ebe40e5a5be6be47de5a7bc P d1a8f61d3323447282ee6068aa623216: Bootstrap complete.
I20251023 07:58:59.099918 19119 ts_tablet_manager.cc:1403] T 3c5c040d6ebe40e5a5be6be47de5a7bc P d1a8f61d3323447282ee6068aa623216: Time spent bootstrapping tablet: real 0.029s user 0.019s sys 0.008s
I20251023 07:58:59.102593 19119 raft_consensus.cc:359] T 3c5c040d6ebe40e5a5be6be47de5a7bc P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:58:59.103346 19119 raft_consensus.cc:740] T 3c5c040d6ebe40e5a5be6be47de5a7bc P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d1a8f61d3323447282ee6068aa623216, State: Initialized, Role: LEARNER
I20251023 07:58:59.103979 19119 consensus_queue.cc:260] T 3c5c040d6ebe40e5a5be6be47de5a7bc P d1a8f61d3323447282ee6068aa623216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:58:59.104914 19126 tablet_copy_client.cc:806] T 1f437560602a470ca62b7a1fa9471026 P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 0 data blocks...
I20251023 07:58:59.105587 19126 tablet_copy_client.cc:670] T 1f437560602a470ca62b7a1fa9471026 P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 1 WAL segments...
I20251023 07:58:59.106411 19119 ts_tablet_manager.cc:1434] T 3c5c040d6ebe40e5a5be6be47de5a7bc P d1a8f61d3323447282ee6068aa623216: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20251023 07:58:59.108458 18112 tablet_copy_service.cc:342] P b3a1328f9c8c484fab08292ce2171ec9: Request end of tablet copy session d1a8f61d3323447282ee6068aa623216-3c5c040d6ebe40e5a5be6be47de5a7bc received from {username='slave'} at 127.0.0.1:57714
I20251023 07:58:59.108851 18112 tablet_copy_service.cc:434] P b3a1328f9c8c484fab08292ce2171ec9: ending tablet copy session d1a8f61d3323447282ee6068aa623216-3c5c040d6ebe40e5a5be6be47de5a7bc on tablet 3c5c040d6ebe40e5a5be6be47de5a7bc with peer d1a8f61d3323447282ee6068aa623216
I20251023 07:58:59.111300 19126 tablet_copy_client.cc:538] T 1f437560602a470ca62b7a1fa9471026 P d1a8f61d3323447282ee6068aa623216: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251023 07:58:59.120131 19126 tablet_bootstrap.cc:492] T 1f437560602a470ca62b7a1fa9471026 P d1a8f61d3323447282ee6068aa623216: Bootstrap starting.
I20251023 07:58:59.140689 19126 tablet_bootstrap.cc:492] T 1f437560602a470ca62b7a1fa9471026 P d1a8f61d3323447282ee6068aa623216: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:58:59.141398 19126 tablet_bootstrap.cc:492] T 1f437560602a470ca62b7a1fa9471026 P d1a8f61d3323447282ee6068aa623216: Bootstrap complete.
I20251023 07:58:59.141999 19126 ts_tablet_manager.cc:1403] T 1f437560602a470ca62b7a1fa9471026 P d1a8f61d3323447282ee6068aa623216: Time spent bootstrapping tablet: real 0.022s user 0.015s sys 0.007s
I20251023 07:58:59.144387 19126 raft_consensus.cc:359] T 1f437560602a470ca62b7a1fa9471026 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:58:59.144948 19126 raft_consensus.cc:740] T 1f437560602a470ca62b7a1fa9471026 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d1a8f61d3323447282ee6068aa623216, State: Initialized, Role: LEARNER
I20251023 07:58:59.145502 19126 consensus_queue.cc:260] T 1f437560602a470ca62b7a1fa9471026 P d1a8f61d3323447282ee6068aa623216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:58:59.148030 19126 ts_tablet_manager.cc:1434] T 1f437560602a470ca62b7a1fa9471026 P d1a8f61d3323447282ee6068aa623216: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20251023 07:58:59.150049 18261 tablet_copy_service.cc:342] P 982df35c5b554a8fa64807352c4f34ee: Request end of tablet copy session d1a8f61d3323447282ee6068aa623216-1f437560602a470ca62b7a1fa9471026 received from {username='slave'} at 127.0.0.1:40260
I20251023 07:58:59.150404 18261 tablet_copy_service.cc:434] P 982df35c5b554a8fa64807352c4f34ee: ending tablet copy session d1a8f61d3323447282ee6068aa623216-1f437560602a470ca62b7a1fa9471026 on tablet 1f437560602a470ca62b7a1fa9471026 with peer d1a8f61d3323447282ee6068aa623216
I20251023 07:58:59.264815 18786 raft_consensus.cc:1217] T f90cf0955288472898eff5b7e6459195 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20251023 07:58:59.451838 18786 raft_consensus.cc:1217] T eeadb773c7dc416581b44225256a4c3b P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20251023 07:58:59.482352 18786 raft_consensus.cc:1217] T 1f437560602a470ca62b7a1fa9471026 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20251023 07:58:59.540714 18789 raft_consensus.cc:1217] T 3c5c040d6ebe40e5a5be6be47de5a7bc P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20251023 07:58:59.663591 19094 raft_consensus.cc:1064] T f90cf0955288472898eff5b7e6459195 P 10dfae53d0c941f08bded43539841761: attempting to promote NON_VOTER d1a8f61d3323447282ee6068aa623216 to VOTER
I20251023 07:58:59.666347 19094 consensus_queue.cc:237] T f90cf0955288472898eff5b7e6459195 P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:58:59.673727 18789 raft_consensus.cc:1275] T f90cf0955288472898eff5b7e6459195 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:58:59.674945 18101 raft_consensus.cc:1275] T f90cf0955288472898eff5b7e6459195 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:58:59.676391 19068 consensus_queue.cc:1048] T f90cf0955288472898eff5b7e6459195 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:58:59.676805 18247 raft_consensus.cc:1275] T f90cf0955288472898eff5b7e6459195 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:58:59.678120 19068 consensus_queue.cc:1048] T f90cf0955288472898eff5b7e6459195 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:58:59.678905 19133 consensus_queue.cc:1048] T f90cf0955288472898eff5b7e6459195 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:58:59.701651 19100 raft_consensus.cc:2955] T f90cf0955288472898eff5b7e6459195 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:59.707701 18789 raft_consensus.cc:2955] T f90cf0955288472898eff5b7e6459195 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:59.709709 18097 raft_consensus.cc:2955] T f90cf0955288472898eff5b7e6459195 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:59.724023 18000 catalog_manager.cc:5649] T f90cf0955288472898eff5b7e6459195 P d1a8f61d3323447282ee6068aa623216 reported cstate change: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:59.728492 18247 raft_consensus.cc:2955] T f90cf0955288472898eff5b7e6459195 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:59.790827 18171 consensus_queue.cc:237] T f90cf0955288472898eff5b7e6459195 P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:58:59.796069 18097 raft_consensus.cc:1275] T f90cf0955288472898eff5b7e6459195 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251023 07:58:59.797489 19133 consensus_queue.cc:1048] T f90cf0955288472898eff5b7e6459195 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:58:59.799113 18789 raft_consensus.cc:1275] T f90cf0955288472898eff5b7e6459195 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251023 07:58:59.803697 19068 consensus_queue.cc:1048] T f90cf0955288472898eff5b7e6459195 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:58:59.809746 19068 raft_consensus.cc:2955] T f90cf0955288472898eff5b7e6459195 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 982df35c5b554a8fa64807352c4f34ee (127.16.126.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:59.812448 18102 raft_consensus.cc:2955] T f90cf0955288472898eff5b7e6459195 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 982df35c5b554a8fa64807352c4f34ee (127.16.126.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:59.817777 18789 raft_consensus.cc:2955] T f90cf0955288472898eff5b7e6459195 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 982df35c5b554a8fa64807352c4f34ee (127.16.126.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:59.839157 17999 catalog_manager.cc:5649] T f90cf0955288472898eff5b7e6459195 P d1a8f61d3323447282ee6068aa623216 reported cstate change: config changed from index 3 to 4, VOTER 982df35c5b554a8fa64807352c4f34ee (127.16.126.3) evicted. New cstate: current_term: 1 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:58:59.845862 17985 catalog_manager.cc:5162] ChangeConfig:REMOVE_PEER RPC for tablet f90cf0955288472898eff5b7e6459195 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251023 07:58:59.850618 18237 tablet_service.cc:1552] Processing DeleteTablet for tablet f90cf0955288472898eff5b7e6459195 with delete_type TABLET_DATA_TOMBSTONED (TS 982df35c5b554a8fa64807352c4f34ee not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49846
I20251023 07:58:59.858778 19142 tablet_replica.cc:333] T f90cf0955288472898eff5b7e6459195 P 982df35c5b554a8fa64807352c4f34ee: stopping tablet replica
I20251023 07:58:59.859915 19142 raft_consensus.cc:2243] T f90cf0955288472898eff5b7e6459195 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:58:59.860816 19142 raft_consensus.cc:2272] T f90cf0955288472898eff5b7e6459195 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:58:59.865721 19142 ts_tablet_manager.cc:1916] T f90cf0955288472898eff5b7e6459195 P 982df35c5b554a8fa64807352c4f34ee: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251023 07:58:59.881073 19142 ts_tablet_manager.cc:1929] T f90cf0955288472898eff5b7e6459195 P 982df35c5b554a8fa64807352c4f34ee: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20251023 07:58:59.881515 19142 log.cc:1199] T f90cf0955288472898eff5b7e6459195 P 982df35c5b554a8fa64807352c4f34ee: Deleting WAL directory at /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1761206251627710-16888-0/minicluster-data/ts-2-root/wals/f90cf0955288472898eff5b7e6459195
I20251023 07:58:59.883271 17986 catalog_manager.cc:4985] TS 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): tablet f90cf0955288472898eff5b7e6459195 (table test-workload [id=8bb191a5531a4d4fb58a25b13d592213]) successfully deleted
I20251023 07:58:59.926966 19068 raft_consensus.cc:1064] T eeadb773c7dc416581b44225256a4c3b P 10dfae53d0c941f08bded43539841761: attempting to promote NON_VOTER d1a8f61d3323447282ee6068aa623216 to VOTER
I20251023 07:58:59.929400 19068 consensus_queue.cc:237] T eeadb773c7dc416581b44225256a4c3b P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:58:59.935853 19130 raft_consensus.cc:1064] T 1f437560602a470ca62b7a1fa9471026 P 982df35c5b554a8fa64807352c4f34ee: attempting to promote NON_VOTER d1a8f61d3323447282ee6068aa623216 to VOTER
I20251023 07:58:59.941625 19130 consensus_queue.cc:237] T 1f437560602a470ca62b7a1fa9471026 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:58:59.955507 18789 raft_consensus.cc:1275] T eeadb773c7dc416581b44225256a4c3b P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:58:59.955487 18102 raft_consensus.cc:1275] T eeadb773c7dc416581b44225256a4c3b P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:58:59.959869 18244 raft_consensus.cc:1275] T eeadb773c7dc416581b44225256a4c3b P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:58:59.962329 18786 raft_consensus.cc:1275] T 1f437560602a470ca62b7a1fa9471026 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:58:59.962745 18173 raft_consensus.cc:1275] T 1f437560602a470ca62b7a1fa9471026 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:58:59.964105 19114 consensus_queue.cc:1048] T 1f437560602a470ca62b7a1fa9471026 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:58:59.959667 19100 consensus_queue.cc:1048] T eeadb773c7dc416581b44225256a4c3b P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20251023 07:58:59.965523 19094 consensus_queue.cc:1048] T eeadb773c7dc416581b44225256a4c3b P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:58:59.966429 18102 raft_consensus.cc:1275] T 1f437560602a470ca62b7a1fa9471026 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:58:59.966995 19114 consensus_queue.cc:1048] T 1f437560602a470ca62b7a1fa9471026 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:58:59.968916 19114 consensus_queue.cc:1048] T 1f437560602a470ca62b7a1fa9471026 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:58:59.968974 19133 consensus_queue.cc:1048] T eeadb773c7dc416581b44225256a4c3b P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20251023 07:58:59.997925 19133 raft_consensus.cc:2955] T eeadb773c7dc416581b44225256a4c3b P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:00.004295 18247 raft_consensus.cc:2955] T eeadb773c7dc416581b44225256a4c3b P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:00.004729 18097 raft_consensus.cc:2955] T 1f437560602a470ca62b7a1fa9471026 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:00.003193 18786 raft_consensus.cc:2955] T 1f437560602a470ca62b7a1fa9471026 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:00.000571 18101 raft_consensus.cc:2955] T eeadb773c7dc416581b44225256a4c3b P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:00.000464 19114 raft_consensus.cc:2955] T 1f437560602a470ca62b7a1fa9471026 P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:00.024526 17998 catalog_manager.cc:5649] T 1f437560602a470ca62b7a1fa9471026 P d1a8f61d3323447282ee6068aa623216 reported cstate change: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "982df35c5b554a8fa64807352c4f34ee" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:00.038764 18786 raft_consensus.cc:2955] T eeadb773c7dc416581b44225256a4c3b P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:00.048283 18171 raft_consensus.cc:2955] T 1f437560602a470ca62b7a1fa9471026 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:00.055392 17997 catalog_manager.cc:5649] T eeadb773c7dc416581b44225256a4c3b P 10dfae53d0c941f08bded43539841761 reported cstate change: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251023 07:59:00.067394 18244 consensus_queue.cc:237] T 1f437560602a470ca62b7a1fa9471026 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:00.077536 18173 raft_consensus.cc:1275] T 1f437560602a470ca62b7a1fa9471026 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251023 07:59:00.081411 19131 consensus_queue.cc:1048] T 1f437560602a470ca62b7a1fa9471026 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:59:00.078346 18786 raft_consensus.cc:1275] T 1f437560602a470ca62b7a1fa9471026 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251023 07:59:00.084559 19131 consensus_queue.cc:1048] T 1f437560602a470ca62b7a1fa9471026 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:59:00.088150 19110 raft_consensus.cc:1064] T 3c5c040d6ebe40e5a5be6be47de5a7bc P b3a1328f9c8c484fab08292ce2171ec9: attempting to promote NON_VOTER d1a8f61d3323447282ee6068aa623216 to VOTER
I20251023 07:59:00.090472 19110 consensus_queue.cc:237] T 3c5c040d6ebe40e5a5be6be47de5a7bc P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:00.091704 19130 raft_consensus.cc:2955] T 1f437560602a470ca62b7a1fa9471026 P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:00.096598 18789 raft_consensus.cc:2955] T 1f437560602a470ca62b7a1fa9471026 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:00.099567 18173 consensus_queue.cc:237] T eeadb773c7dc416581b44225256a4c3b P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:00.104985 18176 raft_consensus.cc:2955] T 1f437560602a470ca62b7a1fa9471026 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:00.114110 17997 catalog_manager.cc:5649] T 1f437560602a470ca62b7a1fa9471026 P d1a8f61d3323447282ee6068aa623216 reported cstate change: config changed from index 3 to 4, VOTER b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1) evicted. New cstate: current_term: 1 leader_uuid: "982df35c5b554a8fa64807352c4f34ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:00.121892 17986 catalog_manager.cc:5162] ChangeConfig:REMOVE_PEER RPC for tablet 1f437560602a470ca62b7a1fa9471026 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251023 07:59:00.127532 18787 raft_consensus.cc:1275] T 3c5c040d6ebe40e5a5be6be47de5a7bc P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:59:00.132232 18247 raft_consensus.cc:1275] T eeadb773c7dc416581b44225256a4c3b P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251023 07:59:00.133087 18086 tablet_service.cc:1552] Processing DeleteTablet for tablet 1f437560602a470ca62b7a1fa9471026 with delete_type TABLET_DATA_TOMBSTONED (TS b3a1328f9c8c484fab08292ce2171ec9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53940
I20251023 07:59:00.136287 18786 raft_consensus.cc:1275] T eeadb773c7dc416581b44225256a4c3b P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251023 07:59:00.136186 19100 consensus_queue.cc:1048] T eeadb773c7dc416581b44225256a4c3b P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20251023 07:59:00.138993 19068 consensus_queue.cc:1048] T eeadb773c7dc416581b44225256a4c3b P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:59:00.139173 19082 consensus_queue.cc:1048] T 3c5c040d6ebe40e5a5be6be47de5a7bc P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20251023 07:59:00.145745 18247 raft_consensus.cc:1275] T 3c5c040d6ebe40e5a5be6be47de5a7bc P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:59:00.150367 19153 tablet_replica.cc:333] T 1f437560602a470ca62b7a1fa9471026 P b3a1328f9c8c484fab08292ce2171ec9: stopping tablet replica
I20251023 07:59:00.151842 19153 raft_consensus.cc:2243] T 1f437560602a470ca62b7a1fa9471026 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:00.152940 19153 raft_consensus.cc:2272] T 1f437560602a470ca62b7a1fa9471026 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:00.157315 19153 ts_tablet_manager.cc:1916] T 1f437560602a470ca62b7a1fa9471026 P b3a1328f9c8c484fab08292ce2171ec9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251023 07:59:00.183954 19094 raft_consensus.cc:2955] T eeadb773c7dc416581b44225256a4c3b P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:00.179527 19082 consensus_queue.cc:1048] T 3c5c040d6ebe40e5a5be6be47de5a7bc P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20251023 07:59:00.190606 18786 raft_consensus.cc:2955] T eeadb773c7dc416581b44225256a4c3b P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:00.200287 17985 catalog_manager.cc:5162] ChangeConfig:REMOVE_PEER RPC for tablet eeadb773c7dc416581b44225256a4c3b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251023 07:59:00.200625 19153 ts_tablet_manager.cc:1929] T 1f437560602a470ca62b7a1fa9471026 P b3a1328f9c8c484fab08292ce2171ec9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20251023 07:59:00.201121 19153 log.cc:1199] T 1f437560602a470ca62b7a1fa9471026 P b3a1328f9c8c484fab08292ce2171ec9: Deleting WAL directory at /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1761206251627710-16888-0/minicluster-data/ts-0-root/wals/1f437560602a470ca62b7a1fa9471026
I20251023 07:59:00.204535 18247 raft_consensus.cc:2955] T eeadb773c7dc416581b44225256a4c3b P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:00.209594 17987 catalog_manager.cc:4985] TS b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): tablet 1f437560602a470ca62b7a1fa9471026 (table test-workload [id=8bb191a5531a4d4fb58a25b13d592213]) successfully deleted
I20251023 07:59:00.230698 18176 raft_consensus.cc:1275] T 3c5c040d6ebe40e5a5be6be47de5a7bc P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:59:00.237236 19110 consensus_queue.cc:1048] T 3c5c040d6ebe40e5a5be6be47de5a7bc P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20251023 07:59:00.242007 17997 catalog_manager.cc:5649] T eeadb773c7dc416581b44225256a4c3b P 10dfae53d0c941f08bded43539841761 reported cstate change: config changed from index 3 to 4, VOTER b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1) evicted. New cstate: current_term: 1 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251023 07:59:00.250401 19141 raft_consensus.cc:2955] T 3c5c040d6ebe40e5a5be6be47de5a7bc P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:00.253907 18176 raft_consensus.cc:2955] T 3c5c040d6ebe40e5a5be6be47de5a7bc P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:00.258777 18086 tablet_service.cc:1552] Processing DeleteTablet for tablet eeadb773c7dc416581b44225256a4c3b with delete_type TABLET_DATA_TOMBSTONED (TS b3a1328f9c8c484fab08292ce2171ec9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53940
I20251023 07:59:00.259755 19153 tablet_replica.cc:333] T eeadb773c7dc416581b44225256a4c3b P b3a1328f9c8c484fab08292ce2171ec9: stopping tablet replica
I20251023 07:59:00.260782 19153 raft_consensus.cc:2243] T eeadb773c7dc416581b44225256a4c3b P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:00.261571 19153 raft_consensus.cc:2272] T eeadb773c7dc416581b44225256a4c3b P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:00.260380 18248 raft_consensus.cc:2955] T 3c5c040d6ebe40e5a5be6be47de5a7bc P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:00.265237 19153 ts_tablet_manager.cc:1916] T eeadb773c7dc416581b44225256a4c3b P b3a1328f9c8c484fab08292ce2171ec9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251023 07:59:00.274705 18789 raft_consensus.cc:2955] T 3c5c040d6ebe40e5a5be6be47de5a7bc P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:00.286402 17997 catalog_manager.cc:5649] T 3c5c040d6ebe40e5a5be6be47de5a7bc P b3a1328f9c8c484fab08292ce2171ec9 reported cstate change: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251023 07:59:00.302255 19153 ts_tablet_manager.cc:1929] T eeadb773c7dc416581b44225256a4c3b P b3a1328f9c8c484fab08292ce2171ec9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20251023 07:59:00.302793 19153 log.cc:1199] T eeadb773c7dc416581b44225256a4c3b P b3a1328f9c8c484fab08292ce2171ec9: Deleting WAL directory at /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1761206251627710-16888-0/minicluster-data/ts-0-root/wals/eeadb773c7dc416581b44225256a4c3b
I20251023 07:59:00.308566 17987 catalog_manager.cc:4985] TS b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): tablet eeadb773c7dc416581b44225256a4c3b (table test-workload [id=8bb191a5531a4d4fb58a25b13d592213]) successfully deleted
I20251023 07:59:00.314671 18102 consensus_queue.cc:237] T 3c5c040d6ebe40e5a5be6be47de5a7bc P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:00.321640 18789 raft_consensus.cc:1275] T 3c5c040d6ebe40e5a5be6be47de5a7bc P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251023 07:59:00.323061 19141 consensus_queue.cc:1048] T 3c5c040d6ebe40e5a5be6be47de5a7bc P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:59:00.321713 18248 raft_consensus.cc:1275] T 3c5c040d6ebe40e5a5be6be47de5a7bc P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251023 07:59:00.324895 19141 consensus_queue.cc:1048] T 3c5c040d6ebe40e5a5be6be47de5a7bc P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:59:00.330971 19110 raft_consensus.cc:2955] T 3c5c040d6ebe40e5a5be6be47de5a7bc P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 10dfae53d0c941f08bded43539841761 (127.16.126.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:00.343330 18248 raft_consensus.cc:2955] T 3c5c040d6ebe40e5a5be6be47de5a7bc P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 10dfae53d0c941f08bded43539841761 (127.16.126.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:00.334947 18786 raft_consensus.cc:2955] T 3c5c040d6ebe40e5a5be6be47de5a7bc P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 10dfae53d0c941f08bded43539841761 (127.16.126.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:00.345872 17987 catalog_manager.cc:5162] ChangeConfig:REMOVE_PEER RPC for tablet 3c5c040d6ebe40e5a5be6be47de5a7bc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251023 07:59:00.351873 17999 catalog_manager.cc:5649] T 3c5c040d6ebe40e5a5be6be47de5a7bc P b3a1328f9c8c484fab08292ce2171ec9 reported cstate change: config changed from index 3 to 4, VOTER 10dfae53d0c941f08bded43539841761 (127.16.126.2) evicted. New cstate: current_term: 1 leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251023 07:59:00.366236 18163 tablet_service.cc:1552] Processing DeleteTablet for tablet 3c5c040d6ebe40e5a5be6be47de5a7bc with delete_type TABLET_DATA_TOMBSTONED (TS 10dfae53d0c941f08bded43539841761 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33428
I20251023 07:59:00.370486 19158 tablet_replica.cc:333] T 3c5c040d6ebe40e5a5be6be47de5a7bc P 10dfae53d0c941f08bded43539841761: stopping tablet replica
I20251023 07:59:00.371508 19158 raft_consensus.cc:2243] T 3c5c040d6ebe40e5a5be6be47de5a7bc P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:00.372315 19158 raft_consensus.cc:2272] T 3c5c040d6ebe40e5a5be6be47de5a7bc P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:00.375272 19158 ts_tablet_manager.cc:1916] T 3c5c040d6ebe40e5a5be6be47de5a7bc P 10dfae53d0c941f08bded43539841761: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251023 07:59:00.388147 19158 ts_tablet_manager.cc:1929] T 3c5c040d6ebe40e5a5be6be47de5a7bc P 10dfae53d0c941f08bded43539841761: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20251023 07:59:00.388455 19158 log.cc:1199] T 3c5c040d6ebe40e5a5be6be47de5a7bc P 10dfae53d0c941f08bded43539841761: Deleting WAL directory at /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1761206251627710-16888-0/minicluster-data/ts-1-root/wals/3c5c040d6ebe40e5a5be6be47de5a7bc
I20251023 07:59:00.389786 17985 catalog_manager.cc:4985] TS 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): tablet 3c5c040d6ebe40e5a5be6be47de5a7bc (table test-workload [id=8bb191a5531a4d4fb58a25b13d592213]) successfully deleted
I20251023 07:59:01.419301 18171 consensus_queue.cc:237] T 931f55bec99140c69a4b5654b691c861 P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:59:01.425931 18247 raft_consensus.cc:1275] T 931f55bec99140c69a4b5654b691c861 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251023 07:59:01.426542 18097 raft_consensus.cc:1275] T 931f55bec99140c69a4b5654b691c861 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251023 07:59:01.427323 19094 consensus_queue.cc:1048] T 931f55bec99140c69a4b5654b691c861 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:01.428228 19160 consensus_queue.cc:1048] T 931f55bec99140c69a4b5654b691c861 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20251023 07:59:01.429026 18142 consensus_peers.cc:597] T 931f55bec99140c69a4b5654b691c861 P 10dfae53d0c941f08bded43539841761 -> Peer d1a8f61d3323447282ee6068aa623216 (127.16.126.4:33293): Couldn't send request to peer d1a8f61d3323447282ee6068aa623216. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 931f55bec99140c69a4b5654b691c861. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:01.436282 19068 raft_consensus.cc:2955] T 931f55bec99140c69a4b5654b691c861 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:01.438709 18247 raft_consensus.cc:2955] T 931f55bec99140c69a4b5654b691c861 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:01.442080 18097 raft_consensus.cc:2955] T 931f55bec99140c69a4b5654b691c861 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:01.451499 18171 consensus_queue.cc:237] T 3e4d005972f44619b0cf23f4978f51c4 P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:59:01.465762 18000 catalog_manager.cc:5649] T 931f55bec99140c69a4b5654b691c861 P 982df35c5b554a8fa64807352c4f34ee reported cstate change: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New cstate: current_term: 1 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
W20251023 07:59:01.532570 18142 consensus_peers.cc:597] T 3e4d005972f44619b0cf23f4978f51c4 P 10dfae53d0c941f08bded43539841761 -> Peer d1a8f61d3323447282ee6068aa623216 (127.16.126.4:33293): Couldn't send request to peer d1a8f61d3323447282ee6068aa623216. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3e4d005972f44619b0cf23f4978f51c4. This is attempt 1: this message will repeat every 5th retry.
W20251023 07:59:01.533322 18217 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.1:44025, user_credentials={real_user=slave}} blocked reactor thread for 44499.5us
I20251023 07:59:01.534153 18097 raft_consensus.cc:1275] T 3e4d005972f44619b0cf23f4978f51c4 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251023 07:59:01.534236 18247 raft_consensus.cc:1275] T 3e4d005972f44619b0cf23f4978f51c4 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251023 07:59:01.535699 19160 consensus_queue.cc:1048] T 3e4d005972f44619b0cf23f4978f51c4 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:01.536547 19068 consensus_queue.cc:1048] T 3e4d005972f44619b0cf23f4978f51c4 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:01.547523 19068 raft_consensus.cc:2955] T 3e4d005972f44619b0cf23f4978f51c4 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:01.549578 18097 raft_consensus.cc:2955] T 3e4d005972f44619b0cf23f4978f51c4 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:01.568423 18247 raft_consensus.cc:2955] T 3e4d005972f44619b0cf23f4978f51c4 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:01.570218 17999 catalog_manager.cc:5649] T 3e4d005972f44619b0cf23f4978f51c4 P b3a1328f9c8c484fab08292ce2171ec9 reported cstate change: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New cstate: current_term: 1 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:01.574270 18248 consensus_queue.cc:237] T abefe27ebb4c4179a8620d4e638fe119 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
W20251023 07:59:01.588410 18216 consensus_peers.cc:597] T abefe27ebb4c4179a8620d4e638fe119 P 982df35c5b554a8fa64807352c4f34ee -> Peer d1a8f61d3323447282ee6068aa623216 (127.16.126.4:33293): Couldn't send request to peer d1a8f61d3323447282ee6068aa623216. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: abefe27ebb4c4179a8620d4e638fe119. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:01.588572 18171 raft_consensus.cc:1275] T abefe27ebb4c4179a8620d4e638fe119 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251023 07:59:01.590131 19168 consensus_queue.cc:1048] T abefe27ebb4c4179a8620d4e638fe119 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:01.590365 18097 raft_consensus.cc:1275] T abefe27ebb4c4179a8620d4e638fe119 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251023 07:59:01.595903 19168 consensus_queue.cc:1048] T abefe27ebb4c4179a8620d4e638fe119 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:01.602201 19169 raft_consensus.cc:2955] T abefe27ebb4c4179a8620d4e638fe119 P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:01.606165 18171 raft_consensus.cc:2955] T abefe27ebb4c4179a8620d4e638fe119 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:01.606906 18097 raft_consensus.cc:2955] T abefe27ebb4c4179a8620d4e638fe119 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:01.616746 18176 consensus_queue.cc:237] T ce0069d7c0cf4dee84a85731209358f7 P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:59:01.618731 17999 catalog_manager.cc:5649] T abefe27ebb4c4179a8620d4e638fe119 P 982df35c5b554a8fa64807352c4f34ee reported cstate change: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New cstate: current_term: 1 leader_uuid: "982df35c5b554a8fa64807352c4f34ee" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20251023 07:59:01.629731 18142 consensus_peers.cc:597] T ce0069d7c0cf4dee84a85731209358f7 P 10dfae53d0c941f08bded43539841761 -> Peer d1a8f61d3323447282ee6068aa623216 (127.16.126.4:33293): Couldn't send request to peer d1a8f61d3323447282ee6068aa623216. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ce0069d7c0cf4dee84a85731209358f7. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:01.634308 18097 raft_consensus.cc:1275] T ce0069d7c0cf4dee84a85731209358f7 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251023 07:59:01.635778 19160 consensus_queue.cc:1048] T ce0069d7c0cf4dee84a85731209358f7 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:01.635501 18247 raft_consensus.cc:1275] T ce0069d7c0cf4dee84a85731209358f7 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251023 07:59:01.638216 19068 consensus_queue.cc:1048] T ce0069d7c0cf4dee84a85731209358f7 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:01.650847 19160 raft_consensus.cc:2955] T ce0069d7c0cf4dee84a85731209358f7 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:01.652735 18102 raft_consensus.cc:2955] T ce0069d7c0cf4dee84a85731209358f7 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:01.660142 18247 raft_consensus.cc:2955] T ce0069d7c0cf4dee84a85731209358f7 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:01.673779 17999 catalog_manager.cc:5649] T ce0069d7c0cf4dee84a85731209358f7 P b3a1328f9c8c484fab08292ce2171ec9 reported cstate change: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New cstate: current_term: 1 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:01.857580 19179 ts_tablet_manager.cc:933] T 931f55bec99140c69a4b5654b691c861 P d1a8f61d3323447282ee6068aa623216: Initiating tablet copy from peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:59:01.859982 19179 tablet_copy_client.cc:323] T 931f55bec99140c69a4b5654b691c861 P d1a8f61d3323447282ee6068aa623216: tablet copy: Beginning tablet copy session from remote peer at address 127.16.126.2:45799
I20251023 07:59:01.861361 18187 tablet_copy_service.cc:140] P 10dfae53d0c941f08bded43539841761: Received BeginTabletCopySession request for tablet 931f55bec99140c69a4b5654b691c861 from peer d1a8f61d3323447282ee6068aa623216 ({username='slave'} at 127.0.0.1:50534)
I20251023 07:59:01.861891 18187 tablet_copy_service.cc:161] P 10dfae53d0c941f08bded43539841761: Beginning new tablet copy session on tablet 931f55bec99140c69a4b5654b691c861 from peer d1a8f61d3323447282ee6068aa623216 at {username='slave'} at 127.0.0.1:50534: session id = d1a8f61d3323447282ee6068aa623216-931f55bec99140c69a4b5654b691c861
I20251023 07:59:01.869685 18187 tablet_copy_source_session.cc:215] T 931f55bec99140c69a4b5654b691c861 P 10dfae53d0c941f08bded43539841761: Tablet Copy: opened 0 blocks and 1 log segments
I20251023 07:59:01.873965 19179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 931f55bec99140c69a4b5654b691c861. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:01.889164 19179 tablet_copy_client.cc:806] T 931f55bec99140c69a4b5654b691c861 P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 0 data blocks...
I20251023 07:59:01.889825 19179 tablet_copy_client.cc:670] T 931f55bec99140c69a4b5654b691c861 P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 1 WAL segments...
I20251023 07:59:01.893029 19179 tablet_copy_client.cc:538] T 931f55bec99140c69a4b5654b691c861 P d1a8f61d3323447282ee6068aa623216: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251023 07:59:01.903864 19179 tablet_bootstrap.cc:492] T 931f55bec99140c69a4b5654b691c861 P d1a8f61d3323447282ee6068aa623216: Bootstrap starting.
I20251023 07:59:01.923048 19179 tablet_bootstrap.cc:492] T 931f55bec99140c69a4b5654b691c861 P d1a8f61d3323447282ee6068aa623216: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:59:01.923838 19179 tablet_bootstrap.cc:492] T 931f55bec99140c69a4b5654b691c861 P d1a8f61d3323447282ee6068aa623216: Bootstrap complete.
I20251023 07:59:01.924530 19179 ts_tablet_manager.cc:1403] T 931f55bec99140c69a4b5654b691c861 P d1a8f61d3323447282ee6068aa623216: Time spent bootstrapping tablet: real 0.021s user 0.012s sys 0.010s
I20251023 07:59:01.926796 19179 raft_consensus.cc:359] T 931f55bec99140c69a4b5654b691c861 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:59:01.927726 19179 raft_consensus.cc:740] T 931f55bec99140c69a4b5654b691c861 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d1a8f61d3323447282ee6068aa623216, State: Initialized, Role: LEARNER
I20251023 07:59:01.928491 19179 consensus_queue.cc:260] T 931f55bec99140c69a4b5654b691c861 P d1a8f61d3323447282ee6068aa623216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:59:01.938716 19179 ts_tablet_manager.cc:1434] T 931f55bec99140c69a4b5654b691c861 P d1a8f61d3323447282ee6068aa623216: Time spent starting tablet: real 0.014s user 0.011s sys 0.001s
I20251023 07:59:01.940361 19183 ts_tablet_manager.cc:933] T 3e4d005972f44619b0cf23f4978f51c4 P d1a8f61d3323447282ee6068aa623216: Initiating tablet copy from peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:59:01.943045 19183 tablet_copy_client.cc:323] T 3e4d005972f44619b0cf23f4978f51c4 P d1a8f61d3323447282ee6068aa623216: tablet copy: Beginning tablet copy session from remote peer at address 127.16.126.2:45799
I20251023 07:59:01.947237 18186 tablet_copy_service.cc:140] P 10dfae53d0c941f08bded43539841761: Received BeginTabletCopySession request for tablet 3e4d005972f44619b0cf23f4978f51c4 from peer d1a8f61d3323447282ee6068aa623216 ({username='slave'} at 127.0.0.1:50534)
I20251023 07:59:01.947705 18186 tablet_copy_service.cc:161] P 10dfae53d0c941f08bded43539841761: Beginning new tablet copy session on tablet 3e4d005972f44619b0cf23f4978f51c4 from peer d1a8f61d3323447282ee6068aa623216 at {username='slave'} at 127.0.0.1:50534: session id = d1a8f61d3323447282ee6068aa623216-3e4d005972f44619b0cf23f4978f51c4
I20251023 07:59:01.949715 18187 tablet_copy_service.cc:342] P 10dfae53d0c941f08bded43539841761: Request end of tablet copy session d1a8f61d3323447282ee6068aa623216-931f55bec99140c69a4b5654b691c861 received from {username='slave'} at 127.0.0.1:50534
I20251023 07:59:01.950131 18187 tablet_copy_service.cc:434] P 10dfae53d0c941f08bded43539841761: ending tablet copy session d1a8f61d3323447282ee6068aa623216-931f55bec99140c69a4b5654b691c861 on tablet 931f55bec99140c69a4b5654b691c861 with peer d1a8f61d3323447282ee6068aa623216
I20251023 07:59:01.955088 18186 tablet_copy_source_session.cc:215] T 3e4d005972f44619b0cf23f4978f51c4 P 10dfae53d0c941f08bded43539841761: Tablet Copy: opened 0 blocks and 1 log segments
I20251023 07:59:01.959671 19183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e4d005972f44619b0cf23f4978f51c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:01.977388 19183 tablet_copy_client.cc:806] T 3e4d005972f44619b0cf23f4978f51c4 P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 0 data blocks...
I20251023 07:59:01.978076 19183 tablet_copy_client.cc:670] T 3e4d005972f44619b0cf23f4978f51c4 P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 1 WAL segments...
I20251023 07:59:01.981099 19183 tablet_copy_client.cc:538] T 3e4d005972f44619b0cf23f4978f51c4 P d1a8f61d3323447282ee6068aa623216: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251023 07:59:01.988642 19179 ts_tablet_manager.cc:933] T abefe27ebb4c4179a8620d4e638fe119 P d1a8f61d3323447282ee6068aa623216: Initiating tablet copy from peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:59:01.988863 19183 tablet_bootstrap.cc:492] T 3e4d005972f44619b0cf23f4978f51c4 P d1a8f61d3323447282ee6068aa623216: Bootstrap starting.
I20251023 07:59:01.990411 19179 tablet_copy_client.cc:323] T abefe27ebb4c4179a8620d4e638fe119 P d1a8f61d3323447282ee6068aa623216: tablet copy: Beginning tablet copy session from remote peer at address 127.16.126.3:46061
I20251023 07:59:01.992231 18261 tablet_copy_service.cc:140] P 982df35c5b554a8fa64807352c4f34ee: Received BeginTabletCopySession request for tablet abefe27ebb4c4179a8620d4e638fe119 from peer d1a8f61d3323447282ee6068aa623216 ({username='slave'} at 127.0.0.1:40260)
I20251023 07:59:01.992720 18261 tablet_copy_service.cc:161] P 982df35c5b554a8fa64807352c4f34ee: Beginning new tablet copy session on tablet abefe27ebb4c4179a8620d4e638fe119 from peer d1a8f61d3323447282ee6068aa623216 at {username='slave'} at 127.0.0.1:40260: session id = d1a8f61d3323447282ee6068aa623216-abefe27ebb4c4179a8620d4e638fe119
I20251023 07:59:01.999991 18261 tablet_copy_source_session.cc:215] T abefe27ebb4c4179a8620d4e638fe119 P 982df35c5b554a8fa64807352c4f34ee: Tablet Copy: opened 0 blocks and 1 log segments
I20251023 07:59:02.003626 19179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abefe27ebb4c4179a8620d4e638fe119. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:02.029120 19179 tablet_copy_client.cc:806] T abefe27ebb4c4179a8620d4e638fe119 P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 0 data blocks...
I20251023 07:59:02.030272 19179 tablet_copy_client.cc:670] T abefe27ebb4c4179a8620d4e638fe119 P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 1 WAL segments...
I20251023 07:59:02.034348 19179 tablet_copy_client.cc:538] T abefe27ebb4c4179a8620d4e638fe119 P d1a8f61d3323447282ee6068aa623216: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251023 07:59:02.036026 19183 tablet_bootstrap.cc:492] T 3e4d005972f44619b0cf23f4978f51c4 P d1a8f61d3323447282ee6068aa623216: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:59:02.036808 19183 tablet_bootstrap.cc:492] T 3e4d005972f44619b0cf23f4978f51c4 P d1a8f61d3323447282ee6068aa623216: Bootstrap complete.
I20251023 07:59:02.037454 19183 ts_tablet_manager.cc:1403] T 3e4d005972f44619b0cf23f4978f51c4 P d1a8f61d3323447282ee6068aa623216: Time spent bootstrapping tablet: real 0.049s user 0.014s sys 0.006s
I20251023 07:59:02.039773 19183 raft_consensus.cc:359] T 3e4d005972f44619b0cf23f4978f51c4 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:59:02.040514 19183 raft_consensus.cc:740] T 3e4d005972f44619b0cf23f4978f51c4 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d1a8f61d3323447282ee6068aa623216, State: Initialized, Role: LEARNER
I20251023 07:59:02.041087 19183 consensus_queue.cc:260] T 3e4d005972f44619b0cf23f4978f51c4 P d1a8f61d3323447282ee6068aa623216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:59:02.044199 19187 ts_tablet_manager.cc:933] T ce0069d7c0cf4dee84a85731209358f7 P d1a8f61d3323447282ee6068aa623216: Initiating tablet copy from peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:59:02.047093 19183 ts_tablet_manager.cc:1434] T 3e4d005972f44619b0cf23f4978f51c4 P d1a8f61d3323447282ee6068aa623216: Time spent starting tablet: real 0.009s user 0.005s sys 0.000s
I20251023 07:59:02.049772 18186 tablet_copy_service.cc:342] P 10dfae53d0c941f08bded43539841761: Request end of tablet copy session d1a8f61d3323447282ee6068aa623216-3e4d005972f44619b0cf23f4978f51c4 received from {username='slave'} at 127.0.0.1:50534
I20251023 07:59:02.050239 18186 tablet_copy_service.cc:434] P 10dfae53d0c941f08bded43539841761: ending tablet copy session d1a8f61d3323447282ee6068aa623216-3e4d005972f44619b0cf23f4978f51c4 on tablet 3e4d005972f44619b0cf23f4978f51c4 with peer d1a8f61d3323447282ee6068aa623216
I20251023 07:59:02.057312 19187 tablet_copy_client.cc:323] T ce0069d7c0cf4dee84a85731209358f7 P d1a8f61d3323447282ee6068aa623216: tablet copy: Beginning tablet copy session from remote peer at address 127.16.126.2:45799
I20251023 07:59:02.059255 18186 tablet_copy_service.cc:140] P 10dfae53d0c941f08bded43539841761: Received BeginTabletCopySession request for tablet ce0069d7c0cf4dee84a85731209358f7 from peer d1a8f61d3323447282ee6068aa623216 ({username='slave'} at 127.0.0.1:50534)
I20251023 07:59:02.059834 18186 tablet_copy_service.cc:161] P 10dfae53d0c941f08bded43539841761: Beginning new tablet copy session on tablet ce0069d7c0cf4dee84a85731209358f7 from peer d1a8f61d3323447282ee6068aa623216 at {username='slave'} at 127.0.0.1:50534: session id = d1a8f61d3323447282ee6068aa623216-ce0069d7c0cf4dee84a85731209358f7
I20251023 07:59:02.063432 19179 tablet_bootstrap.cc:492] T abefe27ebb4c4179a8620d4e638fe119 P d1a8f61d3323447282ee6068aa623216: Bootstrap starting.
I20251023 07:59:02.070461 18186 tablet_copy_source_session.cc:215] T ce0069d7c0cf4dee84a85731209358f7 P 10dfae53d0c941f08bded43539841761: Tablet Copy: opened 0 blocks and 1 log segments
I20251023 07:59:02.073362 19187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce0069d7c0cf4dee84a85731209358f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:02.083947 19179 tablet_bootstrap.cc:492] T abefe27ebb4c4179a8620d4e638fe119 P d1a8f61d3323447282ee6068aa623216: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:59:02.084987 19179 tablet_bootstrap.cc:492] T abefe27ebb4c4179a8620d4e638fe119 P d1a8f61d3323447282ee6068aa623216: Bootstrap complete.
I20251023 07:59:02.085705 19179 ts_tablet_manager.cc:1403] T abefe27ebb4c4179a8620d4e638fe119 P d1a8f61d3323447282ee6068aa623216: Time spent bootstrapping tablet: real 0.022s user 0.022s sys 0.000s
I20251023 07:59:02.088153 19179 raft_consensus.cc:359] T abefe27ebb4c4179a8620d4e638fe119 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:59:02.088788 19179 raft_consensus.cc:740] T abefe27ebb4c4179a8620d4e638fe119 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d1a8f61d3323447282ee6068aa623216, State: Initialized, Role: LEARNER
I20251023 07:59:02.089941 19179 consensus_queue.cc:260] T abefe27ebb4c4179a8620d4e638fe119 P d1a8f61d3323447282ee6068aa623216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:59:02.092139 19179 ts_tablet_manager.cc:1434] T abefe27ebb4c4179a8620d4e638fe119 P d1a8f61d3323447282ee6068aa623216: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20251023 07:59:02.094852 18261 tablet_copy_service.cc:342] P 982df35c5b554a8fa64807352c4f34ee: Request end of tablet copy session d1a8f61d3323447282ee6068aa623216-abefe27ebb4c4179a8620d4e638fe119 received from {username='slave'} at 127.0.0.1:40260
I20251023 07:59:02.095214 18261 tablet_copy_service.cc:434] P 982df35c5b554a8fa64807352c4f34ee: ending tablet copy session d1a8f61d3323447282ee6068aa623216-abefe27ebb4c4179a8620d4e638fe119 on tablet abefe27ebb4c4179a8620d4e638fe119 with peer d1a8f61d3323447282ee6068aa623216
I20251023 07:59:02.100752 19187 tablet_copy_client.cc:806] T ce0069d7c0cf4dee84a85731209358f7 P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 0 data blocks...
I20251023 07:59:02.104101 19187 tablet_copy_client.cc:670] T ce0069d7c0cf4dee84a85731209358f7 P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 1 WAL segments...
I20251023 07:59:02.108868 19187 tablet_copy_client.cc:538] T ce0069d7c0cf4dee84a85731209358f7 P d1a8f61d3323447282ee6068aa623216: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251023 07:59:02.118782 19187 tablet_bootstrap.cc:492] T ce0069d7c0cf4dee84a85731209358f7 P d1a8f61d3323447282ee6068aa623216: Bootstrap starting.
I20251023 07:59:02.138657 19187 tablet_bootstrap.cc:492] T ce0069d7c0cf4dee84a85731209358f7 P d1a8f61d3323447282ee6068aa623216: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:59:02.139410 19187 tablet_bootstrap.cc:492] T ce0069d7c0cf4dee84a85731209358f7 P d1a8f61d3323447282ee6068aa623216: Bootstrap complete.
I20251023 07:59:02.139977 19187 ts_tablet_manager.cc:1403] T ce0069d7c0cf4dee84a85731209358f7 P d1a8f61d3323447282ee6068aa623216: Time spent bootstrapping tablet: real 0.021s user 0.015s sys 0.003s
I20251023 07:59:02.144742 19187 raft_consensus.cc:359] T ce0069d7c0cf4dee84a85731209358f7 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:59:02.145557 19187 raft_consensus.cc:740] T ce0069d7c0cf4dee84a85731209358f7 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d1a8f61d3323447282ee6068aa623216, State: Initialized, Role: LEARNER
I20251023 07:59:02.146188 19187 consensus_queue.cc:260] T ce0069d7c0cf4dee84a85731209358f7 P d1a8f61d3323447282ee6068aa623216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:59:02.148285 19187 ts_tablet_manager.cc:1434] T ce0069d7c0cf4dee84a85731209358f7 P d1a8f61d3323447282ee6068aa623216: Time spent starting tablet: real 0.008s user 0.003s sys 0.003s
I20251023 07:59:02.150309 18186 tablet_copy_service.cc:342] P 10dfae53d0c941f08bded43539841761: Request end of tablet copy session d1a8f61d3323447282ee6068aa623216-ce0069d7c0cf4dee84a85731209358f7 received from {username='slave'} at 127.0.0.1:50534
I20251023 07:59:02.150714 18186 tablet_copy_service.cc:434] P 10dfae53d0c941f08bded43539841761: ending tablet copy session d1a8f61d3323447282ee6068aa623216-ce0069d7c0cf4dee84a85731209358f7 on tablet ce0069d7c0cf4dee84a85731209358f7 with peer d1a8f61d3323447282ee6068aa623216
I20251023 07:59:02.376009 18789 raft_consensus.cc:1217] T 931f55bec99140c69a4b5654b691c861 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20251023 07:59:02.428975 18787 raft_consensus.cc:1217] T 3e4d005972f44619b0cf23f4978f51c4 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20251023 07:59:02.547344 18786 raft_consensus.cc:1217] T abefe27ebb4c4179a8620d4e638fe119 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20251023 07:59:02.626677 18786 raft_consensus.cc:1217] T ce0069d7c0cf4dee84a85731209358f7 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20251023 07:59:02.897600 19193 raft_consensus.cc:1064] T 931f55bec99140c69a4b5654b691c861 P 10dfae53d0c941f08bded43539841761: attempting to promote NON_VOTER d1a8f61d3323447282ee6068aa623216 to VOTER
I20251023 07:59:02.900118 19193 consensus_queue.cc:237] T 931f55bec99140c69a4b5654b691c861 P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:02.906025 18786 raft_consensus.cc:1275] T 931f55bec99140c69a4b5654b691c861 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:59:02.906148 18248 raft_consensus.cc:1275] T 931f55bec99140c69a4b5654b691c861 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:59:02.906561 18101 raft_consensus.cc:1275] T 931f55bec99140c69a4b5654b691c861 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:59:02.908007 19068 consensus_queue.cc:1048] T 931f55bec99140c69a4b5654b691c861 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20251023 07:59:02.909107 19160 consensus_queue.cc:1048] T 931f55bec99140c69a4b5654b691c861 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20251023 07:59:02.911038 19094 consensus_queue.cc:1048] T 931f55bec99140c69a4b5654b691c861 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20251023 07:59:02.923864 19068 raft_consensus.cc:2955] T 931f55bec99140c69a4b5654b691c861 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:02.926107 18248 raft_consensus.cc:2955] T 931f55bec99140c69a4b5654b691c861 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:02.928821 18786 raft_consensus.cc:2955] T 931f55bec99140c69a4b5654b691c861 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:02.934564 18101 raft_consensus.cc:2955] T 931f55bec99140c69a4b5654b691c861 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:02.941835 18000 catalog_manager.cc:5649] T 931f55bec99140c69a4b5654b691c861 P 10dfae53d0c941f08bded43539841761 reported cstate change: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251023 07:59:02.967248 19196 raft_consensus.cc:1064] T 3e4d005972f44619b0cf23f4978f51c4 P 10dfae53d0c941f08bded43539841761: attempting to promote NON_VOTER d1a8f61d3323447282ee6068aa623216 to VOTER
I20251023 07:59:02.970328 19196 consensus_queue.cc:237] T 3e4d005972f44619b0cf23f4978f51c4 P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:02.979106 18786 raft_consensus.cc:1275] T 3e4d005972f44619b0cf23f4978f51c4 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:59:02.980373 18248 raft_consensus.cc:1275] T 3e4d005972f44619b0cf23f4978f51c4 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:59:02.984004 18174 consensus_queue.cc:237] T 931f55bec99140c69a4b5654b691c861 P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:02.984319 18101 raft_consensus.cc:1275] T 3e4d005972f44619b0cf23f4978f51c4 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:59:02.986150 19196 consensus_queue.cc:1048] T 3e4d005972f44619b0cf23f4978f51c4 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20251023 07:59:02.986934 19094 consensus_queue.cc:1048] T 3e4d005972f44619b0cf23f4978f51c4 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:59:02.987797 19193 consensus_queue.cc:1048] T 3e4d005972f44619b0cf23f4978f51c4 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:59:03.004361 18097 raft_consensus.cc:1275] T 931f55bec99140c69a4b5654b691c861 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251023 07:59:03.005843 19094 consensus_queue.cc:1048] T 931f55bec99140c69a4b5654b691c861 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:59:03.015168 18789 raft_consensus.cc:1275] T 931f55bec99140c69a4b5654b691c861 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251023 07:59:03.021729 19193 consensus_queue.cc:1048] T 931f55bec99140c69a4b5654b691c861 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20251023 07:59:03.036374 19094 raft_consensus.cc:2955] T 931f55bec99140c69a4b5654b691c861 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 982df35c5b554a8fa64807352c4f34ee (127.16.126.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:03.041385 19169 raft_consensus.cc:1064] T abefe27ebb4c4179a8620d4e638fe119 P 982df35c5b554a8fa64807352c4f34ee: attempting to promote NON_VOTER d1a8f61d3323447282ee6068aa623216 to VOTER
I20251023 07:59:03.045035 19169 consensus_queue.cc:237] T abefe27ebb4c4179a8620d4e638fe119 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:03.051177 19210 raft_consensus.cc:1064] T ce0069d7c0cf4dee84a85731209358f7 P 10dfae53d0c941f08bded43539841761: attempting to promote NON_VOTER d1a8f61d3323447282ee6068aa623216 to VOTER
I20251023 07:59:03.054237 19208 raft_consensus.cc:2955] T 3e4d005972f44619b0cf23f4978f51c4 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:03.056699 18101 raft_consensus.cc:2955] T 3e4d005972f44619b0cf23f4978f51c4 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:03.067374 18786 raft_consensus.cc:2955] T 931f55bec99140c69a4b5654b691c861 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 982df35c5b554a8fa64807352c4f34ee (127.16.126.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:03.067437 18787 raft_consensus.cc:2955] T 3e4d005972f44619b0cf23f4978f51c4 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:03.062623 19210 consensus_queue.cc:237] T ce0069d7c0cf4dee84a85731209358f7 P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:03.077847 18101 raft_consensus.cc:2955] T 931f55bec99140c69a4b5654b691c861 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 982df35c5b554a8fa64807352c4f34ee (127.16.126.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:03.084929 17998 catalog_manager.cc:5649] T 3e4d005972f44619b0cf23f4978f51c4 P b3a1328f9c8c484fab08292ce2171ec9 reported cstate change: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:03.097628 18246 raft_consensus.cc:2955] T 3e4d005972f44619b0cf23f4978f51c4 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:03.106994 17985 catalog_manager.cc:5162] ChangeConfig:REMOVE_PEER RPC for tablet 931f55bec99140c69a4b5654b691c861 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251023 07:59:03.117154 18786 raft_consensus.cc:1275] T ce0069d7c0cf4dee84a85731209358f7 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:59:03.117602 18101 raft_consensus.cc:1275] T ce0069d7c0cf4dee84a85731209358f7 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:59:03.117357 18173 consensus_queue.cc:237] T 3e4d005972f44619b0cf23f4978f51c4 P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:03.118964 19196 consensus_queue.cc:1048] T ce0069d7c0cf4dee84a85731209358f7 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:59:03.123622 18786 raft_consensus.cc:1275] T abefe27ebb4c4179a8620d4e638fe119 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:59:03.124562 19208 consensus_queue.cc:1048] T ce0069d7c0cf4dee84a85731209358f7 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:59:03.125116 19194 consensus_queue.cc:1048] T abefe27ebb4c4179a8620d4e638fe119 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20251023 07:59:03.130309 17999 catalog_manager.cc:5649] T 931f55bec99140c69a4b5654b691c861 P d1a8f61d3323447282ee6068aa623216 reported cstate change: config changed from index 3 to 4, VOTER 982df35c5b554a8fa64807352c4f34ee (127.16.126.3) evicted. New cstate: current_term: 1 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:03.148430 18248 raft_consensus.cc:1275] T ce0069d7c0cf4dee84a85731209358f7 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:59:03.148978 18174 raft_consensus.cc:1275] T abefe27ebb4c4179a8620d4e638fe119 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:59:03.153713 18102 raft_consensus.cc:1275] T abefe27ebb4c4179a8620d4e638fe119 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:59:03.154063 19094 consensus_queue.cc:1048] T ce0069d7c0cf4dee84a85731209358f7 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:59:03.156530 19194 consensus_queue.cc:1048] T abefe27ebb4c4179a8620d4e638fe119 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:59:03.163986 18787 raft_consensus.cc:1275] T 3e4d005972f44619b0cf23f4978f51c4 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251023 07:59:03.165552 19196 consensus_queue.cc:1048] T 3e4d005972f44619b0cf23f4978f51c4 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:59:03.165807 19169 consensus_queue.cc:1048] T abefe27ebb4c4179a8620d4e638fe119 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:59:03.171033 18247 raft_consensus.cc:1275] T 3e4d005972f44619b0cf23f4978f51c4 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251023 07:59:03.176513 19196 raft_consensus.cc:2955] T 3e4d005972f44619b0cf23f4978f51c4 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:03.183475 19208 consensus_queue.cc:1048] T 3e4d005972f44619b0cf23f4978f51c4 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20251023 07:59:03.221808 18248 raft_consensus.cc:2955] T 3e4d005972f44619b0cf23f4978f51c4 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:03.232894 18237 tablet_service.cc:1552] Processing DeleteTablet for tablet 931f55bec99140c69a4b5654b691c861 with delete_type TABLET_DATA_TOMBSTONED (TS 982df35c5b554a8fa64807352c4f34ee not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49846
I20251023 07:59:03.232831 18787 raft_consensus.cc:2955] T 3e4d005972f44619b0cf23f4978f51c4 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:03.251396 18000 catalog_manager.cc:5649] T 3e4d005972f44619b0cf23f4978f51c4 P d1a8f61d3323447282ee6068aa623216 reported cstate change: config changed from index 3 to 4, VOTER b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1) evicted. New cstate: current_term: 1 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:03.251443 19209 raft_consensus.cc:2955] T ce0069d7c0cf4dee84a85731209358f7 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:03.254519 17985 catalog_manager.cc:5162] ChangeConfig:REMOVE_PEER RPC for tablet 3e4d005972f44619b0cf23f4978f51c4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251023 07:59:03.288815 18086 tablet_service.cc:1552] Processing DeleteTablet for tablet 3e4d005972f44619b0cf23f4978f51c4 with delete_type TABLET_DATA_TOMBSTONED (TS b3a1328f9c8c484fab08292ce2171ec9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53940
I20251023 07:59:03.294183 18101 raft_consensus.cc:2955] T ce0069d7c0cf4dee84a85731209358f7 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:03.306090 18789 raft_consensus.cc:2955] T ce0069d7c0cf4dee84a85731209358f7 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:03.314030 17998 catalog_manager.cc:5649] T ce0069d7c0cf4dee84a85731209358f7 P 10dfae53d0c941f08bded43539841761 reported cstate change: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251023 07:59:03.326771 19169 raft_consensus.cc:2955] T abefe27ebb4c4179a8620d4e638fe119 P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
W20251023 07:59:03.346611 18215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.2:45799, user_credentials={real_user=slave}} blocked reactor thread for 77842us
W20251023 07:59:03.303007 19216 log.cc:927] Time spent T abefe27ebb4c4179a8620d4e638fe119 P d1a8f61d3323447282ee6068aa623216: Append to log took a long time: real 0.082s user 0.001s sys 0.000s
I20251023 07:59:03.349620 19221 tablet_replica.cc:333] T 931f55bec99140c69a4b5654b691c861 P 982df35c5b554a8fa64807352c4f34ee: stopping tablet replica
I20251023 07:59:03.355659 18786 raft_consensus.cc:2955] T abefe27ebb4c4179a8620d4e638fe119 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:03.354408 18170 consensus_queue.cc:237] T ce0069d7c0cf4dee84a85731209358f7 P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:03.344827 18102 raft_consensus.cc:2955] T abefe27ebb4c4179a8620d4e638fe119 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:03.366410 18097 raft_consensus.cc:1275] T ce0069d7c0cf4dee84a85731209358f7 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251023 07:59:03.368405 18789 raft_consensus.cc:1275] T ce0069d7c0cf4dee84a85731209358f7 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251023 07:59:03.367692 19196 consensus_queue.cc:1048] T ce0069d7c0cf4dee84a85731209358f7 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20251023 07:59:03.372879 18171 raft_consensus.cc:2955] T abefe27ebb4c4179a8620d4e638fe119 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:03.375680 19094 consensus_queue.cc:1048] T ce0069d7c0cf4dee84a85731209358f7 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:59:03.377960 19224 tablet_replica.cc:333] T 3e4d005972f44619b0cf23f4978f51c4 P b3a1328f9c8c484fab08292ce2171ec9: stopping tablet replica
I20251023 07:59:03.378507 19221 raft_consensus.cc:2243] T 931f55bec99140c69a4b5654b691c861 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:03.379333 19221 raft_consensus.cc:2272] T 931f55bec99140c69a4b5654b691c861 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:03.389355 19208 raft_consensus.cc:2955] T ce0069d7c0cf4dee84a85731209358f7 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 982df35c5b554a8fa64807352c4f34ee (127.16.126.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:03.391520 18789 raft_consensus.cc:2955] T ce0069d7c0cf4dee84a85731209358f7 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 982df35c5b554a8fa64807352c4f34ee (127.16.126.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:03.391661 18000 catalog_manager.cc:5649] T abefe27ebb4c4179a8620d4e638fe119 P d1a8f61d3323447282ee6068aa623216 reported cstate change: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "982df35c5b554a8fa64807352c4f34ee" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:03.396421 18097 raft_consensus.cc:2955] T ce0069d7c0cf4dee84a85731209358f7 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 982df35c5b554a8fa64807352c4f34ee (127.16.126.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:03.397503 19221 ts_tablet_manager.cc:1916] T 931f55bec99140c69a4b5654b691c861 P 982df35c5b554a8fa64807352c4f34ee: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251023 07:59:03.418202 19224 raft_consensus.cc:2243] T 3e4d005972f44619b0cf23f4978f51c4 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:03.416618 18000 catalog_manager.cc:5649] T ce0069d7c0cf4dee84a85731209358f7 P d1a8f61d3323447282ee6068aa623216 reported cstate change: config changed from index 3 to 4, VOTER 982df35c5b554a8fa64807352c4f34ee (127.16.126.3) evicted. New cstate: current_term: 1 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:03.418959 19224 raft_consensus.cc:2272] T 3e4d005972f44619b0cf23f4978f51c4 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:03.424640 19224 ts_tablet_manager.cc:1916] T 3e4d005972f44619b0cf23f4978f51c4 P b3a1328f9c8c484fab08292ce2171ec9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251023 07:59:03.427973 17985 catalog_manager.cc:5162] ChangeConfig:REMOVE_PEER RPC for tablet ce0069d7c0cf4dee84a85731209358f7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251023 07:59:03.445891 19221 ts_tablet_manager.cc:1929] T 931f55bec99140c69a4b5654b691c861 P 982df35c5b554a8fa64807352c4f34ee: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20251023 07:59:03.446467 19221 log.cc:1199] T 931f55bec99140c69a4b5654b691c861 P 982df35c5b554a8fa64807352c4f34ee: Deleting WAL directory at /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1761206251627710-16888-0/minicluster-data/ts-2-root/wals/931f55bec99140c69a4b5654b691c861
I20251023 07:59:03.452374 19224 ts_tablet_manager.cc:1929] T 3e4d005972f44619b0cf23f4978f51c4 P b3a1328f9c8c484fab08292ce2171ec9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20251023 07:59:03.454468 19224 log.cc:1199] T 3e4d005972f44619b0cf23f4978f51c4 P b3a1328f9c8c484fab08292ce2171ec9: Deleting WAL directory at /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1761206251627710-16888-0/minicluster-data/ts-0-root/wals/3e4d005972f44619b0cf23f4978f51c4
I20251023 07:59:03.457367 17987 catalog_manager.cc:4985] TS b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): tablet 3e4d005972f44619b0cf23f4978f51c4 (table test-workload [id=8bb191a5531a4d4fb58a25b13d592213]) successfully deleted
I20251023 07:59:03.460016 17986 catalog_manager.cc:4985] TS 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): tablet 931f55bec99140c69a4b5654b691c861 (table test-workload [id=8bb191a5531a4d4fb58a25b13d592213]) successfully deleted
I20251023 07:59:03.462128 18237 tablet_service.cc:1552] Processing DeleteTablet for tablet ce0069d7c0cf4dee84a85731209358f7 with delete_type TABLET_DATA_TOMBSTONED (TS 982df35c5b554a8fa64807352c4f34ee not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49846
I20251023 07:59:03.463081 19221 tablet_replica.cc:333] T ce0069d7c0cf4dee84a85731209358f7 P 982df35c5b554a8fa64807352c4f34ee: stopping tablet replica
I20251023 07:59:03.464087 19221 raft_consensus.cc:2243] T ce0069d7c0cf4dee84a85731209358f7 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:03.464709 19221 pending_rounds.cc:70] T ce0069d7c0cf4dee84a85731209358f7 P 982df35c5b554a8fa64807352c4f34ee: Trying to abort 1 pending ops.
I20251023 07:59:03.465031 19221 pending_rounds.cc:77] T ce0069d7c0cf4dee84a85731209358f7 P 982df35c5b554a8fa64807352c4f34ee: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7213901181143011328 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "ce0069d7c0cf4dee84a85731209358f7" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } } }
I20251023 07:59:03.466346 19221 raft_consensus.cc:2917] T ce0069d7c0cf4dee84a85731209358f7 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20251023 07:59:03.466826 19221 raft_consensus.cc:2889] T ce0069d7c0cf4dee84a85731209358f7 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20251023 07:59:03.467227 19221 raft_consensus.cc:2272] T ce0069d7c0cf4dee84a85731209358f7 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:03.471997 19221 ts_tablet_manager.cc:1916] T ce0069d7c0cf4dee84a85731209358f7 P 982df35c5b554a8fa64807352c4f34ee: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251023 07:59:03.475790 18246 consensus_queue.cc:237] T abefe27ebb4c4179a8620d4e638fe119 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:03.480010 18789 raft_consensus.cc:1275] T abefe27ebb4c4179a8620d4e638fe119 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251023 07:59:03.480921 18097 raft_consensus.cc:1275] T abefe27ebb4c4179a8620d4e638fe119 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251023 07:59:03.481707 19214 consensus_queue.cc:1048] T abefe27ebb4c4179a8620d4e638fe119 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20251023 07:59:03.482934 19169 consensus_queue.cc:1048] T abefe27ebb4c4179a8620d4e638fe119 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:59:03.491124 19221 ts_tablet_manager.cc:1929] T ce0069d7c0cf4dee84a85731209358f7 P 982df35c5b554a8fa64807352c4f34ee: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20251023 07:59:03.491698 19221 log.cc:1199] T ce0069d7c0cf4dee84a85731209358f7 P 982df35c5b554a8fa64807352c4f34ee: Deleting WAL directory at /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1761206251627710-16888-0/minicluster-data/ts-2-root/wals/ce0069d7c0cf4dee84a85731209358f7
I20251023 07:59:03.491493 19131 raft_consensus.cc:2955] T abefe27ebb4c4179a8620d4e638fe119 P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 10dfae53d0c941f08bded43539841761 (127.16.126.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:03.493196 17986 catalog_manager.cc:4985] TS 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): tablet ce0069d7c0cf4dee84a85731209358f7 (table test-workload [id=8bb191a5531a4d4fb58a25b13d592213]) successfully deleted
I20251023 07:59:03.497095 18097 raft_consensus.cc:2955] T abefe27ebb4c4179a8620d4e638fe119 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 10dfae53d0c941f08bded43539841761 (127.16.126.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:03.502305 17986 catalog_manager.cc:5162] ChangeConfig:REMOVE_PEER RPC for tablet abefe27ebb4c4179a8620d4e638fe119 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251023 07:59:03.509697 18789 raft_consensus.cc:2955] T abefe27ebb4c4179a8620d4e638fe119 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 10dfae53d0c941f08bded43539841761 (127.16.126.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:03.519312 18000 catalog_manager.cc:5649] T abefe27ebb4c4179a8620d4e638fe119 P 982df35c5b554a8fa64807352c4f34ee reported cstate change: config changed from index 3 to 4, VOTER 10dfae53d0c941f08bded43539841761 (127.16.126.2) evicted. New cstate: current_term: 1 leader_uuid: "982df35c5b554a8fa64807352c4f34ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251023 07:59:03.530966 18163 tablet_service.cc:1552] Processing DeleteTablet for tablet abefe27ebb4c4179a8620d4e638fe119 with delete_type TABLET_DATA_TOMBSTONED (TS 10dfae53d0c941f08bded43539841761 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33428
I20251023 07:59:03.537539 19226 tablet_replica.cc:333] T abefe27ebb4c4179a8620d4e638fe119 P 10dfae53d0c941f08bded43539841761: stopping tablet replica
I20251023 07:59:03.538491 19226 raft_consensus.cc:2243] T abefe27ebb4c4179a8620d4e638fe119 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:03.539189 19226 raft_consensus.cc:2272] T abefe27ebb4c4179a8620d4e638fe119 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:03.544548 19226 ts_tablet_manager.cc:1916] T abefe27ebb4c4179a8620d4e638fe119 P 10dfae53d0c941f08bded43539841761: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251023 07:59:03.557529 19226 ts_tablet_manager.cc:1929] T abefe27ebb4c4179a8620d4e638fe119 P 10dfae53d0c941f08bded43539841761: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20251023 07:59:03.557874 19226 log.cc:1199] T abefe27ebb4c4179a8620d4e638fe119 P 10dfae53d0c941f08bded43539841761: Deleting WAL directory at /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1761206251627710-16888-0/minicluster-data/ts-1-root/wals/abefe27ebb4c4179a8620d4e638fe119
I20251023 07:59:03.559307 17985 catalog_manager.cc:4985] TS 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): tablet abefe27ebb4c4179a8620d4e638fe119 (table test-workload [id=8bb191a5531a4d4fb58a25b13d592213]) successfully deleted
I20251023 07:59:04.584476 18097 consensus_queue.cc:237] T 5939b6a960ea4b0581b61ccdcdfa7c37 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:59:04.591327 18246 raft_consensus.cc:1275] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20251023 07:59:04.591583 18067 consensus_peers.cc:597] T 5939b6a960ea4b0581b61ccdcdfa7c37 P b3a1328f9c8c484fab08292ce2171ec9 -> Peer d1a8f61d3323447282ee6068aa623216 (127.16.126.4:33293): Couldn't send request to peer d1a8f61d3323447282ee6068aa623216. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5939b6a960ea4b0581b61ccdcdfa7c37. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:04.591815 18173 raft_consensus.cc:1275] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251023 07:59:04.592792 19152 consensus_queue.cc:1048] T 5939b6a960ea4b0581b61ccdcdfa7c37 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:04.594002 19230 consensus_queue.cc:1048] T 5939b6a960ea4b0581b61ccdcdfa7c37 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:04.599895 19152 raft_consensus.cc:2955] T 5939b6a960ea4b0581b61ccdcdfa7c37 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:04.602536 18246 raft_consensus.cc:2955] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:04.604653 18173 raft_consensus.cc:2955] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:04.618849 17998 catalog_manager.cc:5649] T 5939b6a960ea4b0581b61ccdcdfa7c37 P b3a1328f9c8c484fab08292ce2171ec9 reported cstate change: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New cstate: current_term: 1 leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:04.624753 18246 consensus_queue.cc:237] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:59:04.635241 18097 raft_consensus.cc:1275] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20251023 07:59:04.635388 18216 consensus_peers.cc:597] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 982df35c5b554a8fa64807352c4f34ee -> Peer d1a8f61d3323447282ee6068aa623216 (127.16.126.4:33293): Couldn't send request to peer d1a8f61d3323447282ee6068aa623216. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 290b1b1fd4ef42cf9f0b285d4bf5ed36. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:04.636600 19214 consensus_queue.cc:1048] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:04.637209 18173 raft_consensus.cc:1275] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251023 07:59:04.638718 19131 consensus_queue.cc:1048] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:04.657369 19131 raft_consensus.cc:2955] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:04.661469 18171 raft_consensus.cc:2955] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:04.666450 18097 raft_consensus.cc:2955] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:04.679693 18246 consensus_queue.cc:237] T e99e859ac34a47c4b2859ec2638d17e5 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:59:04.684098 18000 catalog_manager.cc:5649] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 982df35c5b554a8fa64807352c4f34ee reported cstate change: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New cstate: current_term: 1 leader_uuid: "982df35c5b554a8fa64807352c4f34ee" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20251023 07:59:04.688442 18216 consensus_peers.cc:597] T e99e859ac34a47c4b2859ec2638d17e5 P 982df35c5b554a8fa64807352c4f34ee -> Peer d1a8f61d3323447282ee6068aa623216 (127.16.126.4:33293): Couldn't send request to peer d1a8f61d3323447282ee6068aa623216. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e99e859ac34a47c4b2859ec2638d17e5. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:04.690605 18097 raft_consensus.cc:1275] T e99e859ac34a47c4b2859ec2638d17e5 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251023 07:59:04.692034 18171 raft_consensus.cc:1275] T e99e859ac34a47c4b2859ec2638d17e5 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251023 07:59:04.692041 19214 consensus_queue.cc:1048] T e99e859ac34a47c4b2859ec2638d17e5 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20251023 07:59:04.693638 19131 consensus_queue.cc:1048] T e99e859ac34a47c4b2859ec2638d17e5 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:04.710011 19214 raft_consensus.cc:2955] T e99e859ac34a47c4b2859ec2638d17e5 P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:04.720103 18097 raft_consensus.cc:2955] T e99e859ac34a47c4b2859ec2638d17e5 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:04.722534 18102 consensus_queue.cc:237] T 744a3368282b44d9b9618922875d20d3 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:59:04.720471 18171 raft_consensus.cc:2955] T e99e859ac34a47c4b2859ec2638d17e5 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:04.729630 18000 catalog_manager.cc:5649] T e99e859ac34a47c4b2859ec2638d17e5 P 982df35c5b554a8fa64807352c4f34ee reported cstate change: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New cstate: current_term: 1 leader_uuid: "982df35c5b554a8fa64807352c4f34ee" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20251023 07:59:04.748528 18067 consensus_peers.cc:597] T 744a3368282b44d9b9618922875d20d3 P b3a1328f9c8c484fab08292ce2171ec9 -> Peer d1a8f61d3323447282ee6068aa623216 (127.16.126.4:33293): Couldn't send request to peer d1a8f61d3323447282ee6068aa623216. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 744a3368282b44d9b9618922875d20d3. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:04.751330 18244 raft_consensus.cc:1275] T 744a3368282b44d9b9618922875d20d3 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251023 07:59:04.753528 18171 raft_consensus.cc:1275] T 744a3368282b44d9b9618922875d20d3 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251023 07:59:04.755146 19152 consensus_queue.cc:1048] T 744a3368282b44d9b9618922875d20d3 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:04.756723 19230 consensus_queue.cc:1048] T 744a3368282b44d9b9618922875d20d3 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:04.776137 19141 raft_consensus.cc:2955] T 744a3368282b44d9b9618922875d20d3 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:04.778199 18244 raft_consensus.cc:2955] T 744a3368282b44d9b9618922875d20d3 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:04.777882 18170 raft_consensus.cc:2955] T 744a3368282b44d9b9618922875d20d3 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:04.794736 18000 catalog_manager.cc:5649] T 744a3368282b44d9b9618922875d20d3 P 982df35c5b554a8fa64807352c4f34ee reported cstate change: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New cstate: current_term: 1 leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:05.025102 19249 ts_tablet_manager.cc:933] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P d1a8f61d3323447282ee6068aa623216: Initiating tablet copy from peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:59:05.027187 19249 tablet_copy_client.cc:323] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P d1a8f61d3323447282ee6068aa623216: tablet copy: Beginning tablet copy session from remote peer at address 127.16.126.3:46061
I20251023 07:59:05.029181 18261 tablet_copy_service.cc:140] P 982df35c5b554a8fa64807352c4f34ee: Received BeginTabletCopySession request for tablet 290b1b1fd4ef42cf9f0b285d4bf5ed36 from peer d1a8f61d3323447282ee6068aa623216 ({username='slave'} at 127.0.0.1:40260)
I20251023 07:59:05.029783 18261 tablet_copy_service.cc:161] P 982df35c5b554a8fa64807352c4f34ee: Beginning new tablet copy session on tablet 290b1b1fd4ef42cf9f0b285d4bf5ed36 from peer d1a8f61d3323447282ee6068aa623216 at {username='slave'} at 127.0.0.1:40260: session id = d1a8f61d3323447282ee6068aa623216-290b1b1fd4ef42cf9f0b285d4bf5ed36
I20251023 07:59:05.037379 18261 tablet_copy_source_session.cc:215] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 982df35c5b554a8fa64807352c4f34ee: Tablet Copy: opened 0 blocks and 1 log segments
I20251023 07:59:05.040675 19249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 290b1b1fd4ef42cf9f0b285d4bf5ed36. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:05.055208 19249 tablet_copy_client.cc:806] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 0 data blocks...
I20251023 07:59:05.055840 19249 tablet_copy_client.cc:670] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 1 WAL segments...
I20251023 07:59:05.060320 19249 tablet_copy_client.cc:538] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P d1a8f61d3323447282ee6068aa623216: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251023 07:59:05.071429 19249 tablet_bootstrap.cc:492] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P d1a8f61d3323447282ee6068aa623216: Bootstrap starting.
I20251023 07:59:05.080509 19252 ts_tablet_manager.cc:933] T e99e859ac34a47c4b2859ec2638d17e5 P d1a8f61d3323447282ee6068aa623216: Initiating tablet copy from peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:59:05.090188 19252 tablet_copy_client.cc:323] T e99e859ac34a47c4b2859ec2638d17e5 P d1a8f61d3323447282ee6068aa623216: tablet copy: Beginning tablet copy session from remote peer at address 127.16.126.3:46061
I20251023 07:59:05.091846 18261 tablet_copy_service.cc:140] P 982df35c5b554a8fa64807352c4f34ee: Received BeginTabletCopySession request for tablet e99e859ac34a47c4b2859ec2638d17e5 from peer d1a8f61d3323447282ee6068aa623216 ({username='slave'} at 127.0.0.1:40260)
I20251023 07:59:05.092398 18261 tablet_copy_service.cc:161] P 982df35c5b554a8fa64807352c4f34ee: Beginning new tablet copy session on tablet e99e859ac34a47c4b2859ec2638d17e5 from peer d1a8f61d3323447282ee6068aa623216 at {username='slave'} at 127.0.0.1:40260: session id = d1a8f61d3323447282ee6068aa623216-e99e859ac34a47c4b2859ec2638d17e5
I20251023 07:59:05.095253 19249 tablet_bootstrap.cc:492] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P d1a8f61d3323447282ee6068aa623216: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:59:05.095999 19249 tablet_bootstrap.cc:492] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P d1a8f61d3323447282ee6068aa623216: Bootstrap complete.
I20251023 07:59:05.096499 19249 ts_tablet_manager.cc:1403] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P d1a8f61d3323447282ee6068aa623216: Time spent bootstrapping tablet: real 0.025s user 0.014s sys 0.008s
I20251023 07:59:05.099267 19249 raft_consensus.cc:359] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:59:05.100190 19249 raft_consensus.cc:740] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d1a8f61d3323447282ee6068aa623216, State: Initialized, Role: LEARNER
I20251023 07:59:05.100925 19249 consensus_queue.cc:260] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P d1a8f61d3323447282ee6068aa623216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:59:05.103233 18261 tablet_copy_source_session.cc:215] T e99e859ac34a47c4b2859ec2638d17e5 P 982df35c5b554a8fa64807352c4f34ee: Tablet Copy: opened 0 blocks and 1 log segments
I20251023 07:59:05.107517 19249 ts_tablet_manager.cc:1434] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P d1a8f61d3323447282ee6068aa623216: Time spent starting tablet: real 0.011s user 0.008s sys 0.003s
I20251023 07:59:05.109509 19252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e99e859ac34a47c4b2859ec2638d17e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:05.111447 18261 tablet_copy_service.cc:342] P 982df35c5b554a8fa64807352c4f34ee: Request end of tablet copy session d1a8f61d3323447282ee6068aa623216-290b1b1fd4ef42cf9f0b285d4bf5ed36 received from {username='slave'} at 127.0.0.1:40260
I20251023 07:59:05.111857 18261 tablet_copy_service.cc:434] P 982df35c5b554a8fa64807352c4f34ee: ending tablet copy session d1a8f61d3323447282ee6068aa623216-290b1b1fd4ef42cf9f0b285d4bf5ed36 on tablet 290b1b1fd4ef42cf9f0b285d4bf5ed36 with peer d1a8f61d3323447282ee6068aa623216
I20251023 07:59:05.125362 19252 tablet_copy_client.cc:806] T e99e859ac34a47c4b2859ec2638d17e5 P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 0 data blocks...
I20251023 07:59:05.126114 19252 tablet_copy_client.cc:670] T e99e859ac34a47c4b2859ec2638d17e5 P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 1 WAL segments...
I20251023 07:59:05.130132 19252 tablet_copy_client.cc:538] T e99e859ac34a47c4b2859ec2638d17e5 P d1a8f61d3323447282ee6068aa623216: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251023 07:59:05.139585 19252 tablet_bootstrap.cc:492] T e99e859ac34a47c4b2859ec2638d17e5 P d1a8f61d3323447282ee6068aa623216: Bootstrap starting.
I20251023 07:59:05.159047 19252 tablet_bootstrap.cc:492] T e99e859ac34a47c4b2859ec2638d17e5 P d1a8f61d3323447282ee6068aa623216: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:59:05.159739 19252 tablet_bootstrap.cc:492] T e99e859ac34a47c4b2859ec2638d17e5 P d1a8f61d3323447282ee6068aa623216: Bootstrap complete.
I20251023 07:59:05.160356 19252 ts_tablet_manager.cc:1403] T e99e859ac34a47c4b2859ec2638d17e5 P d1a8f61d3323447282ee6068aa623216: Time spent bootstrapping tablet: real 0.021s user 0.017s sys 0.001s
I20251023 07:59:05.163344 19252 raft_consensus.cc:359] T e99e859ac34a47c4b2859ec2638d17e5 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:59:05.164484 19252 raft_consensus.cc:740] T e99e859ac34a47c4b2859ec2638d17e5 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d1a8f61d3323447282ee6068aa623216, State: Initialized, Role: LEARNER
I20251023 07:59:05.166199 19252 consensus_queue.cc:260] T e99e859ac34a47c4b2859ec2638d17e5 P d1a8f61d3323447282ee6068aa623216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:59:05.168803 19252 ts_tablet_manager.cc:1434] T e99e859ac34a47c4b2859ec2638d17e5 P d1a8f61d3323447282ee6068aa623216: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20251023 07:59:05.172518 18261 tablet_copy_service.cc:342] P 982df35c5b554a8fa64807352c4f34ee: Request end of tablet copy session d1a8f61d3323447282ee6068aa623216-e99e859ac34a47c4b2859ec2638d17e5 received from {username='slave'} at 127.0.0.1:40260
I20251023 07:59:05.172937 18261 tablet_copy_service.cc:434] P 982df35c5b554a8fa64807352c4f34ee: ending tablet copy session d1a8f61d3323447282ee6068aa623216-e99e859ac34a47c4b2859ec2638d17e5 on tablet e99e859ac34a47c4b2859ec2638d17e5 with peer d1a8f61d3323447282ee6068aa623216
I20251023 07:59:05.185104 19252 ts_tablet_manager.cc:933] T 744a3368282b44d9b9618922875d20d3 P d1a8f61d3323447282ee6068aa623216: Initiating tablet copy from peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025)
I20251023 07:59:05.190189 19252 tablet_copy_client.cc:323] T 744a3368282b44d9b9618922875d20d3 P d1a8f61d3323447282ee6068aa623216: tablet copy: Beginning tablet copy session from remote peer at address 127.16.126.1:44025
I20251023 07:59:05.192283 19249 ts_tablet_manager.cc:933] T 5939b6a960ea4b0581b61ccdcdfa7c37 P d1a8f61d3323447282ee6068aa623216: Initiating tablet copy from peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025)
I20251023 07:59:05.194296 18112 tablet_copy_service.cc:140] P b3a1328f9c8c484fab08292ce2171ec9: Received BeginTabletCopySession request for tablet 744a3368282b44d9b9618922875d20d3 from peer d1a8f61d3323447282ee6068aa623216 ({username='slave'} at 127.0.0.1:57714)
I20251023 07:59:05.194792 19249 tablet_copy_client.cc:323] T 5939b6a960ea4b0581b61ccdcdfa7c37 P d1a8f61d3323447282ee6068aa623216: tablet copy: Beginning tablet copy session from remote peer at address 127.16.126.1:44025
I20251023 07:59:05.194857 18112 tablet_copy_service.cc:161] P b3a1328f9c8c484fab08292ce2171ec9: Beginning new tablet copy session on tablet 744a3368282b44d9b9618922875d20d3 from peer d1a8f61d3323447282ee6068aa623216 at {username='slave'} at 127.0.0.1:57714: session id = d1a8f61d3323447282ee6068aa623216-744a3368282b44d9b9618922875d20d3
I20251023 07:59:05.196442 18111 tablet_copy_service.cc:140] P b3a1328f9c8c484fab08292ce2171ec9: Received BeginTabletCopySession request for tablet 5939b6a960ea4b0581b61ccdcdfa7c37 from peer d1a8f61d3323447282ee6068aa623216 ({username='slave'} at 127.0.0.1:57714)
I20251023 07:59:05.196815 18111 tablet_copy_service.cc:161] P b3a1328f9c8c484fab08292ce2171ec9: Beginning new tablet copy session on tablet 5939b6a960ea4b0581b61ccdcdfa7c37 from peer d1a8f61d3323447282ee6068aa623216 at {username='slave'} at 127.0.0.1:57714: session id = d1a8f61d3323447282ee6068aa623216-5939b6a960ea4b0581b61ccdcdfa7c37
I20251023 07:59:05.203539 18112 tablet_copy_source_session.cc:215] T 744a3368282b44d9b9618922875d20d3 P b3a1328f9c8c484fab08292ce2171ec9: Tablet Copy: opened 0 blocks and 1 log segments
I20251023 07:59:05.206354 18111 tablet_copy_source_session.cc:215] T 5939b6a960ea4b0581b61ccdcdfa7c37 P b3a1328f9c8c484fab08292ce2171ec9: Tablet Copy: opened 0 blocks and 1 log segments
I20251023 07:59:05.210081 19252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 744a3368282b44d9b9618922875d20d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:05.210747 19249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5939b6a960ea4b0581b61ccdcdfa7c37. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:05.226234 19252 tablet_copy_client.cc:806] T 744a3368282b44d9b9618922875d20d3 P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 0 data blocks...
I20251023 07:59:05.226882 19252 tablet_copy_client.cc:670] T 744a3368282b44d9b9618922875d20d3 P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 1 WAL segments...
I20251023 07:59:05.231376 19252 tablet_copy_client.cc:538] T 744a3368282b44d9b9618922875d20d3 P d1a8f61d3323447282ee6068aa623216: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251023 07:59:05.235747 19249 tablet_copy_client.cc:806] T 5939b6a960ea4b0581b61ccdcdfa7c37 P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 0 data blocks...
I20251023 07:59:05.236425 19249 tablet_copy_client.cc:670] T 5939b6a960ea4b0581b61ccdcdfa7c37 P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 1 WAL segments...
I20251023 07:59:05.240108 19249 tablet_copy_client.cc:538] T 5939b6a960ea4b0581b61ccdcdfa7c37 P d1a8f61d3323447282ee6068aa623216: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251023 07:59:05.242355 19252 tablet_bootstrap.cc:492] T 744a3368282b44d9b9618922875d20d3 P d1a8f61d3323447282ee6068aa623216: Bootstrap starting.
I20251023 07:59:05.250370 19249 tablet_bootstrap.cc:492] T 5939b6a960ea4b0581b61ccdcdfa7c37 P d1a8f61d3323447282ee6068aa623216: Bootstrap starting.
I20251023 07:59:05.263551 19252 tablet_bootstrap.cc:492] T 744a3368282b44d9b9618922875d20d3 P d1a8f61d3323447282ee6068aa623216: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:59:05.265142 19252 tablet_bootstrap.cc:492] T 744a3368282b44d9b9618922875d20d3 P d1a8f61d3323447282ee6068aa623216: Bootstrap complete.
I20251023 07:59:05.265779 19252 ts_tablet_manager.cc:1403] T 744a3368282b44d9b9618922875d20d3 P d1a8f61d3323447282ee6068aa623216: Time spent bootstrapping tablet: real 0.024s user 0.016s sys 0.004s
I20251023 07:59:05.269860 19252 raft_consensus.cc:359] T 744a3368282b44d9b9618922875d20d3 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:59:05.271472 19252 raft_consensus.cc:740] T 744a3368282b44d9b9618922875d20d3 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d1a8f61d3323447282ee6068aa623216, State: Initialized, Role: LEARNER
I20251023 07:59:05.272002 19252 consensus_queue.cc:260] T 744a3368282b44d9b9618922875d20d3 P d1a8f61d3323447282ee6068aa623216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:59:05.274212 19252 ts_tablet_manager.cc:1434] T 744a3368282b44d9b9618922875d20d3 P d1a8f61d3323447282ee6068aa623216: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20251023 07:59:05.276026 18111 tablet_copy_service.cc:342] P b3a1328f9c8c484fab08292ce2171ec9: Request end of tablet copy session d1a8f61d3323447282ee6068aa623216-744a3368282b44d9b9618922875d20d3 received from {username='slave'} at 127.0.0.1:57714
I20251023 07:59:05.276383 18111 tablet_copy_service.cc:434] P b3a1328f9c8c484fab08292ce2171ec9: ending tablet copy session d1a8f61d3323447282ee6068aa623216-744a3368282b44d9b9618922875d20d3 on tablet 744a3368282b44d9b9618922875d20d3 with peer d1a8f61d3323447282ee6068aa623216
I20251023 07:59:05.279445 19249 tablet_bootstrap.cc:492] T 5939b6a960ea4b0581b61ccdcdfa7c37 P d1a8f61d3323447282ee6068aa623216: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:59:05.280354 19249 tablet_bootstrap.cc:492] T 5939b6a960ea4b0581b61ccdcdfa7c37 P d1a8f61d3323447282ee6068aa623216: Bootstrap complete.
I20251023 07:59:05.281060 19249 ts_tablet_manager.cc:1403] T 5939b6a960ea4b0581b61ccdcdfa7c37 P d1a8f61d3323447282ee6068aa623216: Time spent bootstrapping tablet: real 0.031s user 0.016s sys 0.005s
I20251023 07:59:05.283815 19249 raft_consensus.cc:359] T 5939b6a960ea4b0581b61ccdcdfa7c37 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:59:05.284762 19249 raft_consensus.cc:740] T 5939b6a960ea4b0581b61ccdcdfa7c37 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d1a8f61d3323447282ee6068aa623216, State: Initialized, Role: LEARNER
I20251023 07:59:05.285409 19249 consensus_queue.cc:260] T 5939b6a960ea4b0581b61ccdcdfa7c37 P d1a8f61d3323447282ee6068aa623216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:59:05.287822 19249 ts_tablet_manager.cc:1434] T 5939b6a960ea4b0581b61ccdcdfa7c37 P d1a8f61d3323447282ee6068aa623216: Time spent starting tablet: real 0.006s user 0.004s sys 0.004s
I20251023 07:59:05.289414 18111 tablet_copy_service.cc:342] P b3a1328f9c8c484fab08292ce2171ec9: Request end of tablet copy session d1a8f61d3323447282ee6068aa623216-5939b6a960ea4b0581b61ccdcdfa7c37 received from {username='slave'} at 127.0.0.1:57714
I20251023 07:59:05.289844 18111 tablet_copy_service.cc:434] P b3a1328f9c8c484fab08292ce2171ec9: ending tablet copy session d1a8f61d3323447282ee6068aa623216-5939b6a960ea4b0581b61ccdcdfa7c37 on tablet 5939b6a960ea4b0581b61ccdcdfa7c37 with peer d1a8f61d3323447282ee6068aa623216
I20251023 07:59:05.406507 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:59:05.475121 18171 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "063924334ed846f3bd41c36cc4651236"
dest_uuid: "10dfae53d0c941f08bded43539841761"
mode: GRACEFUL
new_leader_uuid: "d1a8f61d3323447282ee6068aa623216"
from {username='slave'} at 127.0.0.1:47396
I20251023 07:59:05.475871 18171 raft_consensus.cc:606] T 063924334ed846f3bd41c36cc4651236 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Received request to transfer leadership to TS d1a8f61d3323447282ee6068aa623216
I20251023 07:59:05.476944 19208 raft_consensus.cc:993] T 063924334ed846f3bd41c36cc4651236 P 10dfae53d0c941f08bded43539841761: : Instructing follower d1a8f61d3323447282ee6068aa623216 to start an election
I20251023 07:59:05.477659 19208 raft_consensus.cc:1081] T 063924334ed846f3bd41c36cc4651236 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Signalling peer d1a8f61d3323447282ee6068aa623216 to start an election
I20251023 07:59:05.478442 18786 raft_consensus.cc:1217] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20251023 07:59:05.479352 18789 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "063924334ed846f3bd41c36cc4651236"
dest_uuid: "d1a8f61d3323447282ee6068aa623216"
from {username='slave'} at 127.0.0.1:36500
I20251023 07:59:05.479956 18789 raft_consensus.cc:493] T 063924334ed846f3bd41c36cc4651236 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:59:05.480311 18789 raft_consensus.cc:3060] T 063924334ed846f3bd41c36cc4651236 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:05.491581 18789 raft_consensus.cc:515] T 063924334ed846f3bd41c36cc4651236 P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:05.494683 18171 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "063924334ed846f3bd41c36cc4651236" candidate_uuid: "d1a8f61d3323447282ee6068aa623216" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "10dfae53d0c941f08bded43539841761"
I20251023 07:59:05.495335 18171 raft_consensus.cc:3055] T 063924334ed846f3bd41c36cc4651236 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Stepping down as leader of term 1
I20251023 07:59:05.495625 18171 raft_consensus.cc:740] T 063924334ed846f3bd41c36cc4651236 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Running, Role: LEADER
I20251023 07:59:05.496260 18171 consensus_queue.cc:260] T 063924334ed846f3bd41c36cc4651236 P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:05.497275 18171 raft_consensus.cc:3060] T 063924334ed846f3bd41c36cc4651236 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:05.500255 18789 leader_election.cc:290] T 063924334ed846f3bd41c36cc4651236 P d1a8f61d3323447282ee6068aa623216 [CANDIDATE]: Term 2 election: Requested vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:59:05.502393 18247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "063924334ed846f3bd41c36cc4651236" candidate_uuid: "d1a8f61d3323447282ee6068aa623216" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
I20251023 07:59:05.502943 18247 raft_consensus.cc:3060] T 063924334ed846f3bd41c36cc4651236 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:05.509876 18247 raft_consensus.cc:2468] T 063924334ed846f3bd41c36cc4651236 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1a8f61d3323447282ee6068aa623216 in term 2.
I20251023 07:59:05.512729 18754 leader_election.cc:304] T 063924334ed846f3bd41c36cc4651236 P d1a8f61d3323447282ee6068aa623216 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee, d1a8f61d3323447282ee6068aa623216; no voters:
I20251023 07:59:05.513455 18171 raft_consensus.cc:2468] T 063924334ed846f3bd41c36cc4651236 P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1a8f61d3323447282ee6068aa623216 in term 2.
I20251023 07:59:05.514025 19255 raft_consensus.cc:2804] T 063924334ed846f3bd41c36cc4651236 P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:59:05.518337 18102 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "1f184d89e4244f12af7afd690bc7027d"
dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
mode: GRACEFUL
new_leader_uuid: "d1a8f61d3323447282ee6068aa623216"
from {username='slave'} at 127.0.0.1:34418
I20251023 07:59:05.518942 18102 raft_consensus.cc:606] T 1f184d89e4244f12af7afd690bc7027d P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Received request to transfer leadership to TS d1a8f61d3323447282ee6068aa623216
I20251023 07:59:05.522902 19255 raft_consensus.cc:697] T 063924334ed846f3bd41c36cc4651236 P d1a8f61d3323447282ee6068aa623216 [term 2 LEADER]: Becoming Leader. State: Replica: d1a8f61d3323447282ee6068aa623216, State: Running, Role: LEADER
I20251023 07:59:05.524896 18171 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "3e4d005972f44619b0cf23f4978f51c4"
dest_uuid: "10dfae53d0c941f08bded43539841761"
mode: GRACEFUL
new_leader_uuid: "d1a8f61d3323447282ee6068aa623216"
from {username='slave'} at 127.0.0.1:47396
I20251023 07:59:05.525512 18171 raft_consensus.cc:606] T 3e4d005972f44619b0cf23f4978f51c4 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Received request to transfer leadership to TS d1a8f61d3323447282ee6068aa623216
I20251023 07:59:05.523859 19255 consensus_queue.cc:237] T 063924334ed846f3bd41c36cc4651236 P d1a8f61d3323447282ee6068aa623216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:05.528849 18171 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "ce0069d7c0cf4dee84a85731209358f7"
dest_uuid: "10dfae53d0c941f08bded43539841761"
mode: GRACEFUL
new_leader_uuid: "d1a8f61d3323447282ee6068aa623216"
from {username='slave'} at 127.0.0.1:47396
I20251023 07:59:05.529479 18171 raft_consensus.cc:606] T ce0069d7c0cf4dee84a85731209358f7 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Received request to transfer leadership to TS d1a8f61d3323447282ee6068aa623216
I20251023 07:59:05.532110 18171 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "f90cf0955288472898eff5b7e6459195"
dest_uuid: "10dfae53d0c941f08bded43539841761"
mode: GRACEFUL
new_leader_uuid: "d1a8f61d3323447282ee6068aa623216"
from {username='slave'} at 127.0.0.1:47396
I20251023 07:59:05.532603 18171 raft_consensus.cc:606] T f90cf0955288472898eff5b7e6459195 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Received request to transfer leadership to TS d1a8f61d3323447282ee6068aa623216
I20251023 07:59:05.537101 17999 catalog_manager.cc:5649] T 063924334ed846f3bd41c36cc4651236 P d1a8f61d3323447282ee6068aa623216 reported cstate change: term changed from 1 to 2, leader changed from 10dfae53d0c941f08bded43539841761 (127.16.126.2) to d1a8f61d3323447282ee6068aa623216 (127.16.126.4). New cstate: current_term: 2 leader_uuid: "d1a8f61d3323447282ee6068aa623216" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251023 07:59:05.548687 18247 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "fe0293c22cae49cfa7cd698f17626a35"
dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
mode: GRACEFUL
new_leader_uuid: "10dfae53d0c941f08bded43539841761"
from {username='slave'} at 127.0.0.1:60948
I20251023 07:59:05.549299 18247 raft_consensus.cc:606] T fe0293c22cae49cfa7cd698f17626a35 P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Received request to transfer leadership to TS 10dfae53d0c941f08bded43539841761
I20251023 07:59:05.550534 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
I20251023 07:59:05.552276 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 07:59:05.553370 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:59:05.586980 19240 raft_consensus.cc:993] T fe0293c22cae49cfa7cd698f17626a35 P 982df35c5b554a8fa64807352c4f34ee: : Instructing follower 10dfae53d0c941f08bded43539841761 to start an election
I20251023 07:59:05.587800 19131 raft_consensus.cc:1081] T fe0293c22cae49cfa7cd698f17626a35 P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Signalling peer 10dfae53d0c941f08bded43539841761 to start an election
I20251023 07:59:05.590126 18171 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "fe0293c22cae49cfa7cd698f17626a35"
dest_uuid: "10dfae53d0c941f08bded43539841761"
from {username='slave'} at 127.0.0.1:51868
I20251023 07:59:05.590662 18171 raft_consensus.cc:493] T fe0293c22cae49cfa7cd698f17626a35 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:59:05.591106 18171 raft_consensus.cc:3060] T fe0293c22cae49cfa7cd698f17626a35 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:05.600111 18171 raft_consensus.cc:515] T fe0293c22cae49cfa7cd698f17626a35 P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:59:05.603557 18101 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe0293c22cae49cfa7cd698f17626a35" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
I20251023 07:59:05.607453 18789 raft_consensus.cc:1217] T 744a3368282b44d9b9618922875d20d3 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20251023 07:59:05.604166 18101 raft_consensus.cc:3060] T fe0293c22cae49cfa7cd698f17626a35 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:05.622220 18171 leader_election.cc:290] T fe0293c22cae49cfa7cd698f17626a35 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 2 election: Requested vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:59:05.625389 18101 raft_consensus.cc:2468] T fe0293c22cae49cfa7cd698f17626a35 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 2.
I20251023 07:59:05.629997 18143 leader_election.cc:304] T fe0293c22cae49cfa7cd698f17626a35 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:59:05.632166 19208 raft_consensus.cc:2804] T fe0293c22cae49cfa7cd698f17626a35 P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:59:05.633347 19208 raft_consensus.cc:697] T fe0293c22cae49cfa7cd698f17626a35 P 10dfae53d0c941f08bded43539841761 [term 2 LEADER]: Becoming Leader. State: Replica: 10dfae53d0c941f08bded43539841761, State: Running, Role: LEADER
I20251023 07:59:05.634336 19208 consensus_queue.cc:237] T fe0293c22cae49cfa7cd698f17626a35 P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:59:05.634630 18244 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe0293c22cae49cfa7cd698f17626a35" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
I20251023 07:59:05.635488 18244 raft_consensus.cc:3055] T fe0293c22cae49cfa7cd698f17626a35 P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Stepping down as leader of term 1
I20251023 07:59:05.635784 18244 raft_consensus.cc:740] T fe0293c22cae49cfa7cd698f17626a35 P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Running, Role: LEADER
I20251023 07:59:05.636513 18244 consensus_queue.cc:260] T fe0293c22cae49cfa7cd698f17626a35 P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:59:05.637573 18244 raft_consensus.cc:3060] T fe0293c22cae49cfa7cd698f17626a35 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:05.644485 18244 raft_consensus.cc:2468] T fe0293c22cae49cfa7cd698f17626a35 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 2.
I20251023 07:59:05.657588 17998 catalog_manager.cc:5649] T fe0293c22cae49cfa7cd698f17626a35 P 10dfae53d0c941f08bded43539841761 reported cstate change: term changed from 1 to 2, leader changed from 982df35c5b554a8fa64807352c4f34ee (127.16.126.3) to 10dfae53d0c941f08bded43539841761 (127.16.126.2). New cstate: current_term: 2 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:05.687925 18789 raft_consensus.cc:1217] T e99e859ac34a47c4b2859ec2638d17e5 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20251023 07:59:05.756023 19245 raft_consensus.cc:993] T 1f184d89e4244f12af7afd690bc7027d P b3a1328f9c8c484fab08292ce2171ec9: : Instructing follower d1a8f61d3323447282ee6068aa623216 to start an election
I20251023 07:59:05.756554 19245 raft_consensus.cc:1081] T 1f184d89e4244f12af7afd690bc7027d P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Signalling peer d1a8f61d3323447282ee6068aa623216 to start an election
I20251023 07:59:05.757978 18786 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "1f184d89e4244f12af7afd690bc7027d"
dest_uuid: "d1a8f61d3323447282ee6068aa623216"
from {username='slave'} at 127.0.0.1:36492
I20251023 07:59:05.758399 18786 raft_consensus.cc:493] T 1f184d89e4244f12af7afd690bc7027d P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:59:05.758656 18786 raft_consensus.cc:3060] T 1f184d89e4244f12af7afd690bc7027d P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:05.763639 18786 raft_consensus.cc:515] T 1f184d89e4244f12af7afd690bc7027d P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:05.765594 18786 leader_election.cc:290] T 1f184d89e4244f12af7afd690bc7027d P d1a8f61d3323447282ee6068aa623216 [CANDIDATE]: Term 2 election: Requested vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:59:05.766289 18101 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1f184d89e4244f12af7afd690bc7027d" candidate_uuid: "d1a8f61d3323447282ee6068aa623216" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
I20251023 07:59:05.766901 18101 raft_consensus.cc:3055] T 1f184d89e4244f12af7afd690bc7027d P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Stepping down as leader of term 1
I20251023 07:59:05.767189 18101 raft_consensus.cc:740] T 1f184d89e4244f12af7afd690bc7027d P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Running, Role: LEADER
I20251023 07:59:05.767056 18246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1f184d89e4244f12af7afd690bc7027d" candidate_uuid: "d1a8f61d3323447282ee6068aa623216" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
I20251023 07:59:05.767693 18246 raft_consensus.cc:3060] T 1f184d89e4244f12af7afd690bc7027d P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:05.767874 18101 consensus_queue.cc:260] T 1f184d89e4244f12af7afd690bc7027d P b3a1328f9c8c484fab08292ce2171ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:05.769261 18101 raft_consensus.cc:3060] T 1f184d89e4244f12af7afd690bc7027d P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:05.773070 18246 raft_consensus.cc:2468] T 1f184d89e4244f12af7afd690bc7027d P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1a8f61d3323447282ee6068aa623216 in term 2.
I20251023 07:59:05.774681 18754 leader_election.cc:304] T 1f184d89e4244f12af7afd690bc7027d P d1a8f61d3323447282ee6068aa623216 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee, d1a8f61d3323447282ee6068aa623216; no voters:
I20251023 07:59:05.775393 19255 raft_consensus.cc:2804] T 1f184d89e4244f12af7afd690bc7027d P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:59:05.775879 19255 raft_consensus.cc:697] T 1f184d89e4244f12af7afd690bc7027d P d1a8f61d3323447282ee6068aa623216 [term 2 LEADER]: Becoming Leader. State: Replica: d1a8f61d3323447282ee6068aa623216, State: Running, Role: LEADER
I20251023 07:59:05.776505 19255 consensus_queue.cc:237] T 1f184d89e4244f12af7afd690bc7027d P d1a8f61d3323447282ee6068aa623216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:05.777171 18101 raft_consensus.cc:2468] T 1f184d89e4244f12af7afd690bc7027d P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1a8f61d3323447282ee6068aa623216 in term 2.
I20251023 07:59:05.786576 19251 raft_consensus.cc:993] T ce0069d7c0cf4dee84a85731209358f7 P 10dfae53d0c941f08bded43539841761: : Instructing follower d1a8f61d3323447282ee6068aa623216 to start an election
I20251023 07:59:05.787129 19251 raft_consensus.cc:1081] T ce0069d7c0cf4dee84a85731209358f7 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Signalling peer d1a8f61d3323447282ee6068aa623216 to start an election
I20251023 07:59:05.788558 18786 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "ce0069d7c0cf4dee84a85731209358f7"
dest_uuid: "d1a8f61d3323447282ee6068aa623216"
from {username='slave'} at 127.0.0.1:36500
I20251023 07:59:05.789068 18786 raft_consensus.cc:493] T ce0069d7c0cf4dee84a85731209358f7 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:59:05.789460 18786 raft_consensus.cc:3060] T ce0069d7c0cf4dee84a85731209358f7 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:05.789212 17998 catalog_manager.cc:5649] T 1f184d89e4244f12af7afd690bc7027d P d1a8f61d3323447282ee6068aa623216 reported cstate change: term changed from 1 to 2, leader changed from b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1) to d1a8f61d3323447282ee6068aa623216 (127.16.126.4). New cstate: current_term: 2 leader_uuid: "d1a8f61d3323447282ee6068aa623216" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251023 07:59:05.798205 19251 raft_consensus.cc:993] T 3e4d005972f44619b0cf23f4978f51c4 P 10dfae53d0c941f08bded43539841761: : Instructing follower d1a8f61d3323447282ee6068aa623216 to start an election
I20251023 07:59:05.798779 19251 raft_consensus.cc:1081] T 3e4d005972f44619b0cf23f4978f51c4 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Signalling peer d1a8f61d3323447282ee6068aa623216 to start an election
I20251023 07:59:05.800345 18789 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "3e4d005972f44619b0cf23f4978f51c4"
dest_uuid: "d1a8f61d3323447282ee6068aa623216"
from {username='slave'} at 127.0.0.1:36500
I20251023 07:59:05.800794 18789 raft_consensus.cc:493] T 3e4d005972f44619b0cf23f4978f51c4 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:59:05.801141 18789 raft_consensus.cc:3060] T 3e4d005972f44619b0cf23f4978f51c4 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:05.805063 18786 raft_consensus.cc:515] T ce0069d7c0cf4dee84a85731209358f7 P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:05.807583 18786 leader_election.cc:290] T ce0069d7c0cf4dee84a85731209358f7 P d1a8f61d3323447282ee6068aa623216 [CANDIDATE]: Term 2 election: Requested vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:59:05.808230 18173 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce0069d7c0cf4dee84a85731209358f7" candidate_uuid: "d1a8f61d3323447282ee6068aa623216" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "10dfae53d0c941f08bded43539841761"
I20251023 07:59:05.808086 18789 raft_consensus.cc:515] T 3e4d005972f44619b0cf23f4978f51c4 P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:05.808866 18173 raft_consensus.cc:3055] T ce0069d7c0cf4dee84a85731209358f7 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Stepping down as leader of term 1
I20251023 07:59:05.812975 18173 raft_consensus.cc:740] T ce0069d7c0cf4dee84a85731209358f7 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Running, Role: LEADER
I20251023 07:59:05.813760 18173 consensus_queue.cc:260] T ce0069d7c0cf4dee84a85731209358f7 P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:05.815119 18173 raft_consensus.cc:3060] T ce0069d7c0cf4dee84a85731209358f7 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:05.810160 18789 leader_election.cc:290] T 3e4d005972f44619b0cf23f4978f51c4 P d1a8f61d3323447282ee6068aa623216 [CANDIDATE]: Term 2 election: Requested vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:59:05.811086 18786 raft_consensus.cc:1217] T 5939b6a960ea4b0581b61ccdcdfa7c37 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20251023 07:59:05.812157 18171 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3e4d005972f44619b0cf23f4978f51c4" candidate_uuid: "d1a8f61d3323447282ee6068aa623216" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "10dfae53d0c941f08bded43539841761"
I20251023 07:59:05.821702 18171 raft_consensus.cc:3055] T 3e4d005972f44619b0cf23f4978f51c4 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Stepping down as leader of term 1
I20251023 07:59:05.822005 18171 raft_consensus.cc:740] T 3e4d005972f44619b0cf23f4978f51c4 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Running, Role: LEADER
I20251023 07:59:05.822623 18171 consensus_queue.cc:260] T 3e4d005972f44619b0cf23f4978f51c4 P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:05.823519 18171 raft_consensus.cc:3060] T 3e4d005972f44619b0cf23f4978f51c4 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:05.810782 18101 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce0069d7c0cf4dee84a85731209358f7" candidate_uuid: "d1a8f61d3323447282ee6068aa623216" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
I20251023 07:59:05.826031 18101 raft_consensus.cc:3060] T ce0069d7c0cf4dee84a85731209358f7 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:05.811456 18246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3e4d005972f44619b0cf23f4978f51c4" candidate_uuid: "d1a8f61d3323447282ee6068aa623216" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
I20251023 07:59:05.827178 18246 raft_consensus.cc:3060] T 3e4d005972f44619b0cf23f4978f51c4 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:05.832516 18101 raft_consensus.cc:2468] T ce0069d7c0cf4dee84a85731209358f7 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1a8f61d3323447282ee6068aa623216 in term 2.
I20251023 07:59:05.833575 18246 raft_consensus.cc:2468] T 3e4d005972f44619b0cf23f4978f51c4 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1a8f61d3323447282ee6068aa623216 in term 2.
I20251023 07:59:05.834347 18755 leader_election.cc:304] T ce0069d7c0cf4dee84a85731209358f7 P d1a8f61d3323447282ee6068aa623216 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3a1328f9c8c484fab08292ce2171ec9, d1a8f61d3323447282ee6068aa623216; no voters:
I20251023 07:59:05.835753 19255 raft_consensus.cc:2804] T ce0069d7c0cf4dee84a85731209358f7 P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:59:05.836263 19255 raft_consensus.cc:697] T ce0069d7c0cf4dee84a85731209358f7 P d1a8f61d3323447282ee6068aa623216 [term 2 LEADER]: Becoming Leader. State: Replica: d1a8f61d3323447282ee6068aa623216, State: Running, Role: LEADER
I20251023 07:59:05.837152 19255 consensus_queue.cc:237] T ce0069d7c0cf4dee84a85731209358f7 P d1a8f61d3323447282ee6068aa623216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:05.839048 18171 raft_consensus.cc:2468] T 3e4d005972f44619b0cf23f4978f51c4 P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1a8f61d3323447282ee6068aa623216 in term 2.
I20251023 07:59:05.840109 18753 leader_election.cc:304] T 3e4d005972f44619b0cf23f4978f51c4 P d1a8f61d3323447282ee6068aa623216 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, d1a8f61d3323447282ee6068aa623216; no voters:
I20251023 07:59:05.840842 19264 raft_consensus.cc:2804] T 3e4d005972f44619b0cf23f4978f51c4 P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:59:05.842696 19264 raft_consensus.cc:697] T 3e4d005972f44619b0cf23f4978f51c4 P d1a8f61d3323447282ee6068aa623216 [term 2 LEADER]: Becoming Leader. State: Replica: d1a8f61d3323447282ee6068aa623216, State: Running, Role: LEADER
I20251023 07:59:05.843509 19264 consensus_queue.cc:237] T 3e4d005972f44619b0cf23f4978f51c4 P d1a8f61d3323447282ee6068aa623216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:05.845822 18173 raft_consensus.cc:2468] T ce0069d7c0cf4dee84a85731209358f7 P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1a8f61d3323447282ee6068aa623216 in term 2.
I20251023 07:59:05.855327 19208 raft_consensus.cc:993] T f90cf0955288472898eff5b7e6459195 P 10dfae53d0c941f08bded43539841761: : Instructing follower d1a8f61d3323447282ee6068aa623216 to start an election
I20251023 07:59:05.855717 19208 raft_consensus.cc:1081] T f90cf0955288472898eff5b7e6459195 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Signalling peer d1a8f61d3323447282ee6068aa623216 to start an election
I20251023 07:59:05.856251 19131 raft_consensus.cc:1064] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 982df35c5b554a8fa64807352c4f34ee: attempting to promote NON_VOTER d1a8f61d3323447282ee6068aa623216 to VOTER
I20251023 07:59:05.857158 18786 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "f90cf0955288472898eff5b7e6459195"
dest_uuid: "d1a8f61d3323447282ee6068aa623216"
from {username='slave'} at 127.0.0.1:36500
I20251023 07:59:05.857908 18786 raft_consensus.cc:493] T f90cf0955288472898eff5b7e6459195 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:59:05.858465 19131 consensus_queue.cc:237] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:05.859220 18786 raft_consensus.cc:3060] T f90cf0955288472898eff5b7e6459195 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:05.867728 18786 raft_consensus.cc:515] T f90cf0955288472898eff5b7e6459195 P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:05.870393 18101 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f90cf0955288472898eff5b7e6459195" candidate_uuid: "d1a8f61d3323447282ee6068aa623216" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
I20251023 07:59:05.870602 18173 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f90cf0955288472898eff5b7e6459195" candidate_uuid: "d1a8f61d3323447282ee6068aa623216" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "10dfae53d0c941f08bded43539841761"
I20251023 07:59:05.870982 18101 raft_consensus.cc:3060] T f90cf0955288472898eff5b7e6459195 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:05.871130 18173 raft_consensus.cc:3055] T f90cf0955288472898eff5b7e6459195 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Stepping down as leader of term 1
I20251023 07:59:05.871855 18173 raft_consensus.cc:740] T f90cf0955288472898eff5b7e6459195 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Running, Role: LEADER
I20251023 07:59:05.872551 18173 consensus_queue.cc:260] T f90cf0955288472898eff5b7e6459195 P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:05.873605 18173 raft_consensus.cc:3060] T f90cf0955288472898eff5b7e6459195 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:05.874642 17998 catalog_manager.cc:5649] T ce0069d7c0cf4dee84a85731209358f7 P d1a8f61d3323447282ee6068aa623216 reported cstate change: term changed from 1 to 2, leader changed from 10dfae53d0c941f08bded43539841761 (127.16.126.2) to d1a8f61d3323447282ee6068aa623216 (127.16.126.4). New cstate: current_term: 2 leader_uuid: "d1a8f61d3323447282ee6068aa623216" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251023 07:59:05.876237 18170 raft_consensus.cc:1275] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:59:05.877619 18101 raft_consensus.cc:2468] T f90cf0955288472898eff5b7e6459195 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1a8f61d3323447282ee6068aa623216 in term 2.
I20251023 07:59:05.877977 19131 consensus_queue.cc:1048] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:59:05.878880 18755 leader_election.cc:304] T f90cf0955288472898eff5b7e6459195 P d1a8f61d3323447282ee6068aa623216 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3a1328f9c8c484fab08292ce2171ec9, d1a8f61d3323447282ee6068aa623216; no voters:
I20251023 07:59:05.879165 18786 leader_election.cc:290] T f90cf0955288472898eff5b7e6459195 P d1a8f61d3323447282ee6068aa623216 [CANDIDATE]: Term 2 election: Requested vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:59:05.879345 18789 raft_consensus.cc:1275] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:59:05.880658 19255 raft_consensus.cc:2804] T f90cf0955288472898eff5b7e6459195 P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:59:05.881174 19255 raft_consensus.cc:697] T f90cf0955288472898eff5b7e6459195 P d1a8f61d3323447282ee6068aa623216 [term 2 LEADER]: Becoming Leader. State: Replica: d1a8f61d3323447282ee6068aa623216, State: Running, Role: LEADER
I20251023 07:59:05.882040 19255 consensus_queue.cc:237] T f90cf0955288472898eff5b7e6459195 P d1a8f61d3323447282ee6068aa623216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:05.882632 18101 raft_consensus.cc:1275] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:59:05.883267 18173 raft_consensus.cc:2468] T f90cf0955288472898eff5b7e6459195 P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1a8f61d3323447282ee6068aa623216 in term 2.
I20251023 07:59:05.885520 19214 consensus_queue.cc:1048] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:59:05.886358 19240 consensus_queue.cc:1048] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:59:05.903157 17999 catalog_manager.cc:5649] T 3e4d005972f44619b0cf23f4978f51c4 P d1a8f61d3323447282ee6068aa623216 reported cstate change: term changed from 1 to 2, leader changed from 10dfae53d0c941f08bded43539841761 (127.16.126.2) to d1a8f61d3323447282ee6068aa623216 (127.16.126.4). New cstate: current_term: 2 leader_uuid: "d1a8f61d3323447282ee6068aa623216" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251023 07:59:05.904531 17999 catalog_manager.cc:5649] T f90cf0955288472898eff5b7e6459195 P d1a8f61d3323447282ee6068aa623216 reported cstate change: term changed from 1 to 2, leader changed from 10dfae53d0c941f08bded43539841761 (127.16.126.2) to d1a8f61d3323447282ee6068aa623216 (127.16.126.4). New cstate: current_term: 2 leader_uuid: "d1a8f61d3323447282ee6068aa623216" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251023 07:59:05.920689 19240 raft_consensus.cc:2955] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:05.923416 18101 raft_consensus.cc:2955] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:05.926863 18173 raft_consensus.cc:2955] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:05.953392 18786 raft_consensus.cc:2955] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:05.968206 17998 catalog_manager.cc:5649] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 10dfae53d0c941f08bded43539841761 reported cstate change: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "982df35c5b554a8fa64807352c4f34ee" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:05.996488 18246 consensus_queue.cc:237] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:06.003535 18101 raft_consensus.cc:1275] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251023 07:59:06.004659 19240 consensus_queue.cc:1048] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20251023 07:59:06.005697 18789 raft_consensus.cc:1275] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251023 07:59:06.009114 19131 consensus_queue.cc:1048] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:59:06.071859 18097 raft_consensus.cc:1275] T fe0293c22cae49cfa7cd698f17626a35 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:06.071287 18101 raft_consensus.cc:2955] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 10dfae53d0c941f08bded43539841761 (127.16.126.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:06.077363 19208 consensus_queue.cc:1048] T fe0293c22cae49cfa7cd698f17626a35 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:06.061796 19240 raft_consensus.cc:2955] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 10dfae53d0c941f08bded43539841761 (127.16.126.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:06.083206 18789 raft_consensus.cc:2955] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 10dfae53d0c941f08bded43539841761 (127.16.126.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:06.087481 18246 raft_consensus.cc:1275] T fe0293c22cae49cfa7cd698f17626a35 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:06.094853 19208 consensus_queue.cc:1048] T fe0293c22cae49cfa7cd698f17626a35 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:06.095858 18244 raft_consensus.cc:1275] T 063924334ed846f3bd41c36cc4651236 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Refusing update from remote peer d1a8f61d3323447282ee6068aa623216: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20251023 07:59:06.097817 19255 consensus_queue.cc:1048] T 063924334ed846f3bd41c36cc4651236 P d1a8f61d3323447282ee6068aa623216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20251023 07:59:06.099766 17997 catalog_manager.cc:5649] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P d1a8f61d3323447282ee6068aa623216 reported cstate change: config changed from index 3 to 4, VOTER 10dfae53d0c941f08bded43539841761 (127.16.126.2) evicted. New cstate: current_term: 1 leader_uuid: "982df35c5b554a8fa64807352c4f34ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:06.118592 18170 raft_consensus.cc:1275] T 063924334ed846f3bd41c36cc4651236 P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Refusing update from remote peer d1a8f61d3323447282ee6068aa623216: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20251023 07:59:06.120004 19255 consensus_queue.cc:1048] T 063924334ed846f3bd41c36cc4651236 P d1a8f61d3323447282ee6068aa623216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20251023 07:59:06.120549 19230 raft_consensus.cc:1064] T 744a3368282b44d9b9618922875d20d3 P b3a1328f9c8c484fab08292ce2171ec9: attempting to promote NON_VOTER d1a8f61d3323447282ee6068aa623216 to VOTER
I20251023 07:59:06.122296 19214 raft_consensus.cc:1064] T e99e859ac34a47c4b2859ec2638d17e5 P 982df35c5b554a8fa64807352c4f34ee: attempting to promote NON_VOTER d1a8f61d3323447282ee6068aa623216 to VOTER
I20251023 07:59:06.124140 19230 consensus_queue.cc:237] T 744a3368282b44d9b9618922875d20d3 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:06.126554 18163 tablet_service.cc:1552] Processing DeleteTablet for tablet 290b1b1fd4ef42cf9f0b285d4bf5ed36 with delete_type TABLET_DATA_TOMBSTONED (TS 10dfae53d0c941f08bded43539841761 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33428
I20251023 07:59:06.128190 19214 consensus_queue.cc:237] T e99e859ac34a47c4b2859ec2638d17e5 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:06.171883 18102 raft_consensus.cc:1275] T 1f184d89e4244f12af7afd690bc7027d P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Refusing update from remote peer d1a8f61d3323447282ee6068aa623216: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20251023 07:59:06.177620 19272 consensus_queue.cc:1048] T 1f184d89e4244f12af7afd690bc7027d P d1a8f61d3323447282ee6068aa623216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20251023 07:59:06.196951 17986 catalog_manager.cc:5162] ChangeConfig:REMOVE_PEER RPC for tablet 290b1b1fd4ef42cf9f0b285d4bf5ed36 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251023 07:59:06.204260 19284 tablet_replica.cc:333] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 10dfae53d0c941f08bded43539841761: stopping tablet replica
I20251023 07:59:06.205509 19284 raft_consensus.cc:2243] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:06.207980 19284 raft_consensus.cc:2272] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:06.212149 18786 raft_consensus.cc:1275] T e99e859ac34a47c4b2859ec2638d17e5 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:59:06.213636 18101 raft_consensus.cc:1275] T e99e859ac34a47c4b2859ec2638d17e5 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:59:06.213869 19131 consensus_queue.cc:1048] T e99e859ac34a47c4b2859ec2638d17e5 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:59:06.214166 18789 raft_consensus.cc:1275] T 744a3368282b44d9b9618922875d20d3 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:59:06.216514 19141 consensus_queue.cc:1048] T 744a3368282b44d9b9618922875d20d3 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:59:06.219169 19131 consensus_queue.cc:1048] T e99e859ac34a47c4b2859ec2638d17e5 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:59:06.226039 18170 raft_consensus.cc:1275] T 744a3368282b44d9b9618922875d20d3 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:59:06.229292 19141 consensus_queue.cc:1048] T 744a3368282b44d9b9618922875d20d3 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:59:06.237739 18248 raft_consensus.cc:1275] T 744a3368282b44d9b9618922875d20d3 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:59:06.238536 18170 raft_consensus.cc:1275] T e99e859ac34a47c4b2859ec2638d17e5 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:59:06.238935 19141 consensus_queue.cc:1048] T 744a3368282b44d9b9618922875d20d3 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20251023 07:59:06.253574 19280 consensus_queue.cc:1048] T e99e859ac34a47c4b2859ec2638d17e5 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20251023 07:59:06.271147 19284 ts_tablet_manager.cc:1916] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 10dfae53d0c941f08bded43539841761: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251023 07:59:06.316409 18246 raft_consensus.cc:1275] T 1f184d89e4244f12af7afd690bc7027d P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Refusing update from remote peer d1a8f61d3323447282ee6068aa623216: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20251023 07:59:06.334698 18171 raft_consensus.cc:1275] T 3e4d005972f44619b0cf23f4978f51c4 P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Refusing update from remote peer d1a8f61d3323447282ee6068aa623216: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20251023 07:59:06.319311 19255 consensus_queue.cc:1048] T 1f184d89e4244f12af7afd690bc7027d P d1a8f61d3323447282ee6068aa623216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20251023 07:59:06.365722 19230 raft_consensus.cc:1064] T 5939b6a960ea4b0581b61ccdcdfa7c37 P b3a1328f9c8c484fab08292ce2171ec9: attempting to promote NON_VOTER d1a8f61d3323447282ee6068aa623216 to VOTER
I20251023 07:59:06.345346 19264 consensus_queue.cc:1048] T 3e4d005972f44619b0cf23f4978f51c4 P d1a8f61d3323447282ee6068aa623216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20251023 07:59:06.376685 19284 ts_tablet_manager.cc:1929] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 10dfae53d0c941f08bded43539841761: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20251023 07:59:06.381528 19284 log.cc:1199] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 10dfae53d0c941f08bded43539841761: Deleting WAL directory at /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1761206251627710-16888-0/minicluster-data/ts-1-root/wals/290b1b1fd4ef42cf9f0b285d4bf5ed36
W20251023 07:59:06.388506 18066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.2:45799, user_credentials={real_user=slave}} blocked reactor thread for 60944.5us
I20251023 07:59:06.399735 17985 catalog_manager.cc:4985] TS 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): tablet 290b1b1fd4ef42cf9f0b285d4bf5ed36 (table test-workload [id=8bb191a5531a4d4fb58a25b13d592213]) successfully deleted
I20251023 07:59:06.403931 18246 raft_consensus.cc:1275] T 3e4d005972f44619b0cf23f4978f51c4 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Refusing update from remote peer d1a8f61d3323447282ee6068aa623216: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20251023 07:59:06.407512 19255 consensus_queue.cc:1048] T 3e4d005972f44619b0cf23f4978f51c4 P d1a8f61d3323447282ee6068aa623216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20251023 07:59:06.408830 18067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.4:33293, user_credentials={real_user=slave}} blocked reactor thread for 59677.1us
I20251023 07:59:06.415971 19302 raft_consensus.cc:2955] T 744a3368282b44d9b9618922875d20d3 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:06.414597 19240 raft_consensus.cc:2955] T e99e859ac34a47c4b2859ec2638d17e5 P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:06.441524 18176 raft_consensus.cc:2955] T e99e859ac34a47c4b2859ec2638d17e5 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:06.449493 19230 consensus_queue.cc:237] T 5939b6a960ea4b0581b61ccdcdfa7c37 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
W20251023 07:59:06.453536 18142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.4:33293, user_credentials={real_user=slave}} blocked reactor thread for 53041.1us
I20251023 07:59:06.492813 18176 raft_consensus.cc:1275] T f90cf0955288472898eff5b7e6459195 P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Refusing update from remote peer d1a8f61d3323447282ee6068aa623216: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20251023 07:59:06.494339 18066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.2:45799, user_credentials={real_user=slave}} blocked reactor thread for 101229us
I20251023 07:59:06.502846 18789 raft_consensus.cc:2955] T 744a3368282b44d9b9618922875d20d3 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:06.507493 18097 raft_consensus.cc:1275] T f90cf0955288472898eff5b7e6459195 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Refusing update from remote peer d1a8f61d3323447282ee6068aa623216: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20251023 07:59:06.522953 18176 raft_consensus.cc:1275] T ce0069d7c0cf4dee84a85731209358f7 P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Refusing update from remote peer d1a8f61d3323447282ee6068aa623216: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20251023 07:59:06.498809 19264 consensus_queue.cc:1048] T f90cf0955288472898eff5b7e6459195 P d1a8f61d3323447282ee6068aa623216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20251023 07:59:06.557422 18099 raft_consensus.cc:1275] T ce0069d7c0cf4dee84a85731209358f7 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Refusing update from remote peer d1a8f61d3323447282ee6068aa623216: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20251023 07:59:06.547396 19255 consensus_queue.cc:1048] T ce0069d7c0cf4dee84a85731209358f7 P d1a8f61d3323447282ee6068aa623216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20251023 07:59:06.567480 19272 consensus_queue.cc:1048] T f90cf0955288472898eff5b7e6459195 P d1a8f61d3323447282ee6068aa623216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20251023 07:59:06.629552 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20251023 07:59:06.649657 18753 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.2:45799, user_credentials={real_user=slave}} blocked reactor thread for 74136.1us
W20251023 07:59:06.653779 18754 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.3:46061, user_credentials={real_user=slave}} blocked reactor thread for 82454.6us
W20251023 07:59:06.655232 18755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.1:44025, user_credentials={real_user=slave}} blocked reactor thread for 108770us
W20251023 07:59:06.723587 18142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.3:46061, user_credentials={real_user=slave}} blocked reactor thread for 173407us
I20251023 07:59:06.677476 18171 raft_consensus.cc:2955] T 744a3368282b44d9b9618922875d20d3 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
W20251023 07:59:06.757537 18065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251023 07:59:06.675982 18000 catalog_manager.cc:5649] T 744a3368282b44d9b9618922875d20d3 P d1a8f61d3323447282ee6068aa623216 reported cstate change: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:06.807277 18787 raft_consensus.cc:2955] T e99e859ac34a47c4b2859ec2638d17e5 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:06.858258 19272 consensus_queue.cc:1048] T ce0069d7c0cf4dee84a85731209358f7 P d1a8f61d3323447282ee6068aa623216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
W20251023 07:59:06.872822 18143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.1:44025, user_credentials={real_user=slave}} blocked reactor thread for 117762us
W20251023 07:59:06.879539 18067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.3:46061, user_credentials={real_user=slave}} blocked reactor thread for 368139us
I20251023 07:59:06.885592 18173 raft_consensus.cc:1275] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:59:06.917822 18101 raft_consensus.cc:2955] T e99e859ac34a47c4b2859ec2638d17e5 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:06.915931 19306 consensus_queue.cc:1048] T 5939b6a960ea4b0581b61ccdcdfa7c37 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20251023 07:59:07.006150 18787 raft_consensus.cc:1275] T 5939b6a960ea4b0581b61ccdcdfa7c37 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:59:07.046977 18244 raft_consensus.cc:1275] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:59:07.069514 19141 consensus_queue.cc:1048] T 5939b6a960ea4b0581b61ccdcdfa7c37 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:59:07.111441 18247 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "0d6dd28a0f414e8e93fe9cf4c98ce4a2"
dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
mode: GRACEFUL
new_leader_uuid: "10dfae53d0c941f08bded43539841761"
from {username='slave'} at 127.0.0.1:60948
I20251023 07:59:07.136533 18247 raft_consensus.cc:606] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Received request to transfer leadership to TS 10dfae53d0c941f08bded43539841761
I20251023 07:59:07.213105 18171 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "2d81605b8fe7427b94af7f3c481ed765"
dest_uuid: "10dfae53d0c941f08bded43539841761"
mode: GRACEFUL
new_leader_uuid: "d1a8f61d3323447282ee6068aa623216"
from {username='slave'} at 127.0.0.1:47396
I20251023 07:59:07.213742 18171 raft_consensus.cc:606] T 2d81605b8fe7427b94af7f3c481ed765 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Received request to transfer leadership to TS d1a8f61d3323447282ee6068aa623216
I20251023 07:59:07.227708 17999 catalog_manager.cc:5649] T e99e859ac34a47c4b2859ec2638d17e5 P 10dfae53d0c941f08bded43539841761 reported cstate change: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "982df35c5b554a8fa64807352c4f34ee" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:07.245236 18251 raft_consensus.cc:2955] T 744a3368282b44d9b9618922875d20d3 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:07.248605 19324 raft_consensus.cc:993] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P 982df35c5b554a8fa64807352c4f34ee: : Instructing follower 10dfae53d0c941f08bded43539841761 to start an election
I20251023 07:59:07.249462 19324 raft_consensus.cc:1081] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Signalling peer 10dfae53d0c941f08bded43539841761 to start an election
W20251023 07:59:07.255209 18067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.3:46061, user_credentials={real_user=slave}} blocked reactor thread for 169749us
I20251023 07:59:07.257468 19306 consensus_queue.cc:1048] T 5939b6a960ea4b0581b61ccdcdfa7c37 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20251023 07:59:07.272397 18176 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "0d6dd28a0f414e8e93fe9cf4c98ce4a2"
dest_uuid: "10dfae53d0c941f08bded43539841761"
from {username='slave'} at 127.0.0.1:51868
I20251023 07:59:07.273032 18176 raft_consensus.cc:493] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:59:07.273397 18176 raft_consensus.cc:3060] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:07.272450 18093 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "5939b6a960ea4b0581b61ccdcdfa7c37"
dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
mode: GRACEFUL
new_leader_uuid: "982df35c5b554a8fa64807352c4f34ee"
from {username='slave'} at 127.0.0.1:34418
I20251023 07:59:07.288589 18093 raft_consensus.cc:606] T 5939b6a960ea4b0581b61ccdcdfa7c37 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Received request to transfer leadership to TS 982df35c5b554a8fa64807352c4f34ee
I20251023 07:59:07.290688 18176 raft_consensus.cc:515] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:59:07.294585 18102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d6dd28a0f414e8e93fe9cf4c98ce4a2" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
I20251023 07:59:07.295153 18102 raft_consensus.cc:3060] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:07.295478 18176 leader_election.cc:290] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 2 election: Requested vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:59:07.307328 18251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d6dd28a0f414e8e93fe9cf4c98ce4a2" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
I20251023 07:59:07.307967 18102 raft_consensus.cc:2468] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 2.
I20251023 07:59:07.308068 18251 raft_consensus.cc:3055] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Stepping down as leader of term 1
I20251023 07:59:07.308558 18251 raft_consensus.cc:740] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Running, Role: LEADER
I20251023 07:59:07.309233 18143 leader_election.cc:304] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:59:07.309393 18251 consensus_queue.cc:260] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:59:07.311156 19334 raft_consensus.cc:2804] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:59:07.311772 19334 raft_consensus.cc:697] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P 10dfae53d0c941f08bded43539841761 [term 2 LEADER]: Becoming Leader. State: Replica: 10dfae53d0c941f08bded43539841761, State: Running, Role: LEADER
I20251023 07:59:07.312866 19334 consensus_queue.cc:237] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:59:07.318871 18247 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "5d4096f60c864412bb51be0c52c22961"
dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
mode: GRACEFUL
new_leader_uuid: "10dfae53d0c941f08bded43539841761"
from {username='slave'} at 127.0.0.1:60948
I20251023 07:59:07.326680 18247 raft_consensus.cc:606] T 5d4096f60c864412bb51be0c52c22961 P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Received request to transfer leadership to TS 10dfae53d0c941f08bded43539841761
I20251023 07:59:07.320760 18244 consensus_queue.cc:237] T e99e859ac34a47c4b2859ec2638d17e5 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:07.329493 18251 raft_consensus.cc:3060] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:07.336651 18788 raft_consensus.cc:1275] T e99e859ac34a47c4b2859ec2638d17e5 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251023 07:59:07.342386 19330 consensus_queue.cc:1048] T e99e859ac34a47c4b2859ec2638d17e5 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20251023 07:59:07.342895 18176 raft_consensus.cc:1275] T e99e859ac34a47c4b2859ec2638d17e5 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251023 07:59:07.355136 19328 consensus_queue.cc:1048] T e99e859ac34a47c4b2859ec2638d17e5 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20251023 07:59:07.357749 18247 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "a939fd9e853a45d1aa626a4566c14abc"
dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
mode: GRACEFUL
new_leader_uuid: "d1a8f61d3323447282ee6068aa623216"
from {username='slave'} at 127.0.0.1:60948
I20251023 07:59:07.358332 18247 raft_consensus.cc:606] T a939fd9e853a45d1aa626a4566c14abc P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Received request to transfer leadership to TS d1a8f61d3323447282ee6068aa623216
I20251023 07:59:07.359313 19296 raft_consensus.cc:2955] T e99e859ac34a47c4b2859ec2638d17e5 P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:07.364408 18788 raft_consensus.cc:2955] T e99e859ac34a47c4b2859ec2638d17e5 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:07.369683 19339 raft_consensus.cc:993] T 5939b6a960ea4b0581b61ccdcdfa7c37 P b3a1328f9c8c484fab08292ce2171ec9: : Instructing follower 982df35c5b554a8fa64807352c4f34ee to start an election
I20251023 07:59:07.370298 19314 raft_consensus.cc:1081] T 5939b6a960ea4b0581b61ccdcdfa7c37 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Signalling peer 982df35c5b554a8fa64807352c4f34ee to start an election
I20251023 07:59:07.371623 19339 raft_consensus.cc:2955] T 5939b6a960ea4b0581b61ccdcdfa7c37 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:07.372562 18176 raft_consensus.cc:2955] T e99e859ac34a47c4b2859ec2638d17e5 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:07.353138 18251 raft_consensus.cc:2468] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 2.
I20251023 07:59:07.386368 19240 raft_consensus.cc:993] T 5d4096f60c864412bb51be0c52c22961 P 982df35c5b554a8fa64807352c4f34ee: : Instructing follower 10dfae53d0c941f08bded43539841761 to start an election
I20251023 07:59:07.386863 19240 raft_consensus.cc:1081] T 5d4096f60c864412bb51be0c52c22961 P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Signalling peer 10dfae53d0c941f08bded43539841761 to start an election
I20251023 07:59:07.393673 17986 catalog_manager.cc:5162] ChangeConfig:REMOVE_PEER RPC for tablet e99e859ac34a47c4b2859ec2638d17e5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251023 07:59:07.395126 18171 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "5d4096f60c864412bb51be0c52c22961"
dest_uuid: "10dfae53d0c941f08bded43539841761"
from {username='slave'} at 127.0.0.1:51868
I20251023 07:59:07.395730 18171 raft_consensus.cc:493] T 5d4096f60c864412bb51be0c52c22961 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:59:07.396090 18171 raft_consensus.cc:3060] T 5d4096f60c864412bb51be0c52c22961 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:07.403472 18788 raft_consensus.cc:2955] T 5939b6a960ea4b0581b61ccdcdfa7c37 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:07.404389 18171 raft_consensus.cc:515] T 5d4096f60c864412bb51be0c52c22961 P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } }
I20251023 07:59:07.407233 18246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d4096f60c864412bb51be0c52c22961" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
I20251023 07:59:07.407791 18246 raft_consensus.cc:3055] T 5d4096f60c864412bb51be0c52c22961 P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Stepping down as leader of term 1
I20251023 07:59:07.408186 18246 raft_consensus.cc:740] T 5d4096f60c864412bb51be0c52c22961 P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Running, Role: LEADER
I20251023 07:59:07.408627 18247 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "b9841e711f8e4a019c2d0dec5409474c"
dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
mode: GRACEFUL
new_leader_uuid: "d1a8f61d3323447282ee6068aa623216"
from {username='slave'} at 127.0.0.1:60948
I20251023 07:59:07.408931 18246 consensus_queue.cc:260] T 5d4096f60c864412bb51be0c52c22961 P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } }
I20251023 07:59:07.410009 18246 raft_consensus.cc:3060] T 5d4096f60c864412bb51be0c52c22961 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:07.409205 18247 raft_consensus.cc:606] T b9841e711f8e4a019c2d0dec5409474c P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Received request to transfer leadership to TS d1a8f61d3323447282ee6068aa623216
I20251023 07:59:07.407672 18171 leader_election.cc:290] T 5d4096f60c864412bb51be0c52c22961 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 2 election: Requested vote from peers 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061), b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025)
I20251023 07:59:07.411772 18247 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "5939b6a960ea4b0581b61ccdcdfa7c37"
dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
from {username='slave'} at 127.0.0.1:49420
I20251023 07:59:07.412287 18102 consensus_queue.cc:237] T 744a3368282b44d9b9618922875d20d3 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:07.412261 18247 raft_consensus.cc:493] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:59:07.414039 18096 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d4096f60c864412bb51be0c52c22961" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
I20251023 07:59:07.414363 18247 raft_consensus.cc:3060] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:07.414603 18096 raft_consensus.cc:3060] T 5d4096f60c864412bb51be0c52c22961 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:07.416428 19296 raft_consensus.cc:993] T b9841e711f8e4a019c2d0dec5409474c P 982df35c5b554a8fa64807352c4f34ee: : Instructing follower d1a8f61d3323447282ee6068aa623216 to start an election
I20251023 07:59:07.416887 19280 raft_consensus.cc:1081] T b9841e711f8e4a019c2d0dec5409474c P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Signalling peer d1a8f61d3323447282ee6068aa623216 to start an election
I20251023 07:59:07.418581 18787 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "b9841e711f8e4a019c2d0dec5409474c"
dest_uuid: "d1a8f61d3323447282ee6068aa623216"
from {username='slave'} at 127.0.0.1:36478
I20251023 07:59:07.419055 18787 raft_consensus.cc:493] T b9841e711f8e4a019c2d0dec5409474c P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:59:07.419368 18787 raft_consensus.cc:3060] T b9841e711f8e4a019c2d0dec5409474c P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:07.426044 18246 raft_consensus.cc:2468] T 5d4096f60c864412bb51be0c52c22961 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 2.
I20251023 07:59:07.427707 17999 catalog_manager.cc:5649] T e99e859ac34a47c4b2859ec2638d17e5 P d1a8f61d3323447282ee6068aa623216 reported cstate change: config changed from index 3 to 4, VOTER b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1) evicted. New cstate: current_term: 1 leader_uuid: "982df35c5b554a8fa64807352c4f34ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:07.428161 18247 raft_consensus.cc:515] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:07.429209 18251 raft_consensus.cc:1240] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Rejecting Update request from peer b3a1328f9c8c484fab08292ce2171ec9 for earlier term 1. Current term is 2. Ops: []
I20251023 07:59:07.430614 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
I20251023 07:59:07.432238 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 07:59:07.432940 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:59:07.434388 18787 raft_consensus.cc:515] T b9841e711f8e4a019c2d0dec5409474c P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:07.438158 18142 leader_election.cc:304] T 5d4096f60c864412bb51be0c52c22961 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, 982df35c5b554a8fa64807352c4f34ee; no voters:
I20251023 07:59:07.440400 19334 raft_consensus.cc:2804] T 5d4096f60c864412bb51be0c52c22961 P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:59:07.441658 18101 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b9841e711f8e4a019c2d0dec5409474c" candidate_uuid: "d1a8f61d3323447282ee6068aa623216" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
I20251023 07:59:07.442379 18101 raft_consensus.cc:3060] T b9841e711f8e4a019c2d0dec5409474c P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:07.441160 19334 raft_consensus.cc:697] T 5d4096f60c864412bb51be0c52c22961 P 10dfae53d0c941f08bded43539841761 [term 2 LEADER]: Becoming Leader. State: Replica: 10dfae53d0c941f08bded43539841761, State: Running, Role: LEADER
I20251023 07:59:07.445416 17997 catalog_manager.cc:5649] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P 10dfae53d0c941f08bded43539841761 reported cstate change: term changed from 1 to 2, leader changed from 982df35c5b554a8fa64807352c4f34ee (127.16.126.3) to 10dfae53d0c941f08bded43539841761 (127.16.126.2). New cstate: current_term: 2 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:07.451546 19324 raft_consensus.cc:993] T a939fd9e853a45d1aa626a4566c14abc P 982df35c5b554a8fa64807352c4f34ee: : Instructing follower d1a8f61d3323447282ee6068aa623216 to start an election
I20251023 07:59:07.452003 19324 raft_consensus.cc:1081] T a939fd9e853a45d1aa626a4566c14abc P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Signalling peer d1a8f61d3323447282ee6068aa623216 to start an election
I20251023 07:59:07.453598 18788 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "a939fd9e853a45d1aa626a4566c14abc"
dest_uuid: "d1a8f61d3323447282ee6068aa623216"
from {username='slave'} at 127.0.0.1:36478
I20251023 07:59:07.454097 18788 raft_consensus.cc:493] T a939fd9e853a45d1aa626a4566c14abc P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:59:07.454507 18788 raft_consensus.cc:3060] T a939fd9e853a45d1aa626a4566c14abc P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:07.455876 18101 raft_consensus.cc:2468] T b9841e711f8e4a019c2d0dec5409474c P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1a8f61d3323447282ee6068aa623216 in term 2.
I20251023 07:59:07.456949 18755 leader_election.cc:304] T b9841e711f8e4a019c2d0dec5409474c P d1a8f61d3323447282ee6068aa623216 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3a1328f9c8c484fab08292ce2171ec9, d1a8f61d3323447282ee6068aa623216; no voters:
I20251023 07:59:07.459126 19272 raft_consensus.cc:2804] T b9841e711f8e4a019c2d0dec5409474c P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:59:07.459582 19272 raft_consensus.cc:697] T b9841e711f8e4a019c2d0dec5409474c P d1a8f61d3323447282ee6068aa623216 [term 2 LEADER]: Becoming Leader. State: Replica: d1a8f61d3323447282ee6068aa623216, State: Running, Role: LEADER
I20251023 07:59:07.460374 18787 leader_election.cc:290] T b9841e711f8e4a019c2d0dec5409474c P d1a8f61d3323447282ee6068aa623216 [CANDIDATE]: Term 2 election: Requested vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:59:07.461908 18789 raft_consensus.cc:1275] T 744a3368282b44d9b9618922875d20d3 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251023 07:59:07.463002 18247 leader_election.cc:290] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 2 election: Requested vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), d1a8f61d3323447282ee6068aa623216 (127.16.126.4:33293)
I20251023 07:59:07.463264 18176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5939b6a960ea4b0581b61ccdcdfa7c37" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "10dfae53d0c941f08bded43539841761"
I20251023 07:59:07.463796 18176 raft_consensus.cc:3060] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:07.466588 18789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5939b6a960ea4b0581b61ccdcdfa7c37" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "d1a8f61d3323447282ee6068aa623216"
I20251023 07:59:07.467129 18789 raft_consensus.cc:3060] T 5939b6a960ea4b0581b61ccdcdfa7c37 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:07.460414 19272 consensus_queue.cc:237] T b9841e711f8e4a019c2d0dec5409474c P d1a8f61d3323447282ee6068aa623216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:07.475765 18247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b9841e711f8e4a019c2d0dec5409474c" candidate_uuid: "d1a8f61d3323447282ee6068aa623216" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
I20251023 07:59:07.476369 18247 raft_consensus.cc:3055] T b9841e711f8e4a019c2d0dec5409474c P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Stepping down as leader of term 1
I20251023 07:59:07.476637 18247 raft_consensus.cc:740] T b9841e711f8e4a019c2d0dec5409474c P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Running, Role: LEADER
I20251023 07:59:07.477311 18247 consensus_queue.cc:260] T b9841e711f8e4a019c2d0dec5409474c P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:07.478731 18247 raft_consensus.cc:3060] T b9841e711f8e4a019c2d0dec5409474c P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:07.479897 19306 consensus_queue.cc:1048] T 744a3368282b44d9b9618922875d20d3 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:59:07.482128 18251 raft_consensus.cc:1275] T 744a3368282b44d9b9618922875d20d3 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251023 07:59:07.482717 17997 catalog_manager.cc:5649] T 5939b6a960ea4b0581b61ccdcdfa7c37 P d1a8f61d3323447282ee6068aa623216 reported cstate change: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:07.485033 18096 raft_consensus.cc:2468] T 5d4096f60c864412bb51be0c52c22961 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 2.
I20251023 07:59:07.489651 18247 raft_consensus.cc:2468] T b9841e711f8e4a019c2d0dec5409474c P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1a8f61d3323447282ee6068aa623216 in term 2.
I20251023 07:59:07.490061 18101 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5939b6a960ea4b0581b61ccdcdfa7c37" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
I20251023 07:59:07.497821 19306 consensus_queue.cc:1059] T 5939b6a960ea4b0581b61ccdcdfa7c37 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:59:07.491031 18086 tablet_service.cc:1552] Processing DeleteTablet for tablet e99e859ac34a47c4b2859ec2638d17e5 with delete_type TABLET_DATA_TOMBSTONED (TS b3a1328f9c8c484fab08292ce2171ec9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53940
I20251023 07:59:07.498828 18101 raft_consensus.cc:3055] T 5939b6a960ea4b0581b61ccdcdfa7c37 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Stepping down as leader of term 1
I20251023 07:59:07.499253 18101 raft_consensus.cc:740] T 5939b6a960ea4b0581b61ccdcdfa7c37 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Running, Role: LEADER
I20251023 07:59:07.500196 18101 consensus_queue.cc:260] T 5939b6a960ea4b0581b61ccdcdfa7c37 P b3a1328f9c8c484fab08292ce2171ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:07.501912 18789 raft_consensus.cc:2468] T 5939b6a960ea4b0581b61ccdcdfa7c37 P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 2.
I20251023 07:59:07.445847 19334 consensus_queue.cc:237] T 5d4096f60c864412bb51be0c52c22961 P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } }
I20251023 07:59:07.489686 18788 raft_consensus.cc:515] T a939fd9e853a45d1aa626a4566c14abc P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:07.510208 18096 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a939fd9e853a45d1aa626a4566c14abc" candidate_uuid: "d1a8f61d3323447282ee6068aa623216" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
I20251023 07:59:07.510891 18096 raft_consensus.cc:3060] T a939fd9e853a45d1aa626a4566c14abc P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:07.511248 18788 leader_election.cc:290] T a939fd9e853a45d1aa626a4566c14abc P d1a8f61d3323447282ee6068aa623216 [CANDIDATE]: Term 2 election: Requested vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:59:07.513233 17997 catalog_manager.cc:5649] T b9841e711f8e4a019c2d0dec5409474c P d1a8f61d3323447282ee6068aa623216 reported cstate change: term changed from 1 to 2, leader changed from 982df35c5b554a8fa64807352c4f34ee (127.16.126.3) to d1a8f61d3323447282ee6068aa623216 (127.16.126.4). New cstate: current_term: 2 leader_uuid: "d1a8f61d3323447282ee6068aa623216" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251023 07:59:07.524995 18101 raft_consensus.cc:3060] T 5939b6a960ea4b0581b61ccdcdfa7c37 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:07.528007 19306 consensus_queue.cc:1048] T 744a3368282b44d9b9618922875d20d3 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:59:07.528591 18247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a939fd9e853a45d1aa626a4566c14abc" candidate_uuid: "d1a8f61d3323447282ee6068aa623216" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
I20251023 07:59:07.529182 18247 raft_consensus.cc:3055] T a939fd9e853a45d1aa626a4566c14abc P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Stepping down as leader of term 1
I20251023 07:59:07.529484 18247 raft_consensus.cc:740] T a939fd9e853a45d1aa626a4566c14abc P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Running, Role: LEADER
I20251023 07:59:07.530346 18247 consensus_queue.cc:260] T a939fd9e853a45d1aa626a4566c14abc P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:07.531525 18247 raft_consensus.cc:3060] T a939fd9e853a45d1aa626a4566c14abc P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:07.539386 18101 raft_consensus.cc:2468] T 5939b6a960ea4b0581b61ccdcdfa7c37 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 2.
I20251023 07:59:07.542346 19302 raft_consensus.cc:2955] T 744a3368282b44d9b9618922875d20d3 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 10dfae53d0c941f08bded43539841761 (127.16.126.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:07.550724 18096 raft_consensus.cc:2468] T a939fd9e853a45d1aa626a4566c14abc P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1a8f61d3323447282ee6068aa623216 in term 2.
I20251023 07:59:07.554759 19345 tablet_replica.cc:333] T e99e859ac34a47c4b2859ec2638d17e5 P b3a1328f9c8c484fab08292ce2171ec9: stopping tablet replica
I20251023 07:59:07.552174 18176 raft_consensus.cc:2468] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 2.
I20251023 07:59:07.553347 18217 leader_election.cc:304] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9, d1a8f61d3323447282ee6068aa623216; no voters:
I20251023 07:59:07.555860 19296 raft_consensus.cc:2804] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:59:07.556213 18755 leader_election.cc:304] T a939fd9e853a45d1aa626a4566c14abc P d1a8f61d3323447282ee6068aa623216 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3a1328f9c8c484fab08292ce2171ec9, d1a8f61d3323447282ee6068aa623216; no voters:
I20251023 07:59:07.557020 19296 raft_consensus.cc:697] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 982df35c5b554a8fa64807352c4f34ee [term 2 LEADER]: Becoming Leader. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Running, Role: LEADER
I20251023 07:59:07.557148 19272 raft_consensus.cc:2804] T a939fd9e853a45d1aa626a4566c14abc P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:59:07.557742 19272 raft_consensus.cc:697] T a939fd9e853a45d1aa626a4566c14abc P d1a8f61d3323447282ee6068aa623216 [term 2 LEADER]: Becoming Leader. State: Replica: d1a8f61d3323447282ee6068aa623216, State: Running, Role: LEADER
I20251023 07:59:07.558024 19296 consensus_queue.cc:237] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:07.558549 19272 consensus_queue.cc:237] T a939fd9e853a45d1aa626a4566c14abc P d1a8f61d3323447282ee6068aa623216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
W20251023 07:59:07.558943 17987 catalog_manager.cc:5179] ChangeConfig:REMOVE_PEER RPC for tablet 5939b6a960ea4b0581b61ccdcdfa7c37 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica b3a1328f9c8c484fab08292ce2171ec9 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:07.578826 18171 raft_consensus.cc:1240] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Rejecting Update request from peer b3a1328f9c8c484fab08292ce2171ec9 for earlier term 1. Current term is 2. Ops: []
I20251023 07:59:07.592970 18788 raft_consensus.cc:2955] T 744a3368282b44d9b9618922875d20d3 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 10dfae53d0c941f08bded43539841761 (127.16.126.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:07.595855 18247 raft_consensus.cc:2468] T a939fd9e853a45d1aa626a4566c14abc P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1a8f61d3323447282ee6068aa623216 in term 2.
I20251023 07:59:07.563433 19345 raft_consensus.cc:2243] T e99e859ac34a47c4b2859ec2638d17e5 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:07.599182 17997 catalog_manager.cc:5649] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 982df35c5b554a8fa64807352c4f34ee reported cstate change: config changed from index 3 to 2, term changed from 1 to 2, leader changed from b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1) to 982df35c5b554a8fa64807352c4f34ee (127.16.126.3), d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from VOTER to NON_VOTER, now has a pending config: VOTER b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1), VOTER 10dfae53d0c941f08bded43539841761 (127.16.126.2), VOTER 982df35c5b554a8fa64807352c4f34ee (127.16.126.3), VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4). New cstate: current_term: 2 leader_uuid: "982df35c5b554a8fa64807352c4f34ee" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:07.602840 17999 catalog_manager.cc:5649] T 5d4096f60c864412bb51be0c52c22961 P 10dfae53d0c941f08bded43539841761 reported cstate change: term changed from 1 to 2, leader changed from 982df35c5b554a8fa64807352c4f34ee (127.16.126.3) to 10dfae53d0c941f08bded43539841761 (127.16.126.2). New cstate: current_term: 2 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:07.603206 17998 catalog_manager.cc:5649] T a939fd9e853a45d1aa626a4566c14abc P d1a8f61d3323447282ee6068aa623216 reported cstate change: term changed from 1 to 2, leader changed from 982df35c5b554a8fa64807352c4f34ee (127.16.126.3) to d1a8f61d3323447282ee6068aa623216 (127.16.126.4). New cstate: current_term: 2 leader_uuid: "d1a8f61d3323447282ee6068aa623216" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251023 07:59:07.621404 17987 catalog_manager.cc:5162] ChangeConfig:REMOVE_PEER RPC for tablet 744a3368282b44d9b9618922875d20d3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251023 07:59:07.626991 19345 raft_consensus.cc:2272] T e99e859ac34a47c4b2859ec2638d17e5 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:07.633944 18000 catalog_manager.cc:5649] T 744a3368282b44d9b9618922875d20d3 P b3a1328f9c8c484fab08292ce2171ec9 reported cstate change: config changed from index 3 to 4, VOTER 10dfae53d0c941f08bded43539841761 (127.16.126.2) evicted. New cstate: current_term: 1 leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251023 07:59:07.638142 19345 ts_tablet_manager.cc:1916] T e99e859ac34a47c4b2859ec2638d17e5 P b3a1328f9c8c484fab08292ce2171ec9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251023 07:59:07.652400 18246 raft_consensus.cc:2955] T 744a3368282b44d9b9618922875d20d3 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 10dfae53d0c941f08bded43539841761 (127.16.126.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:07.655611 19310 raft_consensus.cc:993] T 2d81605b8fe7427b94af7f3c481ed765 P 10dfae53d0c941f08bded43539841761: : Instructing follower d1a8f61d3323447282ee6068aa623216 to start an election
I20251023 07:59:07.656116 19310 raft_consensus.cc:1081] T 2d81605b8fe7427b94af7f3c481ed765 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Signalling peer d1a8f61d3323447282ee6068aa623216 to start an election
I20251023 07:59:07.658519 18789 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "2d81605b8fe7427b94af7f3c481ed765"
dest_uuid: "d1a8f61d3323447282ee6068aa623216"
from {username='slave'} at 127.0.0.1:36500
I20251023 07:59:07.659037 18789 raft_consensus.cc:493] T 2d81605b8fe7427b94af7f3c481ed765 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:59:07.659350 18789 raft_consensus.cc:3060] T 2d81605b8fe7427b94af7f3c481ed765 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:07.666007 18789 raft_consensus.cc:515] T 2d81605b8fe7427b94af7f3c481ed765 P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:07.680940 18789 leader_election.cc:290] T 2d81605b8fe7427b94af7f3c481ed765 P d1a8f61d3323447282ee6068aa623216 [CANDIDATE]: Term 2 election: Requested vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:59:07.684741 18171 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2d81605b8fe7427b94af7f3c481ed765" candidate_uuid: "d1a8f61d3323447282ee6068aa623216" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "10dfae53d0c941f08bded43539841761"
I20251023 07:59:07.685322 18171 raft_consensus.cc:3055] T 2d81605b8fe7427b94af7f3c481ed765 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Stepping down as leader of term 1
I20251023 07:59:07.685633 18171 raft_consensus.cc:740] T 2d81605b8fe7427b94af7f3c481ed765 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Running, Role: LEADER
I20251023 07:59:07.686301 18171 consensus_queue.cc:260] T 2d81605b8fe7427b94af7f3c481ed765 P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:07.687593 18171 raft_consensus.cc:3060] T 2d81605b8fe7427b94af7f3c481ed765 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:07.689714 18163 tablet_service.cc:1552] Processing DeleteTablet for tablet 744a3368282b44d9b9618922875d20d3 with delete_type TABLET_DATA_TOMBSTONED (TS 10dfae53d0c941f08bded43539841761 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33428
I20251023 07:59:07.691630 18102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2d81605b8fe7427b94af7f3c481ed765" candidate_uuid: "d1a8f61d3323447282ee6068aa623216" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
I20251023 07:59:07.692198 18102 raft_consensus.cc:3060] T 2d81605b8fe7427b94af7f3c481ed765 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:07.696688 18171 raft_consensus.cc:2468] T 2d81605b8fe7427b94af7f3c481ed765 P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1a8f61d3323447282ee6068aa623216 in term 2.
I20251023 07:59:07.698837 18102 raft_consensus.cc:2468] T 2d81605b8fe7427b94af7f3c481ed765 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1a8f61d3323447282ee6068aa623216 in term 2.
I20251023 07:59:07.699230 18753 leader_election.cc:304] T 2d81605b8fe7427b94af7f3c481ed765 P d1a8f61d3323447282ee6068aa623216 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, d1a8f61d3323447282ee6068aa623216; no voters:
I20251023 07:59:07.700830 19317 raft_consensus.cc:2804] T 2d81605b8fe7427b94af7f3c481ed765 P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:59:07.701467 19317 raft_consensus.cc:697] T 2d81605b8fe7427b94af7f3c481ed765 P d1a8f61d3323447282ee6068aa623216 [term 2 LEADER]: Becoming Leader. State: Replica: d1a8f61d3323447282ee6068aa623216, State: Running, Role: LEADER
I20251023 07:59:07.702311 19317 consensus_queue.cc:237] T 2d81605b8fe7427b94af7f3c481ed765 P d1a8f61d3323447282ee6068aa623216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:07.713644 18247 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "5939b6a960ea4b0581b61ccdcdfa7c37"
dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:49846
I20251023 07:59:07.714303 18247 raft_consensus.cc:606] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 982df35c5b554a8fa64807352c4f34ee [term 2 LEADER]: Received request to transfer leadership
I20251023 07:59:07.732188 19349 tablet_replica.cc:333] T 744a3368282b44d9b9618922875d20d3 P 10dfae53d0c941f08bded43539841761: stopping tablet replica
I20251023 07:59:07.731918 18000 catalog_manager.cc:5649] T 2d81605b8fe7427b94af7f3c481ed765 P d1a8f61d3323447282ee6068aa623216 reported cstate change: term changed from 1 to 2, leader changed from 10dfae53d0c941f08bded43539841761 (127.16.126.2) to d1a8f61d3323447282ee6068aa623216 (127.16.126.4). New cstate: current_term: 2 leader_uuid: "d1a8f61d3323447282ee6068aa623216" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251023 07:59:07.735495 19345 ts_tablet_manager.cc:1929] T e99e859ac34a47c4b2859ec2638d17e5 P b3a1328f9c8c484fab08292ce2171ec9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20251023 07:59:07.736033 19345 log.cc:1199] T e99e859ac34a47c4b2859ec2638d17e5 P b3a1328f9c8c484fab08292ce2171ec9: Deleting WAL directory at /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1761206251627710-16888-0/minicluster-data/ts-0-root/wals/e99e859ac34a47c4b2859ec2638d17e5
I20251023 07:59:07.740008 17987 catalog_manager.cc:4985] TS b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): tablet e99e859ac34a47c4b2859ec2638d17e5 (table test-workload [id=8bb191a5531a4d4fb58a25b13d592213]) successfully deleted
I20251023 07:59:07.733597 19349 raft_consensus.cc:2243] T 744a3368282b44d9b9618922875d20d3 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Raft consensus shutting down.
W20251023 07:59:07.750658 17986 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leader transfer in progress [suppressed 4 similar messages]
I20251023 07:59:07.751938 19349 raft_consensus.cc:2272] T 744a3368282b44d9b9618922875d20d3 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:07.757216 19349 ts_tablet_manager.cc:1916] T 744a3368282b44d9b9618922875d20d3 P 10dfae53d0c941f08bded43539841761: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251023 07:59:07.781302 18247 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "5939b6a960ea4b0581b61ccdcdfa7c37"
dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:49846
I20251023 07:59:07.782102 18247 raft_consensus.cc:606] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 982df35c5b554a8fa64807352c4f34ee [term 2 LEADER]: Received request to transfer leadership
I20251023 07:59:07.783196 19349 ts_tablet_manager.cc:1929] T 744a3368282b44d9b9618922875d20d3 P 10dfae53d0c941f08bded43539841761: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20251023 07:59:07.783712 19349 log.cc:1199] T 744a3368282b44d9b9618922875d20d3 P 10dfae53d0c941f08bded43539841761: Deleting WAL directory at /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1761206251627710-16888-0/minicluster-data/ts-1-root/wals/744a3368282b44d9b9618922875d20d3
I20251023 07:59:07.785302 17985 catalog_manager.cc:4985] TS 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): tablet 744a3368282b44d9b9618922875d20d3 (table test-workload [id=8bb191a5531a4d4fb58a25b13d592213]) successfully deleted
W20251023 07:59:07.787333 17986 catalog_manager.cc:4712] TS 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): ChangeConfig:REMOVE_PEER RPC failed for tablet 5939b6a960ea4b0581b61ccdcdfa7c37: Remote error: Service unavailable: leader transfer in progress
I20251023 07:59:07.790390 18247 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "5939b6a960ea4b0581b61ccdcdfa7c37"
dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:49846
I20251023 07:59:07.790834 18247 raft_consensus.cc:606] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 982df35c5b554a8fa64807352c4f34ee [term 2 LEADER]: Received request to transfer leadership
W20251023 07:59:07.792191 18048 auto_rebalancer.cc:663] Could not move replica: Remote error: Service unavailable: leadership transfer for 5939b6a960ea4b0581b61ccdcdfa7c37 already in progress
W20251023 07:59:07.792546 18048 auto_rebalancer.cc:264] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 5939b6a960ea4b0581b61ccdcdfa7c37 already in progress
I20251023 07:59:07.804201 18247 raft_consensus.cc:1275] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:07.805410 19334 consensus_queue.cc:1048] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:07.822196 18102 raft_consensus.cc:1275] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:07.824071 19334 consensus_queue.cc:1048] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:07.867283 18102 raft_consensus.cc:1275] T b9841e711f8e4a019c2d0dec5409474c P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Refusing update from remote peer d1a8f61d3323447282ee6068aa623216: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20251023 07:59:07.868366 19317 consensus_queue.cc:1048] T b9841e711f8e4a019c2d0dec5409474c P d1a8f61d3323447282ee6068aa623216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20251023 07:59:07.881886 18247 raft_consensus.cc:1275] T b9841e711f8e4a019c2d0dec5409474c P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Refusing update from remote peer d1a8f61d3323447282ee6068aa623216: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20251023 07:59:07.883462 19264 consensus_queue.cc:1048] T b9841e711f8e4a019c2d0dec5409474c P d1a8f61d3323447282ee6068aa623216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20251023 07:59:07.945325 18102 raft_consensus.cc:1275] T a939fd9e853a45d1aa626a4566c14abc P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Refusing update from remote peer d1a8f61d3323447282ee6068aa623216: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20251023 07:59:07.946540 19272 consensus_queue.cc:1048] T a939fd9e853a45d1aa626a4566c14abc P d1a8f61d3323447282ee6068aa623216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20251023 07:59:07.963464 18247 raft_consensus.cc:1275] T a939fd9e853a45d1aa626a4566c14abc P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Refusing update from remote peer d1a8f61d3323447282ee6068aa623216: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20251023 07:59:07.966415 19272 consensus_queue.cc:1048] T a939fd9e853a45d1aa626a4566c14abc P d1a8f61d3323447282ee6068aa623216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20251023 07:59:07.973788 18246 raft_consensus.cc:1275] T 5d4096f60c864412bb51be0c52c22961 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:07.975219 19208 consensus_queue.cc:1048] T 5d4096f60c864412bb51be0c52c22961 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:07.983768 18101 raft_consensus.cc:1275] T 5d4096f60c864412bb51be0c52c22961 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:07.984933 19310 consensus_queue.cc:1048] T 5d4096f60c864412bb51be0c52c22961 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:08.007848 18171 raft_consensus.cc:1275] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20251023 07:59:08.008966 19240 consensus_queue.cc:1048] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:59:08.019627 19296 raft_consensus.cc:993] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 982df35c5b554a8fa64807352c4f34ee: : Instructing follower 10dfae53d0c941f08bded43539841761 to start an election
I20251023 07:59:08.020153 19296 raft_consensus.cc:1081] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 982df35c5b554a8fa64807352c4f34ee [term 2 LEADER]: Signalling peer 10dfae53d0c941f08bded43539841761 to start an election
I20251023 07:59:08.021881 18171 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "5939b6a960ea4b0581b61ccdcdfa7c37"
dest_uuid: "10dfae53d0c941f08bded43539841761"
from {username='slave'} at 127.0.0.1:51868
I20251023 07:59:08.022483 18171 raft_consensus.cc:493] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:59:08.022858 18171 raft_consensus.cc:3060] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:59:08.032308 18171 raft_consensus.cc:515] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 10dfae53d0c941f08bded43539841761 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:08.034138 18171 leader_election.cc:290] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 3 election: Requested vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061), d1a8f61d3323447282ee6068aa623216 (127.16.126.4:33293)
I20251023 07:59:08.034904 18101 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5939b6a960ea4b0581b61ccdcdfa7c37" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
I20251023 07:59:08.035006 18246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5939b6a960ea4b0581b61ccdcdfa7c37" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
I20251023 07:59:08.035555 18101 raft_consensus.cc:3060] T 5939b6a960ea4b0581b61ccdcdfa7c37 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:59:08.035665 18246 raft_consensus.cc:3055] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 982df35c5b554a8fa64807352c4f34ee [term 2 LEADER]: Stepping down as leader of term 2
I20251023 07:59:08.036056 18246 raft_consensus.cc:740] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 982df35c5b554a8fa64807352c4f34ee [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Running, Role: LEADER
I20251023 07:59:08.035187 18787 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5939b6a960ea4b0581b61ccdcdfa7c37" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "d1a8f61d3323447282ee6068aa623216"
I20251023 07:59:08.037147 18787 raft_consensus.cc:3060] T 5939b6a960ea4b0581b61ccdcdfa7c37 P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:59:08.036810 18246 consensus_queue.cc:260] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:08.038028 18246 raft_consensus.cc:3060] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:59:08.042272 18101 raft_consensus.cc:2468] T 5939b6a960ea4b0581b61ccdcdfa7c37 P b3a1328f9c8c484fab08292ce2171ec9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 3.
I20251023 07:59:08.044973 18787 raft_consensus.cc:2468] T 5939b6a960ea4b0581b61ccdcdfa7c37 P d1a8f61d3323447282ee6068aa623216 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 3.
I20251023 07:59:08.046005 18142 leader_election.cc:304] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9, d1a8f61d3323447282ee6068aa623216; no voters:
I20251023 07:59:08.046541 18246 raft_consensus.cc:2468] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 982df35c5b554a8fa64807352c4f34ee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 3.
I20251023 07:59:08.046873 19334 raft_consensus.cc:2804] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 10dfae53d0c941f08bded43539841761 [term 3 FOLLOWER]: Leader election won for term 3
I20251023 07:59:08.047358 19334 raft_consensus.cc:697] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 10dfae53d0c941f08bded43539841761 [term 3 LEADER]: Becoming Leader. State: Replica: 10dfae53d0c941f08bded43539841761, State: Running, Role: LEADER
I20251023 07:59:08.048188 19334 consensus_queue.cc:237] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:08.058974 17997 catalog_manager.cc:5649] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 10dfae53d0c941f08bded43539841761 reported cstate change: term changed from 2 to 3, leader changed from 982df35c5b554a8fa64807352c4f34ee (127.16.126.3) to 10dfae53d0c941f08bded43539841761 (127.16.126.2), pending config changed. New cstate: current_term: 3 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:08.119160 18102 raft_consensus.cc:1275] T 2d81605b8fe7427b94af7f3c481ed765 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Refusing update from remote peer d1a8f61d3323447282ee6068aa623216: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20251023 07:59:08.120447 19272 consensus_queue.cc:1048] T 2d81605b8fe7427b94af7f3c481ed765 P d1a8f61d3323447282ee6068aa623216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20251023 07:59:08.130779 18171 raft_consensus.cc:1275] T 2d81605b8fe7427b94af7f3c481ed765 P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Refusing update from remote peer d1a8f61d3323447282ee6068aa623216: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20251023 07:59:08.134820 19272 consensus_queue.cc:1048] T 2d81605b8fe7427b94af7f3c481ed765 P d1a8f61d3323447282ee6068aa623216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20251023 07:59:08.452370 18246 raft_consensus.cc:1275] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 982df35c5b554a8fa64807352c4f34ee [term 3 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20251023 07:59:08.453466 19334 consensus_queue.cc:1048] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:59:08.504802 18101 raft_consensus.cc:1275] T 5939b6a960ea4b0581b61ccdcdfa7c37 P b3a1328f9c8c484fab08292ce2171ec9 [term 3 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20251023 07:59:08.505982 19310 consensus_queue.cc:1048] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:59:08.511713 19334 raft_consensus.cc:2955] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 10dfae53d0c941f08bded43539841761 [term 3 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:08.522003 18000 catalog_manager.cc:5649] T 5939b6a960ea4b0581b61ccdcdfa7c37 P b3a1328f9c8c484fab08292ce2171ec9 reported cstate change: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1), VOTER 10dfae53d0c941f08bded43539841761 (127.16.126.2), VOTER 982df35c5b554a8fa64807352c4f34ee (127.16.126.3), VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4). New cstate: current_term: 3 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:08.533838 18787 raft_consensus.cc:1275] T 5939b6a960ea4b0581b61ccdcdfa7c37 P d1a8f61d3323447282ee6068aa623216 [term 3 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20251023 07:59:08.535948 18246 raft_consensus.cc:2955] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 982df35c5b554a8fa64807352c4f34ee [term 3 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:08.535547 19310 consensus_queue.cc:1048] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.005s
I20251023 07:59:08.642377 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:59:08.683610 18176 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "33ee36de303b458e88fa6bad4587c0e6"
dest_uuid: "10dfae53d0c941f08bded43539841761"
mode: GRACEFUL
new_leader_uuid: "d1a8f61d3323447282ee6068aa623216"
from {username='slave'} at 127.0.0.1:47396
I20251023 07:59:08.684115 18176 raft_consensus.cc:606] T 33ee36de303b458e88fa6bad4587c0e6 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Received request to transfer leadership to TS d1a8f61d3323447282ee6068aa623216
I20251023 07:59:08.686480 18176 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "7fe190354178418bae8b7cc5abbb74ef"
dest_uuid: "10dfae53d0c941f08bded43539841761"
mode: GRACEFUL
new_leader_uuid: "d1a8f61d3323447282ee6068aa623216"
from {username='slave'} at 127.0.0.1:47396
I20251023 07:59:08.686929 18176 raft_consensus.cc:606] T 7fe190354178418bae8b7cc5abbb74ef P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Received request to transfer leadership to TS d1a8f61d3323447282ee6068aa623216
I20251023 07:59:08.689127 18101 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "9bc482083f3b4c9ba97b8769ece194ad"
dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
mode: GRACEFUL
new_leader_uuid: "982df35c5b554a8fa64807352c4f34ee"
from {username='slave'} at 127.0.0.1:34418
I20251023 07:59:08.689642 18101 raft_consensus.cc:606] T 9bc482083f3b4c9ba97b8769ece194ad P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Received request to transfer leadership to TS 982df35c5b554a8fa64807352c4f34ee
I20251023 07:59:08.692021 18176 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "d3b72ceda32a4ebc8de6e7a7992498aa"
dest_uuid: "10dfae53d0c941f08bded43539841761"
mode: GRACEFUL
new_leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
from {username='slave'} at 127.0.0.1:47396
I20251023 07:59:08.692526 18176 raft_consensus.cc:606] T d3b72ceda32a4ebc8de6e7a7992498aa P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Received request to transfer leadership to TS b3a1328f9c8c484fab08292ce2171ec9
I20251023 07:59:08.695631 18251 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "e25fd146cb564be69022d0f53010bbfa"
dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
mode: GRACEFUL
new_leader_uuid: "10dfae53d0c941f08bded43539841761"
from {username='slave'} at 127.0.0.1:60948
I20251023 07:59:08.696198 18251 raft_consensus.cc:606] T e25fd146cb564be69022d0f53010bbfa P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Received request to transfer leadership to TS 10dfae53d0c941f08bded43539841761
I20251023 07:59:08.697669 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20251023 07:59:08.699466 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 07:59:08.700165 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:59:08.778362 19280 raft_consensus.cc:993] T e25fd146cb564be69022d0f53010bbfa P 982df35c5b554a8fa64807352c4f34ee: : Instructing follower 10dfae53d0c941f08bded43539841761 to start an election
I20251023 07:59:08.778898 19240 raft_consensus.cc:1081] T e25fd146cb564be69022d0f53010bbfa P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Signalling peer 10dfae53d0c941f08bded43539841761 to start an election
I20251023 07:59:08.780175 18171 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "e25fd146cb564be69022d0f53010bbfa"
dest_uuid: "10dfae53d0c941f08bded43539841761"
from {username='slave'} at 127.0.0.1:51868
I20251023 07:59:08.780591 18171 raft_consensus.cc:493] T e25fd146cb564be69022d0f53010bbfa P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:59:08.780822 18171 raft_consensus.cc:3060] T e25fd146cb564be69022d0f53010bbfa P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:08.785689 18171 raft_consensus.cc:515] T e25fd146cb564be69022d0f53010bbfa P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:59:08.787097 18171 leader_election.cc:290] T e25fd146cb564be69022d0f53010bbfa P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 2 election: Requested vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:59:08.787683 18101 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e25fd146cb564be69022d0f53010bbfa" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
I20251023 07:59:08.788233 18101 raft_consensus.cc:3060] T e25fd146cb564be69022d0f53010bbfa P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:08.788391 18251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e25fd146cb564be69022d0f53010bbfa" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
I20251023 07:59:08.788852 18251 raft_consensus.cc:3055] T e25fd146cb564be69022d0f53010bbfa P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Stepping down as leader of term 1
I20251023 07:59:08.789052 18251 raft_consensus.cc:740] T e25fd146cb564be69022d0f53010bbfa P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Running, Role: LEADER
I20251023 07:59:08.789637 18251 consensus_queue.cc:260] T e25fd146cb564be69022d0f53010bbfa P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:59:08.790625 18251 raft_consensus.cc:3060] T e25fd146cb564be69022d0f53010bbfa P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:08.793629 18101 raft_consensus.cc:2468] T e25fd146cb564be69022d0f53010bbfa P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 2.
I20251023 07:59:08.794607 18143 leader_election.cc:304] T e25fd146cb564be69022d0f53010bbfa P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:59:08.795410 19227 raft_consensus.cc:2804] T e25fd146cb564be69022d0f53010bbfa P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:59:08.795835 18251 raft_consensus.cc:2468] T e25fd146cb564be69022d0f53010bbfa P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 2.
I20251023 07:59:08.796595 19227 raft_consensus.cc:697] T e25fd146cb564be69022d0f53010bbfa P 10dfae53d0c941f08bded43539841761 [term 2 LEADER]: Becoming Leader. State: Replica: 10dfae53d0c941f08bded43539841761, State: Running, Role: LEADER
I20251023 07:59:08.797595 19227 consensus_queue.cc:237] T e25fd146cb564be69022d0f53010bbfa P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:59:08.811236 17999 catalog_manager.cc:5649] T e25fd146cb564be69022d0f53010bbfa P 10dfae53d0c941f08bded43539841761 reported cstate change: term changed from 1 to 2, leader changed from 982df35c5b554a8fa64807352c4f34ee (127.16.126.3) to 10dfae53d0c941f08bded43539841761 (127.16.126.2). New cstate: current_term: 2 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:08.869828 18171 consensus_queue.cc:237] T 5585a11a884140c7abc7d5a3b6ab86f3 P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:59:08.876000 18247 raft_consensus.cc:1275] T 5585a11a884140c7abc7d5a3b6ab86f3 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20251023 07:59:08.876298 18142 consensus_peers.cc:597] T 5585a11a884140c7abc7d5a3b6ab86f3 P 10dfae53d0c941f08bded43539841761 -> Peer d1a8f61d3323447282ee6068aa623216 (127.16.126.4:33293): Couldn't send request to peer d1a8f61d3323447282ee6068aa623216. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5585a11a884140c7abc7d5a3b6ab86f3. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:08.877144 18101 raft_consensus.cc:1275] T 5585a11a884140c7abc7d5a3b6ab86f3 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251023 07:59:08.877445 19310 consensus_queue.cc:1048] T 5585a11a884140c7abc7d5a3b6ab86f3 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:08.879199 19334 consensus_queue.cc:1048] T 5585a11a884140c7abc7d5a3b6ab86f3 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:08.882251 18171 consensus_queue.cc:237] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:08.889150 18787 raft_consensus.cc:1275] T 5939b6a960ea4b0581b61ccdcdfa7c37 P d1a8f61d3323447282ee6068aa623216 [term 3 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20251023 07:59:08.890069 18101 raft_consensus.cc:1275] T 5939b6a960ea4b0581b61ccdcdfa7c37 P b3a1328f9c8c484fab08292ce2171ec9 [term 3 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20251023 07:59:08.891033 19227 consensus_queue.cc:1048] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20251023 07:59:08.890215 19367 raft_consensus.cc:2955] T 5585a11a884140c7abc7d5a3b6ab86f3 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:08.892010 19310 consensus_queue.cc:1048] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20251023 07:59:08.892084 18101 raft_consensus.cc:2955] T 5585a11a884140c7abc7d5a3b6ab86f3 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:08.898727 19310 raft_consensus.cc:2955] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 10dfae53d0c941f08bded43539841761 [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 3 to 6, VOTER 982df35c5b554a8fa64807352c4f34ee (127.16.126.3) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:08.900979 18247 raft_consensus.cc:2955] T 5585a11a884140c7abc7d5a3b6ab86f3 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:08.905126 18788 raft_consensus.cc:2955] T 5939b6a960ea4b0581b61ccdcdfa7c37 P d1a8f61d3323447282ee6068aa623216 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 3 to 6, VOTER 982df35c5b554a8fa64807352c4f34ee (127.16.126.3) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:08.903650 18102 raft_consensus.cc:2955] T 5939b6a960ea4b0581b61ccdcdfa7c37 P b3a1328f9c8c484fab08292ce2171ec9 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 3 to 6, VOTER 982df35c5b554a8fa64807352c4f34ee (127.16.126.3) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:08.925299 17999 catalog_manager.cc:5649] T 5585a11a884140c7abc7d5a3b6ab86f3 P 982df35c5b554a8fa64807352c4f34ee reported cstate change: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New cstate: current_term: 1 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:08.943291 19375 raft_consensus.cc:993] T 7fe190354178418bae8b7cc5abbb74ef P 10dfae53d0c941f08bded43539841761: : Instructing follower d1a8f61d3323447282ee6068aa623216 to start an election
I20251023 07:59:08.943822 19375 raft_consensus.cc:1081] T 7fe190354178418bae8b7cc5abbb74ef P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Signalling peer d1a8f61d3323447282ee6068aa623216 to start an election
I20251023 07:59:08.945273 18787 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "7fe190354178418bae8b7cc5abbb74ef"
dest_uuid: "d1a8f61d3323447282ee6068aa623216"
from {username='slave'} at 127.0.0.1:36500
I20251023 07:59:08.945816 18787 raft_consensus.cc:493] T 7fe190354178418bae8b7cc5abbb74ef P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:59:08.946143 18787 raft_consensus.cc:3060] T 7fe190354178418bae8b7cc5abbb74ef P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:08.946264 18096 consensus_queue.cc:237] T c6022ad5a70c4b4f8f34339956122cb7 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
W20251023 07:59:08.957003 18067 consensus_peers.cc:597] T c6022ad5a70c4b4f8f34339956122cb7 P b3a1328f9c8c484fab08292ce2171ec9 -> Peer d1a8f61d3323447282ee6068aa623216 (127.16.126.4:33293): Couldn't send request to peer d1a8f61d3323447282ee6068aa623216. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c6022ad5a70c4b4f8f34339956122cb7. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:08.958527 18247 raft_consensus.cc:1275] T c6022ad5a70c4b4f8f34339956122cb7 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251023 07:59:08.964298 18787 raft_consensus.cc:515] T 7fe190354178418bae8b7cc5abbb74ef P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:08.965044 19379 consensus_queue.cc:1048] T c6022ad5a70c4b4f8f34339956122cb7 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20251023 07:59:08.968271 18173 raft_consensus.cc:1275] T c6022ad5a70c4b4f8f34339956122cb7 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251023 07:59:08.968294 18787 leader_election.cc:290] T 7fe190354178418bae8b7cc5abbb74ef P d1a8f61d3323447282ee6068aa623216 [CANDIDATE]: Term 2 election: Requested vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:59:08.968529 18096 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7fe190354178418bae8b7cc5abbb74ef" candidate_uuid: "d1a8f61d3323447282ee6068aa623216" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
I20251023 07:59:08.969702 18096 raft_consensus.cc:3060] T 7fe190354178418bae8b7cc5abbb74ef P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:08.969945 19302 consensus_queue.cc:1048] T c6022ad5a70c4b4f8f34339956122cb7 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:08.970992 18176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7fe190354178418bae8b7cc5abbb74ef" candidate_uuid: "d1a8f61d3323447282ee6068aa623216" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "10dfae53d0c941f08bded43539841761"
I20251023 07:59:08.971637 18176 raft_consensus.cc:3055] T 7fe190354178418bae8b7cc5abbb74ef P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Stepping down as leader of term 1
I20251023 07:59:08.971994 18176 raft_consensus.cc:740] T 7fe190354178418bae8b7cc5abbb74ef P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Running, Role: LEADER
I20251023 07:59:08.972784 18176 consensus_queue.cc:260] T 7fe190354178418bae8b7cc5abbb74ef P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:08.974459 18176 raft_consensus.cc:3060] T 7fe190354178418bae8b7cc5abbb74ef P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:08.979779 17999 catalog_manager.cc:5649] T 5939b6a960ea4b0581b61ccdcdfa7c37 P d1a8f61d3323447282ee6068aa623216 reported cstate change: config changed from index 3 to 6, VOTER 982df35c5b554a8fa64807352c4f34ee (127.16.126.3) evicted. New cstate: current_term: 3 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:08.992683 19334 raft_consensus.cc:993] T 33ee36de303b458e88fa6bad4587c0e6 P 10dfae53d0c941f08bded43539841761: : Instructing follower d1a8f61d3323447282ee6068aa623216 to start an election
I20251023 07:59:08.993983 19334 raft_consensus.cc:1081] T 33ee36de303b458e88fa6bad4587c0e6 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Signalling peer d1a8f61d3323447282ee6068aa623216 to start an election
I20251023 07:59:08.995129 19339 raft_consensus.cc:2955] T c6022ad5a70c4b4f8f34339956122cb7 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:08.996784 18788 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "33ee36de303b458e88fa6bad4587c0e6"
dest_uuid: "d1a8f61d3323447282ee6068aa623216"
from {username='slave'} at 127.0.0.1:36500
I20251023 07:59:08.997354 18788 raft_consensus.cc:493] T 33ee36de303b458e88fa6bad4587c0e6 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:59:09.008215 18788 raft_consensus.cc:3060] T 33ee36de303b458e88fa6bad4587c0e6 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:09.012902 18171 raft_consensus.cc:2955] T c6022ad5a70c4b4f8f34339956122cb7 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:09.020236 17985 catalog_manager.cc:5162] ChangeConfig:REMOVE_PEER RPC for tablet 5939b6a960ea4b0581b61ccdcdfa7c37 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 7)
I20251023 07:59:09.023471 18176 raft_consensus.cc:2468] T 7fe190354178418bae8b7cc5abbb74ef P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1a8f61d3323447282ee6068aa623216 in term 2.
I20251023 07:59:09.025965 18753 leader_election.cc:304] T 7fe190354178418bae8b7cc5abbb74ef P d1a8f61d3323447282ee6068aa623216 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, d1a8f61d3323447282ee6068aa623216; no voters:
I20251023 07:59:09.027208 19317 raft_consensus.cc:2804] T 7fe190354178418bae8b7cc5abbb74ef P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:59:09.027698 19317 raft_consensus.cc:697] T 7fe190354178418bae8b7cc5abbb74ef P d1a8f61d3323447282ee6068aa623216 [term 2 LEADER]: Becoming Leader. State: Replica: d1a8f61d3323447282ee6068aa623216, State: Running, Role: LEADER
I20251023 07:59:09.028329 19377 raft_consensus.cc:993] T d3b72ceda32a4ebc8de6e7a7992498aa P 10dfae53d0c941f08bded43539841761: : Instructing follower b3a1328f9c8c484fab08292ce2171ec9 to start an election
I20251023 07:59:09.028812 19377 raft_consensus.cc:1081] T d3b72ceda32a4ebc8de6e7a7992498aa P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Signalling peer b3a1328f9c8c484fab08292ce2171ec9 to start an election
I20251023 07:59:09.028640 19317 consensus_queue.cc:237] T 7fe190354178418bae8b7cc5abbb74ef P d1a8f61d3323447282ee6068aa623216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:09.025507 18788 raft_consensus.cc:515] T 33ee36de303b458e88fa6bad4587c0e6 P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:09.035144 18176 consensus_queue.cc:237] T 85799f6eb6ae41fa9620accb877d8708 P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:59:09.037020 18173 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "33ee36de303b458e88fa6bad4587c0e6" candidate_uuid: "d1a8f61d3323447282ee6068aa623216" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "10dfae53d0c941f08bded43539841761"
I20251023 07:59:09.055934 18173 raft_consensus.cc:3055] T 33ee36de303b458e88fa6bad4587c0e6 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Stepping down as leader of term 1
I20251023 07:59:09.056288 18173 raft_consensus.cc:740] T 33ee36de303b458e88fa6bad4587c0e6 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Running, Role: LEADER
I20251023 07:59:09.056994 18173 consensus_queue.cc:260] T 33ee36de303b458e88fa6bad4587c0e6 P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:09.038666 18251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "33ee36de303b458e88fa6bad4587c0e6" candidate_uuid: "d1a8f61d3323447282ee6068aa623216" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
I20251023 07:59:09.058109 18173 raft_consensus.cc:3060] T 33ee36de303b458e88fa6bad4587c0e6 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:09.058416 18251 raft_consensus.cc:3060] T 33ee36de303b458e88fa6bad4587c0e6 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:09.057906 18000 catalog_manager.cc:5649] T 7fe190354178418bae8b7cc5abbb74ef P d1a8f61d3323447282ee6068aa623216 reported cstate change: term changed from 1 to 2, leader changed from 10dfae53d0c941f08bded43539841761 (127.16.126.2) to d1a8f61d3323447282ee6068aa623216 (127.16.126.4). New cstate: current_term: 2 leader_uuid: "d1a8f61d3323447282ee6068aa623216" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251023 07:59:09.064965 18173 raft_consensus.cc:2468] T 33ee36de303b458e88fa6bad4587c0e6 P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1a8f61d3323447282ee6068aa623216 in term 2.
I20251023 07:59:09.066717 18753 leader_election.cc:304] T 33ee36de303b458e88fa6bad4587c0e6 P d1a8f61d3323447282ee6068aa623216 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, d1a8f61d3323447282ee6068aa623216; no voters:
I20251023 07:59:09.038174 18101 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "d3b72ceda32a4ebc8de6e7a7992498aa"
dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
from {username='slave'} at 127.0.0.1:53946
I20251023 07:59:09.039228 18788 leader_election.cc:290] T 33ee36de303b458e88fa6bad4587c0e6 P d1a8f61d3323447282ee6068aa623216 [CANDIDATE]: Term 2 election: Requested vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:59:09.019372 18096 raft_consensus.cc:2468] T 7fe190354178418bae8b7cc5abbb74ef P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1a8f61d3323447282ee6068aa623216 in term 2.
I20251023 07:59:09.073932 18251 raft_consensus.cc:2468] T 33ee36de303b458e88fa6bad4587c0e6 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1a8f61d3323447282ee6068aa623216 in term 2.
I20251023 07:59:09.073282 18246 raft_consensus.cc:2955] T c6022ad5a70c4b4f8f34339956122cb7 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:09.074673 18101 raft_consensus.cc:493] T d3b72ceda32a4ebc8de6e7a7992498aa P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:59:09.074951 18101 raft_consensus.cc:3060] T d3b72ceda32a4ebc8de6e7a7992498aa P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:09.042071 18237 tablet_service.cc:1552] Processing DeleteTablet for tablet 5939b6a960ea4b0581b61ccdcdfa7c37 with delete_type TABLET_DATA_TOMBSTONED (TS 982df35c5b554a8fa64807352c4f34ee not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:49846
I20251023 07:59:09.052378 17999 catalog_manager.cc:5649] T c6022ad5a70c4b4f8f34339956122cb7 P b3a1328f9c8c484fab08292ce2171ec9 reported cstate change: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New cstate: current_term: 1 leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:09.071398 19317 raft_consensus.cc:2804] T 33ee36de303b458e88fa6bad4587c0e6 P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:59:09.074113 19339 raft_consensus.cc:993] T 9bc482083f3b4c9ba97b8769ece194ad P b3a1328f9c8c484fab08292ce2171ec9: : Instructing follower 982df35c5b554a8fa64807352c4f34ee to start an election
I20251023 07:59:09.087483 18101 raft_consensus.cc:515] T d3b72ceda32a4ebc8de6e7a7992498aa P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:59:09.089907 18101 leader_election.cc:290] T d3b72ceda32a4ebc8de6e7a7992498aa P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 2 election: Requested vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:59:09.098755 18251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d3b72ceda32a4ebc8de6e7a7992498aa" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
I20251023 07:59:09.082773 19317 raft_consensus.cc:697] T 33ee36de303b458e88fa6bad4587c0e6 P d1a8f61d3323447282ee6068aa623216 [term 2 LEADER]: Becoming Leader. State: Replica: d1a8f61d3323447282ee6068aa623216, State: Running, Role: LEADER
I20251023 07:59:09.099416 18251 raft_consensus.cc:3060] T d3b72ceda32a4ebc8de6e7a7992498aa P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:09.100312 19317 consensus_queue.cc:237] T 33ee36de303b458e88fa6bad4587c0e6 P d1a8f61d3323447282ee6068aa623216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:09.084005 19339 raft_consensus.cc:1081] T 9bc482083f3b4c9ba97b8769ece194ad P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Signalling peer 982df35c5b554a8fa64807352c4f34ee to start an election
I20251023 07:59:09.105720 19384 tablet_replica.cc:333] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 982df35c5b554a8fa64807352c4f34ee: stopping tablet replica
I20251023 07:59:09.106388 18176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d3b72ceda32a4ebc8de6e7a7992498aa" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "10dfae53d0c941f08bded43539841761"
I20251023 07:59:09.106984 18176 raft_consensus.cc:3055] T d3b72ceda32a4ebc8de6e7a7992498aa P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Stepping down as leader of term 1
I20251023 07:59:09.107259 18176 raft_consensus.cc:740] T d3b72ceda32a4ebc8de6e7a7992498aa P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Running, Role: LEADER
I20251023 07:59:09.108012 18247 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "9bc482083f3b4c9ba97b8769ece194ad"
dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
from {username='slave'} at 127.0.0.1:49420
I20251023 07:59:09.108549 18247 raft_consensus.cc:493] T 9bc482083f3b4c9ba97b8769ece194ad P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:59:09.108891 18247 raft_consensus.cc:3060] T 9bc482083f3b4c9ba97b8769ece194ad P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Advancing to term 2
W20251023 07:59:09.109211 18142 consensus_peers.cc:597] T 85799f6eb6ae41fa9620accb877d8708 P 10dfae53d0c941f08bded43539841761 -> Peer d1a8f61d3323447282ee6068aa623216 (127.16.126.4:33293): Couldn't send request to peer d1a8f61d3323447282ee6068aa623216. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 85799f6eb6ae41fa9620accb877d8708. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:09.111069 18251 raft_consensus.cc:2468] T d3b72ceda32a4ebc8de6e7a7992498aa P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3a1328f9c8c484fab08292ce2171ec9 in term 2.
I20251023 07:59:09.113153 18101 raft_consensus.cc:1275] T 85799f6eb6ae41fa9620accb877d8708 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251023 07:59:09.113340 18067 leader_election.cc:304] T d3b72ceda32a4ebc8de6e7a7992498aa P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:59:09.114741 19377 consensus_queue.cc:1048] T 85799f6eb6ae41fa9620accb877d8708 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:09.115092 19302 raft_consensus.cc:2804] T d3b72ceda32a4ebc8de6e7a7992498aa P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:59:09.115674 19302 raft_consensus.cc:697] T d3b72ceda32a4ebc8de6e7a7992498aa P b3a1328f9c8c484fab08292ce2171ec9 [term 2 LEADER]: Becoming Leader. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Running, Role: LEADER
I20251023 07:59:09.116357 18246 raft_consensus.cc:1275] T 85799f6eb6ae41fa9620accb877d8708 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251023 07:59:09.116628 19302 consensus_queue.cc:237] T d3b72ceda32a4ebc8de6e7a7992498aa P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:59:09.118315 19384 raft_consensus.cc:2243] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 982df35c5b554a8fa64807352c4f34ee [term 3 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:09.118355 19377 consensus_queue.cc:1048] T 85799f6eb6ae41fa9620accb877d8708 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20251023 07:59:09.119035 18176 consensus_queue.cc:260] T d3b72ceda32a4ebc8de6e7a7992498aa P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:59:09.121367 18176 raft_consensus.cc:3060] T d3b72ceda32a4ebc8de6e7a7992498aa P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:09.122145 19384 raft_consensus.cc:2272] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 982df35c5b554a8fa64807352c4f34ee [term 3 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:09.133450 19384 ts_tablet_manager.cc:1916] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 982df35c5b554a8fa64807352c4f34ee: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251023 07:59:09.144127 19376 raft_consensus.cc:2955] T 85799f6eb6ae41fa9620accb877d8708 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:09.146049 18246 raft_consensus.cc:2955] T 85799f6eb6ae41fa9620accb877d8708 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:09.115670 18247 raft_consensus.cc:515] T 9bc482083f3b4c9ba97b8769ece194ad P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:09.154289 18096 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bc482083f3b4c9ba97b8769ece194ad" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
I20251023 07:59:09.154903 18096 raft_consensus.cc:3055] T 9bc482083f3b4c9ba97b8769ece194ad P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Stepping down as leader of term 1
I20251023 07:59:09.155172 18788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bc482083f3b4c9ba97b8769ece194ad" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d1a8f61d3323447282ee6068aa623216"
I20251023 07:59:09.155695 18788 raft_consensus.cc:3060] T 9bc482083f3b4c9ba97b8769ece194ad P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:09.155195 18096 raft_consensus.cc:740] T 9bc482083f3b4c9ba97b8769ece194ad P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Running, Role: LEADER
I20251023 07:59:09.156656 18096 consensus_queue.cc:260] T 9bc482083f3b4c9ba97b8769ece194ad P b3a1328f9c8c484fab08292ce2171ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:09.157712 18096 raft_consensus.cc:3060] T 9bc482083f3b4c9ba97b8769ece194ad P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:09.159299 18247 leader_election.cc:290] T 9bc482083f3b4c9ba97b8769ece194ad P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 2 election: Requested vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), d1a8f61d3323447282ee6068aa623216 (127.16.126.4:33293)
I20251023 07:59:09.161374 18251 consensus_queue.cc:237] T e85adbfd669946ce9f939c02865fea6a P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:59:09.164820 18176 raft_consensus.cc:2468] T d3b72ceda32a4ebc8de6e7a7992498aa P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3a1328f9c8c484fab08292ce2171ec9 in term 2.
I20251023 07:59:09.172848 18096 raft_consensus.cc:2468] T 9bc482083f3b4c9ba97b8769ece194ad P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 2.
I20251023 07:59:09.174996 18788 raft_consensus.cc:2468] T 9bc482083f3b4c9ba97b8769ece194ad P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 2.
I20251023 07:59:09.175989 18217 leader_election.cc:304] T 9bc482083f3b4c9ba97b8769ece194ad P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:59:09.176203 18000 catalog_manager.cc:5649] T 33ee36de303b458e88fa6bad4587c0e6 P d1a8f61d3323447282ee6068aa623216 reported cstate change: term changed from 1 to 2, leader changed from 10dfae53d0c941f08bded43539841761 (127.16.126.2) to d1a8f61d3323447282ee6068aa623216 (127.16.126.4). New cstate: current_term: 2 leader_uuid: "d1a8f61d3323447282ee6068aa623216" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251023 07:59:09.178572 17997 catalog_manager.cc:5649] T d3b72ceda32a4ebc8de6e7a7992498aa P b3a1328f9c8c484fab08292ce2171ec9 reported cstate change: term changed from 1 to 2, leader changed from 10dfae53d0c941f08bded43539841761 (127.16.126.2) to b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1). New cstate: current_term: 2 leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:09.181113 19240 raft_consensus.cc:2804] T 9bc482083f3b4c9ba97b8769ece194ad P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:59:09.181667 19240 raft_consensus.cc:697] T 9bc482083f3b4c9ba97b8769ece194ad P 982df35c5b554a8fa64807352c4f34ee [term 2 LEADER]: Becoming Leader. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Running, Role: LEADER
I20251023 07:59:09.182521 19240 consensus_queue.cc:237] T 9bc482083f3b4c9ba97b8769ece194ad P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:09.187920 19384 ts_tablet_manager.cc:1929] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 982df35c5b554a8fa64807352c4f34ee: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20251023 07:59:09.188385 19384 log.cc:1199] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 982df35c5b554a8fa64807352c4f34ee: Deleting WAL directory at /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1761206251627710-16888-0/minicluster-data/ts-2-root/wals/5939b6a960ea4b0581b61ccdcdfa7c37
W20251023 07:59:09.202111 18216 consensus_peers.cc:597] T e85adbfd669946ce9f939c02865fea6a P 982df35c5b554a8fa64807352c4f34ee -> Peer d1a8f61d3323447282ee6068aa623216 (127.16.126.4:33293): Couldn't send request to peer d1a8f61d3323447282ee6068aa623216. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e85adbfd669946ce9f939c02865fea6a. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:09.204010 17986 catalog_manager.cc:4985] TS 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): tablet 5939b6a960ea4b0581b61ccdcdfa7c37 (table test-workload [id=8bb191a5531a4d4fb58a25b13d592213]) successfully deleted
I20251023 07:59:09.207813 18173 raft_consensus.cc:1275] T e85adbfd669946ce9f939c02865fea6a P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251023 07:59:09.213171 19240 consensus_queue.cc:1048] T e85adbfd669946ce9f939c02865fea6a P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:09.214488 18096 raft_consensus.cc:1275] T e85adbfd669946ce9f939c02865fea6a P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251023 07:59:09.212491 18102 raft_consensus.cc:2955] T 85799f6eb6ae41fa9620accb877d8708 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:09.214850 17998 catalog_manager.cc:5649] T 85799f6eb6ae41fa9620accb877d8708 P 982df35c5b554a8fa64807352c4f34ee reported cstate change: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New cstate: current_term: 1 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:09.216542 19240 consensus_queue.cc:1048] T e85adbfd669946ce9f939c02865fea6a P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20251023 07:59:09.270875 18247 raft_consensus.cc:1275] T e25fd146cb564be69022d0f53010bbfa P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:09.272351 19310 consensus_queue.cc:1048] T e25fd146cb564be69022d0f53010bbfa P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:09.273252 19394 ts_tablet_manager.cc:933] T 5585a11a884140c7abc7d5a3b6ab86f3 P d1a8f61d3323447282ee6068aa623216: Initiating tablet copy from peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:59:09.276108 19240 raft_consensus.cc:2955] T e85adbfd669946ce9f939c02865fea6a P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:09.283888 17998 catalog_manager.cc:5649] T 9bc482083f3b4c9ba97b8769ece194ad P 982df35c5b554a8fa64807352c4f34ee reported cstate change: term changed from 1 to 2, leader changed from b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1) to 982df35c5b554a8fa64807352c4f34ee (127.16.126.3). New cstate: current_term: 2 leader_uuid: "982df35c5b554a8fa64807352c4f34ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:09.288185 18173 raft_consensus.cc:2955] T e85adbfd669946ce9f939c02865fea6a P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:09.299126 18101 raft_consensus.cc:2955] T e85adbfd669946ce9f939c02865fea6a P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:09.310842 19394 tablet_copy_client.cc:323] T 5585a11a884140c7abc7d5a3b6ab86f3 P d1a8f61d3323447282ee6068aa623216: tablet copy: Beginning tablet copy session from remote peer at address 127.16.126.2:45799
I20251023 07:59:09.311762 18102 raft_consensus.cc:1275] T e25fd146cb564be69022d0f53010bbfa P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:09.313611 18186 tablet_copy_service.cc:140] P 10dfae53d0c941f08bded43539841761: Received BeginTabletCopySession request for tablet 5585a11a884140c7abc7d5a3b6ab86f3 from peer d1a8f61d3323447282ee6068aa623216 ({username='slave'} at 127.0.0.1:50534)
I20251023 07:59:09.314222 18186 tablet_copy_service.cc:161] P 10dfae53d0c941f08bded43539841761: Beginning new tablet copy session on tablet 5585a11a884140c7abc7d5a3b6ab86f3 from peer d1a8f61d3323447282ee6068aa623216 at {username='slave'} at 127.0.0.1:50534: session id = d1a8f61d3323447282ee6068aa623216-5585a11a884140c7abc7d5a3b6ab86f3
I20251023 07:59:09.324512 19310 consensus_queue.cc:1048] T e25fd146cb564be69022d0f53010bbfa P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:09.328306 17998 catalog_manager.cc:5649] T e85adbfd669946ce9f939c02865fea6a P 10dfae53d0c941f08bded43539841761 reported cstate change: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New cstate: current_term: 1 leader_uuid: "982df35c5b554a8fa64807352c4f34ee" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:09.338276 18186 tablet_copy_source_session.cc:215] T 5585a11a884140c7abc7d5a3b6ab86f3 P 10dfae53d0c941f08bded43539841761: Tablet Copy: opened 0 blocks and 1 log segments
I20251023 07:59:09.342347 19394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5585a11a884140c7abc7d5a3b6ab86f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:09.397866 19394 tablet_copy_client.cc:806] T 5585a11a884140c7abc7d5a3b6ab86f3 P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 0 data blocks...
I20251023 07:59:09.399646 19394 tablet_copy_client.cc:670] T 5585a11a884140c7abc7d5a3b6ab86f3 P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 1 WAL segments...
I20251023 07:59:09.401008 19403 ts_tablet_manager.cc:933] T c6022ad5a70c4b4f8f34339956122cb7 P d1a8f61d3323447282ee6068aa623216: Initiating tablet copy from peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025)
I20251023 07:59:09.405073 19403 tablet_copy_client.cc:323] T c6022ad5a70c4b4f8f34339956122cb7 P d1a8f61d3323447282ee6068aa623216: tablet copy: Beginning tablet copy session from remote peer at address 127.16.126.1:44025
I20251023 07:59:09.406380 19394 tablet_copy_client.cc:538] T 5585a11a884140c7abc7d5a3b6ab86f3 P d1a8f61d3323447282ee6068aa623216: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251023 07:59:09.406646 18111 tablet_copy_service.cc:140] P b3a1328f9c8c484fab08292ce2171ec9: Received BeginTabletCopySession request for tablet c6022ad5a70c4b4f8f34339956122cb7 from peer d1a8f61d3323447282ee6068aa623216 ({username='slave'} at 127.0.0.1:57714)
I20251023 07:59:09.407202 18111 tablet_copy_service.cc:161] P b3a1328f9c8c484fab08292ce2171ec9: Beginning new tablet copy session on tablet c6022ad5a70c4b4f8f34339956122cb7 from peer d1a8f61d3323447282ee6068aa623216 at {username='slave'} at 127.0.0.1:57714: session id = d1a8f61d3323447282ee6068aa623216-c6022ad5a70c4b4f8f34339956122cb7
I20251023 07:59:09.415248 19394 tablet_bootstrap.cc:492] T 5585a11a884140c7abc7d5a3b6ab86f3 P d1a8f61d3323447282ee6068aa623216: Bootstrap starting.
I20251023 07:59:09.421231 18111 tablet_copy_source_session.cc:215] T c6022ad5a70c4b4f8f34339956122cb7 P b3a1328f9c8c484fab08292ce2171ec9: Tablet Copy: opened 0 blocks and 1 log segments
I20251023 07:59:09.427985 19403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6022ad5a70c4b4f8f34339956122cb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:09.439426 19394 tablet_bootstrap.cc:492] T 5585a11a884140c7abc7d5a3b6ab86f3 P d1a8f61d3323447282ee6068aa623216: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:59:09.440316 19394 tablet_bootstrap.cc:492] T 5585a11a884140c7abc7d5a3b6ab86f3 P d1a8f61d3323447282ee6068aa623216: Bootstrap complete.
I20251023 07:59:09.441028 19394 ts_tablet_manager.cc:1403] T 5585a11a884140c7abc7d5a3b6ab86f3 P d1a8f61d3323447282ee6068aa623216: Time spent bootstrapping tablet: real 0.026s user 0.019s sys 0.004s
I20251023 07:59:09.443565 19394 raft_consensus.cc:359] T 5585a11a884140c7abc7d5a3b6ab86f3 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:59:09.444288 19394 raft_consensus.cc:740] T 5585a11a884140c7abc7d5a3b6ab86f3 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d1a8f61d3323447282ee6068aa623216, State: Initialized, Role: LEARNER
I20251023 07:59:09.444906 19394 consensus_queue.cc:260] T 5585a11a884140c7abc7d5a3b6ab86f3 P d1a8f61d3323447282ee6068aa623216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:59:09.447853 19394 ts_tablet_manager.cc:1434] T 5585a11a884140c7abc7d5a3b6ab86f3 P d1a8f61d3323447282ee6068aa623216: Time spent starting tablet: real 0.007s user 0.003s sys 0.003s
I20251023 07:59:09.452224 18173 raft_consensus.cc:1275] T 7fe190354178418bae8b7cc5abbb74ef P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Refusing update from remote peer d1a8f61d3323447282ee6068aa623216: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20251023 07:59:09.454119 18186 tablet_copy_service.cc:342] P 10dfae53d0c941f08bded43539841761: Request end of tablet copy session d1a8f61d3323447282ee6068aa623216-5585a11a884140c7abc7d5a3b6ab86f3 received from {username='slave'} at 127.0.0.1:50534
I20251023 07:59:09.454526 18186 tablet_copy_service.cc:434] P 10dfae53d0c941f08bded43539841761: ending tablet copy session d1a8f61d3323447282ee6068aa623216-5585a11a884140c7abc7d5a3b6ab86f3 on tablet 5585a11a884140c7abc7d5a3b6ab86f3 with peer d1a8f61d3323447282ee6068aa623216
I20251023 07:59:09.455528 19317 consensus_queue.cc:1048] T 7fe190354178418bae8b7cc5abbb74ef P d1a8f61d3323447282ee6068aa623216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20251023 07:59:09.479599 18102 raft_consensus.cc:1275] T 7fe190354178418bae8b7cc5abbb74ef P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Refusing update from remote peer d1a8f61d3323447282ee6068aa623216: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20251023 07:59:09.482328 19317 consensus_queue.cc:1048] T 7fe190354178418bae8b7cc5abbb74ef P d1a8f61d3323447282ee6068aa623216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20251023 07:59:09.512248 18247 raft_consensus.cc:1275] T 33ee36de303b458e88fa6bad4587c0e6 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Refusing update from remote peer d1a8f61d3323447282ee6068aa623216: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20251023 07:59:09.512554 19403 tablet_copy_client.cc:806] T c6022ad5a70c4b4f8f34339956122cb7 P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 0 data blocks...
I20251023 07:59:09.513195 19403 tablet_copy_client.cc:670] T c6022ad5a70c4b4f8f34339956122cb7 P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 1 WAL segments...
I20251023 07:59:09.514019 19317 consensus_queue.cc:1048] T 33ee36de303b458e88fa6bad4587c0e6 P d1a8f61d3323447282ee6068aa623216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20251023 07:59:09.517815 19403 tablet_copy_client.cc:538] T c6022ad5a70c4b4f8f34339956122cb7 P d1a8f61d3323447282ee6068aa623216: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251023 07:59:09.532280 19403 tablet_bootstrap.cc:492] T c6022ad5a70c4b4f8f34339956122cb7 P d1a8f61d3323447282ee6068aa623216: Bootstrap starting.
I20251023 07:59:09.535952 18173 raft_consensus.cc:1275] T 33ee36de303b458e88fa6bad4587c0e6 P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Refusing update from remote peer d1a8f61d3323447282ee6068aa623216: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20251023 07:59:09.539341 18171 raft_consensus.cc:1275] T d3b72ceda32a4ebc8de6e7a7992498aa P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:09.571501 19408 consensus_queue.cc:1048] T 33ee36de303b458e88fa6bad4587c0e6 P d1a8f61d3323447282ee6068aa623216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20251023 07:59:09.599581 19374 consensus_queue.cc:1048] T d3b72ceda32a4ebc8de6e7a7992498aa P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20251023 07:59:09.740231 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:59:09.773154 19403 tablet_bootstrap.cc:492] T c6022ad5a70c4b4f8f34339956122cb7 P d1a8f61d3323447282ee6068aa623216: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:59:09.774341 19403 tablet_bootstrap.cc:492] T c6022ad5a70c4b4f8f34339956122cb7 P d1a8f61d3323447282ee6068aa623216: Bootstrap complete.
I20251023 07:59:09.782136 19403 ts_tablet_manager.cc:1403] T c6022ad5a70c4b4f8f34339956122cb7 P d1a8f61d3323447282ee6068aa623216: Time spent bootstrapping tablet: real 0.250s user 0.042s sys 0.011s
I20251023 07:59:09.787437 18243 raft_consensus.cc:1275] T d3b72ceda32a4ebc8de6e7a7992498aa P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:09.791257 18788 raft_consensus.cc:1217] T 5585a11a884140c7abc7d5a3b6ab86f3 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20251023 07:59:09.792531 18101 raft_consensus.cc:1275] T 9bc482083f3b4c9ba97b8769ece194ad P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20251023 07:59:09.785131 19403 raft_consensus.cc:359] T c6022ad5a70c4b4f8f34339956122cb7 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:59:09.794348 19403 raft_consensus.cc:740] T c6022ad5a70c4b4f8f34339956122cb7 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d1a8f61d3323447282ee6068aa623216, State: Initialized, Role: LEARNER
I20251023 07:59:09.795063 19403 consensus_queue.cc:260] T c6022ad5a70c4b4f8f34339956122cb7 P d1a8f61d3323447282ee6068aa623216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:59:09.797737 19403 ts_tablet_manager.cc:1434] T c6022ad5a70c4b4f8f34339956122cb7 P d1a8f61d3323447282ee6068aa623216: Time spent starting tablet: real 0.015s user 0.002s sys 0.004s
I20251023 07:59:09.801638 19339 consensus_queue.cc:1048] T d3b72ceda32a4ebc8de6e7a7992498aa P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:09.828413 19421 consensus_queue.cc:1048] T 9bc482083f3b4c9ba97b8769ece194ad P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20251023 07:59:09.841261 18111 tablet_copy_service.cc:342] P b3a1328f9c8c484fab08292ce2171ec9: Request end of tablet copy session d1a8f61d3323447282ee6068aa623216-c6022ad5a70c4b4f8f34339956122cb7 received from {username='slave'} at 127.0.0.1:57714
I20251023 07:59:09.841954 18111 tablet_copy_service.cc:434] P b3a1328f9c8c484fab08292ce2171ec9: ending tablet copy session d1a8f61d3323447282ee6068aa623216-c6022ad5a70c4b4f8f34339956122cb7 on tablet c6022ad5a70c4b4f8f34339956122cb7 with peer d1a8f61d3323447282ee6068aa623216
I20251023 07:59:09.873579 18784 raft_consensus.cc:1275] T 9bc482083f3b4c9ba97b8769ece194ad P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20251023 07:59:09.874825 19403 ts_tablet_manager.cc:933] T e85adbfd669946ce9f939c02865fea6a P d1a8f61d3323447282ee6068aa623216: Initiating tablet copy from peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:59:09.888505 19240 consensus_queue.cc:1048] T 9bc482083f3b4c9ba97b8769ece194ad P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20251023 07:59:09.905289 18217 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.1:44025, user_credentials={real_user=slave}} blocked reactor thread for 77488.9us
I20251023 07:59:09.919623 19403 tablet_copy_client.cc:323] T e85adbfd669946ce9f939c02865fea6a P d1a8f61d3323447282ee6068aa623216: tablet copy: Beginning tablet copy session from remote peer at address 127.16.126.3:46061
I20251023 07:59:09.924666 18261 tablet_copy_service.cc:140] P 982df35c5b554a8fa64807352c4f34ee: Received BeginTabletCopySession request for tablet e85adbfd669946ce9f939c02865fea6a from peer d1a8f61d3323447282ee6068aa623216 ({username='slave'} at 127.0.0.1:40260)
I20251023 07:59:09.925251 18261 tablet_copy_service.cc:161] P 982df35c5b554a8fa64807352c4f34ee: Beginning new tablet copy session on tablet e85adbfd669946ce9f939c02865fea6a from peer d1a8f61d3323447282ee6068aa623216 at {username='slave'} at 127.0.0.1:40260: session id = d1a8f61d3323447282ee6068aa623216-e85adbfd669946ce9f939c02865fea6a
I20251023 07:59:09.941192 18261 tablet_copy_source_session.cc:215] T e85adbfd669946ce9f939c02865fea6a P 982df35c5b554a8fa64807352c4f34ee: Tablet Copy: opened 0 blocks and 1 log segments
I20251023 07:59:09.946727 19403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e85adbfd669946ce9f939c02865fea6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:09.958122 18788 raft_consensus.cc:1217] T c6022ad5a70c4b4f8f34339956122cb7 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20251023 07:59:10.012933 19403 tablet_copy_client.cc:806] T e85adbfd669946ce9f939c02865fea6a P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 0 data blocks...
I20251023 07:59:10.045981 19403 tablet_copy_client.cc:670] T e85adbfd669946ce9f939c02865fea6a P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 1 WAL segments...
I20251023 07:59:10.058730 19432 ts_tablet_manager.cc:933] T 85799f6eb6ae41fa9620accb877d8708 P d1a8f61d3323447282ee6068aa623216: Initiating tablet copy from peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:59:10.053613 19403 tablet_copy_client.cc:538] T e85adbfd669946ce9f939c02865fea6a P d1a8f61d3323447282ee6068aa623216: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251023 07:59:10.074388 19432 tablet_copy_client.cc:323] T 85799f6eb6ae41fa9620accb877d8708 P d1a8f61d3323447282ee6068aa623216: tablet copy: Beginning tablet copy session from remote peer at address 127.16.126.2:45799
I20251023 07:59:10.076205 18186 tablet_copy_service.cc:140] P 10dfae53d0c941f08bded43539841761: Received BeginTabletCopySession request for tablet 85799f6eb6ae41fa9620accb877d8708 from peer d1a8f61d3323447282ee6068aa623216 ({username='slave'} at 127.0.0.1:50534)
I20251023 07:59:10.076753 18186 tablet_copy_service.cc:161] P 10dfae53d0c941f08bded43539841761: Beginning new tablet copy session on tablet 85799f6eb6ae41fa9620accb877d8708 from peer d1a8f61d3323447282ee6068aa623216 at {username='slave'} at 127.0.0.1:50534: session id = d1a8f61d3323447282ee6068aa623216-85799f6eb6ae41fa9620accb877d8708
I20251023 07:59:10.085204 18186 tablet_copy_source_session.cc:215] T 85799f6eb6ae41fa9620accb877d8708 P 10dfae53d0c941f08bded43539841761: Tablet Copy: opened 0 blocks and 1 log segments
I20251023 07:59:10.088183 19432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85799f6eb6ae41fa9620accb877d8708. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:10.099089 19403 tablet_bootstrap.cc:492] T e85adbfd669946ce9f939c02865fea6a P d1a8f61d3323447282ee6068aa623216: Bootstrap starting.
I20251023 07:59:10.132927 19403 tablet_bootstrap.cc:492] T e85adbfd669946ce9f939c02865fea6a P d1a8f61d3323447282ee6068aa623216: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:59:10.134003 19403 tablet_bootstrap.cc:492] T e85adbfd669946ce9f939c02865fea6a P d1a8f61d3323447282ee6068aa623216: Bootstrap complete.
I20251023 07:59:10.134759 19403 ts_tablet_manager.cc:1403] T e85adbfd669946ce9f939c02865fea6a P d1a8f61d3323447282ee6068aa623216: Time spent bootstrapping tablet: real 0.036s user 0.022s sys 0.006s
I20251023 07:59:10.137701 19403 raft_consensus.cc:359] T e85adbfd669946ce9f939c02865fea6a P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:59:10.138566 19403 raft_consensus.cc:740] T e85adbfd669946ce9f939c02865fea6a P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d1a8f61d3323447282ee6068aa623216, State: Initialized, Role: LEARNER
I20251023 07:59:10.139559 19432 tablet_copy_client.cc:806] T 85799f6eb6ae41fa9620accb877d8708 P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 0 data blocks...
I20251023 07:59:10.139269 19403 consensus_queue.cc:260] T e85adbfd669946ce9f939c02865fea6a P d1a8f61d3323447282ee6068aa623216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:59:10.140203 19432 tablet_copy_client.cc:670] T 85799f6eb6ae41fa9620accb877d8708 P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 1 WAL segments...
I20251023 07:59:10.142151 19403 ts_tablet_manager.cc:1434] T e85adbfd669946ce9f939c02865fea6a P d1a8f61d3323447282ee6068aa623216: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20251023 07:59:10.143941 19432 tablet_copy_client.cc:538] T 85799f6eb6ae41fa9620accb877d8708 P d1a8f61d3323447282ee6068aa623216: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251023 07:59:10.144052 18171 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "1178e2ed919b40f29672fc6233b71cf3"
dest_uuid: "10dfae53d0c941f08bded43539841761"
mode: GRACEFUL
new_leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
from {username='slave'} at 127.0.0.1:47396
I20251023 07:59:10.144662 18171 raft_consensus.cc:606] T 1178e2ed919b40f29672fc6233b71cf3 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Received request to transfer leadership to TS b3a1328f9c8c484fab08292ce2171ec9
I20251023 07:59:10.158761 18261 tablet_copy_service.cc:342] P 982df35c5b554a8fa64807352c4f34ee: Request end of tablet copy session d1a8f61d3323447282ee6068aa623216-e85adbfd669946ce9f939c02865fea6a received from {username='slave'} at 127.0.0.1:40260
I20251023 07:59:10.159240 18261 tablet_copy_service.cc:434] P 982df35c5b554a8fa64807352c4f34ee: ending tablet copy session d1a8f61d3323447282ee6068aa623216-e85adbfd669946ce9f939c02865fea6a on tablet e85adbfd669946ce9f939c02865fea6a with peer d1a8f61d3323447282ee6068aa623216
I20251023 07:59:10.159812 18244 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "8f25975c7ab4439c9975a5e5604727dc"
dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
mode: GRACEFUL
new_leader_uuid: "10dfae53d0c941f08bded43539841761"
from {username='slave'} at 127.0.0.1:60948
I20251023 07:59:10.160454 18244 raft_consensus.cc:606] T 8f25975c7ab4439c9975a5e5604727dc P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Received request to transfer leadership to TS 10dfae53d0c941f08bded43539841761
I20251023 07:59:10.166502 19432 tablet_bootstrap.cc:492] T 85799f6eb6ae41fa9620accb877d8708 P d1a8f61d3323447282ee6068aa623216: Bootstrap starting.
I20251023 07:59:10.166455 18096 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "c6022ad5a70c4b4f8f34339956122cb7"
dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
mode: GRACEFUL
new_leader_uuid: "982df35c5b554a8fa64807352c4f34ee"
from {username='slave'} at 127.0.0.1:34418
I20251023 07:59:10.169090 18096 raft_consensus.cc:606] T c6022ad5a70c4b4f8f34339956122cb7 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Received request to transfer leadership to TS 982df35c5b554a8fa64807352c4f34ee
I20251023 07:59:10.170501 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 3
I20251023 07:59:10.172169 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 07:59:10.172868 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:59:10.212518 19432 tablet_bootstrap.cc:492] T 85799f6eb6ae41fa9620accb877d8708 P d1a8f61d3323447282ee6068aa623216: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:59:10.213292 19432 tablet_bootstrap.cc:492] T 85799f6eb6ae41fa9620accb877d8708 P d1a8f61d3323447282ee6068aa623216: Bootstrap complete.
I20251023 07:59:10.214041 19432 ts_tablet_manager.cc:1403] T 85799f6eb6ae41fa9620accb877d8708 P d1a8f61d3323447282ee6068aa623216: Time spent bootstrapping tablet: real 0.048s user 0.017s sys 0.004s
I20251023 07:59:10.216450 19432 raft_consensus.cc:359] T 85799f6eb6ae41fa9620accb877d8708 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:59:10.217281 19432 raft_consensus.cc:740] T 85799f6eb6ae41fa9620accb877d8708 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d1a8f61d3323447282ee6068aa623216, State: Initialized, Role: LEARNER
I20251023 07:59:10.217948 19432 consensus_queue.cc:260] T 85799f6eb6ae41fa9620accb877d8708 P d1a8f61d3323447282ee6068aa623216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:59:10.226270 19432 ts_tablet_manager.cc:1434] T 85799f6eb6ae41fa9620accb877d8708 P d1a8f61d3323447282ee6068aa623216: Time spent starting tablet: real 0.012s user 0.006s sys 0.000s
I20251023 07:59:10.227886 18186 tablet_copy_service.cc:342] P 10dfae53d0c941f08bded43539841761: Request end of tablet copy session d1a8f61d3323447282ee6068aa623216-85799f6eb6ae41fa9620accb877d8708 received from {username='slave'} at 127.0.0.1:50534
I20251023 07:59:10.228340 18186 tablet_copy_service.cc:434] P 10dfae53d0c941f08bded43539841761: ending tablet copy session d1a8f61d3323447282ee6068aa623216-85799f6eb6ae41fa9620accb877d8708 on tablet 85799f6eb6ae41fa9620accb877d8708 with peer d1a8f61d3323447282ee6068aa623216
I20251023 07:59:10.261646 18787 raft_consensus.cc:1217] T e85adbfd669946ce9f939c02865fea6a P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20251023 07:59:10.334507 19339 raft_consensus.cc:1064] T c6022ad5a70c4b4f8f34339956122cb7 P b3a1328f9c8c484fab08292ce2171ec9: attempting to promote NON_VOTER d1a8f61d3323447282ee6068aa623216 to VOTER
W20251023 07:59:10.334888 19339 raft_consensus.cc:1068] T c6022ad5a70c4b4f8f34339956122cb7 P b3a1328f9c8c484fab08292ce2171ec9: Unable to promote non-voter d1a8f61d3323447282ee6068aa623216: Service unavailable: leader transfer in progress
I20251023 07:59:10.368273 19412 raft_consensus.cc:1064] T 5585a11a884140c7abc7d5a3b6ab86f3 P 10dfae53d0c941f08bded43539841761: attempting to promote NON_VOTER d1a8f61d3323447282ee6068aa623216 to VOTER
I20251023 07:59:10.370951 19412 consensus_queue.cc:237] T 5585a11a884140c7abc7d5a3b6ab86f3 P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:10.380712 18101 raft_consensus.cc:1275] T 5585a11a884140c7abc7d5a3b6ab86f3 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:59:10.381927 19423 consensus_queue.cc:1048] T 5585a11a884140c7abc7d5a3b6ab86f3 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:59:10.383873 18787 raft_consensus.cc:1275] T 5585a11a884140c7abc7d5a3b6ab86f3 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:59:10.385948 18243 raft_consensus.cc:1275] T 5585a11a884140c7abc7d5a3b6ab86f3 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:59:10.387140 19414 consensus_queue.cc:1048] T 5585a11a884140c7abc7d5a3b6ab86f3 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:59:10.388888 19414 consensus_queue.cc:1048] T 5585a11a884140c7abc7d5a3b6ab86f3 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:59:10.411787 19423 raft_consensus.cc:2955] T 5585a11a884140c7abc7d5a3b6ab86f3 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:10.418709 18244 raft_consensus.cc:2955] T 5585a11a884140c7abc7d5a3b6ab86f3 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:10.424228 18101 raft_consensus.cc:2955] T 5585a11a884140c7abc7d5a3b6ab86f3 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:10.427760 18788 raft_consensus.cc:2955] T 5585a11a884140c7abc7d5a3b6ab86f3 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:10.436625 18787 raft_consensus.cc:1217] T 85799f6eb6ae41fa9620accb877d8708 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20251023 07:59:10.437629 19414 raft_consensus.cc:993] T 1178e2ed919b40f29672fc6233b71cf3 P 10dfae53d0c941f08bded43539841761: : Instructing follower b3a1328f9c8c484fab08292ce2171ec9 to start an election
I20251023 07:59:10.438234 19417 raft_consensus.cc:1081] T 1178e2ed919b40f29672fc6233b71cf3 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Signalling peer b3a1328f9c8c484fab08292ce2171ec9 to start an election
I20251023 07:59:10.442677 18096 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "1178e2ed919b40f29672fc6233b71cf3"
dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
from {username='slave'} at 127.0.0.1:53946
I20251023 07:59:10.443205 18096 raft_consensus.cc:493] T 1178e2ed919b40f29672fc6233b71cf3 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:59:10.444087 18096 raft_consensus.cc:3060] T 1178e2ed919b40f29672fc6233b71cf3 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:10.451056 17999 catalog_manager.cc:5649] T 5585a11a884140c7abc7d5a3b6ab86f3 P 982df35c5b554a8fa64807352c4f34ee reported cstate change: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:10.463600 18096 raft_consensus.cc:515] T 1178e2ed919b40f29672fc6233b71cf3 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:59:10.465273 18096 leader_election.cc:290] T 1178e2ed919b40f29672fc6233b71cf3 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 2 election: Requested vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:59:10.466888 18243 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1178e2ed919b40f29672fc6233b71cf3" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
I20251023 07:59:10.468611 18176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1178e2ed919b40f29672fc6233b71cf3" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "10dfae53d0c941f08bded43539841761"
I20251023 07:59:10.470496 18176 raft_consensus.cc:3055] T 1178e2ed919b40f29672fc6233b71cf3 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Stepping down as leader of term 1
I20251023 07:59:10.470810 18176 raft_consensus.cc:740] T 1178e2ed919b40f29672fc6233b71cf3 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Running, Role: LEADER
I20251023 07:59:10.471521 18176 consensus_queue.cc:260] T 1178e2ed919b40f29672fc6233b71cf3 P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:59:10.472658 18176 raft_consensus.cc:3060] T 1178e2ed919b40f29672fc6233b71cf3 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:10.476533 18243 raft_consensus.cc:3060] T 1178e2ed919b40f29672fc6233b71cf3 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:10.481046 18176 raft_consensus.cc:2468] T 1178e2ed919b40f29672fc6233b71cf3 P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3a1328f9c8c484fab08292ce2171ec9 in term 2.
I20251023 07:59:10.482187 18066 leader_election.cc:304] T 1178e2ed919b40f29672fc6233b71cf3 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:59:10.483090 19379 raft_consensus.cc:2804] T 1178e2ed919b40f29672fc6233b71cf3 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:59:10.483821 19379 raft_consensus.cc:697] T 1178e2ed919b40f29672fc6233b71cf3 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 LEADER]: Becoming Leader. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Running, Role: LEADER
I20251023 07:59:10.483904 18243 raft_consensus.cc:2468] T 1178e2ed919b40f29672fc6233b71cf3 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3a1328f9c8c484fab08292ce2171ec9 in term 2.
I20251023 07:59:10.486755 19379 consensus_queue.cc:237] T 1178e2ed919b40f29672fc6233b71cf3 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:59:10.510524 17997 catalog_manager.cc:5649] T 1178e2ed919b40f29672fc6233b71cf3 P b3a1328f9c8c484fab08292ce2171ec9 reported cstate change: term changed from 1 to 2, leader changed from 10dfae53d0c941f08bded43539841761 (127.16.126.2) to b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1). New cstate: current_term: 2 leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:10.510053 18176 consensus_queue.cc:237] T 5585a11a884140c7abc7d5a3b6ab86f3 P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:10.530387 18787 raft_consensus.cc:1275] T 5585a11a884140c7abc7d5a3b6ab86f3 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251023 07:59:10.531559 18096 raft_consensus.cc:1275] T 5585a11a884140c7abc7d5a3b6ab86f3 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251023 07:59:10.533140 19412 consensus_queue.cc:1048] T 5585a11a884140c7abc7d5a3b6ab86f3 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:59:10.534147 19423 consensus_queue.cc:1048] T 5585a11a884140c7abc7d5a3b6ab86f3 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:59:10.536581 19427 raft_consensus.cc:993] T c6022ad5a70c4b4f8f34339956122cb7 P b3a1328f9c8c484fab08292ce2171ec9: : Instructing follower 982df35c5b554a8fa64807352c4f34ee to start an election
I20251023 07:59:10.537061 19379 raft_consensus.cc:1081] T c6022ad5a70c4b4f8f34339956122cb7 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Signalling peer 982df35c5b554a8fa64807352c4f34ee to start an election
I20251023 07:59:10.541213 18248 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "c6022ad5a70c4b4f8f34339956122cb7"
dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
from {username='slave'} at 127.0.0.1:49420
I20251023 07:59:10.541775 18248 raft_consensus.cc:493] T c6022ad5a70c4b4f8f34339956122cb7 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:59:10.542148 18248 raft_consensus.cc:3060] T c6022ad5a70c4b4f8f34339956122cb7 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:10.543855 19423 raft_consensus.cc:2955] T 5585a11a884140c7abc7d5a3b6ab86f3 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 982df35c5b554a8fa64807352c4f34ee (127.16.126.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:10.547441 18248 raft_consensus.cc:515] T c6022ad5a70c4b4f8f34339956122cb7 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:59:10.549194 18248 leader_election.cc:290] T c6022ad5a70c4b4f8f34339956122cb7 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 2 election: Requested vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:59:10.550959 18171 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6022ad5a70c4b4f8f34339956122cb7" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "10dfae53d0c941f08bded43539841761"
I20251023 07:59:10.551534 18171 raft_consensus.cc:3060] T c6022ad5a70c4b4f8f34339956122cb7 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:10.551681 18101 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6022ad5a70c4b4f8f34339956122cb7" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
I20251023 07:59:10.552239 18101 raft_consensus.cc:3055] T c6022ad5a70c4b4f8f34339956122cb7 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Stepping down as leader of term 1
I20251023 07:59:10.552522 18101 raft_consensus.cc:740] T c6022ad5a70c4b4f8f34339956122cb7 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Running, Role: LEADER
I20251023 07:59:10.553249 18101 consensus_queue.cc:260] T c6022ad5a70c4b4f8f34339956122cb7 P b3a1328f9c8c484fab08292ce2171ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:59:10.552990 18102 raft_consensus.cc:2955] T 5585a11a884140c7abc7d5a3b6ab86f3 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 982df35c5b554a8fa64807352c4f34ee (127.16.126.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:10.554637 18101 raft_consensus.cc:3060] T c6022ad5a70c4b4f8f34339956122cb7 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:10.558279 18787 raft_consensus.cc:2955] T 5585a11a884140c7abc7d5a3b6ab86f3 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 982df35c5b554a8fa64807352c4f34ee (127.16.126.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:10.560422 18171 raft_consensus.cc:2468] T c6022ad5a70c4b4f8f34339956122cb7 P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 2.
I20251023 07:59:10.561215 18101 raft_consensus.cc:2468] T c6022ad5a70c4b4f8f34339956122cb7 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 2.
I20251023 07:59:10.567849 17985 catalog_manager.cc:5162] ChangeConfig:REMOVE_PEER RPC for tablet 5585a11a884140c7abc7d5a3b6ab86f3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251023 07:59:10.569502 18217 leader_election.cc:304] T c6022ad5a70c4b4f8f34339956122cb7 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:59:10.570519 19421 raft_consensus.cc:2804] T c6022ad5a70c4b4f8f34339956122cb7 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:59:10.571063 19421 raft_consensus.cc:697] T c6022ad5a70c4b4f8f34339956122cb7 P 982df35c5b554a8fa64807352c4f34ee [term 2 LEADER]: Becoming Leader. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Running, Role: LEADER
I20251023 07:59:10.572185 19421 consensus_queue.cc:237] T c6022ad5a70c4b4f8f34339956122cb7 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:59:10.579483 18000 catalog_manager.cc:5649] T 5585a11a884140c7abc7d5a3b6ab86f3 P d1a8f61d3323447282ee6068aa623216 reported cstate change: config changed from index 3 to 4, VOTER 982df35c5b554a8fa64807352c4f34ee (127.16.126.3) evicted. New cstate: current_term: 1 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:10.599304 18237 tablet_service.cc:1552] Processing DeleteTablet for tablet 5585a11a884140c7abc7d5a3b6ab86f3 with delete_type TABLET_DATA_TOMBSTONED (TS 982df35c5b554a8fa64807352c4f34ee not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49846
I20251023 07:59:10.604158 19450 tablet_replica.cc:333] T 5585a11a884140c7abc7d5a3b6ab86f3 P 982df35c5b554a8fa64807352c4f34ee: stopping tablet replica
I20251023 07:59:10.607323 19450 raft_consensus.cc:2243] T 5585a11a884140c7abc7d5a3b6ab86f3 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:10.607966 19450 raft_consensus.cc:2272] T 5585a11a884140c7abc7d5a3b6ab86f3 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Raft consensus is shut down!
W20251023 07:59:10.609633 18031 debug-util.cc:398] Leaking SignalData structure 0x7b08001f5d40 after lost signal to thread 16891
W20251023 07:59:10.610639 18031 debug-util.cc:398] Leaking SignalData structure 0x7b08001c2c20 after lost signal to thread 18034
I20251023 07:59:10.611665 19450 ts_tablet_manager.cc:1916] T 5585a11a884140c7abc7d5a3b6ab86f3 P 982df35c5b554a8fa64807352c4f34ee: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20251023 07:59:10.611765 18031 debug-util.cc:398] Leaking SignalData structure 0x7b0800338ee0 after lost signal to thread 18126
W20251023 07:59:10.612884 18031 debug-util.cc:398] Leaking SignalData structure 0x7b0800357780 after lost signal to thread 18201
W20251023 07:59:10.614002 18031 debug-util.cc:398] Leaking SignalData structure 0x7b0800279f20 after lost signal to thread 18275
W20251023 07:59:10.615065 18031 debug-util.cc:398] Leaking SignalData structure 0x7b08002fb4e0 after lost signal to thread 18813
I20251023 07:59:10.619807 18000 catalog_manager.cc:5649] T c6022ad5a70c4b4f8f34339956122cb7 P 982df35c5b554a8fa64807352c4f34ee reported cstate change: term changed from 1 to 2, leader changed from b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1) to 982df35c5b554a8fa64807352c4f34ee (127.16.126.3). New cstate: current_term: 2 leader_uuid: "982df35c5b554a8fa64807352c4f34ee" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:10.629273 19450 ts_tablet_manager.cc:1929] T 5585a11a884140c7abc7d5a3b6ab86f3 P 982df35c5b554a8fa64807352c4f34ee: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20251023 07:59:10.629916 19450 log.cc:1199] T 5585a11a884140c7abc7d5a3b6ab86f3 P 982df35c5b554a8fa64807352c4f34ee: Deleting WAL directory at /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1761206251627710-16888-0/minicluster-data/ts-2-root/wals/5585a11a884140c7abc7d5a3b6ab86f3
I20251023 07:59:10.631609 17986 catalog_manager.cc:4985] TS 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): tablet 5585a11a884140c7abc7d5a3b6ab86f3 (table test-workload [id=8bb191a5531a4d4fb58a25b13d592213]) successfully deleted
I20251023 07:59:10.642457 18244 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "c6022ad5a70c4b4f8f34339956122cb7"
dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:49846
I20251023 07:59:10.643121 18244 raft_consensus.cc:606] T c6022ad5a70c4b4f8f34339956122cb7 P 982df35c5b554a8fa64807352c4f34ee [term 2 LEADER]: Received request to transfer leadership
I20251023 07:59:10.643290 19240 raft_consensus.cc:1064] T e85adbfd669946ce9f939c02865fea6a P 982df35c5b554a8fa64807352c4f34ee: attempting to promote NON_VOTER d1a8f61d3323447282ee6068aa623216 to VOTER
I20251023 07:59:10.645630 19240 consensus_queue.cc:237] T e85adbfd669946ce9f939c02865fea6a P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:10.660043 19396 raft_consensus.cc:993] T 8f25975c7ab4439c9975a5e5604727dc P 982df35c5b554a8fa64807352c4f34ee: : Instructing follower 10dfae53d0c941f08bded43539841761 to start an election
I20251023 07:59:10.661774 19421 raft_consensus.cc:1081] T 8f25975c7ab4439c9975a5e5604727dc P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Signalling peer 10dfae53d0c941f08bded43539841761 to start an election
I20251023 07:59:10.663422 18171 raft_consensus.cc:1275] T e85adbfd669946ce9f939c02865fea6a P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:59:10.663472 18787 raft_consensus.cc:1275] T e85adbfd669946ce9f939c02865fea6a P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:59:10.666091 19421 consensus_queue.cc:1048] T e85adbfd669946ce9f939c02865fea6a P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:59:10.673593 18171 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "8f25975c7ab4439c9975a5e5604727dc"
dest_uuid: "10dfae53d0c941f08bded43539841761"
from {username='slave'} at 127.0.0.1:51868
I20251023 07:59:10.674156 19422 consensus_queue.cc:1048] T e85adbfd669946ce9f939c02865fea6a P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20251023 07:59:10.674208 18171 raft_consensus.cc:493] T 8f25975c7ab4439c9975a5e5604727dc P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:59:10.680246 18171 raft_consensus.cc:3060] T 8f25975c7ab4439c9975a5e5604727dc P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:10.705621 18787 raft_consensus.cc:2955] T e85adbfd669946ce9f939c02865fea6a P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:10.710505 18243 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "c6022ad5a70c4b4f8f34339956122cb7"
dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:49846
I20251023 07:59:10.711274 18243 raft_consensus.cc:606] T c6022ad5a70c4b4f8f34339956122cb7 P 982df35c5b554a8fa64807352c4f34ee [term 2 LEADER]: Received request to transfer leadership
I20251023 07:59:10.705601 19422 raft_consensus.cc:2955] T e85adbfd669946ce9f939c02865fea6a P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:10.746202 18248 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "c6022ad5a70c4b4f8f34339956122cb7"
dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:49846
I20251023 07:59:10.747073 18248 raft_consensus.cc:606] T c6022ad5a70c4b4f8f34339956122cb7 P 982df35c5b554a8fa64807352c4f34ee [term 2 LEADER]: Received request to transfer leadership
W20251023 07:59:10.749531 18048 auto_rebalancer.cc:663] Could not move replica: Remote error: Service unavailable: leadership transfer for c6022ad5a70c4b4f8f34339956122cb7 already in progress
W20251023 07:59:10.750065 18048 auto_rebalancer.cc:264] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for c6022ad5a70c4b4f8f34339956122cb7 already in progress
I20251023 07:59:10.760449 18000 catalog_manager.cc:5649] T e85adbfd669946ce9f939c02865fea6a P d1a8f61d3323447282ee6068aa623216 reported cstate change: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "982df35c5b554a8fa64807352c4f34ee" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:10.743268 18171 raft_consensus.cc:515] T 8f25975c7ab4439c9975a5e5604727dc P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:10.764631 18248 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8f25975c7ab4439c9975a5e5604727dc" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
I20251023 07:59:10.765208 18248 raft_consensus.cc:3055] T 8f25975c7ab4439c9975a5e5604727dc P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Stepping down as leader of term 1
I20251023 07:59:10.765542 18248 raft_consensus.cc:740] T 8f25975c7ab4439c9975a5e5604727dc P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Running, Role: LEADER
I20251023 07:59:10.766245 18248 consensus_queue.cc:260] T 8f25975c7ab4439c9975a5e5604727dc P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:10.767294 18248 raft_consensus.cc:3060] T 8f25975c7ab4439c9975a5e5604727dc P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:10.776036 18248 raft_consensus.cc:2468] T 8f25975c7ab4439c9975a5e5604727dc P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 2.
I20251023 07:59:10.778052 18142 leader_election.cc:304] T 8f25975c7ab4439c9975a5e5604727dc P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, 982df35c5b554a8fa64807352c4f34ee; no voters:
I20251023 07:59:10.778791 19423 raft_consensus.cc:2804] T 8f25975c7ab4439c9975a5e5604727dc P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:59:10.779290 19423 raft_consensus.cc:697] T 8f25975c7ab4439c9975a5e5604727dc P 10dfae53d0c941f08bded43539841761 [term 2 LEADER]: Becoming Leader. State: Replica: 10dfae53d0c941f08bded43539841761, State: Running, Role: LEADER
I20251023 07:59:10.780090 19423 consensus_queue.cc:237] T 8f25975c7ab4439c9975a5e5604727dc P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:10.802758 18784 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8f25975c7ab4439c9975a5e5604727dc" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d1a8f61d3323447282ee6068aa623216"
I20251023 07:59:10.803498 18784 raft_consensus.cc:3060] T 8f25975c7ab4439c9975a5e5604727dc P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:10.809566 18171 leader_election.cc:290] T 8f25975c7ab4439c9975a5e5604727dc P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 2 election: Requested vote from peers 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061), d1a8f61d3323447282ee6068aa623216 (127.16.126.4:33293)
I20251023 07:59:10.817669 18784 raft_consensus.cc:2468] T 8f25975c7ab4439c9975a5e5604727dc P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 2.
I20251023 07:59:10.824857 18102 raft_consensus.cc:1275] T e85adbfd669946ce9f939c02865fea6a P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:59:10.825047 18000 catalog_manager.cc:5649] T 8f25975c7ab4439c9975a5e5604727dc P 10dfae53d0c941f08bded43539841761 reported cstate change: term changed from 1 to 2, leader changed from 982df35c5b554a8fa64807352c4f34ee (127.16.126.3) to 10dfae53d0c941f08bded43539841761 (127.16.126.2). New cstate: current_term: 2 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:10.826679 19421 consensus_queue.cc:1048] T e85adbfd669946ce9f939c02865fea6a P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:59:10.838256 18102 raft_consensus.cc:2955] T e85adbfd669946ce9f939c02865fea6a P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:10.838354 18176 raft_consensus.cc:2955] T e85adbfd669946ce9f939c02865fea6a P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:10.929840 18174 raft_consensus.cc:1275] T 1178e2ed919b40f29672fc6233b71cf3 P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:10.931258 19379 consensus_queue.cc:1048] T 1178e2ed919b40f29672fc6233b71cf3 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:10.963335 18244 raft_consensus.cc:1275] T 1178e2ed919b40f29672fc6233b71cf3 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:10.965637 19379 consensus_queue.cc:1048] T 1178e2ed919b40f29672fc6233b71cf3 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:11.010553 19412 raft_consensus.cc:1064] T 85799f6eb6ae41fa9620accb877d8708 P 10dfae53d0c941f08bded43539841761: attempting to promote NON_VOTER d1a8f61d3323447282ee6068aa623216 to VOTER
I20251023 07:59:11.013320 19412 consensus_queue.cc:237] T 85799f6eb6ae41fa9620accb877d8708 P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:11.028863 18787 raft_consensus.cc:1275] T 85799f6eb6ae41fa9620accb877d8708 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:59:11.031553 19414 consensus_queue.cc:1048] T 85799f6eb6ae41fa9620accb877d8708 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:59:11.047699 18101 raft_consensus.cc:1275] T 85799f6eb6ae41fa9620accb877d8708 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:59:11.049861 19375 consensus_queue.cc:1048] T 85799f6eb6ae41fa9620accb877d8708 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:59:11.057077 18244 raft_consensus.cc:1275] T 85799f6eb6ae41fa9620accb877d8708 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:59:11.059152 19375 consensus_queue.cc:1048] T 85799f6eb6ae41fa9620accb877d8708 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:59:11.083933 19423 raft_consensus.cc:2955] T 85799f6eb6ae41fa9620accb877d8708 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:11.091511 18243 raft_consensus.cc:2955] T 85799f6eb6ae41fa9620accb877d8708 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:11.098866 18787 raft_consensus.cc:2955] T 85799f6eb6ae41fa9620accb877d8708 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:11.106154 18171 raft_consensus.cc:1275] T c6022ad5a70c4b4f8f34339956122cb7 P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20251023 07:59:11.109287 19452 consensus_queue.cc:1048] T c6022ad5a70c4b4f8f34339956122cb7 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:59:11.119843 18784 raft_consensus.cc:3060] T c6022ad5a70c4b4f8f34339956122cb7 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Advancing to term 2
I20251023 07:59:11.136196 19452 raft_consensus.cc:993] T c6022ad5a70c4b4f8f34339956122cb7 P 982df35c5b554a8fa64807352c4f34ee: : Instructing follower 10dfae53d0c941f08bded43539841761 to start an election
I20251023 07:59:11.136739 19452 raft_consensus.cc:1081] T c6022ad5a70c4b4f8f34339956122cb7 P 982df35c5b554a8fa64807352c4f34ee [term 2 LEADER]: Signalling peer 10dfae53d0c941f08bded43539841761 to start an election
I20251023 07:59:11.147258 18101 raft_consensus.cc:1275] T c6022ad5a70c4b4f8f34339956122cb7 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20251023 07:59:11.148574 19452 consensus_queue.cc:1048] T c6022ad5a70c4b4f8f34339956122cb7 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:59:11.158283 18171 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "c6022ad5a70c4b4f8f34339956122cb7"
dest_uuid: "10dfae53d0c941f08bded43539841761"
from {username='slave'} at 127.0.0.1:51868
I20251023 07:59:11.163616 18171 raft_consensus.cc:493] T c6022ad5a70c4b4f8f34339956122cb7 P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:59:11.164263 18171 raft_consensus.cc:3060] T c6022ad5a70c4b4f8f34339956122cb7 P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:59:11.163686 18784 raft_consensus.cc:1275] T c6022ad5a70c4b4f8f34339956122cb7 P d1a8f61d3323447282ee6068aa623216 [term 2 LEARNER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20251023 07:59:11.177038 19452 consensus_queue.cc:1048] T c6022ad5a70c4b4f8f34339956122cb7 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:59:11.175611 17997 catalog_manager.cc:5649] T 85799f6eb6ae41fa9620accb877d8708 P 982df35c5b554a8fa64807352c4f34ee reported cstate change: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:11.178658 18171 raft_consensus.cc:515] T c6022ad5a70c4b4f8f34339956122cb7 P 10dfae53d0c941f08bded43539841761 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:59:11.198457 18102 raft_consensus.cc:2955] T 85799f6eb6ae41fa9620accb877d8708 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:11.205396 18096 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6022ad5a70c4b4f8f34339956122cb7" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
I20251023 07:59:11.206226 18096 raft_consensus.cc:3060] T c6022ad5a70c4b4f8f34339956122cb7 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:59:11.206892 18171 leader_election.cc:290] T c6022ad5a70c4b4f8f34339956122cb7 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 3 election: Requested vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:59:11.209832 18248 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6022ad5a70c4b4f8f34339956122cb7" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
I20251023 07:59:11.210445 18248 raft_consensus.cc:3055] T c6022ad5a70c4b4f8f34339956122cb7 P 982df35c5b554a8fa64807352c4f34ee [term 2 LEADER]: Stepping down as leader of term 2
I20251023 07:59:11.210754 18248 raft_consensus.cc:740] T c6022ad5a70c4b4f8f34339956122cb7 P 982df35c5b554a8fa64807352c4f34ee [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Running, Role: LEADER
I20251023 07:59:11.211562 18248 consensus_queue.cc:260] T c6022ad5a70c4b4f8f34339956122cb7 P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:59:11.219753 18096 raft_consensus.cc:2468] T c6022ad5a70c4b4f8f34339956122cb7 P b3a1328f9c8c484fab08292ce2171ec9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 3.
I20251023 07:59:11.223230 18143 leader_election.cc:304] T c6022ad5a70c4b4f8f34339956122cb7 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:59:11.224179 19375 raft_consensus.cc:2804] T c6022ad5a70c4b4f8f34339956122cb7 P 10dfae53d0c941f08bded43539841761 [term 3 FOLLOWER]: Leader election won for term 3
I20251023 07:59:11.224689 19375 raft_consensus.cc:697] T c6022ad5a70c4b4f8f34339956122cb7 P 10dfae53d0c941f08bded43539841761 [term 3 LEADER]: Becoming Leader. State: Replica: 10dfae53d0c941f08bded43539841761, State: Running, Role: LEADER
I20251023 07:59:11.213171 18248 raft_consensus.cc:3060] T c6022ad5a70c4b4f8f34339956122cb7 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:59:11.225674 19375 consensus_queue.cc:237] T c6022ad5a70c4b4f8f34339956122cb7 P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:59:11.236595 18248 raft_consensus.cc:2468] T c6022ad5a70c4b4f8f34339956122cb7 P 982df35c5b554a8fa64807352c4f34ee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 3.
I20251023 07:59:11.238840 18243 raft_consensus.cc:1275] T 8f25975c7ab4439c9975a5e5604727dc P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20251023 07:59:11.239166 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:59:11.244849 19375 consensus_queue.cc:1048] T 8f25975c7ab4439c9975a5e5604727dc P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20251023 07:59:11.257812 18784 raft_consensus.cc:1275] T 8f25975c7ab4439c9975a5e5604727dc P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20251023 07:59:11.284565 17997 catalog_manager.cc:5649] T c6022ad5a70c4b4f8f34339956122cb7 P 10dfae53d0c941f08bded43539841761 reported cstate change: term changed from 2 to 3, leader changed from 982df35c5b554a8fa64807352c4f34ee (127.16.126.3) to 10dfae53d0c941f08bded43539841761 (127.16.126.2). New cstate: current_term: 3 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:11.287122 18171 consensus_queue.cc:237] T 85799f6eb6ae41fa9620accb877d8708 P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:11.289563 19375 consensus_queue.cc:1048] T 8f25975c7ab4439c9975a5e5604727dc P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20251023 07:59:11.308809 18787 raft_consensus.cc:1275] T 85799f6eb6ae41fa9620accb877d8708 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251023 07:59:11.310361 19375 consensus_queue.cc:1048] T 85799f6eb6ae41fa9620accb877d8708 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:59:11.321630 19412 raft_consensus.cc:2955] T 85799f6eb6ae41fa9620accb877d8708 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:11.332439 18251 raft_consensus.cc:1275] T 85799f6eb6ae41fa9620accb877d8708 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251023 07:59:11.332302 18787 raft_consensus.cc:2955] T 85799f6eb6ae41fa9620accb877d8708 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:11.343055 19423 consensus_queue.cc:1048] T 85799f6eb6ae41fa9620accb877d8708 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:59:11.347899 18102 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "3c5c040d6ebe40e5a5be6be47de5a7bc"
dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
mode: GRACEFUL
new_leader_uuid: "982df35c5b554a8fa64807352c4f34ee"
from {username='slave'} at 127.0.0.1:34418
I20251023 07:59:11.348546 18102 raft_consensus.cc:606] T 3c5c040d6ebe40e5a5be6be47de5a7bc P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Received request to transfer leadership to TS 982df35c5b554a8fa64807352c4f34ee
I20251023 07:59:11.352396 18174 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "5939b6a960ea4b0581b61ccdcdfa7c37"
dest_uuid: "10dfae53d0c941f08bded43539841761"
mode: GRACEFUL
new_leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
from {username='slave'} at 127.0.0.1:47396
I20251023 07:59:11.352942 18174 raft_consensus.cc:606] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 10dfae53d0c941f08bded43539841761 [term 3 LEADER]: Received request to transfer leadership to TS b3a1328f9c8c484fab08292ce2171ec9
I20251023 07:59:11.370589 17985 catalog_manager.cc:5162] ChangeConfig:REMOVE_PEER RPC for tablet 85799f6eb6ae41fa9620accb877d8708 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251023 07:59:11.372030 18248 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "c63b5a4dc8eb4b6e918608f281183068"
dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
mode: GRACEFUL
new_leader_uuid: "10dfae53d0c941f08bded43539841761"
from {username='slave'} at 127.0.0.1:60948
I20251023 07:59:11.372682 18248 raft_consensus.cc:606] T c63b5a4dc8eb4b6e918608f281183068 P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Received request to transfer leadership to TS 10dfae53d0c941f08bded43539841761
I20251023 07:59:11.376858 18251 raft_consensus.cc:2955] T 85799f6eb6ae41fa9620accb877d8708 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:11.396869 18248 consensus_queue.cc:237] T e85adbfd669946ce9f939c02865fea6a P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:11.405923 18787 raft_consensus.cc:1275] T e85adbfd669946ce9f939c02865fea6a P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251023 07:59:11.406316 18096 raft_consensus.cc:1275] T e85adbfd669946ce9f939c02865fea6a P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251023 07:59:11.408916 19240 consensus_queue.cc:1048] T e85adbfd669946ce9f939c02865fea6a P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:59:11.410101 19396 consensus_queue.cc:1048] T e85adbfd669946ce9f939c02865fea6a P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:59:11.432608 19240 raft_consensus.cc:2955] T e85adbfd669946ce9f939c02865fea6a P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 10dfae53d0c941f08bded43539841761 (127.16.126.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:11.445114 18096 raft_consensus.cc:2955] T e85adbfd669946ce9f939c02865fea6a P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 10dfae53d0c941f08bded43539841761 (127.16.126.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:11.433193 18787 raft_consensus.cc:2955] T e85adbfd669946ce9f939c02865fea6a P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 10dfae53d0c941f08bded43539841761 (127.16.126.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:11.414129 18248 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "c8b2781a072e401dba80e2879748e681"
dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
mode: GRACEFUL
new_leader_uuid: "10dfae53d0c941f08bded43539841761"
from {username='slave'} at 127.0.0.1:60948
I20251023 07:59:11.455969 18248 raft_consensus.cc:606] T c8b2781a072e401dba80e2879748e681 P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Received request to transfer leadership to TS 10dfae53d0c941f08bded43539841761
I20251023 07:59:11.466873 17998 catalog_manager.cc:5649] T e85adbfd669946ce9f939c02865fea6a P b3a1328f9c8c484fab08292ce2171ec9 reported cstate change: config changed from index 3 to 4, VOTER 10dfae53d0c941f08bded43539841761 (127.16.126.2) evicted. New cstate: current_term: 1 leader_uuid: "982df35c5b554a8fa64807352c4f34ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:11.477617 17986 catalog_manager.cc:5162] ChangeConfig:REMOVE_PEER RPC for tablet e85adbfd669946ce9f939c02865fea6a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251023 07:59:11.483086 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 4
I20251023 07:59:11.485064 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 07:59:11.486065 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:59:11.489673 18163 tablet_service.cc:1552] Processing DeleteTablet for tablet e85adbfd669946ce9f939c02865fea6a with delete_type TABLET_DATA_TOMBSTONED (TS 10dfae53d0c941f08bded43539841761 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33428
I20251023 07:59:11.494333 17999 catalog_manager.cc:5649] T 85799f6eb6ae41fa9620accb877d8708 P 10dfae53d0c941f08bded43539841761 reported cstate change: config changed from index 3 to 4, VOTER b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1) evicted. New cstate: current_term: 1 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251023 07:59:11.511492 18086 tablet_service.cc:1552] Processing DeleteTablet for tablet 85799f6eb6ae41fa9620accb877d8708 with delete_type TABLET_DATA_TOMBSTONED (TS b3a1328f9c8c484fab08292ce2171ec9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53940
I20251023 07:59:11.526870 19476 tablet_replica.cc:333] T 85799f6eb6ae41fa9620accb877d8708 P b3a1328f9c8c484fab08292ce2171ec9: stopping tablet replica
I20251023 07:59:11.533802 19475 tablet_replica.cc:333] T e85adbfd669946ce9f939c02865fea6a P 10dfae53d0c941f08bded43539841761: stopping tablet replica
I20251023 07:59:11.535001 19475 raft_consensus.cc:2243] T e85adbfd669946ce9f939c02865fea6a P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:11.535794 19475 raft_consensus.cc:2272] T e85adbfd669946ce9f939c02865fea6a P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:11.547922 19476 raft_consensus.cc:2243] T 85799f6eb6ae41fa9620accb877d8708 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:11.549019 19476 raft_consensus.cc:2272] T 85799f6eb6ae41fa9620accb877d8708 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20251023 07:59:11.556524 18753 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.2:45799, user_credentials={real_user=slave}} blocked reactor thread for 199592us
I20251023 07:59:11.559628 19475 ts_tablet_manager.cc:1916] T e85adbfd669946ce9f939c02865fea6a P 10dfae53d0c941f08bded43539841761: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251023 07:59:11.560259 19375 raft_consensus.cc:993] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 10dfae53d0c941f08bded43539841761: : Instructing follower b3a1328f9c8c484fab08292ce2171ec9 to start an election
I20251023 07:59:11.577136 19375 raft_consensus.cc:1081] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 10dfae53d0c941f08bded43539841761 [term 3 LEADER]: Signalling peer b3a1328f9c8c484fab08292ce2171ec9 to start an election
I20251023 07:59:11.581813 18096 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "5939b6a960ea4b0581b61ccdcdfa7c37"
dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
from {username='slave'} at 127.0.0.1:53946
I20251023 07:59:11.582443 18096 raft_consensus.cc:493] T 5939b6a960ea4b0581b61ccdcdfa7c37 P b3a1328f9c8c484fab08292ce2171ec9 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:59:11.582949 18096 raft_consensus.cc:3060] T 5939b6a960ea4b0581b61ccdcdfa7c37 P b3a1328f9c8c484fab08292ce2171ec9 [term 3 FOLLOWER]: Advancing to term 4
I20251023 07:59:11.572947 19476 ts_tablet_manager.cc:1916] T 85799f6eb6ae41fa9620accb877d8708 P b3a1328f9c8c484fab08292ce2171ec9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251023 07:59:11.617843 18096 raft_consensus.cc:515] T 5939b6a960ea4b0581b61ccdcdfa7c37 P b3a1328f9c8c484fab08292ce2171ec9 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:11.621121 18784 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5939b6a960ea4b0581b61ccdcdfa7c37" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "d1a8f61d3323447282ee6068aa623216"
I20251023 07:59:11.621789 18784 raft_consensus.cc:3060] T 5939b6a960ea4b0581b61ccdcdfa7c37 P d1a8f61d3323447282ee6068aa623216 [term 3 FOLLOWER]: Advancing to term 4
I20251023 07:59:11.629814 18102 raft_consensus.cc:1275] T c6022ad5a70c4b4f8f34339956122cb7 P b3a1328f9c8c484fab08292ce2171ec9 [term 3 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20251023 07:59:11.631247 19412 consensus_queue.cc:1048] T c6022ad5a70c4b4f8f34339956122cb7 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:59:11.633862 18784 raft_consensus.cc:2468] T 5939b6a960ea4b0581b61ccdcdfa7c37 P d1a8f61d3323447282ee6068aa623216 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3a1328f9c8c484fab08292ce2171ec9 in term 4.
I20251023 07:59:11.626039 18176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5939b6a960ea4b0581b61ccdcdfa7c37" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "10dfae53d0c941f08bded43539841761"
I20251023 07:59:11.635599 18067 leader_election.cc:304] T 5939b6a960ea4b0581b61ccdcdfa7c37 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3a1328f9c8c484fab08292ce2171ec9, d1a8f61d3323447282ee6068aa623216; no voters:
I20251023 07:59:11.641897 19379 raft_consensus.cc:2804] T 5939b6a960ea4b0581b61ccdcdfa7c37 P b3a1328f9c8c484fab08292ce2171ec9 [term 4 FOLLOWER]: Leader election won for term 4
I20251023 07:59:11.642374 19379 raft_consensus.cc:697] T 5939b6a960ea4b0581b61ccdcdfa7c37 P b3a1328f9c8c484fab08292ce2171ec9 [term 4 LEADER]: Becoming Leader. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Running, Role: LEADER
I20251023 07:59:11.643150 19379 consensus_queue.cc:237] T 5939b6a960ea4b0581b61ccdcdfa7c37 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:11.646733 18784 raft_consensus.cc:3060] T c6022ad5a70c4b4f8f34339956122cb7 P d1a8f61d3323447282ee6068aa623216 [term 2 LEARNER]: Advancing to term 3
I20251023 07:59:11.636118 18176 raft_consensus.cc:3055] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 10dfae53d0c941f08bded43539841761 [term 3 LEADER]: Stepping down as leader of term 3
I20251023 07:59:11.649382 18176 raft_consensus.cc:740] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 10dfae53d0c941f08bded43539841761 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Running, Role: LEADER
I20251023 07:59:11.647190 18096 leader_election.cc:290] T 5939b6a960ea4b0581b61ccdcdfa7c37 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 4 election: Requested vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), d1a8f61d3323447282ee6068aa623216 (127.16.126.4:33293)
I20251023 07:59:11.650489 18176 consensus_queue.cc:260] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:11.653009 18176 raft_consensus.cc:3060] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 10dfae53d0c941f08bded43539841761 [term 3 FOLLOWER]: Advancing to term 4
I20251023 07:59:11.692127 18784 raft_consensus.cc:1275] T c6022ad5a70c4b4f8f34339956122cb7 P d1a8f61d3323447282ee6068aa623216 [term 3 LEARNER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20251023 07:59:11.703004 18176 raft_consensus.cc:2468] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 10dfae53d0c941f08bded43539841761 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3a1328f9c8c484fab08292ce2171ec9 in term 4.
I20251023 07:59:11.707594 19476 ts_tablet_manager.cc:1929] T 85799f6eb6ae41fa9620accb877d8708 P b3a1328f9c8c484fab08292ce2171ec9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20251023 07:59:11.711732 19412 consensus_queue.cc:1048] T c6022ad5a70c4b4f8f34339956122cb7 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20251023 07:59:11.713045 19452 raft_consensus.cc:993] T c8b2781a072e401dba80e2879748e681 P 982df35c5b554a8fa64807352c4f34ee: : Instructing follower 10dfae53d0c941f08bded43539841761 to start an election
I20251023 07:59:11.713905 17997 catalog_manager.cc:5649] T 5939b6a960ea4b0581b61ccdcdfa7c37 P b3a1328f9c8c484fab08292ce2171ec9 reported cstate change: term changed from 3 to 4, leader changed from 10dfae53d0c941f08bded43539841761 (127.16.126.2) to b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1). New cstate: current_term: 4 leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:11.715238 19452 raft_consensus.cc:1081] T c8b2781a072e401dba80e2879748e681 P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Signalling peer 10dfae53d0c941f08bded43539841761 to start an election
W20251023 07:59:11.714097 18215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.2:45799, user_credentials={real_user=slave}} blocked reactor thread for 49144.8us
I20251023 07:59:11.717572 19476 log.cc:1199] T 85799f6eb6ae41fa9620accb877d8708 P b3a1328f9c8c484fab08292ce2171ec9: Deleting WAL directory at /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1761206251627710-16888-0/minicluster-data/ts-0-root/wals/85799f6eb6ae41fa9620accb877d8708
I20251023 07:59:11.717900 18176 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "c8b2781a072e401dba80e2879748e681"
dest_uuid: "10dfae53d0c941f08bded43539841761"
from {username='slave'} at 127.0.0.1:51868
I20251023 07:59:11.720176 18176 raft_consensus.cc:493] T c8b2781a072e401dba80e2879748e681 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:59:11.720505 18176 raft_consensus.cc:3060] T c8b2781a072e401dba80e2879748e681 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:11.718403 19475 ts_tablet_manager.cc:1929] T e85adbfd669946ce9f939c02865fea6a P 10dfae53d0c941f08bded43539841761: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20251023 07:59:11.728729 19475 log.cc:1199] T e85adbfd669946ce9f939c02865fea6a P 10dfae53d0c941f08bded43539841761: Deleting WAL directory at /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1761206251627710-16888-0/minicluster-data/ts-1-root/wals/e85adbfd669946ce9f939c02865fea6a
I20251023 07:59:11.729599 18242 raft_consensus.cc:1275] T c6022ad5a70c4b4f8f34339956122cb7 P 982df35c5b554a8fa64807352c4f34ee [term 3 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20251023 07:59:11.725579 17987 catalog_manager.cc:4985] TS b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): tablet 85799f6eb6ae41fa9620accb877d8708 (table test-workload [id=8bb191a5531a4d4fb58a25b13d592213]) successfully deleted
I20251023 07:59:11.737917 17985 catalog_manager.cc:4985] TS 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): tablet e85adbfd669946ce9f939c02865fea6a (table test-workload [id=8bb191a5531a4d4fb58a25b13d592213]) successfully deleted
I20251023 07:59:11.744429 18176 raft_consensus.cc:515] T c8b2781a072e401dba80e2879748e681 P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:11.758869 18176 leader_election.cc:290] T c8b2781a072e401dba80e2879748e681 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 2 election: Requested vote from peers 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061), d1a8f61d3323447282ee6068aa623216 (127.16.126.4:33293)
I20251023 07:59:11.770885 19430 raft_consensus.cc:993] T 3c5c040d6ebe40e5a5be6be47de5a7bc P b3a1328f9c8c484fab08292ce2171ec9: : Instructing follower 982df35c5b554a8fa64807352c4f34ee to start an election
I20251023 07:59:11.771399 19477 raft_consensus.cc:1081] T 3c5c040d6ebe40e5a5be6be47de5a7bc P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Signalling peer 982df35c5b554a8fa64807352c4f34ee to start an election
I20251023 07:59:11.775097 19423 consensus_queue.cc:1048] T c6022ad5a70c4b4f8f34339956122cb7 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:59:11.777568 18242 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "3c5c040d6ebe40e5a5be6be47de5a7bc"
dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
from {username='slave'} at 127.0.0.1:49420
I20251023 07:59:11.778213 18242 raft_consensus.cc:493] T 3c5c040d6ebe40e5a5be6be47de5a7bc P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:59:11.778554 18242 raft_consensus.cc:3060] T 3c5c040d6ebe40e5a5be6be47de5a7bc P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:11.783293 19414 raft_consensus.cc:1064] T c6022ad5a70c4b4f8f34339956122cb7 P 10dfae53d0c941f08bded43539841761: attempting to promote NON_VOTER d1a8f61d3323447282ee6068aa623216 to VOTER
I20251023 07:59:11.781126 18243 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c8b2781a072e401dba80e2879748e681" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
I20251023 07:59:11.784806 18243 raft_consensus.cc:3055] T c8b2781a072e401dba80e2879748e681 P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Stepping down as leader of term 1
I20251023 07:59:11.785157 18243 raft_consensus.cc:740] T c8b2781a072e401dba80e2879748e681 P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Running, Role: LEADER
I20251023 07:59:11.785985 18243 consensus_queue.cc:260] T c8b2781a072e401dba80e2879748e681 P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:11.787257 18243 raft_consensus.cc:3060] T c8b2781a072e401dba80e2879748e681 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:11.796445 19414 consensus_queue.cc:237] T c6022ad5a70c4b4f8f34339956122cb7 P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:11.800215 18242 raft_consensus.cc:515] T 3c5c040d6ebe40e5a5be6be47de5a7bc P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:11.802631 18784 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c8b2781a072e401dba80e2879748e681" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d1a8f61d3323447282ee6068aa623216"
I20251023 07:59:11.804759 18787 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3c5c040d6ebe40e5a5be6be47de5a7bc" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d1a8f61d3323447282ee6068aa623216"
I20251023 07:59:11.806355 18787 raft_consensus.cc:3060] T 3c5c040d6ebe40e5a5be6be47de5a7bc P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:11.807762 18242 leader_election.cc:290] T 3c5c040d6ebe40e5a5be6be47de5a7bc P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 2 election: Requested vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), d1a8f61d3323447282ee6068aa623216 (127.16.126.4:33293)
I20251023 07:59:11.805519 18096 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3c5c040d6ebe40e5a5be6be47de5a7bc" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
I20251023 07:59:11.809887 18096 raft_consensus.cc:3055] T 3c5c040d6ebe40e5a5be6be47de5a7bc P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Stepping down as leader of term 1
I20251023 07:59:11.810225 18096 raft_consensus.cc:740] T 3c5c040d6ebe40e5a5be6be47de5a7bc P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Running, Role: LEADER
I20251023 07:59:11.813665 18784 raft_consensus.cc:3060] T c8b2781a072e401dba80e2879748e681 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:11.826934 18784 raft_consensus.cc:2468] T c8b2781a072e401dba80e2879748e681 P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 2.
I20251023 07:59:11.813555 18096 consensus_queue.cc:260] T 3c5c040d6ebe40e5a5be6be47de5a7bc P b3a1328f9c8c484fab08292ce2171ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:11.816396 18243 raft_consensus.cc:2468] T c8b2781a072e401dba80e2879748e681 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 2.
I20251023 07:59:11.817191 18099 raft_consensus.cc:1275] T c6022ad5a70c4b4f8f34339956122cb7 P b3a1328f9c8c484fab08292ce2171ec9 [term 3 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20251023 07:59:11.829324 19423 consensus_queue.cc:1048] T c6022ad5a70c4b4f8f34339956122cb7 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20251023 07:59:11.834208 19480 raft_consensus.cc:993] T c63b5a4dc8eb4b6e918608f281183068 P 982df35c5b554a8fa64807352c4f34ee: : Instructing follower 10dfae53d0c941f08bded43539841761 to start an election
I20251023 07:59:11.834761 19479 raft_consensus.cc:1081] T c63b5a4dc8eb4b6e918608f281183068 P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Signalling peer 10dfae53d0c941f08bded43539841761 to start an election
I20251023 07:59:11.836330 18171 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "c63b5a4dc8eb4b6e918608f281183068"
dest_uuid: "10dfae53d0c941f08bded43539841761"
from {username='slave'} at 127.0.0.1:51868
I20251023 07:59:11.836885 18171 raft_consensus.cc:493] T c63b5a4dc8eb4b6e918608f281183068 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:59:11.837239 18171 raft_consensus.cc:3060] T c63b5a4dc8eb4b6e918608f281183068 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:11.840801 18096 raft_consensus.cc:3060] T 3c5c040d6ebe40e5a5be6be47de5a7bc P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:11.844877 18171 raft_consensus.cc:515] T c63b5a4dc8eb4b6e918608f281183068 P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:59:11.851646 18787 raft_consensus.cc:2468] T 3c5c040d6ebe40e5a5be6be47de5a7bc P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 2.
I20251023 07:59:11.855003 18246 raft_consensus.cc:1275] T c6022ad5a70c4b4f8f34339956122cb7 P 982df35c5b554a8fa64807352c4f34ee [term 3 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20251023 07:59:11.863638 18788 raft_consensus.cc:1240] T 3c5c040d6ebe40e5a5be6be47de5a7bc P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Rejecting Update request from peer b3a1328f9c8c484fab08292ce2171ec9 for earlier term 1. Current term is 2. Ops: []
I20251023 07:59:11.855226 18784 raft_consensus.cc:1275] T c6022ad5a70c4b4f8f34339956122cb7 P d1a8f61d3323447282ee6068aa623216 [term 3 LEARNER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20251023 07:59:11.864255 18216 leader_election.cc:304] T 3c5c040d6ebe40e5a5be6be47de5a7bc P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee, d1a8f61d3323447282ee6068aa623216; no voters:
I20251023 07:59:11.856945 18142 leader_election.cc:304] T c8b2781a072e401dba80e2879748e681 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, d1a8f61d3323447282ee6068aa623216; no voters:
I20251023 07:59:11.866235 18099 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c63b5a4dc8eb4b6e918608f281183068" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
I20251023 07:59:11.866822 18099 raft_consensus.cc:3060] T c63b5a4dc8eb4b6e918608f281183068 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:11.866956 19414 raft_consensus.cc:2804] T c8b2781a072e401dba80e2879748e681 P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:59:11.868638 19414 raft_consensus.cc:697] T c8b2781a072e401dba80e2879748e681 P 10dfae53d0c941f08bded43539841761 [term 2 LEADER]: Becoming Leader. State: Replica: 10dfae53d0c941f08bded43539841761, State: Running, Role: LEADER
I20251023 07:59:11.871488 19375 consensus_queue.cc:1048] T c6022ad5a70c4b4f8f34339956122cb7 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20251023 07:59:11.861836 18096 raft_consensus.cc:2468] T 3c5c040d6ebe40e5a5be6be47de5a7bc P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 2.
I20251023 07:59:11.874159 19479 raft_consensus.cc:2804] T 3c5c040d6ebe40e5a5be6be47de5a7bc P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:59:11.874748 19479 raft_consensus.cc:697] T 3c5c040d6ebe40e5a5be6be47de5a7bc P 982df35c5b554a8fa64807352c4f34ee [term 2 LEADER]: Becoming Leader. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Running, Role: LEADER
I20251023 07:59:11.875675 19479 consensus_queue.cc:237] T 3c5c040d6ebe40e5a5be6be47de5a7bc P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:11.877530 18171 leader_election.cc:290] T c63b5a4dc8eb4b6e918608f281183068 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 2 election: Requested vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:59:11.878791 18099 raft_consensus.cc:2468] T c63b5a4dc8eb4b6e918608f281183068 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 2.
I20251023 07:59:11.880214 18143 leader_election.cc:304] T c63b5a4dc8eb4b6e918608f281183068 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:59:11.881341 19482 raft_consensus.cc:2804] T c63b5a4dc8eb4b6e918608f281183068 P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:59:11.881861 19482 raft_consensus.cc:697] T c63b5a4dc8eb4b6e918608f281183068 P 10dfae53d0c941f08bded43539841761 [term 2 LEADER]: Becoming Leader. State: Replica: 10dfae53d0c941f08bded43539841761, State: Running, Role: LEADER
I20251023 07:59:11.882727 19482 consensus_queue.cc:237] T c63b5a4dc8eb4b6e918608f281183068 P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:59:11.879850 19414 consensus_queue.cc:237] T c8b2781a072e401dba80e2879748e681 P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:11.886888 19423 consensus_queue.cc:1048] T c6022ad5a70c4b4f8f34339956122cb7 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20251023 07:59:11.894520 18246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c63b5a4dc8eb4b6e918608f281183068" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
I20251023 07:59:11.895153 18246 raft_consensus.cc:3055] T c63b5a4dc8eb4b6e918608f281183068 P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Stepping down as leader of term 1
I20251023 07:59:11.895469 18246 raft_consensus.cc:740] T c63b5a4dc8eb4b6e918608f281183068 P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Running, Role: LEADER
I20251023 07:59:11.896199 18246 consensus_queue.cc:260] T c63b5a4dc8eb4b6e918608f281183068 P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:59:11.897239 18246 raft_consensus.cc:3060] T c63b5a4dc8eb4b6e918608f281183068 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:11.901562 19423 raft_consensus.cc:2955] T c6022ad5a70c4b4f8f34339956122cb7 P 10dfae53d0c941f08bded43539841761 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 2 to 5, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:11.906864 18246 raft_consensus.cc:2468] T c63b5a4dc8eb4b6e918608f281183068 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 2.
I20251023 07:59:11.909207 18784 raft_consensus.cc:2955] T c6022ad5a70c4b4f8f34339956122cb7 P d1a8f61d3323447282ee6068aa623216 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:11.919276 17997 catalog_manager.cc:5649] T c8b2781a072e401dba80e2879748e681 P 10dfae53d0c941f08bded43539841761 reported cstate change: term changed from 1 to 2, leader changed from 982df35c5b554a8fa64807352c4f34ee (127.16.126.3) to 10dfae53d0c941f08bded43539841761 (127.16.126.2). New cstate: current_term: 2 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:11.969187 17997 catalog_manager.cc:5649] T c63b5a4dc8eb4b6e918608f281183068 P 10dfae53d0c941f08bded43539841761 reported cstate change: term changed from 1 to 2, leader changed from 982df35c5b554a8fa64807352c4f34ee (127.16.126.3) to 10dfae53d0c941f08bded43539841761 (127.16.126.2). New cstate: current_term: 2 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:11.978099 17999 catalog_manager.cc:5649] T c6022ad5a70c4b4f8f34339956122cb7 P d1a8f61d3323447282ee6068aa623216 reported cstate change: config changed from index 2 to 5, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
W20251023 07:59:11.983901 18142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.3:46061, user_credentials={real_user=slave}} blocked reactor thread for 50016.9us
I20251023 07:59:11.995172 18096 raft_consensus.cc:2955] T c6022ad5a70c4b4f8f34339956122cb7 P b3a1328f9c8c484fab08292ce2171ec9 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:12.013530 18176 consensus_queue.cc:237] T c6022ad5a70c4b4f8f34339956122cb7 P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:12.027987 18784 raft_consensus.cc:1275] T c6022ad5a70c4b4f8f34339956122cb7 P d1a8f61d3323447282ee6068aa623216 [term 3 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20251023 07:59:12.033011 18243 raft_consensus.cc:2955] T c6022ad5a70c4b4f8f34339956122cb7 P 982df35c5b554a8fa64807352c4f34ee [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:12.034881 18176 raft_consensus.cc:1275] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 10dfae53d0c941f08bded43539841761 [term 4 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20251023 07:59:12.036072 19477 consensus_queue.cc:1048] T 5939b6a960ea4b0581b61ccdcdfa7c37 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20251023 07:59:12.029158 19423 consensus_queue.cc:1048] T c6022ad5a70c4b4f8f34339956122cb7 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20251023 07:59:12.056912 17997 catalog_manager.cc:5649] T 3c5c040d6ebe40e5a5be6be47de5a7bc P 982df35c5b554a8fa64807352c4f34ee reported cstate change: term changed from 1 to 2, leader changed from b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1) to 982df35c5b554a8fa64807352c4f34ee (127.16.126.3). New cstate: current_term: 2 leader_uuid: "982df35c5b554a8fa64807352c4f34ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:12.060608 18096 raft_consensus.cc:1275] T c6022ad5a70c4b4f8f34339956122cb7 P b3a1328f9c8c484fab08292ce2171ec9 [term 3 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20251023 07:59:12.062323 19489 raft_consensus.cc:2955] T c6022ad5a70c4b4f8f34339956122cb7 P 10dfae53d0c941f08bded43539841761 [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 982df35c5b554a8fa64807352c4f34ee (127.16.126.3) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:12.063601 19482 consensus_queue.cc:1048] T c6022ad5a70c4b4f8f34339956122cb7 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20251023 07:59:12.066684 18788 raft_consensus.cc:2955] T c6022ad5a70c4b4f8f34339956122cb7 P d1a8f61d3323447282ee6068aa623216 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 982df35c5b554a8fa64807352c4f34ee (127.16.126.3) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:12.071652 18787 raft_consensus.cc:1275] T 5939b6a960ea4b0581b61ccdcdfa7c37 P d1a8f61d3323447282ee6068aa623216 [term 4 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20251023 07:59:12.073726 19481 consensus_queue.cc:1048] T 5939b6a960ea4b0581b61ccdcdfa7c37 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20251023 07:59:12.102531 18096 raft_consensus.cc:2955] T c6022ad5a70c4b4f8f34339956122cb7 P b3a1328f9c8c484fab08292ce2171ec9 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 982df35c5b554a8fa64807352c4f34ee (127.16.126.3) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:12.107144 17985 catalog_manager.cc:5162] ChangeConfig:REMOVE_PEER RPC for tablet c6022ad5a70c4b4f8f34339956122cb7 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251023 07:59:12.138278 17999 catalog_manager.cc:5649] T c6022ad5a70c4b4f8f34339956122cb7 P 10dfae53d0c941f08bded43539841761 reported cstate change: config changed from index 5 to 6, VOTER 982df35c5b554a8fa64807352c4f34ee (127.16.126.3) evicted. New cstate: current_term: 3 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251023 07:59:12.152252 18237 tablet_service.cc:1552] Processing DeleteTablet for tablet c6022ad5a70c4b4f8f34339956122cb7 with delete_type TABLET_DATA_TOMBSTONED (TS 982df35c5b554a8fa64807352c4f34ee not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:49846
I20251023 07:59:12.171753 19492 tablet_replica.cc:333] T c6022ad5a70c4b4f8f34339956122cb7 P 982df35c5b554a8fa64807352c4f34ee: stopping tablet replica
I20251023 07:59:12.178547 19492 raft_consensus.cc:2243] T c6022ad5a70c4b4f8f34339956122cb7 P 982df35c5b554a8fa64807352c4f34ee [term 3 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:12.179484 19492 raft_consensus.cc:2272] T c6022ad5a70c4b4f8f34339956122cb7 P 982df35c5b554a8fa64807352c4f34ee [term 3 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:12.182403 19492 ts_tablet_manager.cc:1916] T c6022ad5a70c4b4f8f34339956122cb7 P 982df35c5b554a8fa64807352c4f34ee: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251023 07:59:12.193521 19492 ts_tablet_manager.cc:1929] T c6022ad5a70c4b4f8f34339956122cb7 P 982df35c5b554a8fa64807352c4f34ee: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20251023 07:59:12.193838 19492 log.cc:1199] T c6022ad5a70c4b4f8f34339956122cb7 P 982df35c5b554a8fa64807352c4f34ee: Deleting WAL directory at /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1761206251627710-16888-0/minicluster-data/ts-2-root/wals/c6022ad5a70c4b4f8f34339956122cb7
I20251023 07:59:12.195348 17986 catalog_manager.cc:4985] TS 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): tablet c6022ad5a70c4b4f8f34339956122cb7 (table test-workload [id=8bb191a5531a4d4fb58a25b13d592213]) successfully deleted
I20251023 07:59:12.271979 18787 raft_consensus.cc:1275] T 3c5c040d6ebe40e5a5be6be47de5a7bc P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20251023 07:59:12.273707 19479 consensus_queue.cc:1048] T 3c5c040d6ebe40e5a5be6be47de5a7bc P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20251023 07:59:12.284343 18096 raft_consensus.cc:1275] T 3c5c040d6ebe40e5a5be6be47de5a7bc P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20251023 07:59:12.285709 19452 consensus_queue.cc:1048] T 3c5c040d6ebe40e5a5be6be47de5a7bc P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20251023 07:59:12.305193 18243 raft_consensus.cc:1275] T c63b5a4dc8eb4b6e918608f281183068 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:12.306625 19423 consensus_queue.cc:1048] T c63b5a4dc8eb4b6e918608f281183068 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:12.326306 18101 raft_consensus.cc:1275] T c63b5a4dc8eb4b6e918608f281183068 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:12.330401 19375 consensus_queue.cc:1048] T c63b5a4dc8eb4b6e918608f281183068 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:12.393858 18787 raft_consensus.cc:1275] T c8b2781a072e401dba80e2879748e681 P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20251023 07:59:12.395071 19375 consensus_queue.cc:1048] T c8b2781a072e401dba80e2879748e681 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20251023 07:59:12.412658 18243 raft_consensus.cc:1275] T c8b2781a072e401dba80e2879748e681 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20251023 07:59:12.413897 19487 consensus_queue.cc:1048] T c8b2781a072e401dba80e2879748e681 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20251023 07:59:12.612000 18754 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.3:46061, user_credentials={real_user=slave}} blocked reactor thread for 59883us
W20251023 07:59:12.613411 18753 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.2:45799, user_credentials={real_user=slave}} blocked reactor thread for 62214.1us
I20251023 07:59:12.637210 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:59:12.733166 18176 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "94cd6588f7824a30ba02f891ae089671"
dest_uuid: "10dfae53d0c941f08bded43539841761"
mode: GRACEFUL
new_leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
from {username='slave'} at 127.0.0.1:47396
I20251023 07:59:12.734154 18176 raft_consensus.cc:606] T 94cd6588f7824a30ba02f891ae089671 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Received request to transfer leadership to TS b3a1328f9c8c484fab08292ce2171ec9
I20251023 07:59:12.737628 18101 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "b19b550093fb4ab181e62957d89460e7"
dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
mode: GRACEFUL
new_leader_uuid: "10dfae53d0c941f08bded43539841761"
from {username='slave'} at 127.0.0.1:34418
I20251023 07:59:12.738253 18101 raft_consensus.cc:606] T b19b550093fb4ab181e62957d89460e7 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Received request to transfer leadership to TS 10dfae53d0c941f08bded43539841761
I20251023 07:59:12.740999 18176 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "c6022ad5a70c4b4f8f34339956122cb7"
dest_uuid: "10dfae53d0c941f08bded43539841761"
mode: GRACEFUL
new_leader_uuid: "d1a8f61d3323447282ee6068aa623216"
from {username='slave'} at 127.0.0.1:47396
I20251023 07:59:12.741600 18176 raft_consensus.cc:606] T c6022ad5a70c4b4f8f34339956122cb7 P 10dfae53d0c941f08bded43539841761 [term 3 LEADER]: Received request to transfer leadership to TS d1a8f61d3323447282ee6068aa623216
I20251023 07:59:12.744194 18176 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "c63b5a4dc8eb4b6e918608f281183068"
dest_uuid: "10dfae53d0c941f08bded43539841761"
mode: GRACEFUL
new_leader_uuid: "982df35c5b554a8fa64807352c4f34ee"
from {username='slave'} at 127.0.0.1:47396
I20251023 07:59:12.744712 18176 raft_consensus.cc:606] T c63b5a4dc8eb4b6e918608f281183068 P 10dfae53d0c941f08bded43539841761 [term 2 LEADER]: Received request to transfer leadership to TS 982df35c5b554a8fa64807352c4f34ee
I20251023 07:59:12.747424 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 4
I20251023 07:59:12.749178 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 07:59:12.750306 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:59:12.772891 18176 consensus_queue.cc:237] T fe0293c22cae49cfa7cd698f17626a35 P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
W20251023 07:59:12.787931 18142 consensus_peers.cc:597] T fe0293c22cae49cfa7cd698f17626a35 P 10dfae53d0c941f08bded43539841761 -> Peer d1a8f61d3323447282ee6068aa623216 (127.16.126.4:33293): Couldn't send request to peer d1a8f61d3323447282ee6068aa623216. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fe0293c22cae49cfa7cd698f17626a35. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:12.792939 18101 raft_consensus.cc:1275] T fe0293c22cae49cfa7cd698f17626a35 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20251023 07:59:12.794279 18246 raft_consensus.cc:1275] T fe0293c22cae49cfa7cd698f17626a35 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20251023 07:59:12.794587 19412 consensus_queue.cc:1048] T fe0293c22cae49cfa7cd698f17626a35 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20251023 07:59:12.805636 19375 consensus_queue.cc:1048] T fe0293c22cae49cfa7cd698f17626a35 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20251023 07:59:12.823294 19482 raft_consensus.cc:993] T c63b5a4dc8eb4b6e918608f281183068 P 10dfae53d0c941f08bded43539841761: : Instructing follower 982df35c5b554a8fa64807352c4f34ee to start an election
I20251023 07:59:12.822314 18099 raft_consensus.cc:2955] T fe0293c22cae49cfa7cd698f17626a35 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:12.823860 19482 raft_consensus.cc:1081] T c63b5a4dc8eb4b6e918608f281183068 P 10dfae53d0c941f08bded43539841761 [term 2 LEADER]: Signalling peer 982df35c5b554a8fa64807352c4f34ee to start an election
I20251023 07:59:12.821934 19489 raft_consensus.cc:2955] T fe0293c22cae49cfa7cd698f17626a35 P 10dfae53d0c941f08bded43539841761 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:12.827723 18243 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "c63b5a4dc8eb4b6e918608f281183068"
dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
from {username='slave'} at 127.0.0.1:49858
I20251023 07:59:12.828392 18243 raft_consensus.cc:493] T c63b5a4dc8eb4b6e918608f281183068 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:59:12.828770 18243 raft_consensus.cc:3060] T c63b5a4dc8eb4b6e918608f281183068 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:59:12.836957 18243 raft_consensus.cc:515] T c63b5a4dc8eb4b6e918608f281183068 P 982df35c5b554a8fa64807352c4f34ee [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:59:12.843422 17997 catalog_manager.cc:5649] T fe0293c22cae49cfa7cd698f17626a35 P b3a1328f9c8c484fab08292ce2171ec9 reported cstate change: config changed from index -1 to 3, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New cstate: current_term: 2 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:12.845652 18099 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c63b5a4dc8eb4b6e918608f281183068" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
I20251023 07:59:12.846514 18099 raft_consensus.cc:3060] T c63b5a4dc8eb4b6e918608f281183068 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:59:12.848763 18101 consensus_queue.cc:237] T fbc1ceb70a0c42c6871ea24480ee4221 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:59:12.852886 18176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c63b5a4dc8eb4b6e918608f281183068" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "10dfae53d0c941f08bded43539841761"
I20251023 07:59:12.853492 18176 raft_consensus.cc:3055] T c63b5a4dc8eb4b6e918608f281183068 P 10dfae53d0c941f08bded43539841761 [term 2 LEADER]: Stepping down as leader of term 2
I20251023 07:59:12.853808 18176 raft_consensus.cc:740] T c63b5a4dc8eb4b6e918608f281183068 P 10dfae53d0c941f08bded43539841761 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Running, Role: LEADER
I20251023 07:59:12.854588 18176 consensus_queue.cc:260] T c63b5a4dc8eb4b6e918608f281183068 P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:59:12.855831 18176 raft_consensus.cc:3060] T c63b5a4dc8eb4b6e918608f281183068 P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:59:12.859725 18099 raft_consensus.cc:2468] T c63b5a4dc8eb4b6e918608f281183068 P b3a1328f9c8c484fab08292ce2171ec9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 3.
I20251023 07:59:12.865597 18217 leader_election.cc:304] T c63b5a4dc8eb4b6e918608f281183068 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:59:12.867712 19396 raft_consensus.cc:2804] T c63b5a4dc8eb4b6e918608f281183068 P 982df35c5b554a8fa64807352c4f34ee [term 3 FOLLOWER]: Leader election won for term 3
I20251023 07:59:12.868283 19396 raft_consensus.cc:697] T c63b5a4dc8eb4b6e918608f281183068 P 982df35c5b554a8fa64807352c4f34ee [term 3 LEADER]: Becoming Leader. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Running, Role: LEADER
I20251023 07:59:12.869181 19396 consensus_queue.cc:237] T c63b5a4dc8eb4b6e918608f281183068 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:59:12.891486 17997 catalog_manager.cc:5649] T c63b5a4dc8eb4b6e918608f281183068 P 982df35c5b554a8fa64807352c4f34ee reported cstate change: term changed from 2 to 3, leader changed from 10dfae53d0c941f08bded43539841761 (127.16.126.2) to 982df35c5b554a8fa64807352c4f34ee (127.16.126.3). New cstate: current_term: 3 leader_uuid: "982df35c5b554a8fa64807352c4f34ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: HEALTHY } } }
I20251023 07:59:12.895625 18243 leader_election.cc:290] T c63b5a4dc8eb4b6e918608f281183068 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 3 election: Requested vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:59:12.898876 18176 raft_consensus.cc:2468] T c63b5a4dc8eb4b6e918608f281183068 P 10dfae53d0c941f08bded43539841761 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 3.
W20251023 07:59:12.906253 18067 consensus_peers.cc:597] T fbc1ceb70a0c42c6871ea24480ee4221 P b3a1328f9c8c484fab08292ce2171ec9 -> Peer d1a8f61d3323447282ee6068aa623216 (127.16.126.4:33293): Couldn't send request to peer d1a8f61d3323447282ee6068aa623216. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fbc1ceb70a0c42c6871ea24480ee4221. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:12.908185 18246 raft_consensus.cc:1275] T fbc1ceb70a0c42c6871ea24480ee4221 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251023 07:59:12.908722 18171 raft_consensus.cc:1275] T fbc1ceb70a0c42c6871ea24480ee4221 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251023 07:59:12.911103 19379 consensus_queue.cc:1048] T fbc1ceb70a0c42c6871ea24480ee4221 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:12.915150 19379 consensus_queue.cc:1048] T fbc1ceb70a0c42c6871ea24480ee4221 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:12.925034 18243 raft_consensus.cc:2955] T fe0293c22cae49cfa7cd698f17626a35 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:12.963500 19427 raft_consensus.cc:2955] T fbc1ceb70a0c42c6871ea24480ee4221 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:12.968284 18171 raft_consensus.cc:2955] T fbc1ceb70a0c42c6871ea24480ee4221 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:12.989675 18246 consensus_queue.cc:237] T 1f539da81d60449b9d96866c7ceee1be P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:59:13.003667 17999 catalog_manager.cc:5649] T fbc1ceb70a0c42c6871ea24480ee4221 P b3a1328f9c8c484fab08292ce2171ec9 reported cstate change: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New cstate: current_term: 1 leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:13.007736 18247 raft_consensus.cc:2955] T fbc1ceb70a0c42c6871ea24480ee4221 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
W20251023 07:59:13.034099 18216 consensus_peers.cc:597] T 1f539da81d60449b9d96866c7ceee1be P 982df35c5b554a8fa64807352c4f34ee -> Peer d1a8f61d3323447282ee6068aa623216 (127.16.126.4:33293): Couldn't send request to peer d1a8f61d3323447282ee6068aa623216. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1f539da81d60449b9d96866c7ceee1be. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:13.034498 18101 raft_consensus.cc:1275] T 1f539da81d60449b9d96866c7ceee1be P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251023 07:59:13.039099 19480 consensus_queue.cc:1048] T 1f539da81d60449b9d96866c7ceee1be P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20251023 07:59:13.041961 18174 raft_consensus.cc:1275] T 1f539da81d60449b9d96866c7ceee1be P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251023 07:59:13.047358 19480 consensus_queue.cc:1048] T 1f539da81d60449b9d96866c7ceee1be P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:13.050550 19489 raft_consensus.cc:993] T c6022ad5a70c4b4f8f34339956122cb7 P 10dfae53d0c941f08bded43539841761: : Instructing follower d1a8f61d3323447282ee6068aa623216 to start an election
I20251023 07:59:13.051041 19489 raft_consensus.cc:1081] T c6022ad5a70c4b4f8f34339956122cb7 P 10dfae53d0c941f08bded43539841761 [term 3 LEADER]: Signalling peer d1a8f61d3323447282ee6068aa623216 to start an election
I20251023 07:59:13.053035 18787 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "c6022ad5a70c4b4f8f34339956122cb7"
dest_uuid: "d1a8f61d3323447282ee6068aa623216"
from {username='slave'} at 127.0.0.1:36500
I20251023 07:59:13.053557 18787 raft_consensus.cc:493] T c6022ad5a70c4b4f8f34339956122cb7 P d1a8f61d3323447282ee6068aa623216 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:59:13.053812 18787 raft_consensus.cc:3060] T c6022ad5a70c4b4f8f34339956122cb7 P d1a8f61d3323447282ee6068aa623216 [term 3 FOLLOWER]: Advancing to term 4
I20251023 07:59:13.059403 19452 raft_consensus.cc:2955] T 1f539da81d60449b9d96866c7ceee1be P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:13.061599 18787 raft_consensus.cc:515] T c6022ad5a70c4b4f8f34339956122cb7 P d1a8f61d3323447282ee6068aa623216 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:13.064502 18099 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6022ad5a70c4b4f8f34339956122cb7" candidate_uuid: "d1a8f61d3323447282ee6068aa623216" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
I20251023 07:59:13.065076 18099 raft_consensus.cc:3060] T c6022ad5a70c4b4f8f34339956122cb7 P b3a1328f9c8c484fab08292ce2171ec9 [term 3 FOLLOWER]: Advancing to term 4
I20251023 07:59:13.066520 18171 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6022ad5a70c4b4f8f34339956122cb7" candidate_uuid: "d1a8f61d3323447282ee6068aa623216" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "10dfae53d0c941f08bded43539841761"
I20251023 07:59:13.067114 18171 raft_consensus.cc:3055] T c6022ad5a70c4b4f8f34339956122cb7 P 10dfae53d0c941f08bded43539841761 [term 3 LEADER]: Stepping down as leader of term 3
I20251023 07:59:13.067404 18171 raft_consensus.cc:740] T c6022ad5a70c4b4f8f34339956122cb7 P 10dfae53d0c941f08bded43539841761 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Running, Role: LEADER
I20251023 07:59:13.072934 18101 raft_consensus.cc:2955] T 1f539da81d60449b9d96866c7ceee1be P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:13.076040 18096 consensus_queue.cc:237] T d3b72ceda32a4ebc8de6e7a7992498aa P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:59:13.080227 18099 raft_consensus.cc:2468] T c6022ad5a70c4b4f8f34339956122cb7 P b3a1328f9c8c484fab08292ce2171ec9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1a8f61d3323447282ee6068aa623216 in term 4.
I20251023 07:59:13.061781 18174 raft_consensus.cc:2955] T 1f539da81d60449b9d96866c7ceee1be P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:13.083149 18171 consensus_queue.cc:260] T c6022ad5a70c4b4f8f34339956122cb7 P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:13.084412 18171 raft_consensus.cc:3060] T c6022ad5a70c4b4f8f34339956122cb7 P 10dfae53d0c941f08bded43539841761 [term 3 FOLLOWER]: Advancing to term 4
I20251023 07:59:13.092819 17999 catalog_manager.cc:5649] T 1f539da81d60449b9d96866c7ceee1be P 982df35c5b554a8fa64807352c4f34ee reported cstate change: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New cstate: current_term: 1 leader_uuid: "982df35c5b554a8fa64807352c4f34ee" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:13.093844 18755 leader_election.cc:304] T c6022ad5a70c4b4f8f34339956122cb7 P d1a8f61d3323447282ee6068aa623216 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3a1328f9c8c484fab08292ce2171ec9, d1a8f61d3323447282ee6068aa623216; no voters:
I20251023 07:59:13.094928 19501 raft_consensus.cc:2804] T c6022ad5a70c4b4f8f34339956122cb7 P d1a8f61d3323447282ee6068aa623216 [term 4 FOLLOWER]: Leader election won for term 4
I20251023 07:59:13.095407 19501 raft_consensus.cc:697] T c6022ad5a70c4b4f8f34339956122cb7 P d1a8f61d3323447282ee6068aa623216 [term 4 LEADER]: Becoming Leader. State: Replica: d1a8f61d3323447282ee6068aa623216, State: Running, Role: LEADER
I20251023 07:59:13.101997 18787 leader_election.cc:290] T c6022ad5a70c4b4f8f34339956122cb7 P d1a8f61d3323447282ee6068aa623216 [CANDIDATE]: Term 4 election: Requested vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:59:13.101187 18171 raft_consensus.cc:2468] T c6022ad5a70c4b4f8f34339956122cb7 P 10dfae53d0c941f08bded43539841761 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1a8f61d3323447282ee6068aa623216 in term 4.
I20251023 07:59:13.105894 19501 consensus_queue.cc:237] T c6022ad5a70c4b4f8f34339956122cb7 P d1a8f61d3323447282ee6068aa623216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:13.148483 18171 raft_consensus.cc:1275] T d3b72ceda32a4ebc8de6e7a7992498aa P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20251023 07:59:13.149976 19427 consensus_queue.cc:1048] T d3b72ceda32a4ebc8de6e7a7992498aa P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:59:13.150276 18247 raft_consensus.cc:1275] T d3b72ceda32a4ebc8de6e7a7992498aa P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20251023 07:59:13.156251 19481 raft_consensus.cc:993] T b19b550093fb4ab181e62957d89460e7 P b3a1328f9c8c484fab08292ce2171ec9: : Instructing follower 10dfae53d0c941f08bded43539841761 to start an election
I20251023 07:59:13.156788 19481 raft_consensus.cc:1081] T b19b550093fb4ab181e62957d89460e7 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Signalling peer 10dfae53d0c941f08bded43539841761 to start an election
I20251023 07:59:13.156313 17999 catalog_manager.cc:5649] T c6022ad5a70c4b4f8f34339956122cb7 P d1a8f61d3323447282ee6068aa623216 reported cstate change: term changed from 3 to 4, leader changed from 10dfae53d0c941f08bded43539841761 (127.16.126.2) to d1a8f61d3323447282ee6068aa623216 (127.16.126.4). New cstate: current_term: 4 leader_uuid: "d1a8f61d3323447282ee6068aa623216" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251023 07:59:13.157990 19379 consensus_queue.cc:1048] T d3b72ceda32a4ebc8de6e7a7992498aa P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20251023 07:59:13.160224 18067 consensus_peers.cc:597] T d3b72ceda32a4ebc8de6e7a7992498aa P b3a1328f9c8c484fab08292ce2171ec9 -> Peer d1a8f61d3323447282ee6068aa623216 (127.16.126.4:33293): Couldn't send request to peer d1a8f61d3323447282ee6068aa623216. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d3b72ceda32a4ebc8de6e7a7992498aa. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:13.162202 18171 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "b19b550093fb4ab181e62957d89460e7"
dest_uuid: "10dfae53d0c941f08bded43539841761"
from {username='slave'} at 127.0.0.1:51874
I20251023 07:59:13.162758 18171 raft_consensus.cc:493] T b19b550093fb4ab181e62957d89460e7 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:59:13.163158 18171 raft_consensus.cc:3060] T b19b550093fb4ab181e62957d89460e7 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:13.181658 18171 raft_consensus.cc:515] T b19b550093fb4ab181e62957d89460e7 P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:59:13.187197 18101 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b19b550093fb4ab181e62957d89460e7" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
I20251023 07:59:13.187410 18246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b19b550093fb4ab181e62957d89460e7" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
I20251023 07:59:13.187944 18101 raft_consensus.cc:3055] T b19b550093fb4ab181e62957d89460e7 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Stepping down as leader of term 1
I20251023 07:59:13.188519 18101 raft_consensus.cc:740] T b19b550093fb4ab181e62957d89460e7 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Running, Role: LEADER
I20251023 07:59:13.190085 18171 leader_election.cc:290] T b19b550093fb4ab181e62957d89460e7 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 2 election: Requested vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:59:13.188048 18246 raft_consensus.cc:3060] T b19b550093fb4ab181e62957d89460e7 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:13.196555 18101 consensus_queue.cc:260] T b19b550093fb4ab181e62957d89460e7 P b3a1328f9c8c484fab08292ce2171ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:59:13.197975 18101 raft_consensus.cc:3060] T b19b550093fb4ab181e62957d89460e7 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:13.200587 19379 raft_consensus.cc:2955] T d3b72ceda32a4ebc8de6e7a7992498aa P b3a1328f9c8c484fab08292ce2171ec9 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:13.210071 18174 raft_consensus.cc:2955] T d3b72ceda32a4ebc8de6e7a7992498aa P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:13.211824 19375 raft_consensus.cc:993] T 94cd6588f7824a30ba02f891ae089671 P 10dfae53d0c941f08bded43539841761: : Instructing follower b3a1328f9c8c484fab08292ce2171ec9 to start an election
I20251023 07:59:13.212327 19375 raft_consensus.cc:1081] T 94cd6588f7824a30ba02f891ae089671 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Signalling peer b3a1328f9c8c484fab08292ce2171ec9 to start an election
I20251023 07:59:13.214558 18102 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "94cd6588f7824a30ba02f891ae089671"
dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
from {username='slave'} at 127.0.0.1:53946
I20251023 07:59:13.215090 18102 raft_consensus.cc:493] T 94cd6588f7824a30ba02f891ae089671 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:59:13.215430 18102 raft_consensus.cc:3060] T 94cd6588f7824a30ba02f891ae089671 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:13.235859 18101 raft_consensus.cc:2468] T b19b550093fb4ab181e62957d89460e7 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 2.
I20251023 07:59:13.237324 18143 leader_election.cc:304] T b19b550093fb4ab181e62957d89460e7 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:59:13.238304 19375 raft_consensus.cc:2804] T b19b550093fb4ab181e62957d89460e7 P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:59:13.236393 17999 catalog_manager.cc:5649] T d3b72ceda32a4ebc8de6e7a7992498aa P b3a1328f9c8c484fab08292ce2171ec9 reported cstate change: config changed from index -1 to 3, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New cstate: current_term: 2 leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:13.238794 19375 raft_consensus.cc:697] T b19b550093fb4ab181e62957d89460e7 P 10dfae53d0c941f08bded43539841761 [term 2 LEADER]: Becoming Leader. State: Replica: 10dfae53d0c941f08bded43539841761, State: Running, Role: LEADER
I20251023 07:59:13.241261 18246 raft_consensus.cc:2468] T b19b550093fb4ab181e62957d89460e7 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 2.
I20251023 07:59:13.241983 18102 raft_consensus.cc:515] T 94cd6588f7824a30ba02f891ae089671 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:59:13.241163 19375 consensus_queue.cc:237] T b19b550093fb4ab181e62957d89460e7 P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:59:13.245486 18174 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "94cd6588f7824a30ba02f891ae089671" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "10dfae53d0c941f08bded43539841761"
I20251023 07:59:13.246030 18174 raft_consensus.cc:3055] T 94cd6588f7824a30ba02f891ae089671 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Stepping down as leader of term 1
I20251023 07:59:13.246300 18174 raft_consensus.cc:740] T 94cd6588f7824a30ba02f891ae089671 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Running, Role: LEADER
I20251023 07:59:13.247014 18174 consensus_queue.cc:260] T 94cd6588f7824a30ba02f891ae089671 P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:59:13.248101 18174 raft_consensus.cc:3060] T 94cd6588f7824a30ba02f891ae089671 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:13.248554 18102 leader_election.cc:290] T 94cd6588f7824a30ba02f891ae089671 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 2 election: Requested vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:59:13.255407 18174 raft_consensus.cc:2468] T 94cd6588f7824a30ba02f891ae089671 P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3a1328f9c8c484fab08292ce2171ec9 in term 2.
I20251023 07:59:13.256821 18242 raft_consensus.cc:2955] T d3b72ceda32a4ebc8de6e7a7992498aa P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:13.258229 18066 leader_election.cc:304] T 94cd6588f7824a30ba02f891ae089671 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:59:13.259159 19481 raft_consensus.cc:2804] T 94cd6588f7824a30ba02f891ae089671 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:59:13.259629 19481 raft_consensus.cc:697] T 94cd6588f7824a30ba02f891ae089671 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 LEADER]: Becoming Leader. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Running, Role: LEADER
I20251023 07:59:13.260509 19481 consensus_queue.cc:237] T 94cd6588f7824a30ba02f891ae089671 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:59:13.263191 18246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "94cd6588f7824a30ba02f891ae089671" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
I20251023 07:59:13.263789 18246 raft_consensus.cc:3060] T 94cd6588f7824a30ba02f891ae089671 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:13.282781 18246 raft_consensus.cc:2468] T 94cd6588f7824a30ba02f891ae089671 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3a1328f9c8c484fab08292ce2171ec9 in term 2.
I20251023 07:59:13.285617 19522 ts_tablet_manager.cc:933] T fe0293c22cae49cfa7cd698f17626a35 P d1a8f61d3323447282ee6068aa623216: Initiating tablet copy from peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:59:13.310413 18171 raft_consensus.cc:1275] T c63b5a4dc8eb4b6e918608f281183068 P 10dfae53d0c941f08bded43539841761 [term 3 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251023 07:59:13.313419 17997 catalog_manager.cc:5649] T b19b550093fb4ab181e62957d89460e7 P 10dfae53d0c941f08bded43539841761 reported cstate change: term changed from 1 to 2, leader changed from b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1) to 10dfae53d0c941f08bded43539841761 (127.16.126.2). New cstate: current_term: 2 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:13.316912 19511 consensus_queue.cc:1048] T c63b5a4dc8eb4b6e918608f281183068 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20251023 07:59:13.321123 19522 tablet_copy_client.cc:323] T fe0293c22cae49cfa7cd698f17626a35 P d1a8f61d3323447282ee6068aa623216: tablet copy: Beginning tablet copy session from remote peer at address 127.16.126.2:45799
I20251023 07:59:13.323302 18186 tablet_copy_service.cc:140] P 10dfae53d0c941f08bded43539841761: Received BeginTabletCopySession request for tablet fe0293c22cae49cfa7cd698f17626a35 from peer d1a8f61d3323447282ee6068aa623216 ({username='slave'} at 127.0.0.1:50534)
I20251023 07:59:13.323944 18186 tablet_copy_service.cc:161] P 10dfae53d0c941f08bded43539841761: Beginning new tablet copy session on tablet fe0293c22cae49cfa7cd698f17626a35 from peer d1a8f61d3323447282ee6068aa623216 at {username='slave'} at 127.0.0.1:50534: session id = d1a8f61d3323447282ee6068aa623216-fe0293c22cae49cfa7cd698f17626a35
I20251023 07:59:13.342672 18186 tablet_copy_source_session.cc:215] T fe0293c22cae49cfa7cd698f17626a35 P 10dfae53d0c941f08bded43539841761: Tablet Copy: opened 0 blocks and 1 log segments
I20251023 07:59:13.346823 19522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe0293c22cae49cfa7cd698f17626a35. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:13.363910 18101 raft_consensus.cc:1275] T c63b5a4dc8eb4b6e918608f281183068 P b3a1328f9c8c484fab08292ce2171ec9 [term 3 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251023 07:59:13.365370 19480 consensus_queue.cc:1048] T c63b5a4dc8eb4b6e918608f281183068 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:59:13.363384 17999 catalog_manager.cc:5649] T 94cd6588f7824a30ba02f891ae089671 P b3a1328f9c8c484fab08292ce2171ec9 reported cstate change: term changed from 1 to 2, leader changed from 10dfae53d0c941f08bded43539841761 (127.16.126.2) to b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1). New cstate: current_term: 2 leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:13.417896 19522 tablet_copy_client.cc:806] T fe0293c22cae49cfa7cd698f17626a35 P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 0 data blocks...
I20251023 07:59:13.418587 19522 tablet_copy_client.cc:670] T fe0293c22cae49cfa7cd698f17626a35 P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 1 WAL segments...
I20251023 07:59:13.424274 19522 tablet_copy_client.cc:538] T fe0293c22cae49cfa7cd698f17626a35 P d1a8f61d3323447282ee6068aa623216: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251023 07:59:13.440968 19522 tablet_bootstrap.cc:492] T fe0293c22cae49cfa7cd698f17626a35 P d1a8f61d3323447282ee6068aa623216: Bootstrap starting.
I20251023 07:59:13.483217 19522 tablet_bootstrap.cc:492] T fe0293c22cae49cfa7cd698f17626a35 P d1a8f61d3323447282ee6068aa623216: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:59:13.484158 19522 tablet_bootstrap.cc:492] T fe0293c22cae49cfa7cd698f17626a35 P d1a8f61d3323447282ee6068aa623216: Bootstrap complete.
I20251023 07:59:13.484849 19522 ts_tablet_manager.cc:1403] T fe0293c22cae49cfa7cd698f17626a35 P d1a8f61d3323447282ee6068aa623216: Time spent bootstrapping tablet: real 0.045s user 0.026s sys 0.001s
I20251023 07:59:13.488303 19522 raft_consensus.cc:359] T fe0293c22cae49cfa7cd698f17626a35 P d1a8f61d3323447282ee6068aa623216 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:59:13.489142 19522 raft_consensus.cc:740] T fe0293c22cae49cfa7cd698f17626a35 P d1a8f61d3323447282ee6068aa623216 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: d1a8f61d3323447282ee6068aa623216, State: Initialized, Role: LEARNER
I20251023 07:59:13.489826 19522 consensus_queue.cc:260] T fe0293c22cae49cfa7cd698f17626a35 P d1a8f61d3323447282ee6068aa623216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:59:13.499311 19529 ts_tablet_manager.cc:933] T fbc1ceb70a0c42c6871ea24480ee4221 P d1a8f61d3323447282ee6068aa623216: Initiating tablet copy from peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025)
I20251023 07:59:13.505844 18171 raft_consensus.cc:1275] T c6022ad5a70c4b4f8f34339956122cb7 P 10dfae53d0c941f08bded43539841761 [term 4 FOLLOWER]: Refusing update from remote peer d1a8f61d3323447282ee6068aa623216: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20251023 07:59:13.537575 19530 ts_tablet_manager.cc:933] T 1f539da81d60449b9d96866c7ceee1be P d1a8f61d3323447282ee6068aa623216: Initiating tablet copy from peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:59:13.541657 19517 consensus_queue.cc:1048] T c6022ad5a70c4b4f8f34339956122cb7 P d1a8f61d3323447282ee6068aa623216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20251023 07:59:13.548913 19529 tablet_copy_client.cc:323] T fbc1ceb70a0c42c6871ea24480ee4221 P d1a8f61d3323447282ee6068aa623216: tablet copy: Beginning tablet copy session from remote peer at address 127.16.126.1:44025
I20251023 07:59:13.550061 19522 ts_tablet_manager.cc:1434] T fe0293c22cae49cfa7cd698f17626a35 P d1a8f61d3323447282ee6068aa623216: Time spent starting tablet: real 0.065s user 0.005s sys 0.004s
I20251023 07:59:13.551002 18111 tablet_copy_service.cc:140] P b3a1328f9c8c484fab08292ce2171ec9: Received BeginTabletCopySession request for tablet fbc1ceb70a0c42c6871ea24480ee4221 from peer d1a8f61d3323447282ee6068aa623216 ({username='slave'} at 127.0.0.1:57714)
I20251023 07:59:13.553350 18111 tablet_copy_service.cc:161] P b3a1328f9c8c484fab08292ce2171ec9: Beginning new tablet copy session on tablet fbc1ceb70a0c42c6871ea24480ee4221 from peer d1a8f61d3323447282ee6068aa623216 at {username='slave'} at 127.0.0.1:57714: session id = d1a8f61d3323447282ee6068aa623216-fbc1ceb70a0c42c6871ea24480ee4221
I20251023 07:59:13.560781 19530 tablet_copy_client.cc:323] T 1f539da81d60449b9d96866c7ceee1be P d1a8f61d3323447282ee6068aa623216: tablet copy: Beginning tablet copy session from remote peer at address 127.16.126.3:46061
I20251023 07:59:13.563710 18111 tablet_copy_source_session.cc:215] T fbc1ceb70a0c42c6871ea24480ee4221 P b3a1328f9c8c484fab08292ce2171ec9: Tablet Copy: opened 0 blocks and 1 log segments
I20251023 07:59:13.565521 18261 tablet_copy_service.cc:140] P 982df35c5b554a8fa64807352c4f34ee: Received BeginTabletCopySession request for tablet 1f539da81d60449b9d96866c7ceee1be from peer d1a8f61d3323447282ee6068aa623216 ({username='slave'} at 127.0.0.1:40260)
I20251023 07:59:13.566118 18261 tablet_copy_service.cc:161] P 982df35c5b554a8fa64807352c4f34ee: Beginning new tablet copy session on tablet 1f539da81d60449b9d96866c7ceee1be from peer d1a8f61d3323447282ee6068aa623216 at {username='slave'} at 127.0.0.1:40260: session id = d1a8f61d3323447282ee6068aa623216-1f539da81d60449b9d96866c7ceee1be
I20251023 07:59:13.567083 18186 tablet_copy_service.cc:342] P 10dfae53d0c941f08bded43539841761: Request end of tablet copy session d1a8f61d3323447282ee6068aa623216-fe0293c22cae49cfa7cd698f17626a35 received from {username='slave'} at 127.0.0.1:50534
I20251023 07:59:13.567582 18186 tablet_copy_service.cc:434] P 10dfae53d0c941f08bded43539841761: ending tablet copy session d1a8f61d3323447282ee6068aa623216-fe0293c22cae49cfa7cd698f17626a35 on tablet fe0293c22cae49cfa7cd698f17626a35 with peer d1a8f61d3323447282ee6068aa623216
I20251023 07:59:13.575572 18261 tablet_copy_source_session.cc:215] T 1f539da81d60449b9d96866c7ceee1be P 982df35c5b554a8fa64807352c4f34ee: Tablet Copy: opened 0 blocks and 1 log segments
I20251023 07:59:13.580595 19529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbc1ceb70a0c42c6871ea24480ee4221. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:13.588167 19530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f539da81d60449b9d96866c7ceee1be. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:13.611529 19522 ts_tablet_manager.cc:933] T d3b72ceda32a4ebc8de6e7a7992498aa P d1a8f61d3323447282ee6068aa623216: Initiating tablet copy from peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025)
I20251023 07:59:13.612824 19529 tablet_copy_client.cc:806] T fbc1ceb70a0c42c6871ea24480ee4221 P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 0 data blocks...
I20251023 07:59:13.615417 19529 tablet_copy_client.cc:670] T fbc1ceb70a0c42c6871ea24480ee4221 P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 1 WAL segments...
I20251023 07:59:13.625905 18101 raft_consensus.cc:1275] T c6022ad5a70c4b4f8f34339956122cb7 P b3a1328f9c8c484fab08292ce2171ec9 [term 4 FOLLOWER]: Refusing update from remote peer d1a8f61d3323447282ee6068aa623216: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20251023 07:59:13.636916 19529 tablet_copy_client.cc:538] T fbc1ceb70a0c42c6871ea24480ee4221 P d1a8f61d3323447282ee6068aa623216: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251023 07:59:13.639282 19474 consensus_queue.cc:1048] T c6022ad5a70c4b4f8f34339956122cb7 P d1a8f61d3323447282ee6068aa623216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20251023 07:59:13.661957 19529 tablet_bootstrap.cc:492] T fbc1ceb70a0c42c6871ea24480ee4221 P d1a8f61d3323447282ee6068aa623216: Bootstrap starting.
I20251023 07:59:13.677326 19522 tablet_copy_client.cc:323] T d3b72ceda32a4ebc8de6e7a7992498aa P d1a8f61d3323447282ee6068aa623216: tablet copy: Beginning tablet copy session from remote peer at address 127.16.126.1:44025
I20251023 07:59:13.681632 18111 tablet_copy_service.cc:140] P b3a1328f9c8c484fab08292ce2171ec9: Received BeginTabletCopySession request for tablet d3b72ceda32a4ebc8de6e7a7992498aa from peer d1a8f61d3323447282ee6068aa623216 ({username='slave'} at 127.0.0.1:57714)
I20251023 07:59:13.682191 18111 tablet_copy_service.cc:161] P b3a1328f9c8c484fab08292ce2171ec9: Beginning new tablet copy session on tablet d3b72ceda32a4ebc8de6e7a7992498aa from peer d1a8f61d3323447282ee6068aa623216 at {username='slave'} at 127.0.0.1:57714: session id = d1a8f61d3323447282ee6068aa623216-d3b72ceda32a4ebc8de6e7a7992498aa
I20251023 07:59:13.682981 19530 tablet_copy_client.cc:806] T 1f539da81d60449b9d96866c7ceee1be P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 0 data blocks...
I20251023 07:59:13.684031 19530 tablet_copy_client.cc:670] T 1f539da81d60449b9d96866c7ceee1be P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 1 WAL segments...
I20251023 07:59:13.692301 18111 tablet_copy_source_session.cc:215] T d3b72ceda32a4ebc8de6e7a7992498aa P b3a1328f9c8c484fab08292ce2171ec9: Tablet Copy: opened 0 blocks and 1 log segments
I20251023 07:59:13.700877 19530 tablet_copy_client.cc:538] T 1f539da81d60449b9d96866c7ceee1be P d1a8f61d3323447282ee6068aa623216: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251023 07:59:13.718760 19522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3b72ceda32a4ebc8de6e7a7992498aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:13.724521 18102 raft_consensus.cc:1275] T b19b550093fb4ab181e62957d89460e7 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:13.725859 19530 tablet_bootstrap.cc:492] T 1f539da81d60449b9d96866c7ceee1be P d1a8f61d3323447282ee6068aa623216: Bootstrap starting.
I20251023 07:59:13.731979 18171 raft_consensus.cc:1275] T 94cd6588f7824a30ba02f891ae089671 P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:13.732183 19375 consensus_queue.cc:1048] T b19b550093fb4ab181e62957d89460e7 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20251023 07:59:13.733387 19488 consensus_queue.cc:1048] T 94cd6588f7824a30ba02f891ae089671 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:13.751135 18246 raft_consensus.cc:1275] T b19b550093fb4ab181e62957d89460e7 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:13.757393 19375 consensus_queue.cc:1048] T b19b550093fb4ab181e62957d89460e7 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20251023 07:59:13.757794 18242 raft_consensus.cc:1275] T 94cd6588f7824a30ba02f891ae089671 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:13.768038 19481 consensus_queue.cc:1048] T 94cd6588f7824a30ba02f891ae089671 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20251023 07:59:13.809499 19529 tablet_bootstrap.cc:492] T fbc1ceb70a0c42c6871ea24480ee4221 P d1a8f61d3323447282ee6068aa623216: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:59:13.810385 19529 tablet_bootstrap.cc:492] T fbc1ceb70a0c42c6871ea24480ee4221 P d1a8f61d3323447282ee6068aa623216: Bootstrap complete.
I20251023 07:59:13.811097 19529 ts_tablet_manager.cc:1403] T fbc1ceb70a0c42c6871ea24480ee4221 P d1a8f61d3323447282ee6068aa623216: Time spent bootstrapping tablet: real 0.149s user 0.036s sys 0.044s
I20251023 07:59:13.813985 19529 raft_consensus.cc:359] T fbc1ceb70a0c42c6871ea24480ee4221 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:59:13.814795 19529 raft_consensus.cc:740] T fbc1ceb70a0c42c6871ea24480ee4221 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d1a8f61d3323447282ee6068aa623216, State: Initialized, Role: LEARNER
I20251023 07:59:13.825223 19529 consensus_queue.cc:260] T fbc1ceb70a0c42c6871ea24480ee4221 P d1a8f61d3323447282ee6068aa623216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:59:13.827047 19522 tablet_copy_client.cc:806] T d3b72ceda32a4ebc8de6e7a7992498aa P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 0 data blocks...
I20251023 07:59:13.827647 19522 tablet_copy_client.cc:670] T d3b72ceda32a4ebc8de6e7a7992498aa P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 1 WAL segments...
I20251023 07:59:13.829713 19529 ts_tablet_manager.cc:1434] T fbc1ceb70a0c42c6871ea24480ee4221 P d1a8f61d3323447282ee6068aa623216: Time spent starting tablet: real 0.018s user 0.007s sys 0.001s
I20251023 07:59:13.832731 18111 tablet_copy_service.cc:342] P b3a1328f9c8c484fab08292ce2171ec9: Request end of tablet copy session d1a8f61d3323447282ee6068aa623216-fbc1ceb70a0c42c6871ea24480ee4221 received from {username='slave'} at 127.0.0.1:57714
I20251023 07:59:13.833209 18111 tablet_copy_service.cc:434] P b3a1328f9c8c484fab08292ce2171ec9: ending tablet copy session d1a8f61d3323447282ee6068aa623216-fbc1ceb70a0c42c6871ea24480ee4221 on tablet fbc1ceb70a0c42c6871ea24480ee4221 with peer d1a8f61d3323447282ee6068aa623216
I20251023 07:59:13.844846 19522 tablet_copy_client.cc:538] T d3b72ceda32a4ebc8de6e7a7992498aa P d1a8f61d3323447282ee6068aa623216: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251023 07:59:13.847942 18787 raft_consensus.cc:1217] T fe0293c22cae49cfa7cd698f17626a35 P d1a8f61d3323447282ee6068aa623216 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3] Dedup: 2.3->[]
I20251023 07:59:13.851189 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:59:13.857882 19530 tablet_bootstrap.cc:492] T 1f539da81d60449b9d96866c7ceee1be P d1a8f61d3323447282ee6068aa623216: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:59:13.858844 19530 tablet_bootstrap.cc:492] T 1f539da81d60449b9d96866c7ceee1be P d1a8f61d3323447282ee6068aa623216: Bootstrap complete.
I20251023 07:59:13.859552 19530 ts_tablet_manager.cc:1403] T 1f539da81d60449b9d96866c7ceee1be P d1a8f61d3323447282ee6068aa623216: Time spent bootstrapping tablet: real 0.134s user 0.013s sys 0.009s
I20251023 07:59:13.868618 19530 raft_consensus.cc:359] T 1f539da81d60449b9d96866c7ceee1be P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:59:13.869593 19530 raft_consensus.cc:740] T 1f539da81d60449b9d96866c7ceee1be P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d1a8f61d3323447282ee6068aa623216, State: Initialized, Role: LEARNER
I20251023 07:59:13.870235 19530 consensus_queue.cc:260] T 1f539da81d60449b9d96866c7ceee1be P d1a8f61d3323447282ee6068aa623216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:59:13.876410 19530 ts_tablet_manager.cc:1434] T 1f539da81d60449b9d96866c7ceee1be P d1a8f61d3323447282ee6068aa623216: Time spent starting tablet: real 0.017s user 0.005s sys 0.003s
I20251023 07:59:13.877964 18261 tablet_copy_service.cc:342] P 982df35c5b554a8fa64807352c4f34ee: Request end of tablet copy session d1a8f61d3323447282ee6068aa623216-1f539da81d60449b9d96866c7ceee1be received from {username='slave'} at 127.0.0.1:40260
I20251023 07:59:13.878410 18261 tablet_copy_service.cc:434] P 982df35c5b554a8fa64807352c4f34ee: ending tablet copy session d1a8f61d3323447282ee6068aa623216-1f539da81d60449b9d96866c7ceee1be on tablet 1f539da81d60449b9d96866c7ceee1be with peer d1a8f61d3323447282ee6068aa623216
I20251023 07:59:13.912103 19522 tablet_bootstrap.cc:492] T d3b72ceda32a4ebc8de6e7a7992498aa P d1a8f61d3323447282ee6068aa623216: Bootstrap starting.
I20251023 07:59:13.920733 18787 raft_consensus.cc:1217] T fbc1ceb70a0c42c6871ea24480ee4221 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20251023 07:59:14.066426 19522 tablet_bootstrap.cc:700] T d3b72ceda32a4ebc8de6e7a7992498aa P d1a8f61d3323447282ee6068aa623216: Time spent opening tablet: real 0.128s user 0.008s sys 0.013s
I20251023 07:59:14.158613 18096 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "744a3368282b44d9b9618922875d20d3"
dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
mode: GRACEFUL
new_leader_uuid: "982df35c5b554a8fa64807352c4f34ee"
from {username='slave'} at 127.0.0.1:34418
I20251023 07:59:14.159276 18096 raft_consensus.cc:606] T 744a3368282b44d9b9618922875d20d3 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Received request to transfer leadership to TS 982df35c5b554a8fa64807352c4f34ee
I20251023 07:59:14.174809 18171 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "a83dfc7a7d784b52b9c74bbc451ad603"
dest_uuid: "10dfae53d0c941f08bded43539841761"
mode: GRACEFUL
new_leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
from {username='slave'} at 127.0.0.1:47396
I20251023 07:59:14.175506 18171 raft_consensus.cc:606] T a83dfc7a7d784b52b9c74bbc451ad603 P 10dfae53d0c941f08bded43539841761 [term 2 LEADER]: Received request to transfer leadership to TS b3a1328f9c8c484fab08292ce2171ec9
W20251023 07:59:14.227375 18066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.2:45799, user_credentials={real_user=slave}} blocked reactor thread for 50642.8us
I20251023 07:59:14.271392 18787 raft_consensus.cc:1217] T 1f539da81d60449b9d96866c7ceee1be P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20251023 07:59:14.275277 19566 raft_consensus.cc:1064] T fe0293c22cae49cfa7cd698f17626a35 P 10dfae53d0c941f08bded43539841761: attempting to promote NON_VOTER d1a8f61d3323447282ee6068aa623216 to VOTER
I20251023 07:59:14.278889 19562 raft_consensus.cc:993] T a83dfc7a7d784b52b9c74bbc451ad603 P 10dfae53d0c941f08bded43539841761: : Instructing follower b3a1328f9c8c484fab08292ce2171ec9 to start an election
I20251023 07:59:14.279480 19562 raft_consensus.cc:1081] T a83dfc7a7d784b52b9c74bbc451ad603 P 10dfae53d0c941f08bded43539841761 [term 2 LEADER]: Signalling peer b3a1328f9c8c484fab08292ce2171ec9 to start an election
I20251023 07:59:14.283715 19566 consensus_queue.cc:237] T fe0293c22cae49cfa7cd698f17626a35 P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:14.290249 18099 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "a83dfc7a7d784b52b9c74bbc451ad603"
dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
from {username='slave'} at 127.0.0.1:53946
I20251023 07:59:14.290815 18099 raft_consensus.cc:493] T a83dfc7a7d784b52b9c74bbc451ad603 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:59:14.291183 18099 raft_consensus.cc:3060] T a83dfc7a7d784b52b9c74bbc451ad603 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:59:14.303344 18099 raft_consensus.cc:515] T a83dfc7a7d784b52b9c74bbc451ad603 P b3a1328f9c8c484fab08292ce2171ec9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:59:14.305490 18246 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "c63b5a4dc8eb4b6e918608f281183068"
dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
mode: GRACEFUL
new_leader_uuid: "10dfae53d0c941f08bded43539841761"
from {username='slave'} at 127.0.0.1:60948
I20251023 07:59:14.314270 18099 leader_election.cc:290] T a83dfc7a7d784b52b9c74bbc451ad603 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 3 election: Requested vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:59:14.316274 18176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a83dfc7a7d784b52b9c74bbc451ad603" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "10dfae53d0c941f08bded43539841761"
I20251023 07:59:14.316845 18176 raft_consensus.cc:3055] T a83dfc7a7d784b52b9c74bbc451ad603 P 10dfae53d0c941f08bded43539841761 [term 2 LEADER]: Stepping down as leader of term 2
I20251023 07:59:14.317114 18176 raft_consensus.cc:740] T a83dfc7a7d784b52b9c74bbc451ad603 P 10dfae53d0c941f08bded43539841761 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Running, Role: LEADER
I20251023 07:59:14.320251 18176 consensus_queue.cc:260] T a83dfc7a7d784b52b9c74bbc451ad603 P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:59:14.343261 18176 raft_consensus.cc:3060] T a83dfc7a7d784b52b9c74bbc451ad603 P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:59:14.345587 18787 raft_consensus.cc:1275] T fe0293c22cae49cfa7cd698f17626a35 P d1a8f61d3323447282ee6068aa623216 [term 2 LEARNER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20251023 07:59:14.355000 18243 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a83dfc7a7d784b52b9c74bbc451ad603" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
I20251023 07:59:14.454326 18176 raft_consensus.cc:2468] T a83dfc7a7d784b52b9c74bbc451ad603 P 10dfae53d0c941f08bded43539841761 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3a1328f9c8c484fab08292ce2171ec9 in term 3.
W20251023 07:59:14.433774 18142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.4:33293, user_credentials={real_user=slave}} blocked reactor thread for 80242.5us
I20251023 07:59:14.353335 18102 raft_consensus.cc:1275] T fe0293c22cae49cfa7cd698f17626a35 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20251023 07:59:14.452041 19522 tablet_bootstrap.cc:492] T d3b72ceda32a4ebc8de6e7a7992498aa P d1a8f61d3323447282ee6068aa623216: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:59:14.454459 18243 raft_consensus.cc:3060] T a83dfc7a7d784b52b9c74bbc451ad603 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:59:14.473289 18246 raft_consensus.cc:606] T c63b5a4dc8eb4b6e918608f281183068 P 982df35c5b554a8fa64807352c4f34ee [term 3 LEADER]: Received request to transfer leadership to TS 10dfae53d0c941f08bded43539841761
I20251023 07:59:14.486483 18066 leader_election.cc:304] T a83dfc7a7d784b52b9c74bbc451ad603 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:59:14.487378 19580 raft_consensus.cc:2804] T a83dfc7a7d784b52b9c74bbc451ad603 P b3a1328f9c8c484fab08292ce2171ec9 [term 3 FOLLOWER]: Leader election won for term 3
I20251023 07:59:14.487883 19580 raft_consensus.cc:697] T a83dfc7a7d784b52b9c74bbc451ad603 P b3a1328f9c8c484fab08292ce2171ec9 [term 3 LEADER]: Becoming Leader. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Running, Role: LEADER
I20251023 07:59:14.488791 19580 consensus_queue.cc:237] T a83dfc7a7d784b52b9c74bbc451ad603 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
W20251023 07:59:14.485726 18216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.4:33293, user_credentials={real_user=slave}} blocked reactor thread for 154346us
I20251023 07:59:14.493394 19573 raft_consensus.cc:993] T 744a3368282b44d9b9618922875d20d3 P b3a1328f9c8c484fab08292ce2171ec9: : Instructing follower 982df35c5b554a8fa64807352c4f34ee to start an election
I20251023 07:59:14.494033 19573 raft_consensus.cc:1081] T 744a3368282b44d9b9618922875d20d3 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Signalling peer 982df35c5b554a8fa64807352c4f34ee to start an election
I20251023 07:59:14.434885 19566 consensus_queue.cc:1048] T fe0293c22cae49cfa7cd698f17626a35 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20251023 07:59:14.505081 19522 tablet_bootstrap.cc:492] T d3b72ceda32a4ebc8de6e7a7992498aa P d1a8f61d3323447282ee6068aa623216: Bootstrap complete.
I20251023 07:59:14.506719 19412 consensus_queue.cc:1048] T fe0293c22cae49cfa7cd698f17626a35 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20251023 07:59:14.512310 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 3
I20251023 07:59:14.513478 18243 raft_consensus.cc:2468] T a83dfc7a7d784b52b9c74bbc451ad603 P 982df35c5b554a8fa64807352c4f34ee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3a1328f9c8c484fab08292ce2171ec9 in term 3.
I20251023 07:59:14.514117 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 07:59:14.521939 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:59:14.523344 19563 raft_consensus.cc:993] T c63b5a4dc8eb4b6e918608f281183068 P 982df35c5b554a8fa64807352c4f34ee: : Instructing follower 10dfae53d0c941f08bded43539841761 to start an election
I20251023 07:59:14.523886 19563 raft_consensus.cc:1081] T c63b5a4dc8eb4b6e918608f281183068 P 982df35c5b554a8fa64807352c4f34ee [term 3 LEADER]: Signalling peer 10dfae53d0c941f08bded43539841761 to start an election
I20251023 07:59:14.533805 18248 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "744a3368282b44d9b9618922875d20d3"
dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
from {username='slave'} at 127.0.0.1:49420
I20251023 07:59:14.521737 19522 ts_tablet_manager.cc:1403] T d3b72ceda32a4ebc8de6e7a7992498aa P d1a8f61d3323447282ee6068aa623216: Time spent bootstrapping tablet: real 0.610s user 0.045s sys 0.024s
I20251023 07:59:14.534781 18248 raft_consensus.cc:493] T 744a3368282b44d9b9618922875d20d3 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:59:14.535151 18248 raft_consensus.cc:3060] T 744a3368282b44d9b9618922875d20d3 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:14.538328 19570 raft_consensus.cc:1064] T fbc1ceb70a0c42c6871ea24480ee4221 P b3a1328f9c8c484fab08292ce2171ec9: attempting to promote NON_VOTER d1a8f61d3323447282ee6068aa623216 to VOTER
I20251023 07:59:14.541464 19570 consensus_queue.cc:237] T fbc1ceb70a0c42c6871ea24480ee4221 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:14.546380 18251 raft_consensus.cc:1275] T fe0293c22cae49cfa7cd698f17626a35 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20251023 07:59:14.546826 18174 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "c63b5a4dc8eb4b6e918608f281183068"
dest_uuid: "10dfae53d0c941f08bded43539841761"
from {username='slave'} at 127.0.0.1:51868
I20251023 07:59:14.547370 18174 raft_consensus.cc:493] T c63b5a4dc8eb4b6e918608f281183068 P 10dfae53d0c941f08bded43539841761 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:59:14.547730 18174 raft_consensus.cc:3060] T c63b5a4dc8eb4b6e918608f281183068 P 10dfae53d0c941f08bded43539841761 [term 3 FOLLOWER]: Advancing to term 4
I20251023 07:59:14.558619 18174 raft_consensus.cc:515] T c63b5a4dc8eb4b6e918608f281183068 P 10dfae53d0c941f08bded43539841761 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:59:14.563344 19566 consensus_queue.cc:1048] T fe0293c22cae49cfa7cd698f17626a35 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:59:14.571822 18174 leader_election.cc:290] T c63b5a4dc8eb4b6e918608f281183068 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 4 election: Requested vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:59:14.572170 18102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c63b5a4dc8eb4b6e918608f281183068" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
I20251023 07:59:14.572824 18102 raft_consensus.cc:3060] T c63b5a4dc8eb4b6e918608f281183068 P b3a1328f9c8c484fab08292ce2171ec9 [term 3 FOLLOWER]: Advancing to term 4
I20251023 07:59:14.574697 18243 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c63b5a4dc8eb4b6e918608f281183068" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
I20251023 07:59:14.575278 18243 raft_consensus.cc:3055] T c63b5a4dc8eb4b6e918608f281183068 P 982df35c5b554a8fa64807352c4f34ee [term 3 LEADER]: Stepping down as leader of term 3
I20251023 07:59:14.575559 18243 raft_consensus.cc:740] T c63b5a4dc8eb4b6e918608f281183068 P 982df35c5b554a8fa64807352c4f34ee [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Running, Role: LEADER
I20251023 07:59:14.571651 18248 raft_consensus.cc:515] T 744a3368282b44d9b9618922875d20d3 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:14.576248 18243 consensus_queue.cc:260] T c63b5a4dc8eb4b6e918608f281183068 P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:59:14.580613 18243 raft_consensus.cc:3060] T c63b5a4dc8eb4b6e918608f281183068 P 982df35c5b554a8fa64807352c4f34ee [term 3 FOLLOWER]: Advancing to term 4
I20251023 07:59:14.584945 18248 leader_election.cc:290] T 744a3368282b44d9b9618922875d20d3 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 2 election: Requested vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), d1a8f61d3323447282ee6068aa623216 (127.16.126.4:33293)
I20251023 07:59:14.586964 18788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "744a3368282b44d9b9618922875d20d3" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d1a8f61d3323447282ee6068aa623216"
I20251023 07:59:14.587617 18788 raft_consensus.cc:3060] T 744a3368282b44d9b9618922875d20d3 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:14.587105 17998 catalog_manager.cc:5649] T a83dfc7a7d784b52b9c74bbc451ad603 P b3a1328f9c8c484fab08292ce2171ec9 reported cstate change: term changed from 2 to 3, leader changed from 10dfae53d0c941f08bded43539841761 (127.16.126.2) to b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1). New cstate: current_term: 3 leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:14.601275 18096 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "744a3368282b44d9b9618922875d20d3" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
I20251023 07:59:14.602152 18096 raft_consensus.cc:3055] T 744a3368282b44d9b9618922875d20d3 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Stepping down as leader of term 1
I20251023 07:59:14.602501 18096 raft_consensus.cc:740] T 744a3368282b44d9b9618922875d20d3 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Running, Role: LEADER
I20251023 07:59:14.603896 18102 raft_consensus.cc:2468] T c63b5a4dc8eb4b6e918608f281183068 P b3a1328f9c8c484fab08292ce2171ec9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 4.
I20251023 07:59:14.608525 18143 leader_election.cc:304] T c63b5a4dc8eb4b6e918608f281183068 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:59:14.603324 18096 consensus_queue.cc:260] T 744a3368282b44d9b9618922875d20d3 P b3a1328f9c8c484fab08292ce2171ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:14.611183 18243 raft_consensus.cc:2468] T c63b5a4dc8eb4b6e918608f281183068 P 982df35c5b554a8fa64807352c4f34ee [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 4.
I20251023 07:59:14.611707 18096 raft_consensus.cc:3060] T 744a3368282b44d9b9618922875d20d3 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:14.613466 18788 raft_consensus.cc:2468] T 744a3368282b44d9b9618922875d20d3 P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 2.
I20251023 07:59:14.613986 19412 raft_consensus.cc:2804] T c63b5a4dc8eb4b6e918608f281183068 P 10dfae53d0c941f08bded43539841761 [term 4 FOLLOWER]: Leader election won for term 4
I20251023 07:59:14.618103 19564 raft_consensus.cc:2955] T fe0293c22cae49cfa7cd698f17626a35 P 10dfae53d0c941f08bded43539841761 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:14.623471 18101 raft_consensus.cc:2955] T fe0293c22cae49cfa7cd698f17626a35 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:14.626446 19412 raft_consensus.cc:697] T c63b5a4dc8eb4b6e918608f281183068 P 10dfae53d0c941f08bded43539841761 [term 4 LEADER]: Becoming Leader. State: Replica: 10dfae53d0c941f08bded43539841761, State: Running, Role: LEADER
I20251023 07:59:14.633661 18096 raft_consensus.cc:2468] T 744a3368282b44d9b9618922875d20d3 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 2.
I20251023 07:59:14.637602 18216 leader_election.cc:304] T 744a3368282b44d9b9618922875d20d3 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee, d1a8f61d3323447282ee6068aa623216; no voters:
I20251023 07:59:14.634397 19412 consensus_queue.cc:237] T c63b5a4dc8eb4b6e918608f281183068 P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:59:14.638938 19555 raft_consensus.cc:2804] T 744a3368282b44d9b9618922875d20d3 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:59:14.630525 18784 raft_consensus.cc:2955] T fe0293c22cae49cfa7cd698f17626a35 P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:14.639416 19555 raft_consensus.cc:697] T 744a3368282b44d9b9618922875d20d3 P 982df35c5b554a8fa64807352c4f34ee [term 2 LEADER]: Becoming Leader. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Running, Role: LEADER
I20251023 07:59:14.636297 19522 raft_consensus.cc:359] T d3b72ceda32a4ebc8de6e7a7992498aa P d1a8f61d3323447282ee6068aa623216 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:59:14.648979 19522 raft_consensus.cc:740] T d3b72ceda32a4ebc8de6e7a7992498aa P d1a8f61d3323447282ee6068aa623216 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: d1a8f61d3323447282ee6068aa623216, State: Initialized, Role: LEARNER
I20251023 07:59:14.650126 19522 consensus_queue.cc:260] T d3b72ceda32a4ebc8de6e7a7992498aa P d1a8f61d3323447282ee6068aa623216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:59:14.640369 19555 consensus_queue.cc:237] T 744a3368282b44d9b9618922875d20d3 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:14.673038 17997 catalog_manager.cc:5649] T fe0293c22cae49cfa7cd698f17626a35 P d1a8f61d3323447282ee6068aa623216 reported cstate change: config changed from index 3 to 4, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:14.687237 18251 raft_consensus.cc:2955] T fe0293c22cae49cfa7cd698f17626a35 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:14.708658 19522 ts_tablet_manager.cc:1434] T d3b72ceda32a4ebc8de6e7a7992498aa P d1a8f61d3323447282ee6068aa623216: Time spent starting tablet: real 0.159s user 0.004s sys 0.003s
I20251023 07:59:14.717772 18111 tablet_copy_service.cc:342] P b3a1328f9c8c484fab08292ce2171ec9: Request end of tablet copy session d1a8f61d3323447282ee6068aa623216-d3b72ceda32a4ebc8de6e7a7992498aa received from {username='slave'} at 127.0.0.1:57714
I20251023 07:59:14.718245 18111 tablet_copy_service.cc:434] P b3a1328f9c8c484fab08292ce2171ec9: ending tablet copy session d1a8f61d3323447282ee6068aa623216-d3b72ceda32a4ebc8de6e7a7992498aa on tablet d3b72ceda32a4ebc8de6e7a7992498aa with peer d1a8f61d3323447282ee6068aa623216
I20251023 07:59:14.729974 18243 raft_consensus.cc:1275] T fbc1ceb70a0c42c6871ea24480ee4221 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:59:14.730839 18784 raft_consensus.cc:1275] T fbc1ceb70a0c42c6871ea24480ee4221 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:59:14.732153 18174 raft_consensus.cc:1275] T fbc1ceb70a0c42c6871ea24480ee4221 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:59:14.734009 19488 consensus_queue.cc:1048] T fbc1ceb70a0c42c6871ea24480ee4221 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:59:14.738171 19577 consensus_queue.cc:1048] T fbc1ceb70a0c42c6871ea24480ee4221 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:59:14.784822 17999 catalog_manager.cc:5649] T 744a3368282b44d9b9618922875d20d3 P 982df35c5b554a8fa64807352c4f34ee reported cstate change: term changed from 1 to 2, leader changed from b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1) to 982df35c5b554a8fa64807352c4f34ee (127.16.126.3). New cstate: current_term: 2 leader_uuid: "982df35c5b554a8fa64807352c4f34ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:14.765441 19570 consensus_queue.cc:1048] T fbc1ceb70a0c42c6871ea24480ee4221 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20251023 07:59:14.804661 19555 raft_consensus.cc:1064] T 1f539da81d60449b9d96866c7ceee1be P 982df35c5b554a8fa64807352c4f34ee: attempting to promote NON_VOTER d1a8f61d3323447282ee6068aa623216 to VOTER
I20251023 07:59:14.804425 18000 catalog_manager.cc:5649] T c63b5a4dc8eb4b6e918608f281183068 P 10dfae53d0c941f08bded43539841761 reported cstate change: term changed from 3 to 4, leader changed from 982df35c5b554a8fa64807352c4f34ee (127.16.126.3) to 10dfae53d0c941f08bded43539841761 (127.16.126.2). New cstate: current_term: 4 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:14.820864 19555 consensus_queue.cc:237] T 1f539da81d60449b9d96866c7ceee1be P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:14.820258 19570 raft_consensus.cc:2955] T fbc1ceb70a0c42c6871ea24480ee4221 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:14.823371 18174 raft_consensus.cc:2955] T fbc1ceb70a0c42c6871ea24480ee4221 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:14.874699 18788 raft_consensus.cc:1275] T 1f539da81d60449b9d96866c7ceee1be P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:59:14.876085 19555 consensus_queue.cc:1048] T 1f539da81d60449b9d96866c7ceee1be P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:59:14.878306 18176 raft_consensus.cc:1275] T 1f539da81d60449b9d96866c7ceee1be P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:59:14.881386 19563 consensus_queue.cc:1048] T 1f539da81d60449b9d96866c7ceee1be P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:59:14.907079 18100 raft_consensus.cc:1275] T 1f539da81d60449b9d96866c7ceee1be P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:59:14.911695 19568 consensus_queue.cc:1048] T 1f539da81d60449b9d96866c7ceee1be P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:59:14.937606 18247 raft_consensus.cc:2955] T fbc1ceb70a0c42c6871ea24480ee4221 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:14.964217 17998 catalog_manager.cc:5649] T fbc1ceb70a0c42c6871ea24480ee4221 P b3a1328f9c8c484fab08292ce2171ec9 reported cstate change: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:14.964751 18784 raft_consensus.cc:2955] T fbc1ceb70a0c42c6871ea24480ee4221 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:14.969771 18243 raft_consensus.cc:1275] T a83dfc7a7d784b52b9c74bbc451ad603 P 982df35c5b554a8fa64807352c4f34ee [term 3 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251023 07:59:14.978475 19481 consensus_queue.cc:1048] T a83dfc7a7d784b52b9c74bbc451ad603 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20251023 07:59:14.983995 19563 raft_consensus.cc:2955] T 1f539da81d60449b9d96866c7ceee1be P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:14.988922 18174 raft_consensus.cc:2955] T 1f539da81d60449b9d96866c7ceee1be P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:14.992091 18171 raft_consensus.cc:1275] T a83dfc7a7d784b52b9c74bbc451ad603 P 10dfae53d0c941f08bded43539841761 [term 3 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251023 07:59:14.995085 19573 consensus_queue.cc:1048] T a83dfc7a7d784b52b9c74bbc451ad603 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:59:15.018018 18096 raft_consensus.cc:2955] T 1f539da81d60449b9d96866c7ceee1be P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:15.021656 18788 raft_consensus.cc:2955] T 1f539da81d60449b9d96866c7ceee1be P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:15.028038 18101 consensus_queue.cc:237] T fbc1ceb70a0c42c6871ea24480ee4221 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:15.031325 18176 consensus_queue.cc:237] T fe0293c22cae49cfa7cd698f17626a35 P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:15.034873 18173 raft_consensus.cc:1275] T fbc1ceb70a0c42c6871ea24480ee4221 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251023 07:59:15.037555 19481 consensus_queue.cc:1048] T fbc1ceb70a0c42c6871ea24480ee4221 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:59:15.044366 19573 raft_consensus.cc:2955] T fbc1ceb70a0c42c6871ea24480ee4221 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 982df35c5b554a8fa64807352c4f34ee (127.16.126.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:15.046821 18000 catalog_manager.cc:5649] T 1f539da81d60449b9d96866c7ceee1be P d1a8f61d3323447282ee6068aa623216 reported cstate change: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "982df35c5b554a8fa64807352c4f34ee" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:15.052099 18787 raft_consensus.cc:1275] T fbc1ceb70a0c42c6871ea24480ee4221 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251023 07:59:15.055431 18789 raft_consensus.cc:1275] T fe0293c22cae49cfa7cd698f17626a35 P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20251023 07:59:15.058140 18176 raft_consensus.cc:2955] T fbc1ceb70a0c42c6871ea24480ee4221 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 982df35c5b554a8fa64807352c4f34ee (127.16.126.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:15.060768 18247 raft_consensus.cc:1275] T fe0293c22cae49cfa7cd698f17626a35 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20251023 07:59:15.061206 19564 consensus_queue.cc:1048] T fe0293c22cae49cfa7cd698f17626a35 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20251023 07:59:15.068742 19566 raft_consensus.cc:2955] T fe0293c22cae49cfa7cd698f17626a35 P 10dfae53d0c941f08bded43539841761 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:15.070436 19412 consensus_queue.cc:1048] T fe0293c22cae49cfa7cd698f17626a35 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20251023 07:59:15.079214 18788 raft_consensus.cc:2955] T fe0293c22cae49cfa7cd698f17626a35 P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:15.102011 18784 raft_consensus.cc:1275] T 744a3368282b44d9b9618922875d20d3 P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20251023 07:59:15.103509 19568 consensus_queue.cc:1048] T 744a3368282b44d9b9618922875d20d3 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20251023 07:59:15.106178 17985 catalog_manager.cc:5162] ChangeConfig:REMOVE_PEER RPC for tablet fe0293c22cae49cfa7cd698f17626a35 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251023 07:59:15.108426 18243 raft_consensus.cc:2955] T fe0293c22cae49cfa7cd698f17626a35 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:15.131664 19481 consensus_queue.cc:1048] T fbc1ceb70a0c42c6871ea24480ee4221 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:59:15.145296 18242 consensus_queue.cc:237] T 1f539da81d60449b9d96866c7ceee1be P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:15.151744 18784 raft_consensus.cc:1275] T 1f539da81d60449b9d96866c7ceee1be P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251023 07:59:15.153520 19579 consensus_queue.cc:1048] T 1f539da81d60449b9d96866c7ceee1be P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:59:15.155400 18174 raft_consensus.cc:1275] T 1f539da81d60449b9d96866c7ceee1be P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251023 07:59:15.162489 19568 raft_consensus.cc:2955] T 1f539da81d60449b9d96866c7ceee1be P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:15.163527 18784 raft_consensus.cc:2955] T fbc1ceb70a0c42c6871ea24480ee4221 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 982df35c5b554a8fa64807352c4f34ee (127.16.126.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:15.173399 18787 raft_consensus.cc:2955] T 1f539da81d60449b9d96866c7ceee1be P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:15.183189 19563 consensus_queue.cc:1048] T 1f539da81d60449b9d96866c7ceee1be P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:59:15.189394 17998 catalog_manager.cc:5649] T fe0293c22cae49cfa7cd698f17626a35 P 982df35c5b554a8fa64807352c4f34ee reported cstate change: config changed from index 4 to 5, VOTER b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1) evicted. New cstate: current_term: 2 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:15.194360 18000 catalog_manager.cc:5649] T fbc1ceb70a0c42c6871ea24480ee4221 P d1a8f61d3323447282ee6068aa623216 reported cstate change: config changed from index 3 to 4, VOTER 982df35c5b554a8fa64807352c4f34ee (127.16.126.3) evicted. New cstate: current_term: 1 leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:15.202812 18174 raft_consensus.cc:2955] T 1f539da81d60449b9d96866c7ceee1be P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:15.211185 18784 raft_consensus.cc:1217] T d3b72ceda32a4ebc8de6e7a7992498aa P d1a8f61d3323447282ee6068aa623216 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3] Dedup: 2.3->[]
I20251023 07:59:15.214395 17987 catalog_manager.cc:5162] ChangeConfig:REMOVE_PEER RPC for tablet fbc1ceb70a0c42c6871ea24480ee4221 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251023 07:59:15.224494 18086 tablet_service.cc:1552] Processing DeleteTablet for tablet fe0293c22cae49cfa7cd698f17626a35 with delete_type TABLET_DATA_TOMBSTONED (TS b3a1328f9c8c484fab08292ce2171ec9 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:53940
I20251023 07:59:15.273286 17998 catalog_manager.cc:5649] T 1f539da81d60449b9d96866c7ceee1be P 982df35c5b554a8fa64807352c4f34ee reported cstate change: config changed from index 3 to 4, VOTER b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1) evicted. New cstate: current_term: 1 leader_uuid: "982df35c5b554a8fa64807352c4f34ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251023 07:59:15.279578 18096 raft_consensus.cc:1275] T c63b5a4dc8eb4b6e918608f281183068 P b3a1328f9c8c484fab08292ce2171ec9 [term 4 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20251023 07:59:15.294260 17986 catalog_manager.cc:5162] ChangeConfig:REMOVE_PEER RPC for tablet 1f539da81d60449b9d96866c7ceee1be with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251023 07:59:15.296697 19608 tablet_replica.cc:333] T fe0293c22cae49cfa7cd698f17626a35 P b3a1328f9c8c484fab08292ce2171ec9: stopping tablet replica
I20251023 07:59:15.286516 19545 consensus_queue.cc:1048] T c63b5a4dc8eb4b6e918608f281183068 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
W20251023 07:59:15.335976 18216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.4:33293, user_credentials={real_user=slave}} blocked reactor thread for 54652.6us
I20251023 07:59:15.338385 19608 raft_consensus.cc:2243] T fe0293c22cae49cfa7cd698f17626a35 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:15.339672 19608 raft_consensus.cc:2272] T fe0293c22cae49cfa7cd698f17626a35 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:15.337529 18086 tablet_service.cc:1552] Processing DeleteTablet for tablet 1f539da81d60449b9d96866c7ceee1be with delete_type TABLET_DATA_TOMBSTONED (TS b3a1328f9c8c484fab08292ce2171ec9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53940
I20251023 07:59:15.378895 18242 raft_consensus.cc:1275] T c63b5a4dc8eb4b6e918608f281183068 P 982df35c5b554a8fa64807352c4f34ee [term 4 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20251023 07:59:15.381708 18237 tablet_service.cc:1552] Processing DeleteTablet for tablet fbc1ceb70a0c42c6871ea24480ee4221 with delete_type TABLET_DATA_TOMBSTONED (TS 982df35c5b554a8fa64807352c4f34ee not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49846
I20251023 07:59:15.407109 18100 raft_consensus.cc:1275] T 744a3368282b44d9b9618922875d20d3 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20251023 07:59:15.417713 19545 consensus_queue.cc:1048] T c63b5a4dc8eb4b6e918608f281183068 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20251023 07:59:15.424325 19568 consensus_queue.cc:1048] T 744a3368282b44d9b9618922875d20d3 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20251023 07:59:15.425177 19608 ts_tablet_manager.cc:1916] T fe0293c22cae49cfa7cd698f17626a35 P b3a1328f9c8c484fab08292ce2171ec9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251023 07:59:15.498148 19616 tablet_replica.cc:333] T fbc1ceb70a0c42c6871ea24480ee4221 P 982df35c5b554a8fa64807352c4f34ee: stopping tablet replica
I20251023 07:59:15.523409 19616 raft_consensus.cc:2243] T fbc1ceb70a0c42c6871ea24480ee4221 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:15.524266 19616 raft_consensus.cc:2272] T fbc1ceb70a0c42c6871ea24480ee4221 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:15.536270 19608 ts_tablet_manager.cc:1929] T fe0293c22cae49cfa7cd698f17626a35 P b3a1328f9c8c484fab08292ce2171ec9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20251023 07:59:15.536798 19608 log.cc:1199] T fe0293c22cae49cfa7cd698f17626a35 P b3a1328f9c8c484fab08292ce2171ec9: Deleting WAL directory at /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1761206251627710-16888-0/minicluster-data/ts-0-root/wals/fe0293c22cae49cfa7cd698f17626a35
I20251023 07:59:15.538574 19608 tablet_replica.cc:333] T 1f539da81d60449b9d96866c7ceee1be P b3a1328f9c8c484fab08292ce2171ec9: stopping tablet replica
I20251023 07:59:15.539300 19608 raft_consensus.cc:2243] T 1f539da81d60449b9d96866c7ceee1be P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:15.539855 19608 raft_consensus.cc:2272] T 1f539da81d60449b9d96866c7ceee1be P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:15.540810 19616 ts_tablet_manager.cc:1916] T fbc1ceb70a0c42c6871ea24480ee4221 P 982df35c5b554a8fa64807352c4f34ee: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251023 07:59:15.541694 17987 catalog_manager.cc:4985] TS b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): tablet fe0293c22cae49cfa7cd698f17626a35 (table test-workload [id=8bb191a5531a4d4fb58a25b13d592213]) successfully deleted
I20251023 07:59:15.553480 19608 ts_tablet_manager.cc:1916] T 1f539da81d60449b9d96866c7ceee1be P b3a1328f9c8c484fab08292ce2171ec9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251023 07:59:15.576268 19616 ts_tablet_manager.cc:1929] T fbc1ceb70a0c42c6871ea24480ee4221 P 982df35c5b554a8fa64807352c4f34ee: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20251023 07:59:15.576925 19616 log.cc:1199] T fbc1ceb70a0c42c6871ea24480ee4221 P 982df35c5b554a8fa64807352c4f34ee: Deleting WAL directory at /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1761206251627710-16888-0/minicluster-data/ts-2-root/wals/fbc1ceb70a0c42c6871ea24480ee4221
I20251023 07:59:15.579111 17986 catalog_manager.cc:4985] TS 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): tablet fbc1ceb70a0c42c6871ea24480ee4221 (table test-workload [id=8bb191a5531a4d4fb58a25b13d592213]) successfully deleted
I20251023 07:59:15.600862 19608 ts_tablet_manager.cc:1929] T 1f539da81d60449b9d96866c7ceee1be P b3a1328f9c8c484fab08292ce2171ec9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20251023 07:59:15.602196 19608 log.cc:1199] T 1f539da81d60449b9d96866c7ceee1be P b3a1328f9c8c484fab08292ce2171ec9: Deleting WAL directory at /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1761206251627710-16888-0/minicluster-data/ts-0-root/wals/1f539da81d60449b9d96866c7ceee1be
I20251023 07:59:15.610484 17987 catalog_manager.cc:4985] TS b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): tablet 1f539da81d60449b9d96866c7ceee1be (table test-workload [id=8bb191a5531a4d4fb58a25b13d592213]) successfully deleted
I20251023 07:59:15.621348 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:59:15.766292 19577 raft_consensus.cc:1064] T d3b72ceda32a4ebc8de6e7a7992498aa P b3a1328f9c8c484fab08292ce2171ec9: attempting to promote NON_VOTER d1a8f61d3323447282ee6068aa623216 to VOTER
I20251023 07:59:15.768941 19577 consensus_queue.cc:237] T d3b72ceda32a4ebc8de6e7a7992498aa P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:15.803819 18784 raft_consensus.cc:1275] T d3b72ceda32a4ebc8de6e7a7992498aa P d1a8f61d3323447282ee6068aa623216 [term 2 LEARNER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20251023 07:59:15.806783 19573 consensus_queue.cc:1048] T d3b72ceda32a4ebc8de6e7a7992498aa P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:59:15.814260 18242 raft_consensus.cc:1275] T d3b72ceda32a4ebc8de6e7a7992498aa P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20251023 07:59:15.815582 18174 raft_consensus.cc:1275] T d3b72ceda32a4ebc8de6e7a7992498aa P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20251023 07:59:15.817312 19573 consensus_queue.cc:1048] T d3b72ceda32a4ebc8de6e7a7992498aa P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:59:15.819286 19573 consensus_queue.cc:1048] T d3b72ceda32a4ebc8de6e7a7992498aa P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:59:15.834252 18247 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "3c5c040d6ebe40e5a5be6be47de5a7bc"
dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
mode: GRACEFUL
new_leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
from {username='slave'} at 127.0.0.1:60948
I20251023 07:59:15.834856 18247 raft_consensus.cc:606] T 3c5c040d6ebe40e5a5be6be47de5a7bc P 982df35c5b554a8fa64807352c4f34ee [term 2 LEADER]: Received request to transfer leadership to TS b3a1328f9c8c484fab08292ce2171ec9
I20251023 07:59:15.843230 18101 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "d3b72ceda32a4ebc8de6e7a7992498aa"
dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
mode: GRACEFUL
new_leader_uuid: "10dfae53d0c941f08bded43539841761"
from {username='slave'} at 127.0.0.1:34418
I20251023 07:59:15.843815 18101 raft_consensus.cc:606] T d3b72ceda32a4ebc8de6e7a7992498aa P b3a1328f9c8c484fab08292ce2171ec9 [term 2 LEADER]: Received request to transfer leadership to TS 10dfae53d0c941f08bded43539841761
I20251023 07:59:15.844727 19577 raft_consensus.cc:2955] T d3b72ceda32a4ebc8de6e7a7992498aa P b3a1328f9c8c484fab08292ce2171ec9 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:15.850056 18174 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "fe0293c22cae49cfa7cd698f17626a35"
dest_uuid: "10dfae53d0c941f08bded43539841761"
mode: GRACEFUL
new_leader_uuid: "d1a8f61d3323447282ee6068aa623216"
from {username='slave'} at 127.0.0.1:47396
I20251023 07:59:15.850667 18174 raft_consensus.cc:606] T fe0293c22cae49cfa7cd698f17626a35 P 10dfae53d0c941f08bded43539841761 [term 2 LEADER]: Received request to transfer leadership to TS d1a8f61d3323447282ee6068aa623216
I20251023 07:59:15.852753 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 3
I20251023 07:59:15.852910 18242 raft_consensus.cc:2955] T d3b72ceda32a4ebc8de6e7a7992498aa P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:15.854281 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 07:59:15.856133 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:59:15.854065 18784 raft_consensus.cc:2955] T d3b72ceda32a4ebc8de6e7a7992498aa P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:15.861408 18174 raft_consensus.cc:2955] T d3b72ceda32a4ebc8de6e7a7992498aa P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:15.870165 18000 catalog_manager.cc:5649] T d3b72ceda32a4ebc8de6e7a7992498aa P b3a1328f9c8c484fab08292ce2171ec9 reported cstate change: config changed from index 3 to 4, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251023 07:59:15.892910 19577 raft_consensus.cc:993] T d3b72ceda32a4ebc8de6e7a7992498aa P b3a1328f9c8c484fab08292ce2171ec9: : Instructing follower 10dfae53d0c941f08bded43539841761 to start an election
I20251023 07:59:15.893368 19577 raft_consensus.cc:1081] T d3b72ceda32a4ebc8de6e7a7992498aa P b3a1328f9c8c484fab08292ce2171ec9 [term 2 LEADER]: Signalling peer 10dfae53d0c941f08bded43539841761 to start an election
I20251023 07:59:15.900363 18174 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "d3b72ceda32a4ebc8de6e7a7992498aa"
dest_uuid: "10dfae53d0c941f08bded43539841761"
from {username='slave'} at 127.0.0.1:51874
I20251023 07:59:15.901075 18174 raft_consensus.cc:493] T d3b72ceda32a4ebc8de6e7a7992498aa P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:59:15.908697 18174 raft_consensus.cc:3060] T d3b72ceda32a4ebc8de6e7a7992498aa P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:59:15.920511 18174 raft_consensus.cc:515] T d3b72ceda32a4ebc8de6e7a7992498aa P 10dfae53d0c941f08bded43539841761 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:15.956349 18102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d3b72ceda32a4ebc8de6e7a7992498aa" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
I20251023 07:59:15.962201 18102 raft_consensus.cc:3055] T d3b72ceda32a4ebc8de6e7a7992498aa P b3a1328f9c8c484fab08292ce2171ec9 [term 2 LEADER]: Stepping down as leader of term 2
I20251023 07:59:15.962968 18102 raft_consensus.cc:740] T d3b72ceda32a4ebc8de6e7a7992498aa P b3a1328f9c8c484fab08292ce2171ec9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Running, Role: LEADER
I20251023 07:59:15.964370 18102 consensus_queue.cc:260] T d3b72ceda32a4ebc8de6e7a7992498aa P b3a1328f9c8c484fab08292ce2171ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:15.965840 18102 raft_consensus.cc:3060] T d3b72ceda32a4ebc8de6e7a7992498aa P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:59:15.969229 18242 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d3b72ceda32a4ebc8de6e7a7992498aa" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
I20251023 07:59:15.969866 18242 raft_consensus.cc:3060] T d3b72ceda32a4ebc8de6e7a7992498aa P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:59:15.971056 18784 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d3b72ceda32a4ebc8de6e7a7992498aa" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "d1a8f61d3323447282ee6068aa623216"
I20251023 07:59:15.971607 18784 raft_consensus.cc:3060] T d3b72ceda32a4ebc8de6e7a7992498aa P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:59:15.977526 18242 raft_consensus.cc:2468] T d3b72ceda32a4ebc8de6e7a7992498aa P 982df35c5b554a8fa64807352c4f34ee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 3.
I20251023 07:59:15.981556 18784 raft_consensus.cc:2468] T d3b72ceda32a4ebc8de6e7a7992498aa P d1a8f61d3323447282ee6068aa623216 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 3.
I20251023 07:59:15.982781 18142 leader_election.cc:304] T d3b72ceda32a4ebc8de6e7a7992498aa P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, 982df35c5b554a8fa64807352c4f34ee, d1a8f61d3323447282ee6068aa623216; no voters:
I20251023 07:59:15.983580 19566 raft_consensus.cc:2804] T d3b72ceda32a4ebc8de6e7a7992498aa P 10dfae53d0c941f08bded43539841761 [term 3 FOLLOWER]: Leader election won for term 3
I20251023 07:59:15.984050 19566 raft_consensus.cc:697] T d3b72ceda32a4ebc8de6e7a7992498aa P 10dfae53d0c941f08bded43539841761 [term 3 LEADER]: Becoming Leader. State: Replica: 10dfae53d0c941f08bded43539841761, State: Running, Role: LEADER
I20251023 07:59:15.984948 19566 consensus_queue.cc:237] T d3b72ceda32a4ebc8de6e7a7992498aa P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:15.988626 18174 leader_election.cc:290] T d3b72ceda32a4ebc8de6e7a7992498aa P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 3 election: Requested vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061), d1a8f61d3323447282ee6068aa623216 (127.16.126.4:33293)
I20251023 07:59:15.998958 19612 raft_consensus.cc:993] T 3c5c040d6ebe40e5a5be6be47de5a7bc P 982df35c5b554a8fa64807352c4f34ee: : Instructing follower b3a1328f9c8c484fab08292ce2171ec9 to start an election
I20251023 07:59:15.999446 19612 raft_consensus.cc:1081] T 3c5c040d6ebe40e5a5be6be47de5a7bc P 982df35c5b554a8fa64807352c4f34ee [term 2 LEADER]: Signalling peer b3a1328f9c8c484fab08292ce2171ec9 to start an election
I20251023 07:59:16.000931 18099 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "3c5c040d6ebe40e5a5be6be47de5a7bc"
dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
from {username='slave'} at 127.0.0.1:39440
I20251023 07:59:16.001538 18099 raft_consensus.cc:493] T 3c5c040d6ebe40e5a5be6be47de5a7bc P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:59:16.001905 18099 raft_consensus.cc:3060] T 3c5c040d6ebe40e5a5be6be47de5a7bc P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:59:16.011219 18000 catalog_manager.cc:5649] T d3b72ceda32a4ebc8de6e7a7992498aa P 10dfae53d0c941f08bded43539841761 reported cstate change: term changed from 2 to 3, leader changed from b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1) to 10dfae53d0c941f08bded43539841761 (127.16.126.2). New cstate: current_term: 3 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:16.014015 18099 raft_consensus.cc:515] T 3c5c040d6ebe40e5a5be6be47de5a7bc P b3a1328f9c8c484fab08292ce2171ec9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:16.017555 18247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3c5c040d6ebe40e5a5be6be47de5a7bc" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
I20251023 07:59:16.018141 18247 raft_consensus.cc:3055] T 3c5c040d6ebe40e5a5be6be47de5a7bc P 982df35c5b554a8fa64807352c4f34ee [term 2 LEADER]: Stepping down as leader of term 2
I20251023 07:59:16.018428 18247 raft_consensus.cc:740] T 3c5c040d6ebe40e5a5be6be47de5a7bc P 982df35c5b554a8fa64807352c4f34ee [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Running, Role: LEADER
I20251023 07:59:16.019099 18247 consensus_queue.cc:260] T 3c5c040d6ebe40e5a5be6be47de5a7bc P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:16.020190 18247 raft_consensus.cc:3060] T 3c5c040d6ebe40e5a5be6be47de5a7bc P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:59:16.020454 18099 leader_election.cc:290] T 3c5c040d6ebe40e5a5be6be47de5a7bc P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 3 election: Requested vote from peers 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061), d1a8f61d3323447282ee6068aa623216 (127.16.126.4:33293)
I20251023 07:59:15.986307 18102 raft_consensus.cc:2468] T d3b72ceda32a4ebc8de6e7a7992498aa P b3a1328f9c8c484fab08292ce2171ec9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 3.
I20251023 07:59:16.030709 18784 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3c5c040d6ebe40e5a5be6be47de5a7bc" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "d1a8f61d3323447282ee6068aa623216"
I20251023 07:59:16.038709 18784 raft_consensus.cc:3060] T 3c5c040d6ebe40e5a5be6be47de5a7bc P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Advancing to term 3
W20251023 07:59:16.042737 17987 catalog_manager.cc:5179] ChangeConfig:REMOVE_PEER RPC for tablet d3b72ceda32a4ebc8de6e7a7992498aa with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica b3a1328f9c8c484fab08292ce2171ec9 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:16.051697 18247 raft_consensus.cc:2468] T 3c5c040d6ebe40e5a5be6be47de5a7bc P 982df35c5b554a8fa64807352c4f34ee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3a1328f9c8c484fab08292ce2171ec9 in term 3.
I20251023 07:59:16.054484 18067 leader_election.cc:304] T 3c5c040d6ebe40e5a5be6be47de5a7bc P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:59:16.055335 19577 raft_consensus.cc:2804] T 3c5c040d6ebe40e5a5be6be47de5a7bc P b3a1328f9c8c484fab08292ce2171ec9 [term 3 FOLLOWER]: Leader election won for term 3
I20251023 07:59:16.055812 19577 raft_consensus.cc:697] T 3c5c040d6ebe40e5a5be6be47de5a7bc P b3a1328f9c8c484fab08292ce2171ec9 [term 3 LEADER]: Becoming Leader. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Running, Role: LEADER
I20251023 07:59:16.056638 19577 consensus_queue.cc:237] T 3c5c040d6ebe40e5a5be6be47de5a7bc P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:16.059723 18784 raft_consensus.cc:2468] T 3c5c040d6ebe40e5a5be6be47de5a7bc P d1a8f61d3323447282ee6068aa623216 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3a1328f9c8c484fab08292ce2171ec9 in term 3.
I20251023 07:59:16.068548 18173 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "d3b72ceda32a4ebc8de6e7a7992498aa"
dest_uuid: "10dfae53d0c941f08bded43539841761"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:33428
I20251023 07:59:16.069164 18173 raft_consensus.cc:606] T d3b72ceda32a4ebc8de6e7a7992498aa P 10dfae53d0c941f08bded43539841761 [term 3 LEADER]: Received request to transfer leadership
I20251023 07:59:16.077808 18173 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "d3b72ceda32a4ebc8de6e7a7992498aa"
dest_uuid: "10dfae53d0c941f08bded43539841761"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:33428
I20251023 07:59:16.078372 18173 raft_consensus.cc:606] T d3b72ceda32a4ebc8de6e7a7992498aa P 10dfae53d0c941f08bded43539841761 [term 3 LEADER]: Received request to transfer leadership
W20251023 07:59:16.081422 17985 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leader transfer in progress [suppressed 3 similar messages]
I20251023 07:59:16.090246 18174 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "d3b72ceda32a4ebc8de6e7a7992498aa"
dest_uuid: "10dfae53d0c941f08bded43539841761"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:33428
I20251023 07:59:16.090909 18174 raft_consensus.cc:606] T d3b72ceda32a4ebc8de6e7a7992498aa P 10dfae53d0c941f08bded43539841761 [term 3 LEADER]: Received request to transfer leadership
I20251023 07:59:16.090284 18000 catalog_manager.cc:5649] T 3c5c040d6ebe40e5a5be6be47de5a7bc P b3a1328f9c8c484fab08292ce2171ec9 reported cstate change: term changed from 2 to 3, leader changed from 982df35c5b554a8fa64807352c4f34ee (127.16.126.3) to b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1). New cstate: current_term: 3 leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20251023 07:59:16.092092 17985 catalog_manager.cc:4712] TS 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): ChangeConfig:REMOVE_PEER RPC failed for tablet d3b72ceda32a4ebc8de6e7a7992498aa: Remote error: Service unavailable: leader transfer in progress
W20251023 07:59:16.093109 18048 auto_rebalancer.cc:663] Could not move replica: Remote error: Service unavailable: leadership transfer for d3b72ceda32a4ebc8de6e7a7992498aa already in progress
W20251023 07:59:16.093472 18048 auto_rebalancer.cc:264] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for d3b72ceda32a4ebc8de6e7a7992498aa already in progress
I20251023 07:59:16.206001 19489 raft_consensus.cc:993] T fe0293c22cae49cfa7cd698f17626a35 P 10dfae53d0c941f08bded43539841761: : Instructing follower d1a8f61d3323447282ee6068aa623216 to start an election
I20251023 07:59:16.206496 19581 raft_consensus.cc:1081] T fe0293c22cae49cfa7cd698f17626a35 P 10dfae53d0c941f08bded43539841761 [term 2 LEADER]: Signalling peer d1a8f61d3323447282ee6068aa623216 to start an election
I20251023 07:59:16.207783 18784 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "fe0293c22cae49cfa7cd698f17626a35"
dest_uuid: "d1a8f61d3323447282ee6068aa623216"
from {username='slave'} at 127.0.0.1:36500
I20251023 07:59:16.208222 18784 raft_consensus.cc:493] T fe0293c22cae49cfa7cd698f17626a35 P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:59:16.208477 18784 raft_consensus.cc:3060] T fe0293c22cae49cfa7cd698f17626a35 P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:59:16.212939 18784 raft_consensus.cc:515] T fe0293c22cae49cfa7cd698f17626a35 P d1a8f61d3323447282ee6068aa623216 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:16.214357 18784 leader_election.cc:290] T fe0293c22cae49cfa7cd698f17626a35 P d1a8f61d3323447282ee6068aa623216 [CANDIDATE]: Term 3 election: Requested vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:59:16.215353 18174 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe0293c22cae49cfa7cd698f17626a35" candidate_uuid: "d1a8f61d3323447282ee6068aa623216" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "10dfae53d0c941f08bded43539841761"
I20251023 07:59:16.215829 18174 raft_consensus.cc:3055] T fe0293c22cae49cfa7cd698f17626a35 P 10dfae53d0c941f08bded43539841761 [term 2 LEADER]: Stepping down as leader of term 2
I20251023 07:59:16.216048 18174 raft_consensus.cc:740] T fe0293c22cae49cfa7cd698f17626a35 P 10dfae53d0c941f08bded43539841761 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Running, Role: LEADER
I20251023 07:59:16.216585 18174 consensus_queue.cc:260] T fe0293c22cae49cfa7cd698f17626a35 P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:16.217509 18174 raft_consensus.cc:3060] T fe0293c22cae49cfa7cd698f17626a35 P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:59:16.219246 18247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe0293c22cae49cfa7cd698f17626a35" candidate_uuid: "d1a8f61d3323447282ee6068aa623216" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
I20251023 07:59:16.219805 18247 raft_consensus.cc:3060] T fe0293c22cae49cfa7cd698f17626a35 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:59:16.225981 18174 raft_consensus.cc:2468] T fe0293c22cae49cfa7cd698f17626a35 P 10dfae53d0c941f08bded43539841761 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1a8f61d3323447282ee6068aa623216 in term 3.
I20251023 07:59:16.227202 18753 leader_election.cc:304] T fe0293c22cae49cfa7cd698f17626a35 P d1a8f61d3323447282ee6068aa623216 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, d1a8f61d3323447282ee6068aa623216; no voters:
I20251023 07:59:16.227952 19554 raft_consensus.cc:2804] T fe0293c22cae49cfa7cd698f17626a35 P d1a8f61d3323447282ee6068aa623216 [term 3 FOLLOWER]: Leader election won for term 3
I20251023 07:59:16.228365 19554 raft_consensus.cc:697] T fe0293c22cae49cfa7cd698f17626a35 P d1a8f61d3323447282ee6068aa623216 [term 3 LEADER]: Becoming Leader. State: Replica: d1a8f61d3323447282ee6068aa623216, State: Running, Role: LEADER
I20251023 07:59:16.229182 19554 consensus_queue.cc:237] T fe0293c22cae49cfa7cd698f17626a35 P d1a8f61d3323447282ee6068aa623216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:16.229542 18247 raft_consensus.cc:2468] T fe0293c22cae49cfa7cd698f17626a35 P 982df35c5b554a8fa64807352c4f34ee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1a8f61d3323447282ee6068aa623216 in term 3.
I20251023 07:59:16.243098 18000 catalog_manager.cc:5649] T fe0293c22cae49cfa7cd698f17626a35 P d1a8f61d3323447282ee6068aa623216 reported cstate change: term changed from 2 to 3, leader changed from 10dfae53d0c941f08bded43539841761 (127.16.126.2) to d1a8f61d3323447282ee6068aa623216 (127.16.126.4). New cstate: current_term: 3 leader_uuid: "d1a8f61d3323447282ee6068aa623216" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251023 07:59:16.388935 18242 raft_consensus.cc:1275] T d3b72ceda32a4ebc8de6e7a7992498aa P 982df35c5b554a8fa64807352c4f34ee [term 3 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20251023 07:59:16.390350 19581 consensus_queue.cc:1048] T d3b72ceda32a4ebc8de6e7a7992498aa P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20251023 07:59:16.400724 19489 raft_consensus.cc:993] T d3b72ceda32a4ebc8de6e7a7992498aa P 10dfae53d0c941f08bded43539841761: : Instructing follower 982df35c5b554a8fa64807352c4f34ee to start an election
I20251023 07:59:16.401225 19489 raft_consensus.cc:1081] T d3b72ceda32a4ebc8de6e7a7992498aa P 10dfae53d0c941f08bded43539841761 [term 3 LEADER]: Signalling peer 982df35c5b554a8fa64807352c4f34ee to start an election
I20251023 07:59:16.403215 18242 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "d3b72ceda32a4ebc8de6e7a7992498aa"
dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
from {username='slave'} at 127.0.0.1:49858
I20251023 07:59:16.403774 18242 raft_consensus.cc:493] T d3b72ceda32a4ebc8de6e7a7992498aa P 982df35c5b554a8fa64807352c4f34ee [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:59:16.404132 18242 raft_consensus.cc:3060] T d3b72ceda32a4ebc8de6e7a7992498aa P 982df35c5b554a8fa64807352c4f34ee [term 3 FOLLOWER]: Advancing to term 4
I20251023 07:59:16.411410 18242 raft_consensus.cc:515] T d3b72ceda32a4ebc8de6e7a7992498aa P 982df35c5b554a8fa64807352c4f34ee [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:16.414156 18242 leader_election.cc:290] T d3b72ceda32a4ebc8de6e7a7992498aa P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 4 election: Requested vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), d1a8f61d3323447282ee6068aa623216 (127.16.126.4:33293)
I20251023 07:59:16.414812 18784 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d3b72ceda32a4ebc8de6e7a7992498aa" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "d1a8f61d3323447282ee6068aa623216"
I20251023 07:59:16.415274 18174 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d3b72ceda32a4ebc8de6e7a7992498aa" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "10dfae53d0c941f08bded43539841761"
I20251023 07:59:16.414582 18101 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d3b72ceda32a4ebc8de6e7a7992498aa" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
I20251023 07:59:16.415804 18174 raft_consensus.cc:3055] T d3b72ceda32a4ebc8de6e7a7992498aa P 10dfae53d0c941f08bded43539841761 [term 3 LEADER]: Stepping down as leader of term 3
I20251023 07:59:16.415953 18101 raft_consensus.cc:3060] T d3b72ceda32a4ebc8de6e7a7992498aa P b3a1328f9c8c484fab08292ce2171ec9 [term 3 FOLLOWER]: Advancing to term 4
I20251023 07:59:16.416183 18174 raft_consensus.cc:740] T d3b72ceda32a4ebc8de6e7a7992498aa P 10dfae53d0c941f08bded43539841761 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Running, Role: LEADER
I20251023 07:59:16.415320 18784 raft_consensus.cc:3060] T d3b72ceda32a4ebc8de6e7a7992498aa P d1a8f61d3323447282ee6068aa623216 [term 3 FOLLOWER]: Advancing to term 4
I20251023 07:59:16.417026 18174 consensus_queue.cc:260] T d3b72ceda32a4ebc8de6e7a7992498aa P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:16.418603 18174 raft_consensus.cc:3060] T d3b72ceda32a4ebc8de6e7a7992498aa P 10dfae53d0c941f08bded43539841761 [term 3 FOLLOWER]: Advancing to term 4
I20251023 07:59:16.423939 18101 raft_consensus.cc:2468] T d3b72ceda32a4ebc8de6e7a7992498aa P b3a1328f9c8c484fab08292ce2171ec9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 4.
I20251023 07:59:16.429311 18174 raft_consensus.cc:2468] T d3b72ceda32a4ebc8de6e7a7992498aa P 10dfae53d0c941f08bded43539841761 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 4.
I20251023 07:59:16.430578 18215 leader_election.cc:304] T d3b72ceda32a4ebc8de6e7a7992498aa P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:59:16.431473 19612 raft_consensus.cc:2804] T d3b72ceda32a4ebc8de6e7a7992498aa P 982df35c5b554a8fa64807352c4f34ee [term 4 FOLLOWER]: Leader election won for term 4
I20251023 07:59:16.432111 18784 raft_consensus.cc:2468] T d3b72ceda32a4ebc8de6e7a7992498aa P d1a8f61d3323447282ee6068aa623216 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 4.
I20251023 07:59:16.432859 19612 raft_consensus.cc:697] T d3b72ceda32a4ebc8de6e7a7992498aa P 982df35c5b554a8fa64807352c4f34ee [term 4 LEADER]: Becoming Leader. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Running, Role: LEADER
I20251023 07:59:16.434015 19612 consensus_queue.cc:237] T d3b72ceda32a4ebc8de6e7a7992498aa P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:16.443934 18000 catalog_manager.cc:5649] T d3b72ceda32a4ebc8de6e7a7992498aa P 982df35c5b554a8fa64807352c4f34ee reported cstate change: term changed from 3 to 4, leader changed from 10dfae53d0c941f08bded43539841761 (127.16.126.2) to 982df35c5b554a8fa64807352c4f34ee (127.16.126.3). New cstate: current_term: 4 leader_uuid: "982df35c5b554a8fa64807352c4f34ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:16.636978 18787 raft_consensus.cc:1275] T 3c5c040d6ebe40e5a5be6be47de5a7bc P d1a8f61d3323447282ee6068aa623216 [term 3 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20251023 07:59:16.638237 19577 consensus_queue.cc:1048] T 3c5c040d6ebe40e5a5be6be47de5a7bc P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20251023 07:59:16.640895 18242 raft_consensus.cc:1275] T 3c5c040d6ebe40e5a5be6be47de5a7bc P 982df35c5b554a8fa64807352c4f34ee [term 3 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20251023 07:59:16.643638 19573 consensus_queue.cc:1048] T 3c5c040d6ebe40e5a5be6be47de5a7bc P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20251023 07:59:16.700073 18174 raft_consensus.cc:1275] T fe0293c22cae49cfa7cd698f17626a35 P 10dfae53d0c941f08bded43539841761 [term 3 FOLLOWER]: Refusing update from remote peer d1a8f61d3323447282ee6068aa623216: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20251023 07:59:16.702047 19554 consensus_queue.cc:1048] T fe0293c22cae49cfa7cd698f17626a35 P d1a8f61d3323447282ee6068aa623216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20251023 07:59:16.733484 18242 raft_consensus.cc:1275] T fe0293c22cae49cfa7cd698f17626a35 P 982df35c5b554a8fa64807352c4f34ee [term 3 FOLLOWER]: Refusing update from remote peer d1a8f61d3323447282ee6068aa623216: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20251023 07:59:16.739645 19474 consensus_queue.cc:1048] T fe0293c22cae49cfa7cd698f17626a35 P d1a8f61d3323447282ee6068aa623216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20251023 07:59:16.833159 18102 raft_consensus.cc:1275] T d3b72ceda32a4ebc8de6e7a7992498aa P b3a1328f9c8c484fab08292ce2171ec9 [term 4 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20251023 07:59:16.834239 19612 consensus_queue.cc:1048] T d3b72ceda32a4ebc8de6e7a7992498aa P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20251023 07:59:16.943655 18173 raft_consensus.cc:1275] T d3b72ceda32a4ebc8de6e7a7992498aa P 10dfae53d0c941f08bded43539841761 [term 4 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20251023 07:59:16.944775 19612 consensus_queue.cc:1048] T d3b72ceda32a4ebc8de6e7a7992498aa P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20251023 07:59:16.955816 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:59:16.969870 18787 raft_consensus.cc:1275] T d3b72ceda32a4ebc8de6e7a7992498aa P d1a8f61d3323447282ee6068aa623216 [term 4 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20251023 07:59:16.974068 19568 consensus_queue.cc:1048] T d3b72ceda32a4ebc8de6e7a7992498aa P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20251023 07:59:17.042281 18247 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "25d22e66fcd6444a9b9c469acd781e59"
dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
mode: GRACEFUL
new_leader_uuid: "10dfae53d0c941f08bded43539841761"
from {username='slave'} at 127.0.0.1:60948
I20251023 07:59:17.043654 18247 raft_consensus.cc:606] T 25d22e66fcd6444a9b9c469acd781e59 P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Received request to transfer leadership to TS 10dfae53d0c941f08bded43539841761
I20251023 07:59:17.064282 18102 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "5f7e006a09224285b1e5df5694ff72ae"
dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
mode: GRACEFUL
new_leader_uuid: "982df35c5b554a8fa64807352c4f34ee"
from {username='slave'} at 127.0.0.1:34418
I20251023 07:59:17.064829 18102 raft_consensus.cc:606] T 5f7e006a09224285b1e5df5694ff72ae P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Received request to transfer leadership to TS 982df35c5b554a8fa64807352c4f34ee
I20251023 07:59:17.066712 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20251023 07:59:17.068572 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 07:59:17.069351 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:59:17.133709 19642 raft_consensus.cc:993] T 25d22e66fcd6444a9b9c469acd781e59 P 982df35c5b554a8fa64807352c4f34ee: : Instructing follower 10dfae53d0c941f08bded43539841761 to start an election
I20251023 07:59:17.134195 19642 raft_consensus.cc:1081] T 25d22e66fcd6444a9b9c469acd781e59 P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Signalling peer 10dfae53d0c941f08bded43539841761 to start an election
I20251023 07:59:17.135735 18173 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "25d22e66fcd6444a9b9c469acd781e59"
dest_uuid: "10dfae53d0c941f08bded43539841761"
from {username='slave'} at 127.0.0.1:51868
I20251023 07:59:17.136251 18173 raft_consensus.cc:493] T 25d22e66fcd6444a9b9c469acd781e59 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:59:17.136555 18173 raft_consensus.cc:3060] T 25d22e66fcd6444a9b9c469acd781e59 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:17.145193 18173 raft_consensus.cc:515] T 25d22e66fcd6444a9b9c469acd781e59 P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:59:17.149230 18102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "25d22e66fcd6444a9b9c469acd781e59" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
I20251023 07:59:17.151117 18102 raft_consensus.cc:3060] T 25d22e66fcd6444a9b9c469acd781e59 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:17.162434 18102 raft_consensus.cc:2468] T 25d22e66fcd6444a9b9c469acd781e59 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 2.
I20251023 07:59:17.163625 18143 leader_election.cc:304] T 25d22e66fcd6444a9b9c469acd781e59 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:59:17.164517 19581 raft_consensus.cc:2804] T 25d22e66fcd6444a9b9c469acd781e59 P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:59:17.165014 19581 raft_consensus.cc:697] T 25d22e66fcd6444a9b9c469acd781e59 P 10dfae53d0c941f08bded43539841761 [term 2 LEADER]: Becoming Leader. State: Replica: 10dfae53d0c941f08bded43539841761, State: Running, Role: LEADER
I20251023 07:59:17.165869 19581 consensus_queue.cc:237] T 25d22e66fcd6444a9b9c469acd781e59 P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:59:17.167191 18173 leader_election.cc:290] T 25d22e66fcd6444a9b9c469acd781e59 P 10dfae53d0c941f08bded43539841761 [CANDIDATE]: Term 2 election: Requested vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:59:17.168080 18247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "25d22e66fcd6444a9b9c469acd781e59" candidate_uuid: "10dfae53d0c941f08bded43539841761" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
I20251023 07:59:17.168654 18247 raft_consensus.cc:3055] T 25d22e66fcd6444a9b9c469acd781e59 P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Stepping down as leader of term 1
I20251023 07:59:17.168927 18247 raft_consensus.cc:740] T 25d22e66fcd6444a9b9c469acd781e59 P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Running, Role: LEADER
I20251023 07:59:17.169711 18247 consensus_queue.cc:260] T 25d22e66fcd6444a9b9c469acd781e59 P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:59:17.171067 18247 raft_consensus.cc:3060] T 25d22e66fcd6444a9b9c469acd781e59 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:17.187876 18247 raft_consensus.cc:2468] T 25d22e66fcd6444a9b9c469acd781e59 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10dfae53d0c941f08bded43539841761 in term 2.
I20251023 07:59:17.193218 18243 consensus_queue.cc:237] T d3b72ceda32a4ebc8de6e7a7992498aa P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:17.216717 18102 raft_consensus.cc:1275] T d3b72ceda32a4ebc8de6e7a7992498aa P b3a1328f9c8c484fab08292ce2171ec9 [term 4 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20251023 07:59:17.218194 18101 consensus_queue.cc:237] T 01f269ca63a8498498956fb3577f35d3 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:59:17.219449 19568 consensus_queue.cc:1048] T d3b72ceda32a4ebc8de6e7a7992498aa P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20251023 07:59:17.222764 18787 raft_consensus.cc:1275] T d3b72ceda32a4ebc8de6e7a7992498aa P d1a8f61d3323447282ee6068aa623216 [term 4 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20251023 07:59:17.225616 19612 consensus_queue.cc:1048] T d3b72ceda32a4ebc8de6e7a7992498aa P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20251023 07:59:17.238255 18099 raft_consensus.cc:2955] T d3b72ceda32a4ebc8de6e7a7992498aa P b3a1328f9c8c484fab08292ce2171ec9 [term 4 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 4 to 7, VOTER 10dfae53d0c941f08bded43539841761 (127.16.126.2) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:17.231513 19568 raft_consensus.cc:2955] T d3b72ceda32a4ebc8de6e7a7992498aa P 982df35c5b554a8fa64807352c4f34ee [term 4 LEADER]: Committing config change with OpId 4.7: config changed from index 4 to 7, VOTER 10dfae53d0c941f08bded43539841761 (127.16.126.2) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:17.243919 17999 catalog_manager.cc:5649] T 25d22e66fcd6444a9b9c469acd781e59 P 10dfae53d0c941f08bded43539841761 reported cstate change: term changed from 1 to 2, leader changed from 982df35c5b554a8fa64807352c4f34ee (127.16.126.3) to 10dfae53d0c941f08bded43539841761 (127.16.126.2). New cstate: current_term: 2 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:17.260515 18787 raft_consensus.cc:2955] T d3b72ceda32a4ebc8de6e7a7992498aa P d1a8f61d3323447282ee6068aa623216 [term 4 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 4 to 7, VOTER 10dfae53d0c941f08bded43539841761 (127.16.126.2) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:17.320751 17986 catalog_manager.cc:5162] ChangeConfig:REMOVE_PEER RPC for tablet d3b72ceda32a4ebc8de6e7a7992498aa with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 7)
I20251023 07:59:17.385265 18173 raft_consensus.cc:1275] T 01f269ca63a8498498956fb3577f35d3 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251023 07:59:17.389683 19648 consensus_queue.cc:1048] T 01f269ca63a8498498956fb3577f35d3 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:17.407303 18242 raft_consensus.cc:1275] T 01f269ca63a8498498956fb3577f35d3 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251023 07:59:17.410179 19606 raft_consensus.cc:993] T 5f7e006a09224285b1e5df5694ff72ae P b3a1328f9c8c484fab08292ce2171ec9: : Instructing follower 982df35c5b554a8fa64807352c4f34ee to start an election
I20251023 07:59:17.410712 19606 raft_consensus.cc:1081] T 5f7e006a09224285b1e5df5694ff72ae P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Signalling peer 982df35c5b554a8fa64807352c4f34ee to start an election
I20251023 07:59:17.413190 19577 consensus_queue.cc:1048] T 01f269ca63a8498498956fb3577f35d3 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:17.416250 18251 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "5f7e006a09224285b1e5df5694ff72ae"
dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
from {username='slave'} at 127.0.0.1:49420
I20251023 07:59:17.416777 18251 raft_consensus.cc:493] T 5f7e006a09224285b1e5df5694ff72ae P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:59:17.417107 18251 raft_consensus.cc:3060] T 5f7e006a09224285b1e5df5694ff72ae P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:17.418759 18000 catalog_manager.cc:5649] T d3b72ceda32a4ebc8de6e7a7992498aa P 982df35c5b554a8fa64807352c4f34ee reported cstate change: config changed from index 4 to 7, VOTER 10dfae53d0c941f08bded43539841761 (127.16.126.2) evicted. New cstate: current_term: 4 leader_uuid: "982df35c5b554a8fa64807352c4f34ee" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251023 07:59:17.420881 19606 raft_consensus.cc:2955] T 01f269ca63a8498498956fb3577f35d3 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:17.427114 18171 raft_consensus.cc:2955] T 01f269ca63a8498498956fb3577f35d3 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:17.426102 18251 raft_consensus.cc:515] T 5f7e006a09224285b1e5df5694ff72ae P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:59:17.539000 18251 leader_election.cc:290] T 5f7e006a09224285b1e5df5694ff72ae P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 2 election: Requested vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:59:17.539609 18099 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5f7e006a09224285b1e5df5694ff72ae" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
I20251023 07:59:17.540270 18099 raft_consensus.cc:3055] T 5f7e006a09224285b1e5df5694ff72ae P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Stepping down as leader of term 1
I20251023 07:59:17.540608 18099 raft_consensus.cc:740] T 5f7e006a09224285b1e5df5694ff72ae P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Running, Role: LEADER
I20251023 07:59:17.541359 18099 consensus_queue.cc:260] T 5f7e006a09224285b1e5df5694ff72ae P b3a1328f9c8c484fab08292ce2171ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:59:17.542605 18099 raft_consensus.cc:3060] T 5f7e006a09224285b1e5df5694ff72ae P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:17.566790 18171 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5f7e006a09224285b1e5df5694ff72ae" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "10dfae53d0c941f08bded43539841761"
I20251023 07:59:17.567402 18171 raft_consensus.cc:3060] T 5f7e006a09224285b1e5df5694ff72ae P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:17.569588 18099 raft_consensus.cc:2468] T 5f7e006a09224285b1e5df5694ff72ae P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 2.
I20251023 07:59:17.570660 18217 leader_election.cc:304] T 5f7e006a09224285b1e5df5694ff72ae P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:59:17.572382 19642 raft_consensus.cc:2804] T 5f7e006a09224285b1e5df5694ff72ae P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:59:17.572835 19642 raft_consensus.cc:697] T 5f7e006a09224285b1e5df5694ff72ae P 982df35c5b554a8fa64807352c4f34ee [term 2 LEADER]: Becoming Leader. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Running, Role: LEADER
I20251023 07:59:17.573621 19642 consensus_queue.cc:237] T 5f7e006a09224285b1e5df5694ff72ae P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:59:17.574317 18171 raft_consensus.cc:2468] T 5f7e006a09224285b1e5df5694ff72ae P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 2.
I20251023 07:59:17.585314 18242 raft_consensus.cc:1275] T 25d22e66fcd6444a9b9c469acd781e59 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:17.591799 18163 tablet_service.cc:1552] Processing DeleteTablet for tablet d3b72ceda32a4ebc8de6e7a7992498aa with delete_type TABLET_DATA_TOMBSTONED (TS 10dfae53d0c941f08bded43539841761 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:33428
I20251023 07:59:17.599013 18242 raft_consensus.cc:2955] T 01f269ca63a8498498956fb3577f35d3 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:17.610160 19581 consensus_queue.cc:1048] T 25d22e66fcd6444a9b9c469acd781e59 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20251023 07:59:17.612282 19662 tablet_replica.cc:333] T d3b72ceda32a4ebc8de6e7a7992498aa P 10dfae53d0c941f08bded43539841761: stopping tablet replica
I20251023 07:59:17.668124 19662 raft_consensus.cc:2243] T d3b72ceda32a4ebc8de6e7a7992498aa P 10dfae53d0c941f08bded43539841761 [term 4 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:17.669004 19662 raft_consensus.cc:2272] T d3b72ceda32a4ebc8de6e7a7992498aa P 10dfae53d0c941f08bded43539841761 [term 4 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:17.673377 19662 ts_tablet_manager.cc:1916] T d3b72ceda32a4ebc8de6e7a7992498aa P 10dfae53d0c941f08bded43539841761: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251023 07:59:17.673554 17998 catalog_manager.cc:5649] T 01f269ca63a8498498956fb3577f35d3 P 10dfae53d0c941f08bded43539841761 reported cstate change: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New cstate: current_term: 1 leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
W20251023 07:59:17.695663 18067 consensus_peers.cc:597] T 01f269ca63a8498498956fb3577f35d3 P b3a1328f9c8c484fab08292ce2171ec9 -> Peer d1a8f61d3323447282ee6068aa623216 (127.16.126.4:33293): Couldn't send request to peer d1a8f61d3323447282ee6068aa623216. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 01f269ca63a8498498956fb3577f35d3. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:17.696106 18099 consensus_queue.cc:237] T 94cd6588f7824a30ba02f891ae089671 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:59:17.704200 19662 ts_tablet_manager.cc:1929] T d3b72ceda32a4ebc8de6e7a7992498aa P 10dfae53d0c941f08bded43539841761: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.6
I20251023 07:59:17.704653 19662 log.cc:1199] T d3b72ceda32a4ebc8de6e7a7992498aa P 10dfae53d0c941f08bded43539841761: Deleting WAL directory at /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1761206251627710-16888-0/minicluster-data/ts-1-root/wals/d3b72ceda32a4ebc8de6e7a7992498aa
W20251023 07:59:17.710233 18067 consensus_peers.cc:597] T 94cd6588f7824a30ba02f891ae089671 P b3a1328f9c8c484fab08292ce2171ec9 -> Peer d1a8f61d3323447282ee6068aa623216 (127.16.126.4:33293): Couldn't send request to peer d1a8f61d3323447282ee6068aa623216. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 94cd6588f7824a30ba02f891ae089671. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:17.712920 18101 raft_consensus.cc:1275] T 25d22e66fcd6444a9b9c469acd781e59 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:17.715999 18251 raft_consensus.cc:1275] T 94cd6588f7824a30ba02f891ae089671 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20251023 07:59:17.716969 18171 raft_consensus.cc:1275] T 94cd6588f7824a30ba02f891ae089671 P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20251023 07:59:17.716818 19644 consensus_queue.cc:1048] T 25d22e66fcd6444a9b9c469acd781e59 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:17.719097 19656 consensus_queue.cc:1048] T 94cd6588f7824a30ba02f891ae089671 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:59:17.719287 17985 catalog_manager.cc:4985] TS 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): tablet d3b72ceda32a4ebc8de6e7a7992498aa (table test-workload [id=8bb191a5531a4d4fb58a25b13d592213]) successfully deleted
I20251023 07:59:17.737602 19656 consensus_queue.cc:1048] T 94cd6588f7824a30ba02f891ae089671 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:59:17.763834 19606 raft_consensus.cc:2955] T 94cd6588f7824a30ba02f891ae089671 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:17.784211 17997 catalog_manager.cc:5649] T 5f7e006a09224285b1e5df5694ff72ae P 982df35c5b554a8fa64807352c4f34ee reported cstate change: term changed from 1 to 2, leader changed from b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1) to 982df35c5b554a8fa64807352c4f34ee (127.16.126.3). New cstate: current_term: 2 leader_uuid: "982df35c5b554a8fa64807352c4f34ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: HEALTHY } } }
I20251023 07:59:17.786839 18171 consensus_queue.cc:237] T e25fd146cb564be69022d0f53010bbfa P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:59:17.787441 18176 raft_consensus.cc:2955] T 94cd6588f7824a30ba02f891ae089671 P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
W20251023 07:59:17.800601 18142 consensus_peers.cc:597] T e25fd146cb564be69022d0f53010bbfa P 10dfae53d0c941f08bded43539841761 -> Peer d1a8f61d3323447282ee6068aa623216 (127.16.126.4:33293): Couldn't send request to peer d1a8f61d3323447282ee6068aa623216. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e25fd146cb564be69022d0f53010bbfa. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:17.803902 18101 raft_consensus.cc:1275] T e25fd146cb564be69022d0f53010bbfa P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20251023 07:59:17.805851 19581 consensus_queue.cc:1048] T e25fd146cb564be69022d0f53010bbfa P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:59:17.813477 18251 raft_consensus.cc:1275] T e25fd146cb564be69022d0f53010bbfa P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20251023 07:59:17.820761 18217 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.1:44025, user_credentials={real_user=slave}} blocked reactor thread for 61025.6us
I20251023 07:59:17.821949 19653 consensus_queue.cc:1048] T e25fd146cb564be69022d0f53010bbfa P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20251023 07:59:17.841261 17998 catalog_manager.cc:5649] T 94cd6588f7824a30ba02f891ae089671 P b3a1328f9c8c484fab08292ce2171ec9 reported cstate change: config changed from index -1 to 3, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New cstate: current_term: 2 leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:17.871981 18243 raft_consensus.cc:2955] T 94cd6588f7824a30ba02f891ae089671 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:17.903117 19674 raft_consensus.cc:2955] T e25fd146cb564be69022d0f53010bbfa P 10dfae53d0c941f08bded43539841761 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:17.912149 18243 raft_consensus.cc:2955] T e25fd146cb564be69022d0f53010bbfa P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:17.912175 18094 raft_consensus.cc:2955] T e25fd146cb564be69022d0f53010bbfa P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:17.936780 18171 consensus_queue.cc:237] T 33c314b036134d929890c744d68bc0cc P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:59:17.939708 17999 catalog_manager.cc:5649] T e25fd146cb564be69022d0f53010bbfa P b3a1328f9c8c484fab08292ce2171ec9 reported cstate change: config changed from index -1 to 3, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New cstate: current_term: 2 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:17.962641 19679 ts_tablet_manager.cc:933] T 01f269ca63a8498498956fb3577f35d3 P d1a8f61d3323447282ee6068aa623216: Initiating tablet copy from peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025)
I20251023 07:59:17.972721 18243 raft_consensus.cc:1275] T 33c314b036134d929890c744d68bc0cc P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20251023 07:59:17.974140 18142 consensus_peers.cc:597] T 33c314b036134d929890c744d68bc0cc P 10dfae53d0c941f08bded43539841761 -> Peer d1a8f61d3323447282ee6068aa623216 (127.16.126.4:33293): Couldn't send request to peer d1a8f61d3323447282ee6068aa623216. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 33c314b036134d929890c744d68bc0cc. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:17.975426 18094 raft_consensus.cc:1275] T 33c314b036134d929890c744d68bc0cc P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251023 07:59:17.976919 19675 consensus_queue.cc:1048] T 33c314b036134d929890c744d68bc0cc P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:17.981585 19674 consensus_queue.cc:1048] T 33c314b036134d929890c744d68bc0cc P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:17.990646 19679 tablet_copy_client.cc:323] T 01f269ca63a8498498956fb3577f35d3 P d1a8f61d3323447282ee6068aa623216: tablet copy: Beginning tablet copy session from remote peer at address 127.16.126.1:44025
I20251023 07:59:17.992264 18111 tablet_copy_service.cc:140] P b3a1328f9c8c484fab08292ce2171ec9: Received BeginTabletCopySession request for tablet 01f269ca63a8498498956fb3577f35d3 from peer d1a8f61d3323447282ee6068aa623216 ({username='slave'} at 127.0.0.1:57714)
I20251023 07:59:17.992771 18111 tablet_copy_service.cc:161] P b3a1328f9c8c484fab08292ce2171ec9: Beginning new tablet copy session on tablet 01f269ca63a8498498956fb3577f35d3 from peer d1a8f61d3323447282ee6068aa623216 at {username='slave'} at 127.0.0.1:57714: session id = d1a8f61d3323447282ee6068aa623216-01f269ca63a8498498956fb3577f35d3
I20251023 07:59:18.008306 18111 tablet_copy_source_session.cc:215] T 01f269ca63a8498498956fb3577f35d3 P b3a1328f9c8c484fab08292ce2171ec9: Tablet Copy: opened 0 blocks and 1 log segments
I20251023 07:59:18.008787 19644 raft_consensus.cc:2955] T 33c314b036134d929890c744d68bc0cc P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:18.010906 18243 raft_consensus.cc:2955] T 33c314b036134d929890c744d68bc0cc P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:18.015851 19679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01f269ca63a8498498956fb3577f35d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:18.031611 17998 catalog_manager.cc:5649] T 33c314b036134d929890c744d68bc0cc P 10dfae53d0c941f08bded43539841761 reported cstate change: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New cstate: current_term: 1 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:18.046952 18094 raft_consensus.cc:2955] T 33c314b036134d929890c744d68bc0cc P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:18.069041 19679 tablet_copy_client.cc:806] T 01f269ca63a8498498956fb3577f35d3 P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 0 data blocks...
I20251023 07:59:18.069687 19679 tablet_copy_client.cc:670] T 01f269ca63a8498498956fb3577f35d3 P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 1 WAL segments...
I20251023 07:59:18.073568 19679 tablet_copy_client.cc:538] T 01f269ca63a8498498956fb3577f35d3 P d1a8f61d3323447282ee6068aa623216: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251023 07:59:18.092375 19679 tablet_bootstrap.cc:492] T 01f269ca63a8498498956fb3577f35d3 P d1a8f61d3323447282ee6068aa623216: Bootstrap starting.
I20251023 07:59:18.108008 19684 ts_tablet_manager.cc:933] T 94cd6588f7824a30ba02f891ae089671 P d1a8f61d3323447282ee6068aa623216: Initiating tablet copy from peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025)
I20251023 07:59:18.128232 19684 tablet_copy_client.cc:323] T 94cd6588f7824a30ba02f891ae089671 P d1a8f61d3323447282ee6068aa623216: tablet copy: Beginning tablet copy session from remote peer at address 127.16.126.1:44025
I20251023 07:59:18.131011 18111 tablet_copy_service.cc:140] P b3a1328f9c8c484fab08292ce2171ec9: Received BeginTabletCopySession request for tablet 94cd6588f7824a30ba02f891ae089671 from peer d1a8f61d3323447282ee6068aa623216 ({username='slave'} at 127.0.0.1:57714)
I20251023 07:59:18.131652 18111 tablet_copy_service.cc:161] P b3a1328f9c8c484fab08292ce2171ec9: Beginning new tablet copy session on tablet 94cd6588f7824a30ba02f891ae089671 from peer d1a8f61d3323447282ee6068aa623216 at {username='slave'} at 127.0.0.1:57714: session id = d1a8f61d3323447282ee6068aa623216-94cd6588f7824a30ba02f891ae089671
I20251023 07:59:18.136076 19679 tablet_bootstrap.cc:492] T 01f269ca63a8498498956fb3577f35d3 P d1a8f61d3323447282ee6068aa623216: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:59:18.137064 19679 tablet_bootstrap.cc:492] T 01f269ca63a8498498956fb3577f35d3 P d1a8f61d3323447282ee6068aa623216: Bootstrap complete.
I20251023 07:59:18.138320 19679 ts_tablet_manager.cc:1403] T 01f269ca63a8498498956fb3577f35d3 P d1a8f61d3323447282ee6068aa623216: Time spent bootstrapping tablet: real 0.046s user 0.024s sys 0.000s
I20251023 07:59:18.140991 19679 raft_consensus.cc:359] T 01f269ca63a8498498956fb3577f35d3 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:59:18.141956 19679 raft_consensus.cc:740] T 01f269ca63a8498498956fb3577f35d3 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d1a8f61d3323447282ee6068aa623216, State: Initialized, Role: LEARNER
I20251023 07:59:18.144651 19679 consensus_queue.cc:260] T 01f269ca63a8498498956fb3577f35d3 P d1a8f61d3323447282ee6068aa623216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:59:18.157893 19679 ts_tablet_manager.cc:1434] T 01f269ca63a8498498956fb3577f35d3 P d1a8f61d3323447282ee6068aa623216: Time spent starting tablet: real 0.019s user 0.002s sys 0.004s
I20251023 07:59:18.160194 18112 tablet_copy_service.cc:342] P b3a1328f9c8c484fab08292ce2171ec9: Request end of tablet copy session d1a8f61d3323447282ee6068aa623216-01f269ca63a8498498956fb3577f35d3 received from {username='slave'} at 127.0.0.1:57714
I20251023 07:59:18.160692 18112 tablet_copy_service.cc:434] P b3a1328f9c8c484fab08292ce2171ec9: ending tablet copy session d1a8f61d3323447282ee6068aa623216-01f269ca63a8498498956fb3577f35d3 on tablet 01f269ca63a8498498956fb3577f35d3 with peer d1a8f61d3323447282ee6068aa623216
I20251023 07:59:18.156412 18111 tablet_copy_source_session.cc:215] T 94cd6588f7824a30ba02f891ae089671 P b3a1328f9c8c484fab08292ce2171ec9: Tablet Copy: opened 0 blocks and 1 log segments
I20251023 07:59:18.168485 19684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94cd6588f7824a30ba02f891ae089671. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:18.169467 18094 raft_consensus.cc:1275] T 5f7e006a09224285b1e5df5694ff72ae P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:18.171144 19668 consensus_queue.cc:1048] T 5f7e006a09224285b1e5df5694ff72ae P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:18.188338 19679 ts_tablet_manager.cc:933] T e25fd146cb564be69022d0f53010bbfa P d1a8f61d3323447282ee6068aa623216: Initiating tablet copy from peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:59:18.195348 18173 raft_consensus.cc:1275] T 5f7e006a09224285b1e5df5694ff72ae P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:18.196758 19668 consensus_queue.cc:1048] T 5f7e006a09224285b1e5df5694ff72ae P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:18.209606 19684 tablet_copy_client.cc:806] T 94cd6588f7824a30ba02f891ae089671 P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 0 data blocks...
I20251023 07:59:18.210647 19684 tablet_copy_client.cc:670] T 94cd6588f7824a30ba02f891ae089671 P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 1 WAL segments...
I20251023 07:59:18.218020 19684 tablet_copy_client.cc:538] T 94cd6588f7824a30ba02f891ae089671 P d1a8f61d3323447282ee6068aa623216: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251023 07:59:18.221010 19679 tablet_copy_client.cc:323] T e25fd146cb564be69022d0f53010bbfa P d1a8f61d3323447282ee6068aa623216: tablet copy: Beginning tablet copy session from remote peer at address 127.16.126.2:45799
I20251023 07:59:18.224740 18186 tablet_copy_service.cc:140] P 10dfae53d0c941f08bded43539841761: Received BeginTabletCopySession request for tablet e25fd146cb564be69022d0f53010bbfa from peer d1a8f61d3323447282ee6068aa623216 ({username='slave'} at 127.0.0.1:50534)
I20251023 07:59:18.225339 18186 tablet_copy_service.cc:161] P 10dfae53d0c941f08bded43539841761: Beginning new tablet copy session on tablet e25fd146cb564be69022d0f53010bbfa from peer d1a8f61d3323447282ee6068aa623216 at {username='slave'} at 127.0.0.1:50534: session id = d1a8f61d3323447282ee6068aa623216-e25fd146cb564be69022d0f53010bbfa
I20251023 07:59:18.235379 18186 tablet_copy_source_session.cc:215] T e25fd146cb564be69022d0f53010bbfa P 10dfae53d0c941f08bded43539841761: Tablet Copy: opened 0 blocks and 1 log segments
I20251023 07:59:18.238646 19679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e25fd146cb564be69022d0f53010bbfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:18.248250 19684 tablet_bootstrap.cc:492] T 94cd6588f7824a30ba02f891ae089671 P d1a8f61d3323447282ee6068aa623216: Bootstrap starting.
I20251023 07:59:18.276503 19679 tablet_copy_client.cc:806] T e25fd146cb564be69022d0f53010bbfa P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 0 data blocks...
I20251023 07:59:18.277230 19679 tablet_copy_client.cc:670] T e25fd146cb564be69022d0f53010bbfa P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 1 WAL segments...
I20251023 07:59:18.283594 19679 tablet_copy_client.cc:538] T e25fd146cb564be69022d0f53010bbfa P d1a8f61d3323447282ee6068aa623216: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251023 07:59:18.290333 19684 tablet_bootstrap.cc:492] T 94cd6588f7824a30ba02f891ae089671 P d1a8f61d3323447282ee6068aa623216: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:59:18.291242 19684 tablet_bootstrap.cc:492] T 94cd6588f7824a30ba02f891ae089671 P d1a8f61d3323447282ee6068aa623216: Bootstrap complete.
I20251023 07:59:18.291953 19684 ts_tablet_manager.cc:1403] T 94cd6588f7824a30ba02f891ae089671 P d1a8f61d3323447282ee6068aa623216: Time spent bootstrapping tablet: real 0.044s user 0.012s sys 0.010s
I20251023 07:59:18.299808 19679 tablet_bootstrap.cc:492] T e25fd146cb564be69022d0f53010bbfa P d1a8f61d3323447282ee6068aa623216: Bootstrap starting.
I20251023 07:59:18.301373 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:59:18.306856 19684 raft_consensus.cc:359] T 94cd6588f7824a30ba02f891ae089671 P d1a8f61d3323447282ee6068aa623216 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:59:18.307802 19684 raft_consensus.cc:740] T 94cd6588f7824a30ba02f891ae089671 P d1a8f61d3323447282ee6068aa623216 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: d1a8f61d3323447282ee6068aa623216, State: Initialized, Role: LEARNER
I20251023 07:59:18.308473 19684 consensus_queue.cc:260] T 94cd6588f7824a30ba02f891ae089671 P d1a8f61d3323447282ee6068aa623216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:59:18.314963 19684 ts_tablet_manager.cc:1434] T 94cd6588f7824a30ba02f891ae089671 P d1a8f61d3323447282ee6068aa623216: Time spent starting tablet: real 0.011s user 0.006s sys 0.001s
I20251023 07:59:18.323227 18111 tablet_copy_service.cc:342] P b3a1328f9c8c484fab08292ce2171ec9: Request end of tablet copy session d1a8f61d3323447282ee6068aa623216-94cd6588f7824a30ba02f891ae089671 received from {username='slave'} at 127.0.0.1:57714
I20251023 07:59:18.323681 18111 tablet_copy_service.cc:434] P b3a1328f9c8c484fab08292ce2171ec9: ending tablet copy session d1a8f61d3323447282ee6068aa623216-94cd6588f7824a30ba02f891ae089671 on tablet 94cd6588f7824a30ba02f891ae089671 with peer d1a8f61d3323447282ee6068aa623216
I20251023 07:59:18.355302 19679 tablet_bootstrap.cc:492] T e25fd146cb564be69022d0f53010bbfa P d1a8f61d3323447282ee6068aa623216: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:59:18.356380 19679 tablet_bootstrap.cc:492] T e25fd146cb564be69022d0f53010bbfa P d1a8f61d3323447282ee6068aa623216: Bootstrap complete.
I20251023 07:59:18.357328 19679 ts_tablet_manager.cc:1403] T e25fd146cb564be69022d0f53010bbfa P d1a8f61d3323447282ee6068aa623216: Time spent bootstrapping tablet: real 0.058s user 0.027s sys 0.012s
I20251023 07:59:18.370007 19679 raft_consensus.cc:359] T e25fd146cb564be69022d0f53010bbfa P d1a8f61d3323447282ee6068aa623216 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:59:18.370884 19679 raft_consensus.cc:740] T e25fd146cb564be69022d0f53010bbfa P d1a8f61d3323447282ee6068aa623216 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: d1a8f61d3323447282ee6068aa623216, State: Initialized, Role: LEARNER
I20251023 07:59:18.371546 19679 consensus_queue.cc:260] T e25fd146cb564be69022d0f53010bbfa P d1a8f61d3323447282ee6068aa623216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:59:18.381234 19679 ts_tablet_manager.cc:1434] T e25fd146cb564be69022d0f53010bbfa P d1a8f61d3323447282ee6068aa623216: Time spent starting tablet: real 0.016s user 0.002s sys 0.003s
I20251023 07:59:18.383244 18186 tablet_copy_service.cc:342] P 10dfae53d0c941f08bded43539841761: Request end of tablet copy session d1a8f61d3323447282ee6068aa623216-e25fd146cb564be69022d0f53010bbfa received from {username='slave'} at 127.0.0.1:50534
I20251023 07:59:18.383682 18186 tablet_copy_service.cc:434] P 10dfae53d0c941f08bded43539841761: ending tablet copy session d1a8f61d3323447282ee6068aa623216-e25fd146cb564be69022d0f53010bbfa on tablet e25fd146cb564be69022d0f53010bbfa with peer d1a8f61d3323447282ee6068aa623216
I20251023 07:59:18.386339 19684 ts_tablet_manager.cc:933] T 33c314b036134d929890c744d68bc0cc P d1a8f61d3323447282ee6068aa623216: Initiating tablet copy from peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:59:18.419555 18176 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "25d22e66fcd6444a9b9c469acd781e59"
dest_uuid: "10dfae53d0c941f08bded43539841761"
mode: GRACEFUL
new_leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
from {username='slave'} at 127.0.0.1:47396
I20251023 07:59:18.420197 18176 raft_consensus.cc:606] T 25d22e66fcd6444a9b9c469acd781e59 P 10dfae53d0c941f08bded43539841761 [term 2 LEADER]: Received request to transfer leadership to TS b3a1328f9c8c484fab08292ce2171ec9
I20251023 07:59:18.423924 18243 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "abefe27ebb4c4179a8620d4e638fe119"
dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
mode: GRACEFUL
new_leader_uuid: "d1a8f61d3323447282ee6068aa623216"
from {username='slave'} at 127.0.0.1:60948
I20251023 07:59:18.424526 18243 raft_consensus.cc:606] T abefe27ebb4c4179a8620d4e638fe119 P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Received request to transfer leadership to TS d1a8f61d3323447282ee6068aa623216
I20251023 07:59:18.424602 19684 tablet_copy_client.cc:323] T 33c314b036134d929890c744d68bc0cc P d1a8f61d3323447282ee6068aa623216: tablet copy: Beginning tablet copy session from remote peer at address 127.16.126.2:45799
I20251023 07:59:18.426000 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20251023 07:59:18.426780 18186 tablet_copy_service.cc:140] P 10dfae53d0c941f08bded43539841761: Received BeginTabletCopySession request for tablet 33c314b036134d929890c744d68bc0cc from peer d1a8f61d3323447282ee6068aa623216 ({username='slave'} at 127.0.0.1:50534)
I20251023 07:59:18.427282 18186 tablet_copy_service.cc:161] P 10dfae53d0c941f08bded43539841761: Beginning new tablet copy session on tablet 33c314b036134d929890c744d68bc0cc from peer d1a8f61d3323447282ee6068aa623216 at {username='slave'} at 127.0.0.1:50534: session id = d1a8f61d3323447282ee6068aa623216-33c314b036134d929890c744d68bc0cc
I20251023 07:59:18.427698 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 07:59:18.428406 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:59:18.440841 18186 tablet_copy_source_session.cc:215] T 33c314b036134d929890c744d68bc0cc P 10dfae53d0c941f08bded43539841761: Tablet Copy: opened 0 blocks and 1 log segments
W20251023 07:59:18.443141 18198 debug-util.cc:398] Leaking SignalData structure 0x7b0800238340 after lost signal to thread 16891
W20251023 07:59:18.444231 18198 debug-util.cc:398] Leaking SignalData structure 0x7b08001e22c0 after lost signal to thread 18034
W20251023 07:59:18.445358 18198 debug-util.cc:398] Leaking SignalData structure 0x7b080009f680 after lost signal to thread 18126
W20251023 07:59:18.446348 18198 debug-util.cc:398] Leaking SignalData structure 0x7b08002508c0 after lost signal to thread 18201
W20251023 07:59:18.447335 18198 debug-util.cc:398] Leaking SignalData structure 0x7b0800359ca0 after lost signal to thread 18275
W20251023 07:59:18.448398 18198 debug-util.cc:398] Leaking SignalData structure 0x7b08002e17a0 after lost signal to thread 18813
I20251023 07:59:18.450033 19684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33c314b036134d929890c744d68bc0cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:18.493750 19684 tablet_copy_client.cc:806] T 33c314b036134d929890c744d68bc0cc P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 0 data blocks...
I20251023 07:59:18.494910 19684 tablet_copy_client.cc:670] T 33c314b036134d929890c744d68bc0cc P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 1 WAL segments...
I20251023 07:59:18.503273 19684 tablet_copy_client.cc:538] T 33c314b036134d929890c744d68bc0cc P d1a8f61d3323447282ee6068aa623216: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251023 07:59:18.517130 18788 raft_consensus.cc:1217] T 94cd6588f7824a30ba02f891ae089671 P d1a8f61d3323447282ee6068aa623216 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3] Dedup: 2.3->[]
I20251023 07:59:18.545910 19684 tablet_bootstrap.cc:492] T 33c314b036134d929890c744d68bc0cc P d1a8f61d3323447282ee6068aa623216: Bootstrap starting.
I20251023 07:59:18.553664 18788 raft_consensus.cc:1217] T 01f269ca63a8498498956fb3577f35d3 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20251023 07:59:18.626587 19684 tablet_bootstrap.cc:492] T 33c314b036134d929890c744d68bc0cc P d1a8f61d3323447282ee6068aa623216: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:59:18.627552 19684 tablet_bootstrap.cc:492] T 33c314b036134d929890c744d68bc0cc P d1a8f61d3323447282ee6068aa623216: Bootstrap complete.
I20251023 07:59:18.630486 19684 ts_tablet_manager.cc:1403] T 33c314b036134d929890c744d68bc0cc P d1a8f61d3323447282ee6068aa623216: Time spent bootstrapping tablet: real 0.085s user 0.025s sys 0.007s
I20251023 07:59:18.633586 19684 raft_consensus.cc:359] T 33c314b036134d929890c744d68bc0cc P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:59:18.634418 19684 raft_consensus.cc:740] T 33c314b036134d929890c744d68bc0cc P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d1a8f61d3323447282ee6068aa623216, State: Initialized, Role: LEARNER
I20251023 07:59:18.635103 19684 consensus_queue.cc:260] T 33c314b036134d929890c744d68bc0cc P d1a8f61d3323447282ee6068aa623216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:59:18.638477 19684 ts_tablet_manager.cc:1434] T 33c314b036134d929890c744d68bc0cc P d1a8f61d3323447282ee6068aa623216: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20251023 07:59:18.672400 19644 raft_consensus.cc:993] T 25d22e66fcd6444a9b9c469acd781e59 P 10dfae53d0c941f08bded43539841761: : Instructing follower b3a1328f9c8c484fab08292ce2171ec9 to start an election
I20251023 07:59:18.672919 19644 raft_consensus.cc:1081] T 25d22e66fcd6444a9b9c469acd781e59 P 10dfae53d0c941f08bded43539841761 [term 2 LEADER]: Signalling peer b3a1328f9c8c484fab08292ce2171ec9 to start an election
I20251023 07:59:18.674644 18102 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "25d22e66fcd6444a9b9c469acd781e59"
dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
from {username='slave'} at 127.0.0.1:53946
I20251023 07:59:18.675215 18102 raft_consensus.cc:493] T 25d22e66fcd6444a9b9c469acd781e59 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:59:18.675567 18102 raft_consensus.cc:3060] T 25d22e66fcd6444a9b9c469acd781e59 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:59:18.676829 18186 tablet_copy_service.cc:342] P 10dfae53d0c941f08bded43539841761: Request end of tablet copy session d1a8f61d3323447282ee6068aa623216-33c314b036134d929890c744d68bc0cc received from {username='slave'} at 127.0.0.1:50534
I20251023 07:59:18.677340 18186 tablet_copy_service.cc:434] P 10dfae53d0c941f08bded43539841761: ending tablet copy session d1a8f61d3323447282ee6068aa623216-33c314b036134d929890c744d68bc0cc on tablet 33c314b036134d929890c744d68bc0cc with peer d1a8f61d3323447282ee6068aa623216
I20251023 07:59:18.689133 18102 raft_consensus.cc:515] T 25d22e66fcd6444a9b9c469acd781e59 P b3a1328f9c8c484fab08292ce2171ec9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:59:18.693495 18102 leader_election.cc:290] T 25d22e66fcd6444a9b9c469acd781e59 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 3 election: Requested vote from peers 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:59:18.699656 18788 raft_consensus.cc:1217] T e25fd146cb564be69022d0f53010bbfa P d1a8f61d3323447282ee6068aa623216 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3] Dedup: 2.3->[]
I20251023 07:59:18.708351 18176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "25d22e66fcd6444a9b9c469acd781e59" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "10dfae53d0c941f08bded43539841761"
I20251023 07:59:18.709048 18176 raft_consensus.cc:3055] T 25d22e66fcd6444a9b9c469acd781e59 P 10dfae53d0c941f08bded43539841761 [term 2 LEADER]: Stepping down as leader of term 2
I20251023 07:59:18.709376 18176 raft_consensus.cc:740] T 25d22e66fcd6444a9b9c469acd781e59 P 10dfae53d0c941f08bded43539841761 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 10dfae53d0c941f08bded43539841761, State: Running, Role: LEADER
I20251023 07:59:18.711642 18176 consensus_queue.cc:260] T 25d22e66fcd6444a9b9c469acd781e59 P 10dfae53d0c941f08bded43539841761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:59:18.715938 18243 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "25d22e66fcd6444a9b9c469acd781e59" candidate_uuid: "b3a1328f9c8c484fab08292ce2171ec9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
I20251023 07:59:18.716574 18243 raft_consensus.cc:3060] T 25d22e66fcd6444a9b9c469acd781e59 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:59:18.736948 18243 raft_consensus.cc:2468] T 25d22e66fcd6444a9b9c469acd781e59 P 982df35c5b554a8fa64807352c4f34ee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3a1328f9c8c484fab08292ce2171ec9 in term 3.
I20251023 07:59:18.738039 18067 leader_election.cc:304] T 25d22e66fcd6444a9b9c469acd781e59 P b3a1328f9c8c484fab08292ce2171ec9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:59:18.738869 19694 raft_consensus.cc:2804] T 25d22e66fcd6444a9b9c469acd781e59 P b3a1328f9c8c484fab08292ce2171ec9 [term 3 FOLLOWER]: Leader election won for term 3
I20251023 07:59:18.739362 19694 raft_consensus.cc:697] T 25d22e66fcd6444a9b9c469acd781e59 P b3a1328f9c8c484fab08292ce2171ec9 [term 3 LEADER]: Becoming Leader. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Running, Role: LEADER
I20251023 07:59:18.740259 19694 consensus_queue.cc:237] T 25d22e66fcd6444a9b9c469acd781e59 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:59:18.746126 18176 raft_consensus.cc:3060] T 25d22e66fcd6444a9b9c469acd781e59 P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:59:18.754829 17998 catalog_manager.cc:5649] T 25d22e66fcd6444a9b9c469acd781e59 P b3a1328f9c8c484fab08292ce2171ec9 reported cstate change: term changed from 2 to 3, leader changed from 10dfae53d0c941f08bded43539841761 (127.16.126.2) to b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1). New cstate: current_term: 3 leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:18.772089 18176 raft_consensus.cc:2468] T 25d22e66fcd6444a9b9c469acd781e59 P 10dfae53d0c941f08bded43539841761 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3a1328f9c8c484fab08292ce2171ec9 in term 3.
I20251023 07:59:18.789978 19640 raft_consensus.cc:993] T abefe27ebb4c4179a8620d4e638fe119 P 982df35c5b554a8fa64807352c4f34ee: : Instructing follower d1a8f61d3323447282ee6068aa623216 to start an election
I20251023 07:59:18.790822 19640 raft_consensus.cc:1081] T abefe27ebb4c4179a8620d4e638fe119 P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Signalling peer d1a8f61d3323447282ee6068aa623216 to start an election
I20251023 07:59:18.793251 18788 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "abefe27ebb4c4179a8620d4e638fe119"
dest_uuid: "d1a8f61d3323447282ee6068aa623216"
from {username='slave'} at 127.0.0.1:36478
I20251023 07:59:18.794116 18788 raft_consensus.cc:493] T abefe27ebb4c4179a8620d4e638fe119 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:59:18.794485 18788 raft_consensus.cc:3060] T abefe27ebb4c4179a8620d4e638fe119 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:18.824164 18788 raft_consensus.cc:515] T abefe27ebb4c4179a8620d4e638fe119 P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:18.827162 18102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "abefe27ebb4c4179a8620d4e638fe119" candidate_uuid: "d1a8f61d3323447282ee6068aa623216" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
I20251023 07:59:18.827737 18102 raft_consensus.cc:3060] T abefe27ebb4c4179a8620d4e638fe119 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Advancing to term 2
W20251023 07:59:18.832864 18217 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.1:44025, user_credentials={real_user=slave}} blocked reactor thread for 53204.3us
I20251023 07:59:18.875658 18787 raft_consensus.cc:1217] T 33c314b036134d929890c744d68bc0cc P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20251023 07:59:18.877410 18102 raft_consensus.cc:2468] T abefe27ebb4c4179a8620d4e638fe119 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1a8f61d3323447282ee6068aa623216 in term 2.
I20251023 07:59:18.878134 18094 raft_consensus.cc:1240] T abefe27ebb4c4179a8620d4e638fe119 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Rejecting Update request from peer 982df35c5b554a8fa64807352c4f34ee for earlier term 1. Current term is 2. Ops: []
I20251023 07:59:18.881757 18755 leader_election.cc:304] T abefe27ebb4c4179a8620d4e638fe119 P d1a8f61d3323447282ee6068aa623216 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3a1328f9c8c484fab08292ce2171ec9, d1a8f61d3323447282ee6068aa623216; no voters:
I20251023 07:59:18.881757 18788 leader_election.cc:290] T abefe27ebb4c4179a8620d4e638fe119 P d1a8f61d3323447282ee6068aa623216 [CANDIDATE]: Term 2 election: Requested vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:59:18.885360 18243 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "abefe27ebb4c4179a8620d4e638fe119" candidate_uuid: "d1a8f61d3323447282ee6068aa623216" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
I20251023 07:59:18.886171 18243 raft_consensus.cc:3055] T abefe27ebb4c4179a8620d4e638fe119 P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Stepping down as leader of term 1
I20251023 07:59:18.886438 18243 raft_consensus.cc:740] T abefe27ebb4c4179a8620d4e638fe119 P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Running, Role: LEADER
I20251023 07:59:18.887125 18243 consensus_queue.cc:260] T abefe27ebb4c4179a8620d4e638fe119 P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:18.888137 18243 raft_consensus.cc:3060] T abefe27ebb4c4179a8620d4e638fe119 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:18.894584 18243 raft_consensus.cc:2468] T abefe27ebb4c4179a8620d4e638fe119 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1a8f61d3323447282ee6068aa623216 in term 2.
I20251023 07:59:18.895887 19650 raft_consensus.cc:2804] T abefe27ebb4c4179a8620d4e638fe119 P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:59:18.900395 19650 raft_consensus.cc:697] T abefe27ebb4c4179a8620d4e638fe119 P d1a8f61d3323447282ee6068aa623216 [term 2 LEADER]: Becoming Leader. State: Replica: d1a8f61d3323447282ee6068aa623216, State: Running, Role: LEADER
I20251023 07:59:18.901463 19650 consensus_queue.cc:237] T abefe27ebb4c4179a8620d4e638fe119 P d1a8f61d3323447282ee6068aa623216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:18.904616 19695 raft_consensus.cc:1064] T 94cd6588f7824a30ba02f891ae089671 P b3a1328f9c8c484fab08292ce2171ec9: attempting to promote NON_VOTER d1a8f61d3323447282ee6068aa623216 to VOTER
I20251023 07:59:18.907626 19695 consensus_queue.cc:237] T 94cd6588f7824a30ba02f891ae089671 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:18.926470 18788 raft_consensus.cc:1275] T 94cd6588f7824a30ba02f891ae089671 P d1a8f61d3323447282ee6068aa623216 [term 2 LEARNER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20251023 07:59:18.928874 19656 consensus_queue.cc:1048] T 94cd6588f7824a30ba02f891ae089671 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:59:18.948226 18176 raft_consensus.cc:1275] T 94cd6588f7824a30ba02f891ae089671 P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20251023 07:59:18.950877 19694 consensus_queue.cc:1048] T 94cd6588f7824a30ba02f891ae089671 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:59:18.954815 17998 catalog_manager.cc:5649] T abefe27ebb4c4179a8620d4e638fe119 P d1a8f61d3323447282ee6068aa623216 reported cstate change: term changed from 1 to 2, leader changed from 982df35c5b554a8fa64807352c4f34ee (127.16.126.3) to d1a8f61d3323447282ee6068aa623216 (127.16.126.4). New cstate: current_term: 2 leader_uuid: "d1a8f61d3323447282ee6068aa623216" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251023 07:59:18.950817 18243 raft_consensus.cc:1275] T 94cd6588f7824a30ba02f891ae089671 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20251023 07:59:18.965063 19694 consensus_queue.cc:1048] T 94cd6588f7824a30ba02f891ae089671 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:59:18.977672 19656 raft_consensus.cc:2955] T 94cd6588f7824a30ba02f891ae089671 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:18.984102 18248 raft_consensus.cc:2955] T 94cd6588f7824a30ba02f891ae089671 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:19.020933 18176 raft_consensus.cc:2955] T 94cd6588f7824a30ba02f891ae089671 P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:19.012872 17998 catalog_manager.cc:5649] T 94cd6588f7824a30ba02f891ae089671 P 982df35c5b554a8fa64807352c4f34ee reported cstate change: config changed from index 3 to 4, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:19.040968 18787 raft_consensus.cc:2955] T 94cd6588f7824a30ba02f891ae089671 P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:19.062340 19695 raft_consensus.cc:1064] T 01f269ca63a8498498956fb3577f35d3 P b3a1328f9c8c484fab08292ce2171ec9: attempting to promote NON_VOTER d1a8f61d3323447282ee6068aa623216 to VOTER
I20251023 07:59:19.068840 19695 consensus_queue.cc:237] T 01f269ca63a8498498956fb3577f35d3 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:19.107270 18787 raft_consensus.cc:1275] T 01f269ca63a8498498956fb3577f35d3 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:59:19.109277 19606 consensus_queue.cc:1048] T 01f269ca63a8498498956fb3577f35d3 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:59:19.111543 18243 raft_consensus.cc:1275] T 01f269ca63a8498498956fb3577f35d3 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:59:19.119685 18176 raft_consensus.cc:1275] T 01f269ca63a8498498956fb3577f35d3 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:59:19.123266 19606 consensus_queue.cc:1048] T 01f269ca63a8498498956fb3577f35d3 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:59:19.139308 18094 consensus_queue.cc:237] T 94cd6588f7824a30ba02f891ae089671 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:19.151569 18789 raft_consensus.cc:1275] T 94cd6588f7824a30ba02f891ae089671 P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20251023 07:59:19.151890 19606 consensus_queue.cc:1048] T 01f269ca63a8498498956fb3577f35d3 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:59:19.154219 19707 consensus_queue.cc:1048] T 94cd6588f7824a30ba02f891ae089671 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20251023 07:59:19.159232 18174 raft_consensus.cc:1275] T 25d22e66fcd6444a9b9c469acd781e59 P 10dfae53d0c941f08bded43539841761 [term 3 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251023 07:59:19.160769 19709 consensus_queue.cc:1048] T 25d22e66fcd6444a9b9c469acd781e59 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:59:19.176648 18243 raft_consensus.cc:1275] T 94cd6588f7824a30ba02f891ae089671 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20251023 07:59:19.177242 18242 raft_consensus.cc:1275] T 25d22e66fcd6444a9b9c469acd781e59 P 982df35c5b554a8fa64807352c4f34ee [term 3 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251023 07:59:19.172586 19694 raft_consensus.cc:2955] T 94cd6588f7824a30ba02f891ae089671 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 10dfae53d0c941f08bded43539841761 (127.16.126.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:19.182571 18787 raft_consensus.cc:2955] T 94cd6588f7824a30ba02f891ae089671 P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 10dfae53d0c941f08bded43539841761 (127.16.126.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:19.191128 19709 raft_consensus.cc:2955] T 01f269ca63a8498498956fb3577f35d3 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:19.193238 18176 raft_consensus.cc:2955] T 01f269ca63a8498498956fb3577f35d3 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:19.207773 19710 consensus_queue.cc:1048] T 94cd6588f7824a30ba02f891ae089671 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20251023 07:59:19.212162 19710 consensus_queue.cc:1048] T 25d22e66fcd6444a9b9c469acd781e59 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:59:19.217018 17987 catalog_manager.cc:5162] ChangeConfig:REMOVE_PEER RPC for tablet 94cd6588f7824a30ba02f891ae089671 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251023 07:59:19.225252 17997 catalog_manager.cc:5649] T 94cd6588f7824a30ba02f891ae089671 P b3a1328f9c8c484fab08292ce2171ec9 reported cstate change: config changed from index 4 to 5, VOTER 10dfae53d0c941f08bded43539841761 (127.16.126.2) evicted. New cstate: current_term: 2 leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251023 07:59:19.250434 18787 raft_consensus.cc:2955] T 01f269ca63a8498498956fb3577f35d3 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:19.262257 19675 raft_consensus.cc:1064] T e25fd146cb564be69022d0f53010bbfa P 10dfae53d0c941f08bded43539841761: attempting to promote NON_VOTER d1a8f61d3323447282ee6068aa623216 to VOTER
I20251023 07:59:19.264249 18163 tablet_service.cc:1552] Processing DeleteTablet for tablet 94cd6588f7824a30ba02f891ae089671 with delete_type TABLET_DATA_TOMBSTONED (TS 10dfae53d0c941f08bded43539841761 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:33428
I20251023 07:59:19.265051 19675 consensus_queue.cc:237] T e25fd146cb564be69022d0f53010bbfa P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:19.286608 17999 catalog_manager.cc:5649] T 01f269ca63a8498498956fb3577f35d3 P 10dfae53d0c941f08bded43539841761 reported cstate change: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:19.315707 19715 tablet_replica.cc:333] T 94cd6588f7824a30ba02f891ae089671 P 10dfae53d0c941f08bded43539841761: stopping tablet replica
I20251023 07:59:19.318356 18251 raft_consensus.cc:2955] T 94cd6588f7824a30ba02f891ae089671 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 10dfae53d0c941f08bded43539841761 (127.16.126.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:19.322049 18243 raft_consensus.cc:2955] T 01f269ca63a8498498956fb3577f35d3 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } attrs { replace: true } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:19.324350 18102 raft_consensus.cc:1275] T e25fd146cb564be69022d0f53010bbfa P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20251023 07:59:19.326925 18094 raft_consensus.cc:1275] T abefe27ebb4c4179a8620d4e638fe119 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Refusing update from remote peer d1a8f61d3323447282ee6068aa623216: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20251023 07:59:19.347229 19674 consensus_queue.cc:1048] T e25fd146cb564be69022d0f53010bbfa P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:59:19.351058 19650 consensus_queue.cc:1048] T abefe27ebb4c4179a8620d4e638fe119 P d1a8f61d3323447282ee6068aa623216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20251023 07:59:19.339506 18787 raft_consensus.cc:1275] T e25fd146cb564be69022d0f53010bbfa P d1a8f61d3323447282ee6068aa623216 [term 2 LEARNER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
W20251023 07:59:19.408524 18217 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.1:44025, user_credentials={real_user=slave}} blocked reactor thread for 50756us
I20251023 07:59:19.423458 18101 consensus_queue.cc:237] T 01f269ca63a8498498956fb3577f35d3 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
W20251023 07:59:19.475569 18143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.1:44025, user_credentials={real_user=slave}} blocked reactor thread for 121002us
I20251023 07:59:19.473564 19675 consensus_queue.cc:1048] T e25fd146cb564be69022d0f53010bbfa P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
W20251023 07:59:19.503909 18755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.1:44025, user_credentials={real_user=slave}} blocked reactor thread for 54662.3us
I20251023 07:59:19.507663 18247 raft_consensus.cc:1275] T e25fd146cb564be69022d0f53010bbfa P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
W20251023 07:59:19.512861 18142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.3:46061, user_credentials={real_user=slave}} blocked reactor thread for 95866.7us
I20251023 07:59:19.521344 18248 raft_consensus.cc:1275] T abefe27ebb4c4179a8620d4e638fe119 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Refusing update from remote peer d1a8f61d3323447282ee6068aa623216: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20251023 07:59:19.553352 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20251023 07:59:19.560127 18754 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.3:46061, user_credentials={real_user=slave}} blocked reactor thread for 45993.1us
W20251023 07:59:19.571627 18142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.3:46061, user_credentials={real_user=slave}} blocked reactor thread for 58004.2us
I20251023 07:59:19.615444 19745 consensus_queue.cc:1048] T e25fd146cb564be69022d0f53010bbfa P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20251023 07:59:19.622077 18067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.3:46061, user_credentials={real_user=slave}} blocked reactor thread for 66887.6us
I20251023 07:59:19.628417 19715 raft_consensus.cc:2243] T 94cd6588f7824a30ba02f891ae089671 P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:19.629215 19715 raft_consensus.cc:2272] T 94cd6588f7824a30ba02f891ae089671 P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:19.638156 19733 consensus_queue.cc:1048] T abefe27ebb4c4179a8620d4e638fe119 P d1a8f61d3323447282ee6068aa623216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20251023 07:59:19.643985 19674 raft_consensus.cc:1064] T 33c314b036134d929890c744d68bc0cc P 10dfae53d0c941f08bded43539841761: attempting to promote NON_VOTER d1a8f61d3323447282ee6068aa623216 to VOTER
I20251023 07:59:19.766700 18789 raft_consensus.cc:1275] T 01f269ca63a8498498956fb3577f35d3 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20251023 07:59:19.769819 18142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.3:46061, user_credentials={real_user=slave}} blocked reactor thread for 98895.1us
W20251023 07:59:19.771638 18143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.1:44025, user_credentials={real_user=slave}} blocked reactor thread for 110241us
W20251023 07:59:19.826478 18217 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.1:44025, user_credentials={real_user=slave}} blocked reactor thread for 56113.5us
W20251023 07:59:19.856143 18066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.2:45799, user_credentials={real_user=slave}} blocked reactor thread for 98413.4us
W20251023 07:59:19.856900 18215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.2:45799, user_credentials={real_user=slave}} blocked reactor thread for 91554.2us
W20251023 07:59:19.893370 18067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.4:33293, user_credentials={real_user=slave}} blocked reactor thread for 106097us
W20251023 07:59:19.940155 18142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.3:46061, user_credentials={real_user=slave}} blocked reactor thread for 45535.5us
I20251023 07:59:19.939638 19756 consensus_queue.cc:1048] T 01f269ca63a8498498956fb3577f35d3 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.068s
I20251023 07:59:20.006456 19674 consensus_queue.cc:237] T 33c314b036134d929890c744d68bc0cc P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
W20251023 07:59:20.053560 18066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.2:45799, user_credentials={real_user=slave}} blocked reactor thread for 149732us
W20251023 07:59:20.057238 18217 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.1:44025, user_credentials={real_user=slave}} blocked reactor thread for 229224us
W20251023 07:59:20.057265 18067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.3:46061, user_credentials={real_user=slave}} blocked reactor thread for 113759us
I20251023 07:59:20.109005 19715 ts_tablet_manager.cc:1916] T 94cd6588f7824a30ba02f891ae089671 P 10dfae53d0c941f08bded43539841761: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251023 07:59:20.192488 18248 raft_consensus.cc:1275] T 01f269ca63a8498498956fb3577f35d3 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251023 07:59:20.201524 18787 raft_consensus.cc:2955] T e25fd146cb564be69022d0f53010bbfa P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:20.200928 18789 raft_consensus.cc:2955] T 01f269ca63a8498498956fb3577f35d3 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 10dfae53d0c941f08bded43539841761 (127.16.126.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:20.213256 18248 raft_consensus.cc:2955] T e25fd146cb564be69022d0f53010bbfa P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:20.160300 19740 raft_consensus.cc:2955] T e25fd146cb564be69022d0f53010bbfa P 10dfae53d0c941f08bded43539841761 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:20.227253 19741 consensus_queue.cc:1048] T 01f269ca63a8498498956fb3577f35d3 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20251023 07:59:20.180220 19732 raft_consensus.cc:2955] T 01f269ca63a8498498956fb3577f35d3 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 10dfae53d0c941f08bded43539841761 (127.16.126.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:20.235795 18094 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "a83dfc7a7d784b52b9c74bbc451ad603"
dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
mode: GRACEFUL
new_leader_uuid: "982df35c5b554a8fa64807352c4f34ee"
from {username='slave'} at 127.0.0.1:34418
I20251023 07:59:20.236420 18094 raft_consensus.cc:606] T a83dfc7a7d784b52b9c74bbc451ad603 P b3a1328f9c8c484fab08292ce2171ec9 [term 3 LEADER]: Received request to transfer leadership to TS 982df35c5b554a8fa64807352c4f34ee
I20251023 07:59:20.238231 18247 raft_consensus.cc:2955] T 01f269ca63a8498498956fb3577f35d3 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 10dfae53d0c941f08bded43539841761 (127.16.126.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:20.250070 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 1
I20251023 07:59:20.252082 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 07:59:20.252852 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:59:20.270233 17998 catalog_manager.cc:5649] T 01f269ca63a8498498956fb3577f35d3 P 982df35c5b554a8fa64807352c4f34ee reported cstate change: config changed from index 3 to 4, VOTER 10dfae53d0c941f08bded43539841761 (127.16.126.2) evicted. New cstate: current_term: 1 leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:20.306335 18787 raft_consensus.cc:1275] T 33c314b036134d929890c744d68bc0cc P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:59:20.309770 19761 consensus_queue.cc:1048] T 33c314b036134d929890c744d68bc0cc P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20251023 07:59:20.313467 18094 raft_consensus.cc:1275] T 33c314b036134d929890c744d68bc0cc P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:59:20.316705 17987 catalog_manager.cc:5162] ChangeConfig:REMOVE_PEER RPC for tablet 01f269ca63a8498498956fb3577f35d3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251023 07:59:20.317390 19644 consensus_queue.cc:1048] T 33c314b036134d929890c744d68bc0cc P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20251023 07:59:20.319849 18247 raft_consensus.cc:1275] T 33c314b036134d929890c744d68bc0cc P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:59:20.323246 19644 consensus_queue.cc:1048] T 33c314b036134d929890c744d68bc0cc P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:59:20.346354 18096 raft_consensus.cc:2955] T e25fd146cb564be69022d0f53010bbfa P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:20.337002 17999 catalog_manager.cc:5649] T e25fd146cb564be69022d0f53010bbfa P d1a8f61d3323447282ee6068aa623216 reported cstate change: config changed from index 3 to 4, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:20.382261 19715 ts_tablet_manager.cc:1929] T 94cd6588f7824a30ba02f891ae089671 P 10dfae53d0c941f08bded43539841761: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20251023 07:59:20.382853 19715 log.cc:1199] T 94cd6588f7824a30ba02f891ae089671 P 10dfae53d0c941f08bded43539841761: Deleting WAL directory at /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1761206251627710-16888-0/minicluster-data/ts-1-root/wals/94cd6588f7824a30ba02f891ae089671
I20251023 07:59:20.384058 19715 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33428 (request call id 980) took 1120 ms. Trace:
I20251023 07:59:20.384577 19715 rpcz_store.cc:276] 1023 07:59:19.263958 (+ 0us) service_pool.cc:168] Inserting onto call queue
1023 07:59:19.264087 (+ 129us) service_pool.cc:225] Handling call
1023 07:59:19.315334 (+ 51247us) ts_tablet_manager.cc:1151] Deleting tablet 94cd6588f7824a30ba02f891ae089671
1023 07:59:19.315400 (+ 66us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1023 07:59:20.090907 (+775507us) spinlock_profiling.cc:243] Waited 22 ms on lock 0x7b240001f388. stack: 00007f69de64f463 00007f69de64f360 00007f69ddfa2574 00007f69e7c4bb14 00007f69e7c4baa9 00007f69de4c1dc1 00007f69de4d639e 00007f69de4d4195 00007f69de561ad8 00007f69de561d1d 00007f69de561360 00007f69e7c223b5 00007f69e7c22359 00007f69e7c5ac38 00007f69e12f586a 00007f69e12f582e
1023 07:59:20.261198 (+170291us) tablet_metadata.cc:641] Metadata flushed
1023 07:59:20.374895 (+113697us) tablet_metadata.cc:641] Metadata flushed
1023 07:59:20.383981 (+ 9086us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":181336,"spinlock_wait_cycles":50646912,"tablet-delete.queue_time_us":50555,"thread_start_us":52678,"threads_started":1}
I20251023 07:59:20.394862 17985 catalog_manager.cc:4985] TS 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): tablet 94cd6588f7824a30ba02f891ae089671 (table test-workload [id=8bb191a5531a4d4fb58a25b13d592213]) successfully deleted
I20251023 07:59:20.401476 19761 raft_consensus.cc:2955] T 33c314b036134d929890c744d68bc0cc P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:20.403419 18094 raft_consensus.cc:2955] T 33c314b036134d929890c744d68bc0cc P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:20.407483 18247 raft_consensus.cc:2955] T 33c314b036134d929890c744d68bc0cc P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:20.426762 19765 raft_consensus.cc:993] T a83dfc7a7d784b52b9c74bbc451ad603 P b3a1328f9c8c484fab08292ce2171ec9: : Instructing follower 982df35c5b554a8fa64807352c4f34ee to start an election
I20251023 07:59:20.427289 19765 raft_consensus.cc:1081] T a83dfc7a7d784b52b9c74bbc451ad603 P b3a1328f9c8c484fab08292ce2171ec9 [term 3 LEADER]: Signalling peer 982df35c5b554a8fa64807352c4f34ee to start an election
I20251023 07:59:20.429337 18247 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "a83dfc7a7d784b52b9c74bbc451ad603"
dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
from {username='slave'} at 127.0.0.1:49420
I20251023 07:59:20.430023 18247 raft_consensus.cc:493] T a83dfc7a7d784b52b9c74bbc451ad603 P 982df35c5b554a8fa64807352c4f34ee [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:59:20.430449 18247 raft_consensus.cc:3060] T a83dfc7a7d784b52b9c74bbc451ad603 P 982df35c5b554a8fa64807352c4f34ee [term 3 FOLLOWER]: Advancing to term 4
I20251023 07:59:20.434149 18163 tablet_service.cc:1552] Processing DeleteTablet for tablet 01f269ca63a8498498956fb3577f35d3 with delete_type TABLET_DATA_TOMBSTONED (TS 10dfae53d0c941f08bded43539841761 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33428
I20251023 07:59:20.435180 19715 tablet_replica.cc:333] T 01f269ca63a8498498956fb3577f35d3 P 10dfae53d0c941f08bded43539841761: stopping tablet replica
I20251023 07:59:20.436249 19715 raft_consensus.cc:2243] T 01f269ca63a8498498956fb3577f35d3 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:20.439239 18247 raft_consensus.cc:515] T a83dfc7a7d784b52b9c74bbc451ad603 P 982df35c5b554a8fa64807352c4f34ee [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:59:20.441797 18096 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a83dfc7a7d784b52b9c74bbc451ad603" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
I20251023 07:59:20.442180 18174 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a83dfc7a7d784b52b9c74bbc451ad603" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "10dfae53d0c941f08bded43539841761"
I20251023 07:59:20.442358 18096 raft_consensus.cc:3055] T a83dfc7a7d784b52b9c74bbc451ad603 P b3a1328f9c8c484fab08292ce2171ec9 [term 3 LEADER]: Stepping down as leader of term 3
I20251023 07:59:20.442673 18096 raft_consensus.cc:740] T a83dfc7a7d784b52b9c74bbc451ad603 P b3a1328f9c8c484fab08292ce2171ec9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b3a1328f9c8c484fab08292ce2171ec9, State: Running, Role: LEADER
I20251023 07:59:20.442704 18174 raft_consensus.cc:3060] T a83dfc7a7d784b52b9c74bbc451ad603 P 10dfae53d0c941f08bded43539841761 [term 3 FOLLOWER]: Advancing to term 4
I20251023 07:59:20.443478 18096 consensus_queue.cc:260] T a83dfc7a7d784b52b9c74bbc451ad603 P b3a1328f9c8c484fab08292ce2171ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:59:20.444499 18096 raft_consensus.cc:3060] T a83dfc7a7d784b52b9c74bbc451ad603 P b3a1328f9c8c484fab08292ce2171ec9 [term 3 FOLLOWER]: Advancing to term 4
I20251023 07:59:20.441462 18247 leader_election.cc:290] T a83dfc7a7d784b52b9c74bbc451ad603 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 4 election: Requested vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:59:20.468047 19715 raft_consensus.cc:2272] T 01f269ca63a8498498956fb3577f35d3 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:20.471405 19715 ts_tablet_manager.cc:1916] T 01f269ca63a8498498956fb3577f35d3 P 10dfae53d0c941f08bded43539841761: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251023 07:59:20.478818 18170 consensus_queue.cc:237] T e25fd146cb564be69022d0f53010bbfa P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:20.479349 18789 raft_consensus.cc:2955] T 33c314b036134d929890c744d68bc0cc P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:20.487569 18096 raft_consensus.cc:2468] T a83dfc7a7d784b52b9c74bbc451ad603 P b3a1328f9c8c484fab08292ce2171ec9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 4.
I20251023 07:59:20.487442 18174 raft_consensus.cc:2468] T a83dfc7a7d784b52b9c74bbc451ad603 P 10dfae53d0c941f08bded43539841761 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 982df35c5b554a8fa64807352c4f34ee in term 4.
I20251023 07:59:20.488886 18217 leader_election.cc:304] T a83dfc7a7d784b52b9c74bbc451ad603 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9; no voters:
I20251023 07:59:20.497972 19757 raft_consensus.cc:2804] T a83dfc7a7d784b52b9c74bbc451ad603 P 982df35c5b554a8fa64807352c4f34ee [term 4 FOLLOWER]: Leader election won for term 4
I20251023 07:59:20.498502 19757 raft_consensus.cc:697] T a83dfc7a7d784b52b9c74bbc451ad603 P 982df35c5b554a8fa64807352c4f34ee [term 4 LEADER]: Becoming Leader. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Running, Role: LEADER
I20251023 07:59:20.522097 18000 catalog_manager.cc:5649] T 33c314b036134d929890c744d68bc0cc P b3a1328f9c8c484fab08292ce2171ec9 reported cstate change: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:20.571167 18096 raft_consensus.cc:1275] T e25fd146cb564be69022d0f53010bbfa P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20251023 07:59:20.573257 19644 consensus_queue.cc:1048] T e25fd146cb564be69022d0f53010bbfa P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20251023 07:59:20.499303 19757 consensus_queue.cc:237] T a83dfc7a7d784b52b9c74bbc451ad603 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } }
I20251023 07:59:20.723865 18787 raft_consensus.cc:1275] T e25fd146cb564be69022d0f53010bbfa P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20251023 07:59:20.761999 19675 consensus_queue.cc:1048] T e25fd146cb564be69022d0f53010bbfa P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20251023 07:59:20.878793 19675 raft_consensus.cc:2955] T e25fd146cb564be69022d0f53010bbfa P 10dfae53d0c941f08bded43539841761 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 982df35c5b554a8fa64807352c4f34ee (127.16.126.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
W20251023 07:59:20.888175 18215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.126.2:45799, user_credentials={real_user=slave}} blocked reactor thread for 398483us
I20251023 07:59:20.892267 18787 raft_consensus.cc:2955] T e25fd146cb564be69022d0f53010bbfa P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 982df35c5b554a8fa64807352c4f34ee (127.16.126.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:20.908033 18174 consensus_queue.cc:237] T 33c314b036134d929890c744d68bc0cc P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:20.924530 18789 raft_consensus.cc:1275] T 33c314b036134d929890c744d68bc0cc P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20251023 07:59:20.934474 18755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.1:44025, user_credentials={real_user=slave}} blocked reactor thread for 203745us
W20251023 07:59:20.935585 18067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.4:33293, user_credentials={real_user=slave}} blocked reactor thread for 209322us
I20251023 07:59:20.934883 19745 consensus_queue.cc:1048] T 33c314b036134d929890c744d68bc0cc P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20251023 07:59:20.938884 18066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.2:45799, user_credentials={real_user=slave}} blocked reactor thread for 205841us
W20251023 07:59:20.939725 18753 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.2:45799, user_credentials={real_user=slave}} blocked reactor thread for 196572us
I20251023 07:59:20.941924 18247 raft_consensus.cc:1275] T 33c314b036134d929890c744d68bc0cc P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251023 07:59:20.977110 19644 raft_consensus.cc:2955] T 33c314b036134d929890c744d68bc0cc P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:20.978717 18784 raft_consensus.cc:2955] T 33c314b036134d929890c744d68bc0cc P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:20.990269 18096 raft_consensus.cc:2955] T e25fd146cb564be69022d0f53010bbfa P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 982df35c5b554a8fa64807352c4f34ee (127.16.126.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:20.998104 19715 ts_tablet_manager.cc:1929] T 01f269ca63a8498498956fb3577f35d3 P 10dfae53d0c941f08bded43539841761: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20251023 07:59:20.998600 19715 log.cc:1199] T 01f269ca63a8498498956fb3577f35d3 P 10dfae53d0c941f08bded43539841761: Deleting WAL directory at /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1761206251627710-16888-0/minicluster-data/ts-1-root/wals/01f269ca63a8498498956fb3577f35d3
I20251023 07:59:21.004292 17985 catalog_manager.cc:5162] ChangeConfig:REMOVE_PEER RPC for tablet e25fd146cb564be69022d0f53010bbfa with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251023 07:59:21.010888 17997 catalog_manager.cc:5649] T e25fd146cb564be69022d0f53010bbfa P 10dfae53d0c941f08bded43539841761 reported cstate change: config changed from index 4 to 5, VOTER 982df35c5b554a8fa64807352c4f34ee (127.16.126.3) evicted. New cstate: current_term: 2 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251023 07:59:21.037953 17985 catalog_manager.cc:4985] TS 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): tablet 01f269ca63a8498498956fb3577f35d3 (table test-workload [id=8bb191a5531a4d4fb58a25b13d592213]) successfully deleted
I20251023 07:59:21.041886 17985 catalog_manager.cc:5162] ChangeConfig:REMOVE_PEER RPC for tablet 33c314b036134d929890c744d68bc0cc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251023 07:59:21.047255 19675 consensus_queue.cc:1048] T 33c314b036134d929890c744d68bc0cc P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20251023 07:59:21.047897 18066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.2:45799, user_credentials={real_user=slave}} blocked reactor thread for 72244.9us
W20251023 07:59:21.072201 18217 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.1:44025, user_credentials={real_user=slave}} blocked reactor thread for 127955us
W20251023 07:59:21.077713 18067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.3:46061, user_credentials={real_user=slave}} blocked reactor thread for 56290.3us
I20251023 07:59:21.090654 17998 catalog_manager.cc:5649] T 33c314b036134d929890c744d68bc0cc P 10dfae53d0c941f08bded43539841761 reported cstate change: config changed from index 3 to 4, VOTER b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1) evicted. New cstate: current_term: 1 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251023 07:59:21.096684 18247 raft_consensus.cc:2955] T 33c314b036134d929890c744d68bc0cc P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
W20251023 07:59:21.103164 18753 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.16.126.62:34671, user_credentials={real_user=slave}} blocked reactor thread for 46201.9us
I20251023 07:59:21.099756 17999 catalog_manager.cc:5649] T a83dfc7a7d784b52b9c74bbc451ad603 P 982df35c5b554a8fa64807352c4f34ee reported cstate change: term changed from 3 to 4, leader changed from b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1) to 982df35c5b554a8fa64807352c4f34ee (127.16.126.3). New cstate: current_term: 4 leader_uuid: "982df35c5b554a8fa64807352c4f34ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: HEALTHY } } }
I20251023 07:59:21.101069 18237 tablet_service.cc:1552] Processing DeleteTablet for tablet e25fd146cb564be69022d0f53010bbfa with delete_type TABLET_DATA_TOMBSTONED (TS 982df35c5b554a8fa64807352c4f34ee not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:49846
I20251023 07:59:21.112200 18086 tablet_service.cc:1552] Processing DeleteTablet for tablet 33c314b036134d929890c744d68bc0cc with delete_type TABLET_DATA_TOMBSTONED (TS b3a1328f9c8c484fab08292ce2171ec9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53940
I20251023 07:59:21.141065 19795 tablet_replica.cc:333] T e25fd146cb564be69022d0f53010bbfa P 982df35c5b554a8fa64807352c4f34ee: stopping tablet replica
I20251023 07:59:21.146657 19795 raft_consensus.cc:2243] T e25fd146cb564be69022d0f53010bbfa P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:21.147364 19795 raft_consensus.cc:2272] T e25fd146cb564be69022d0f53010bbfa P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:21.154663 19795 ts_tablet_manager.cc:1916] T e25fd146cb564be69022d0f53010bbfa P 982df35c5b554a8fa64807352c4f34ee: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251023 07:59:21.155952 19796 tablet_replica.cc:333] T 33c314b036134d929890c744d68bc0cc P b3a1328f9c8c484fab08292ce2171ec9: stopping tablet replica
I20251023 07:59:21.157847 19796 raft_consensus.cc:2243] T 33c314b036134d929890c744d68bc0cc P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:21.158576 19796 raft_consensus.cc:2272] T 33c314b036134d929890c744d68bc0cc P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:21.170650 19796 ts_tablet_manager.cc:1916] T 33c314b036134d929890c744d68bc0cc P b3a1328f9c8c484fab08292ce2171ec9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251023 07:59:21.176013 18101 raft_consensus.cc:1275] T a83dfc7a7d784b52b9c74bbc451ad603 P b3a1328f9c8c484fab08292ce2171ec9 [term 4 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20251023 07:59:21.176222 19795 ts_tablet_manager.cc:1929] T e25fd146cb564be69022d0f53010bbfa P 982df35c5b554a8fa64807352c4f34ee: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20251023 07:59:21.176602 19795 log.cc:1199] T e25fd146cb564be69022d0f53010bbfa P 982df35c5b554a8fa64807352c4f34ee: Deleting WAL directory at /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1761206251627710-16888-0/minicluster-data/ts-2-root/wals/e25fd146cb564be69022d0f53010bbfa
I20251023 07:59:21.177592 19738 consensus_queue.cc:1048] T a83dfc7a7d784b52b9c74bbc451ad603 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:59:21.179136 17986 catalog_manager.cc:4985] TS 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): tablet e25fd146cb564be69022d0f53010bbfa (table test-workload [id=8bb191a5531a4d4fb58a25b13d592213]) successfully deleted
I20251023 07:59:21.190358 19796 ts_tablet_manager.cc:1929] T 33c314b036134d929890c744d68bc0cc P b3a1328f9c8c484fab08292ce2171ec9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20251023 07:59:21.190835 19796 log.cc:1199] T 33c314b036134d929890c744d68bc0cc P b3a1328f9c8c484fab08292ce2171ec9: Deleting WAL directory at /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1761206251627710-16888-0/minicluster-data/ts-0-root/wals/33c314b036134d929890c744d68bc0cc
I20251023 07:59:21.192870 17987 catalog_manager.cc:4985] TS b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): tablet 33c314b036134d929890c744d68bc0cc (table test-workload [id=8bb191a5531a4d4fb58a25b13d592213]) successfully deleted
I20251023 07:59:21.203002 18174 raft_consensus.cc:1275] T a83dfc7a7d784b52b9c74bbc451ad603 P 10dfae53d0c941f08bded43539841761 [term 4 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20251023 07:59:21.204939 19739 consensus_queue.cc:1048] T a83dfc7a7d784b52b9c74bbc451ad603 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:59:21.361171 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:59:21.433241 18247 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "d3b72ceda32a4ebc8de6e7a7992498aa"
dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
mode: GRACEFUL
new_leader_uuid: "d1a8f61d3323447282ee6068aa623216"
from {username='slave'} at 127.0.0.1:60948
I20251023 07:59:21.433949 18247 raft_consensus.cc:606] T d3b72ceda32a4ebc8de6e7a7992498aa P 982df35c5b554a8fa64807352c4f34ee [term 4 LEADER]: Received request to transfer leadership to TS d1a8f61d3323447282ee6068aa623216
I20251023 07:59:21.435750 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 1
I20251023 07:59:21.437551 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 07:59:21.438280 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:59:21.486364 19782 raft_consensus.cc:993] T d3b72ceda32a4ebc8de6e7a7992498aa P 982df35c5b554a8fa64807352c4f34ee: : Instructing follower d1a8f61d3323447282ee6068aa623216 to start an election
I20251023 07:59:21.487105 19739 raft_consensus.cc:1081] T d3b72ceda32a4ebc8de6e7a7992498aa P 982df35c5b554a8fa64807352c4f34ee [term 4 LEADER]: Signalling peer d1a8f61d3323447282ee6068aa623216 to start an election
I20251023 07:59:21.488754 18789 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "d3b72ceda32a4ebc8de6e7a7992498aa"
dest_uuid: "d1a8f61d3323447282ee6068aa623216"
from {username='slave'} at 127.0.0.1:36478
I20251023 07:59:21.490118 18789 raft_consensus.cc:493] T d3b72ceda32a4ebc8de6e7a7992498aa P d1a8f61d3323447282ee6068aa623216 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:59:21.490554 18789 raft_consensus.cc:3060] T d3b72ceda32a4ebc8de6e7a7992498aa P d1a8f61d3323447282ee6068aa623216 [term 4 FOLLOWER]: Advancing to term 5
I20251023 07:59:21.501327 18789 raft_consensus.cc:515] T d3b72ceda32a4ebc8de6e7a7992498aa P d1a8f61d3323447282ee6068aa623216 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:21.504504 18096 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d3b72ceda32a4ebc8de6e7a7992498aa" candidate_uuid: "d1a8f61d3323447282ee6068aa623216" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: true dest_uuid: "b3a1328f9c8c484fab08292ce2171ec9"
I20251023 07:59:21.504680 18789 leader_election.cc:290] T d3b72ceda32a4ebc8de6e7a7992498aa P d1a8f61d3323447282ee6068aa623216 [CANDIDATE]: Term 5 election: Requested vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:59:21.505149 18096 raft_consensus.cc:3060] T d3b72ceda32a4ebc8de6e7a7992498aa P b3a1328f9c8c484fab08292ce2171ec9 [term 4 FOLLOWER]: Advancing to term 5
I20251023 07:59:21.506584 18247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d3b72ceda32a4ebc8de6e7a7992498aa" candidate_uuid: "d1a8f61d3323447282ee6068aa623216" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: true dest_uuid: "982df35c5b554a8fa64807352c4f34ee"
I20251023 07:59:21.507174 18247 raft_consensus.cc:3055] T d3b72ceda32a4ebc8de6e7a7992498aa P 982df35c5b554a8fa64807352c4f34ee [term 4 LEADER]: Stepping down as leader of term 4
I20251023 07:59:21.507436 18247 raft_consensus.cc:740] T d3b72ceda32a4ebc8de6e7a7992498aa P 982df35c5b554a8fa64807352c4f34ee [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 982df35c5b554a8fa64807352c4f34ee, State: Running, Role: LEADER
I20251023 07:59:21.508123 18247 consensus_queue.cc:260] T d3b72ceda32a4ebc8de6e7a7992498aa P 982df35c5b554a8fa64807352c4f34ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:21.509388 18247 raft_consensus.cc:3060] T d3b72ceda32a4ebc8de6e7a7992498aa P 982df35c5b554a8fa64807352c4f34ee [term 4 FOLLOWER]: Advancing to term 5
I20251023 07:59:21.512138 18096 raft_consensus.cc:2468] T d3b72ceda32a4ebc8de6e7a7992498aa P b3a1328f9c8c484fab08292ce2171ec9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1a8f61d3323447282ee6068aa623216 in term 5.
I20251023 07:59:21.513347 18755 leader_election.cc:304] T d3b72ceda32a4ebc8de6e7a7992498aa P d1a8f61d3323447282ee6068aa623216 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3a1328f9c8c484fab08292ce2171ec9, d1a8f61d3323447282ee6068aa623216; no voters:
I20251023 07:59:21.514127 19650 raft_consensus.cc:2804] T d3b72ceda32a4ebc8de6e7a7992498aa P d1a8f61d3323447282ee6068aa623216 [term 5 FOLLOWER]: Leader election won for term 5
I20251023 07:59:21.514564 19650 raft_consensus.cc:697] T d3b72ceda32a4ebc8de6e7a7992498aa P d1a8f61d3323447282ee6068aa623216 [term 5 LEADER]: Becoming Leader. State: Replica: d1a8f61d3323447282ee6068aa623216, State: Running, Role: LEADER
I20251023 07:59:21.515878 19650 consensus_queue.cc:237] T d3b72ceda32a4ebc8de6e7a7992498aa P d1a8f61d3323447282ee6068aa623216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:21.517935 18247 raft_consensus.cc:2468] T d3b72ceda32a4ebc8de6e7a7992498aa P 982df35c5b554a8fa64807352c4f34ee [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1a8f61d3323447282ee6068aa623216 in term 5.
I20251023 07:59:21.530298 17997 catalog_manager.cc:5649] T d3b72ceda32a4ebc8de6e7a7992498aa P d1a8f61d3323447282ee6068aa623216 reported cstate change: term changed from 4 to 5, leader changed from 982df35c5b554a8fa64807352c4f34ee (127.16.126.3) to d1a8f61d3323447282ee6068aa623216 (127.16.126.4). New cstate: current_term: 5 leader_uuid: "d1a8f61d3323447282ee6068aa623216" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251023 07:59:22.028075 18101 raft_consensus.cc:1275] T d3b72ceda32a4ebc8de6e7a7992498aa P b3a1328f9c8c484fab08292ce2171ec9 [term 5 FOLLOWER]: Refusing update from remote peer d1a8f61d3323447282ee6068aa623216: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20251023 07:59:22.029284 19650 consensus_queue.cc:1048] T d3b72ceda32a4ebc8de6e7a7992498aa P d1a8f61d3323447282ee6068aa623216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20251023 07:59:22.081156 18247 raft_consensus.cc:1275] T d3b72ceda32a4ebc8de6e7a7992498aa P 982df35c5b554a8fa64807352c4f34ee [term 5 FOLLOWER]: Refusing update from remote peer d1a8f61d3323447282ee6068aa623216: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20251023 07:59:22.083577 19769 consensus_queue.cc:1048] T d3b72ceda32a4ebc8de6e7a7992498aa P d1a8f61d3323447282ee6068aa623216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20251023 07:59:22.178901 18247 consensus_queue.cc:237] T eb40d8c2f73d48868bfc3ef3889bea45 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:59:22.188217 18174 raft_consensus.cc:1275] T eb40d8c2f73d48868bfc3ef3889bea45 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20251023 07:59:22.188586 18216 consensus_peers.cc:597] T eb40d8c2f73d48868bfc3ef3889bea45 P 982df35c5b554a8fa64807352c4f34ee -> Peer d1a8f61d3323447282ee6068aa623216 (127.16.126.4:33293): Couldn't send request to peer d1a8f61d3323447282ee6068aa623216. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: eb40d8c2f73d48868bfc3ef3889bea45. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:22.189580 19738 consensus_queue.cc:1048] T eb40d8c2f73d48868bfc3ef3889bea45 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:22.189980 18101 raft_consensus.cc:1275] T eb40d8c2f73d48868bfc3ef3889bea45 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251023 07:59:22.191252 19738 consensus_queue.cc:1048] T eb40d8c2f73d48868bfc3ef3889bea45 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:22.202720 19782 raft_consensus.cc:2955] T eb40d8c2f73d48868bfc3ef3889bea45 P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:22.204401 18101 raft_consensus.cc:2955] T eb40d8c2f73d48868bfc3ef3889bea45 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:22.216797 18174 raft_consensus.cc:2955] T eb40d8c2f73d48868bfc3ef3889bea45 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:22.224119 17998 catalog_manager.cc:5649] T eb40d8c2f73d48868bfc3ef3889bea45 P 982df35c5b554a8fa64807352c4f34ee reported cstate change: config changed from index -1 to 2, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New cstate: current_term: 1 leader_uuid: "982df35c5b554a8fa64807352c4f34ee" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:22.227169 18093 consensus_queue.cc:237] T 25d22e66fcd6444a9b9c469acd781e59 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
W20251023 07:59:22.257716 18067 consensus_peers.cc:597] T 25d22e66fcd6444a9b9c469acd781e59 P b3a1328f9c8c484fab08292ce2171ec9 -> Peer d1a8f61d3323447282ee6068aa623216 (127.16.126.4:33293): Couldn't send request to peer d1a8f61d3323447282ee6068aa623216. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 25d22e66fcd6444a9b9c469acd781e59. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:22.258329 18174 raft_consensus.cc:1275] T 25d22e66fcd6444a9b9c469acd781e59 P 10dfae53d0c941f08bded43539841761 [term 3 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20251023 07:59:22.259593 18247 raft_consensus.cc:1275] T 25d22e66fcd6444a9b9c469acd781e59 P 982df35c5b554a8fa64807352c4f34ee [term 3 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20251023 07:59:22.259894 19793 consensus_queue.cc:1048] T 25d22e66fcd6444a9b9c469acd781e59 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:59:22.261482 19803 consensus_queue.cc:1048] T 25d22e66fcd6444a9b9c469acd781e59 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20251023 07:59:22.273515 19794 raft_consensus.cc:2955] T 25d22e66fcd6444a9b9c469acd781e59 P b3a1328f9c8c484fab08292ce2171ec9 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:22.282071 18247 raft_consensus.cc:2955] T 25d22e66fcd6444a9b9c469acd781e59 P 982df35c5b554a8fa64807352c4f34ee [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:22.283457 18171 raft_consensus.cc:2955] T 25d22e66fcd6444a9b9c469acd781e59 P 10dfae53d0c941f08bded43539841761 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:22.306762 18093 consensus_queue.cc:237] T 1178e2ed919b40f29672fc6233b71cf3 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:59:22.315316 17999 catalog_manager.cc:5649] T 25d22e66fcd6444a9b9c469acd781e59 P b3a1328f9c8c484fab08292ce2171ec9 reported cstate change: config changed from index -1 to 4, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New cstate: current_term: 3 leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20251023 07:59:22.326309 18067 consensus_peers.cc:597] T 1178e2ed919b40f29672fc6233b71cf3 P b3a1328f9c8c484fab08292ce2171ec9 -> Peer d1a8f61d3323447282ee6068aa623216 (127.16.126.4:33293): Couldn't send request to peer d1a8f61d3323447282ee6068aa623216. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1178e2ed919b40f29672fc6233b71cf3. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:22.328064 18251 raft_consensus.cc:1275] T 1178e2ed919b40f29672fc6233b71cf3 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20251023 07:59:22.329555 19794 consensus_queue.cc:1048] T 1178e2ed919b40f29672fc6233b71cf3 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:59:22.328682 18171 raft_consensus.cc:1275] T 1178e2ed919b40f29672fc6233b71cf3 P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Refusing update from remote peer b3a1328f9c8c484fab08292ce2171ec9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20251023 07:59:22.335713 19803 consensus_queue.cc:1048] T 1178e2ed919b40f29672fc6233b71cf3 P b3a1328f9c8c484fab08292ce2171ec9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:59:22.371711 19793 raft_consensus.cc:2955] T 1178e2ed919b40f29672fc6233b71cf3 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:22.375638 18251 raft_consensus.cc:2955] T 1178e2ed919b40f29672fc6233b71cf3 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:22.400556 18171 raft_consensus.cc:2955] T 1178e2ed919b40f29672fc6233b71cf3 P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:22.411585 17997 catalog_manager.cc:5649] T 1178e2ed919b40f29672fc6233b71cf3 P 982df35c5b554a8fa64807352c4f34ee reported cstate change: config changed from index -1 to 3, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New cstate: current_term: 2 leader_uuid: "b3a1328f9c8c484fab08292ce2171ec9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:22.443590 18171 consensus_queue.cc:237] T b19b550093fb4ab181e62957d89460e7 P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:59:22.456892 18251 raft_consensus.cc:1275] T b19b550093fb4ab181e62957d89460e7 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20251023 07:59:22.457829 18101 raft_consensus.cc:1275] T b19b550093fb4ab181e62957d89460e7 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20251023 07:59:22.459322 19730 consensus_queue.cc:1048] T b19b550093fb4ab181e62957d89460e7 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20251023 07:59:22.460426 18142 consensus_peers.cc:597] T b19b550093fb4ab181e62957d89460e7 P 10dfae53d0c941f08bded43539841761 -> Peer d1a8f61d3323447282ee6068aa623216 (127.16.126.4:33293): Couldn't send request to peer d1a8f61d3323447282ee6068aa623216. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b19b550093fb4ab181e62957d89460e7. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:22.461463 19730 consensus_queue.cc:1048] T b19b550093fb4ab181e62957d89460e7 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:59:22.479458 19675 raft_consensus.cc:2955] T b19b550093fb4ab181e62957d89460e7 P 10dfae53d0c941f08bded43539841761 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:22.481215 18101 raft_consensus.cc:2955] T b19b550093fb4ab181e62957d89460e7 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:22.482945 18247 raft_consensus.cc:2955] T b19b550093fb4ab181e62957d89460e7 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:22.491686 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:59:22.504643 17997 catalog_manager.cc:5649] T b19b550093fb4ab181e62957d89460e7 P b3a1328f9c8c484fab08292ce2171ec9 reported cstate change: config changed from index -1 to 3, NON_VOTER d1a8f61d3323447282ee6068aa623216 (127.16.126.4) added. New cstate: current_term: 2 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } } }
I20251023 07:59:22.658604 19827 ts_tablet_manager.cc:933] T 25d22e66fcd6444a9b9c469acd781e59 P d1a8f61d3323447282ee6068aa623216: Initiating tablet copy from peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025)
I20251023 07:59:22.758101 19827 tablet_copy_client.cc:323] T 25d22e66fcd6444a9b9c469acd781e59 P d1a8f61d3323447282ee6068aa623216: tablet copy: Beginning tablet copy session from remote peer at address 127.16.126.1:44025
I20251023 07:59:22.760717 18111 tablet_copy_service.cc:140] P b3a1328f9c8c484fab08292ce2171ec9: Received BeginTabletCopySession request for tablet 25d22e66fcd6444a9b9c469acd781e59 from peer d1a8f61d3323447282ee6068aa623216 ({username='slave'} at 127.0.0.1:57714)
I20251023 07:59:22.761541 18111 tablet_copy_service.cc:161] P b3a1328f9c8c484fab08292ce2171ec9: Beginning new tablet copy session on tablet 25d22e66fcd6444a9b9c469acd781e59 from peer d1a8f61d3323447282ee6068aa623216 at {username='slave'} at 127.0.0.1:57714: session id = d1a8f61d3323447282ee6068aa623216-25d22e66fcd6444a9b9c469acd781e59
I20251023 07:59:22.784503 18111 tablet_copy_source_session.cc:215] T 25d22e66fcd6444a9b9c469acd781e59 P b3a1328f9c8c484fab08292ce2171ec9: Tablet Copy: opened 0 blocks and 1 log segments
I20251023 07:59:22.798072 19827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25d22e66fcd6444a9b9c469acd781e59. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:22.825345 19830 ts_tablet_manager.cc:933] T eb40d8c2f73d48868bfc3ef3889bea45 P d1a8f61d3323447282ee6068aa623216: Initiating tablet copy from peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:59:22.826318 19827 tablet_copy_client.cc:806] T 25d22e66fcd6444a9b9c469acd781e59 P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 0 data blocks...
I20251023 07:59:22.827032 19827 tablet_copy_client.cc:670] T 25d22e66fcd6444a9b9c469acd781e59 P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 1 WAL segments...
I20251023 07:59:22.833914 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251023 07:59:22.836882 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 07:59:22.837277 19827 tablet_copy_client.cc:538] T 25d22e66fcd6444a9b9c469acd781e59 P d1a8f61d3323447282ee6068aa623216: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251023 07:59:22.838244 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:59:22.847981 19830 tablet_copy_client.cc:323] T eb40d8c2f73d48868bfc3ef3889bea45 P d1a8f61d3323447282ee6068aa623216: tablet copy: Beginning tablet copy session from remote peer at address 127.16.126.3:46061
I20251023 07:59:22.851085 18261 tablet_copy_service.cc:140] P 982df35c5b554a8fa64807352c4f34ee: Received BeginTabletCopySession request for tablet eb40d8c2f73d48868bfc3ef3889bea45 from peer d1a8f61d3323447282ee6068aa623216 ({username='slave'} at 127.0.0.1:40260)
I20251023 07:59:22.851722 18261 tablet_copy_service.cc:161] P 982df35c5b554a8fa64807352c4f34ee: Beginning new tablet copy session on tablet eb40d8c2f73d48868bfc3ef3889bea45 from peer d1a8f61d3323447282ee6068aa623216 at {username='slave'} at 127.0.0.1:40260: session id = d1a8f61d3323447282ee6068aa623216-eb40d8c2f73d48868bfc3ef3889bea45
I20251023 07:59:22.863670 19827 tablet_bootstrap.cc:492] T 25d22e66fcd6444a9b9c469acd781e59 P d1a8f61d3323447282ee6068aa623216: Bootstrap starting.
I20251023 07:59:22.877578 18261 tablet_copy_source_session.cc:215] T eb40d8c2f73d48868bfc3ef3889bea45 P 982df35c5b554a8fa64807352c4f34ee: Tablet Copy: opened 0 blocks and 1 log segments
I20251023 07:59:22.889928 19830 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb40d8c2f73d48868bfc3ef3889bea45. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:22.910522 19832 ts_tablet_manager.cc:933] T 1178e2ed919b40f29672fc6233b71cf3 P d1a8f61d3323447282ee6068aa623216: Initiating tablet copy from peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025)
I20251023 07:59:22.922691 19832 tablet_copy_client.cc:323] T 1178e2ed919b40f29672fc6233b71cf3 P d1a8f61d3323447282ee6068aa623216: tablet copy: Beginning tablet copy session from remote peer at address 127.16.126.1:44025
I20251023 07:59:22.924358 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:59:22.924499 18111 tablet_copy_service.cc:140] P b3a1328f9c8c484fab08292ce2171ec9: Received BeginTabletCopySession request for tablet 1178e2ed919b40f29672fc6233b71cf3 from peer d1a8f61d3323447282ee6068aa623216 ({username='slave'} at 127.0.0.1:57714)
I20251023 07:59:22.925091 18111 tablet_copy_service.cc:161] P b3a1328f9c8c484fab08292ce2171ec9: Beginning new tablet copy session on tablet 1178e2ed919b40f29672fc6233b71cf3 from peer d1a8f61d3323447282ee6068aa623216 at {username='slave'} at 127.0.0.1:57714: session id = d1a8f61d3323447282ee6068aa623216-1178e2ed919b40f29672fc6233b71cf3
I20251023 07:59:22.951123 19827 tablet_bootstrap.cc:492] T 25d22e66fcd6444a9b9c469acd781e59 P d1a8f61d3323447282ee6068aa623216: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:59:22.948045 18111 tablet_copy_source_session.cc:215] T 1178e2ed919b40f29672fc6233b71cf3 P b3a1328f9c8c484fab08292ce2171ec9: Tablet Copy: opened 0 blocks and 1 log segments
I20251023 07:59:22.966245 19827 tablet_bootstrap.cc:492] T 25d22e66fcd6444a9b9c469acd781e59 P d1a8f61d3323447282ee6068aa623216: Bootstrap complete.
I20251023 07:59:22.955317 19830 tablet_copy_client.cc:806] T eb40d8c2f73d48868bfc3ef3889bea45 P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 0 data blocks...
I20251023 07:59:22.967043 19827 ts_tablet_manager.cc:1403] T 25d22e66fcd6444a9b9c469acd781e59 P d1a8f61d3323447282ee6068aa623216: Time spent bootstrapping tablet: real 0.104s user 0.028s sys 0.002s
I20251023 07:59:22.967092 19830 tablet_copy_client.cc:670] T eb40d8c2f73d48868bfc3ef3889bea45 P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 1 WAL segments...
I20251023 07:59:22.968415 19832 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1178e2ed919b40f29672fc6233b71cf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:23.010761 16888 tablet_server.cc:178] TabletServer@127.16.126.1:0 shutting down...
I20251023 07:59:23.074923 19827 raft_consensus.cc:359] T 25d22e66fcd6444a9b9c469acd781e59 P d1a8f61d3323447282ee6068aa623216 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
W20251023 07:59:23.077870 18755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.1:44025, user_credentials={real_user=slave}} blocked reactor thread for 87672.7us
I20251023 07:59:23.078032 19827 raft_consensus.cc:740] T 25d22e66fcd6444a9b9c469acd781e59 P d1a8f61d3323447282ee6068aa623216 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: d1a8f61d3323447282ee6068aa623216, State: Initialized, Role: LEARNER
W20251023 07:59:23.100263 17987 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 4 similar messages]
I20251023 07:59:23.108757 19827 consensus_queue.cc:260] T 25d22e66fcd6444a9b9c469acd781e59 P d1a8f61d3323447282ee6068aa623216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:59:23.109838 19830 tablet_copy_client.cc:538] T eb40d8c2f73d48868bfc3ef3889bea45 P d1a8f61d3323447282ee6068aa623216: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251023 07:59:23.130089 19830 tablet_bootstrap.cc:492] T eb40d8c2f73d48868bfc3ef3889bea45 P d1a8f61d3323447282ee6068aa623216: Bootstrap starting.
W20251023 07:59:23.131474 18217 consensus_peers.cc:597] T a83dfc7a7d784b52b9c74bbc451ad603 P 982df35c5b554a8fa64807352c4f34ee -> Peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): Couldn't send request to peer b3a1328f9c8c484fab08292ce2171ec9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251023 07:59:23.139654 18048 auto_rebalancer.cc:663] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20251023 07:59:23.142083 18048 auto_rebalancer.cc:264] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251023 07:59:23.142944 19827 ts_tablet_manager.cc:1434] T 25d22e66fcd6444a9b9c469acd781e59 P d1a8f61d3323447282ee6068aa623216: Time spent starting tablet: real 0.169s user 0.004s sys 0.004s
I20251023 07:59:23.161396 19832 tablet_copy_client.cc:806] T 1178e2ed919b40f29672fc6233b71cf3 P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 0 data blocks...
I20251023 07:59:23.164906 16888 tablet_copy_service.cc:362] P b3a1328f9c8c484fab08292ce2171ec9: Destroying tablet copy session d1a8f61d3323447282ee6068aa623216-1178e2ed919b40f29672fc6233b71cf3 due to service shutdown
I20251023 07:59:23.169898 16888 tablet_copy_service.cc:434] P b3a1328f9c8c484fab08292ce2171ec9: ending tablet copy session d1a8f61d3323447282ee6068aa623216-1178e2ed919b40f29672fc6233b71cf3 on tablet 1178e2ed919b40f29672fc6233b71cf3 with peer d1a8f61d3323447282ee6068aa623216
I20251023 07:59:23.176363 16888 tablet_copy_service.cc:362] P b3a1328f9c8c484fab08292ce2171ec9: Destroying tablet copy session d1a8f61d3323447282ee6068aa623216-25d22e66fcd6444a9b9c469acd781e59 due to service shutdown
I20251023 07:59:23.178035 16888 tablet_copy_service.cc:434] P b3a1328f9c8c484fab08292ce2171ec9: ending tablet copy session d1a8f61d3323447282ee6068aa623216-25d22e66fcd6444a9b9c469acd781e59 on tablet 25d22e66fcd6444a9b9c469acd781e59 with peer d1a8f61d3323447282ee6068aa623216
W20251023 07:59:23.174281 18755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.1:44025, user_credentials={real_user=slave}} blocked reactor thread for 49532.5us
W20251023 07:59:23.187410 18755 consensus_peers.cc:597] T 7fe190354178418bae8b7cc5abbb74ef P d1a8f61d3323447282ee6068aa623216 -> Peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): Couldn't send request to peer b3a1328f9c8c484fab08292ce2171ec9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251023 07:59:23.174397 18143 consensus_peers.cc:597] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P 10dfae53d0c941f08bded43539841761 -> Peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): Couldn't send request to peer b3a1328f9c8c484fab08292ce2171ec9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:23.168004 19832 tablet_copy_client.cc:670] T 1178e2ed919b40f29672fc6233b71cf3 P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 1 WAL segments...
W20251023 07:59:23.167917 18048 auto_rebalancer.cc:663] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20251023 07:59:23.190393 18048 auto_rebalancer.cc:264] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251023 07:59:23.194434 19830 tablet_bootstrap.cc:492] T eb40d8c2f73d48868bfc3ef3889bea45 P d1a8f61d3323447282ee6068aa623216: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20251023 07:59:23.195374 18755 consensus_peers.cc:597] T b9841e711f8e4a019c2d0dec5409474c P d1a8f61d3323447282ee6068aa623216 -> Peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): Couldn't send request to peer b3a1328f9c8c484fab08292ce2171ec9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251023 07:59:23.198823 18755 consensus_peers.cc:597] T d3b72ceda32a4ebc8de6e7a7992498aa P d1a8f61d3323447282ee6068aa623216 -> Peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): Couldn't send request to peer b3a1328f9c8c484fab08292ce2171ec9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251023 07:59:23.199517 18755 consensus_peers.cc:597] T a939fd9e853a45d1aa626a4566c14abc P d1a8f61d3323447282ee6068aa623216 -> Peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): Couldn't send request to peer b3a1328f9c8c484fab08292ce2171ec9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:23.201474 19830 tablet_bootstrap.cc:492] T eb40d8c2f73d48868bfc3ef3889bea45 P d1a8f61d3323447282ee6068aa623216: Bootstrap complete.
W20251023 07:59:23.202466 18143 consensus_peers.cc:597] T b19b550093fb4ab181e62957d89460e7 P 10dfae53d0c941f08bded43539841761 -> Peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): Couldn't send request to peer b3a1328f9c8c484fab08292ce2171ec9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:23.206568 18786 raft_consensus.cc:1217] T 25d22e66fcd6444a9b9c469acd781e59 P d1a8f61d3323447282ee6068aa623216 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4] Dedup: 3.4->[]
W20251023 07:59:23.213889 18217 consensus_peers.cc:597] T e85adbfd669946ce9f939c02865fea6a P 982df35c5b554a8fa64807352c4f34ee -> Peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): Couldn't send request to peer b3a1328f9c8c484fab08292ce2171ec9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251023 07:59:23.216780 18217 consensus_peers.cc:597] T 5f7e006a09224285b1e5df5694ff72ae P 982df35c5b554a8fa64807352c4f34ee -> Peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): Couldn't send request to peer b3a1328f9c8c484fab08292ce2171ec9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251023 07:59:23.219231 18143 consensus_peers.cc:597] T 5d4096f60c864412bb51be0c52c22961 P 10dfae53d0c941f08bded43539841761 -> Peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): Couldn't send request to peer b3a1328f9c8c484fab08292ce2171ec9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251023 07:59:23.220947 18143 consensus_peers.cc:597] T 7a0f3569fcc34ba8b721d4ca9f31b6fa P 10dfae53d0c941f08bded43539841761 -> Peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): Couldn't send request to peer b3a1328f9c8c484fab08292ce2171ec9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:23.235729 19830 ts_tablet_manager.cc:1403] T eb40d8c2f73d48868bfc3ef3889bea45 P d1a8f61d3323447282ee6068aa623216: Time spent bootstrapping tablet: real 0.106s user 0.019s sys 0.009s
I20251023 07:59:23.255978 19842 ts_tablet_manager.cc:933] T b19b550093fb4ab181e62957d89460e7 P d1a8f61d3323447282ee6068aa623216: Initiating tablet copy from peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:59:23.264384 19830 raft_consensus.cc:359] T eb40d8c2f73d48868bfc3ef3889bea45 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:59:23.281692 19830 raft_consensus.cc:740] T eb40d8c2f73d48868bfc3ef3889bea45 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d1a8f61d3323447282ee6068aa623216, State: Initialized, Role: LEARNER
I20251023 07:59:23.283900 19830 consensus_queue.cc:260] T eb40d8c2f73d48868bfc3ef3889bea45 P d1a8f61d3323447282ee6068aa623216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:59:23.289569 19830 ts_tablet_manager.cc:1434] T eb40d8c2f73d48868bfc3ef3889bea45 P d1a8f61d3323447282ee6068aa623216: Time spent starting tablet: real 0.053s user 0.005s sys 0.004s
W20251023 07:59:23.298135 18067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.4:33293, user_credentials={real_user=slave}} blocked reactor thread for 43517.6us
W20251023 07:59:23.299525 18217 consensus_peers.cc:597] T 79fcf5e4a38448ba95c62cc1ffe2823a P 982df35c5b554a8fa64807352c4f34ee -> Peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): Couldn't send request to peer b3a1328f9c8c484fab08292ce2171ec9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251023 07:59:23.310698 18143 consensus_peers.cc:597] T c63b5a4dc8eb4b6e918608f281183068 P 10dfae53d0c941f08bded43539841761 -> Peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): Couldn't send request to peer b3a1328f9c8c484fab08292ce2171ec9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:23.323997 18261 tablet_copy_service.cc:342] P 982df35c5b554a8fa64807352c4f34ee: Request end of tablet copy session d1a8f61d3323447282ee6068aa623216-eb40d8c2f73d48868bfc3ef3889bea45 received from {username='slave'} at 127.0.0.1:40260
I20251023 07:59:23.324572 18261 tablet_copy_service.cc:434] P 982df35c5b554a8fa64807352c4f34ee: ending tablet copy session d1a8f61d3323447282ee6068aa623216-eb40d8c2f73d48868bfc3ef3889bea45 on tablet eb40d8c2f73d48868bfc3ef3889bea45 with peer d1a8f61d3323447282ee6068aa623216
I20251023 07:59:23.329706 19842 tablet_copy_client.cc:323] T b19b550093fb4ab181e62957d89460e7 P d1a8f61d3323447282ee6068aa623216: tablet copy: Beginning tablet copy session from remote peer at address 127.16.126.2:45799
I20251023 07:59:23.351858 18186 tablet_copy_service.cc:140] P 10dfae53d0c941f08bded43539841761: Received BeginTabletCopySession request for tablet b19b550093fb4ab181e62957d89460e7 from peer d1a8f61d3323447282ee6068aa623216 ({username='slave'} at 127.0.0.1:50534)
I20251023 07:59:23.352583 18186 tablet_copy_service.cc:161] P 10dfae53d0c941f08bded43539841761: Beginning new tablet copy session on tablet b19b550093fb4ab181e62957d89460e7 from peer d1a8f61d3323447282ee6068aa623216 at {username='slave'} at 127.0.0.1:50534: session id = d1a8f61d3323447282ee6068aa623216-b19b550093fb4ab181e62957d89460e7
W20251023 07:59:23.357637 18755 consensus_peers.cc:597] T 1f184d89e4244f12af7afd690bc7027d P d1a8f61d3323447282ee6068aa623216 -> Peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): Couldn't send request to peer b3a1328f9c8c484fab08292ce2171ec9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251023 07:59:23.358085 18143 consensus_peers.cc:597] T e25fd146cb564be69022d0f53010bbfa P 10dfae53d0c941f08bded43539841761 -> Peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): Couldn't send request to peer b3a1328f9c8c484fab08292ce2171ec9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251023 07:59:23.367228 18217 consensus_peers.cc:597] T eb40d8c2f73d48868bfc3ef3889bea45 P 982df35c5b554a8fa64807352c4f34ee -> Peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): Couldn't send request to peer b3a1328f9c8c484fab08292ce2171ec9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:23.382058 18786 raft_consensus.cc:1217] T eb40d8c2f73d48868bfc3ef3889bea45 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
W20251023 07:59:23.386344 18143 consensus_peers.cc:597] T 231c8691a471417c859146b4e7b4b440 P 10dfae53d0c941f08bded43539841761 -> Peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): Couldn't send request to peer b3a1328f9c8c484fab08292ce2171ec9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251023 07:59:23.395915 18217 consensus_peers.cc:597] T ce0cc368c5054eef9dca968072a2d4fd P 982df35c5b554a8fa64807352c4f34ee -> Peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): Couldn't send request to peer b3a1328f9c8c484fab08292ce2171ec9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251023 07:59:23.399253 18217 consensus_peers.cc:597] T 9bc482083f3b4c9ba97b8769ece194ad P 982df35c5b554a8fa64807352c4f34ee -> Peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): Couldn't send request to peer b3a1328f9c8c484fab08292ce2171ec9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251023 07:59:23.399945 18217 consensus_peers.cc:597] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 982df35c5b554a8fa64807352c4f34ee -> Peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): Couldn't send request to peer b3a1328f9c8c484fab08292ce2171ec9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251023 07:59:23.400694 18143 consensus_peers.cc:597] T 931f55bec99140c69a4b5654b691c861 P 10dfae53d0c941f08bded43539841761 -> Peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): Couldn't send request to peer b3a1328f9c8c484fab08292ce2171ec9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:23.393507 18186 tablet_copy_source_session.cc:215] T b19b550093fb4ab181e62957d89460e7 P 10dfae53d0c941f08bded43539841761: Tablet Copy: opened 0 blocks and 1 log segments
W20251023 07:59:23.409088 18755 consensus_peers.cc:597] T 2d81605b8fe7427b94af7f3c481ed765 P d1a8f61d3323447282ee6068aa623216 -> Peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): Couldn't send request to peer b3a1328f9c8c484fab08292ce2171ec9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:23.410056 19842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b19b550093fb4ab181e62957d89460e7. 1 dirs total, 0 dirs full, 0 dirs failed
W20251023 07:59:23.414299 18143 consensus_peers.cc:597] T 5585a11a884140c7abc7d5a3b6ab86f3 P 10dfae53d0c941f08bded43539841761 -> Peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): Couldn't send request to peer b3a1328f9c8c484fab08292ce2171ec9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251023 07:59:23.433482 18217 consensus_peers.cc:597] T 714c3ef74ecc47419a20ab7e23217e5e P 982df35c5b554a8fa64807352c4f34ee -> Peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): Couldn't send request to peer b3a1328f9c8c484fab08292ce2171ec9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251023 07:59:23.435163 18755 consensus_peers.cc:597] T abefe27ebb4c4179a8620d4e638fe119 P d1a8f61d3323447282ee6068aa623216 -> Peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): Couldn't send request to peer b3a1328f9c8c484fab08292ce2171ec9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:23.436328 16888 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251023 07:59:23.437541 16888 tablet_replica.cc:333] T d3b72ceda32a4ebc8de6e7a7992498aa P b3a1328f9c8c484fab08292ce2171ec9: stopping tablet replica
W20251023 07:59:23.438438 18755 consensus_peers.cc:597] T ce0069d7c0cf4dee84a85731209358f7 P d1a8f61d3323447282ee6068aa623216 -> Peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): Couldn't send request to peer b3a1328f9c8c484fab08292ce2171ec9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:23.438680 16888 raft_consensus.cc:2243] T d3b72ceda32a4ebc8de6e7a7992498aa P b3a1328f9c8c484fab08292ce2171ec9 [term 5 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:23.439669 16888 raft_consensus.cc:2272] T d3b72ceda32a4ebc8de6e7a7992498aa P b3a1328f9c8c484fab08292ce2171ec9 [term 5 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:23.442631 16888 tablet_replica.cc:333] T dad81a56e87946cbb2a7f3e33c2e2bd4 P b3a1328f9c8c484fab08292ce2171ec9: stopping tablet replica
I20251023 07:59:23.443445 16888 raft_consensus.cc:2243] T dad81a56e87946cbb2a7f3e33c2e2bd4 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:23.444552 16888 raft_consensus.cc:2272] T dad81a56e87946cbb2a7f3e33c2e2bd4 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:23.447522 16888 tablet_replica.cc:333] T 9bc482083f3b4c9ba97b8769ece194ad P b3a1328f9c8c484fab08292ce2171ec9: stopping tablet replica
I20251023 07:59:23.448458 16888 raft_consensus.cc:2243] T 9bc482083f3b4c9ba97b8769ece194ad P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:23.449095 16888 raft_consensus.cc:2272] T 9bc482083f3b4c9ba97b8769ece194ad P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:23.451918 16888 tablet_replica.cc:333] T ce0cc368c5054eef9dca968072a2d4fd P b3a1328f9c8c484fab08292ce2171ec9: stopping tablet replica
I20251023 07:59:23.452744 16888 raft_consensus.cc:2243] T ce0cc368c5054eef9dca968072a2d4fd P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:23.453256 16888 raft_consensus.cc:2272] T ce0cc368c5054eef9dca968072a2d4fd P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:23.453627 19842 tablet_copy_client.cc:806] T b19b550093fb4ab181e62957d89460e7 P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 0 data blocks...
I20251023 07:59:23.455145 19842 tablet_copy_client.cc:670] T b19b550093fb4ab181e62957d89460e7 P d1a8f61d3323447282ee6068aa623216: tablet copy: Starting download of 1 WAL segments...
I20251023 07:59:23.455911 16888 tablet_replica.cc:333] T ae4437d151054b59a0e93ca01a9609c7 P b3a1328f9c8c484fab08292ce2171ec9: stopping tablet replica
I20251023 07:59:23.458137 16888 raft_consensus.cc:2243] T ae4437d151054b59a0e93ca01a9609c7 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:23.459465 16888 raft_consensus.cc:2272] T ae4437d151054b59a0e93ca01a9609c7 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:23.459619 19842 tablet_copy_client.cc:538] T b19b550093fb4ab181e62957d89460e7 P d1a8f61d3323447282ee6068aa623216: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251023 07:59:23.462391 16888 tablet_replica.cc:333] T 931f55bec99140c69a4b5654b691c861 P b3a1328f9c8c484fab08292ce2171ec9: stopping tablet replica
I20251023 07:59:23.463253 16888 raft_consensus.cc:2243] T 931f55bec99140c69a4b5654b691c861 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:23.463937 16888 raft_consensus.cc:2272] T 931f55bec99140c69a4b5654b691c861 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:23.466540 16888 tablet_replica.cc:333] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P b3a1328f9c8c484fab08292ce2171ec9: stopping tablet replica
I20251023 07:59:23.467252 16888 raft_consensus.cc:2243] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:23.468304 16888 raft_consensus.cc:2272] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:23.471136 16888 tablet_replica.cc:333] T 94cd6588f7824a30ba02f891ae089671 P b3a1328f9c8c484fab08292ce2171ec9: stopping tablet replica
I20251023 07:59:23.472283 16888 raft_consensus.cc:2243] T 94cd6588f7824a30ba02f891ae089671 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 LEADER]: Raft consensus shutting down.
I20251023 07:59:23.473311 16888 raft_consensus.cc:2272] T 94cd6588f7824a30ba02f891ae089671 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:23.475581 19842 tablet_bootstrap.cc:492] T b19b550093fb4ab181e62957d89460e7 P d1a8f61d3323447282ee6068aa623216: Bootstrap starting.
I20251023 07:59:23.476023 16888 tablet_replica.cc:333] T 7a0f3569fcc34ba8b721d4ca9f31b6fa P b3a1328f9c8c484fab08292ce2171ec9: stopping tablet replica
I20251023 07:59:23.476955 16888 raft_consensus.cc:2243] T 7a0f3569fcc34ba8b721d4ca9f31b6fa P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:23.482913 16888 raft_consensus.cc:2272] T 7a0f3569fcc34ba8b721d4ca9f31b6fa P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20251023 07:59:23.485116 18217 consensus_peers.cc:597] T 744a3368282b44d9b9618922875d20d3 P 982df35c5b554a8fa64807352c4f34ee -> Peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): Couldn't send request to peer b3a1328f9c8c484fab08292ce2171ec9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:23.485947 16888 tablet_replica.cc:333] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P b3a1328f9c8c484fab08292ce2171ec9: stopping tablet replica
I20251023 07:59:23.487332 16888 raft_consensus.cc:2243] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:23.488018 16888 raft_consensus.cc:2272] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:23.491360 16888 tablet_replica.cc:333] T 79fcf5e4a38448ba95c62cc1ffe2823a P b3a1328f9c8c484fab08292ce2171ec9: stopping tablet replica
I20251023 07:59:23.492355 16888 raft_consensus.cc:2243] T 79fcf5e4a38448ba95c62cc1ffe2823a P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:23.494530 16888 raft_consensus.cc:2272] T 79fcf5e4a38448ba95c62cc1ffe2823a P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:23.497376 16888 tablet_replica.cc:333] T e25fd146cb564be69022d0f53010bbfa P b3a1328f9c8c484fab08292ce2171ec9: stopping tablet replica
I20251023 07:59:23.498178 16888 raft_consensus.cc:2243] T e25fd146cb564be69022d0f53010bbfa P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:23.498812 16888 raft_consensus.cc:2272] T e25fd146cb564be69022d0f53010bbfa P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Raft consensus is shut down!
W20251023 07:59:23.504807 18755 consensus_peers.cc:597] T c6022ad5a70c4b4f8f34339956122cb7 P d1a8f61d3323447282ee6068aa623216 -> Peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): Couldn't send request to peer b3a1328f9c8c484fab08292ce2171ec9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:23.507166 16888 tablet_replica.cc:333] T 07b28d84c73d42d583d6f80199700309 P b3a1328f9c8c484fab08292ce2171ec9: stopping tablet replica
I20251023 07:59:23.508011 16888 raft_consensus.cc:2243] T 07b28d84c73d42d583d6f80199700309 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:23.509102 16888 raft_consensus.cc:2272] T 07b28d84c73d42d583d6f80199700309 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20251023 07:59:23.516215 18217 consensus_peers.cc:597] T e4884051da6c4cdc9e0811e70667dd19 P 982df35c5b554a8fa64807352c4f34ee -> Peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): Couldn't send request to peer b3a1328f9c8c484fab08292ce2171ec9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:23.517535 16888 tablet_replica.cc:333] T 714c3ef74ecc47419a20ab7e23217e5e P b3a1328f9c8c484fab08292ce2171ec9: stopping tablet replica
I20251023 07:59:23.520423 16888 raft_consensus.cc:2243] T 714c3ef74ecc47419a20ab7e23217e5e P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:23.521019 16888 raft_consensus.cc:2272] T 714c3ef74ecc47419a20ab7e23217e5e P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:23.523739 16888 tablet_replica.cc:333] T 55de6ceb03f343b09190cb2fb4bbe144 P b3a1328f9c8c484fab08292ce2171ec9: stopping tablet replica
I20251023 07:59:23.524576 16888 raft_consensus.cc:2243] T 55de6ceb03f343b09190cb2fb4bbe144 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:23.527354 16888 raft_consensus.cc:2272] T 55de6ceb03f343b09190cb2fb4bbe144 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:23.530061 16888 tablet_replica.cc:333] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P b3a1328f9c8c484fab08292ce2171ec9: stopping tablet replica
I20251023 07:59:23.530840 16888 raft_consensus.cc:2243] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:23.531833 16888 raft_consensus.cc:2272] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:23.536499 16888 tablet_replica.cc:333] T 1178e2ed919b40f29672fc6233b71cf3 P b3a1328f9c8c484fab08292ce2171ec9: stopping tablet replica
I20251023 07:59:23.537317 16888 raft_consensus.cc:2243] T 1178e2ed919b40f29672fc6233b71cf3 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 LEADER]: Raft consensus shutting down.
I20251023 07:59:23.538751 16888 raft_consensus.cc:2272] T 1178e2ed919b40f29672fc6233b71cf3 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Raft consensus is shut down!
W20251023 07:59:23.550321 18143 consensus_peers.cc:597] T 3d1032da07fd44be9c392e8f4cd2af1f P 10dfae53d0c941f08bded43539841761 -> Peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): Couldn't send request to peer b3a1328f9c8c484fab08292ce2171ec9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:23.557991 16888 tablet_replica.cc:333] T 5f7e006a09224285b1e5df5694ff72ae P b3a1328f9c8c484fab08292ce2171ec9: stopping tablet replica
I20251023 07:59:23.564311 16888 raft_consensus.cc:2243] T 5f7e006a09224285b1e5df5694ff72ae P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:23.565006 16888 raft_consensus.cc:2272] T 5f7e006a09224285b1e5df5694ff72ae P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:23.572171 19842 tablet_bootstrap.cc:492] T b19b550093fb4ab181e62957d89460e7 P d1a8f61d3323447282ee6068aa623216: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:59:23.573388 19842 tablet_bootstrap.cc:492] T b19b550093fb4ab181e62957d89460e7 P d1a8f61d3323447282ee6068aa623216: Bootstrap complete.
I20251023 07:59:23.574187 19842 ts_tablet_manager.cc:1403] T b19b550093fb4ab181e62957d89460e7 P d1a8f61d3323447282ee6068aa623216: Time spent bootstrapping tablet: real 0.099s user 0.042s sys 0.027s
I20251023 07:59:23.575577 16888 tablet_replica.cc:333] T e85adbfd669946ce9f939c02865fea6a P b3a1328f9c8c484fab08292ce2171ec9: stopping tablet replica
I20251023 07:59:23.576507 16888 raft_consensus.cc:2243] T e85adbfd669946ce9f939c02865fea6a P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:23.577600 19842 raft_consensus.cc:359] T b19b550093fb4ab181e62957d89460e7 P d1a8f61d3323447282ee6068aa623216 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:59:23.578612 19842 raft_consensus.cc:740] T b19b550093fb4ab181e62957d89460e7 P d1a8f61d3323447282ee6068aa623216 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: d1a8f61d3323447282ee6068aa623216, State: Initialized, Role: LEARNER
I20251023 07:59:23.579942 19842 consensus_queue.cc:260] T b19b550093fb4ab181e62957d89460e7 P d1a8f61d3323447282ee6068aa623216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: NON_VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: true } }
I20251023 07:59:23.582767 19842 ts_tablet_manager.cc:1434] T b19b550093fb4ab181e62957d89460e7 P d1a8f61d3323447282ee6068aa623216: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20251023 07:59:23.577623 16888 raft_consensus.cc:2272] T e85adbfd669946ce9f939c02865fea6a P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:23.586184 16888 tablet_replica.cc:333] T c6c529d344cc483a96dbb509ca4c5890 P b3a1328f9c8c484fab08292ce2171ec9: stopping tablet replica
I20251023 07:59:23.587074 16888 raft_consensus.cc:2243] T c6c529d344cc483a96dbb509ca4c5890 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:23.588300 16888 raft_consensus.cc:2272] T c6c529d344cc483a96dbb509ca4c5890 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20251023 07:59:23.590130 18755 consensus_peers.cc:597] T f90cf0955288472898eff5b7e6459195 P d1a8f61d3323447282ee6068aa623216 -> Peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): Couldn't send request to peer b3a1328f9c8c484fab08292ce2171ec9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:23.591789 16888 tablet_replica.cc:333] T 25d22e66fcd6444a9b9c469acd781e59 P b3a1328f9c8c484fab08292ce2171ec9: stopping tablet replica
I20251023 07:59:23.592693 16888 raft_consensus.cc:2243] T 25d22e66fcd6444a9b9c469acd781e59 P b3a1328f9c8c484fab08292ce2171ec9 [term 3 LEADER]: Raft consensus shutting down.
I20251023 07:59:23.594234 16888 raft_consensus.cc:2272] T 25d22e66fcd6444a9b9c469acd781e59 P b3a1328f9c8c484fab08292ce2171ec9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:23.597079 16888 tablet_replica.cc:333] T 3d1032da07fd44be9c392e8f4cd2af1f P b3a1328f9c8c484fab08292ce2171ec9: stopping tablet replica
I20251023 07:59:23.597970 16888 raft_consensus.cc:2243] T 3d1032da07fd44be9c392e8f4cd2af1f P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:23.598582 16888 raft_consensus.cc:2272] T 3d1032da07fd44be9c392e8f4cd2af1f P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:23.601890 16888 tablet_replica.cc:333] T b9841e711f8e4a019c2d0dec5409474c P b3a1328f9c8c484fab08292ce2171ec9: stopping tablet replica
I20251023 07:59:23.602483 18186 tablet_copy_service.cc:342] P 10dfae53d0c941f08bded43539841761: Request end of tablet copy session d1a8f61d3323447282ee6068aa623216-b19b550093fb4ab181e62957d89460e7 received from {username='slave'} at 127.0.0.1:50534
I20251023 07:59:23.602725 16888 raft_consensus.cc:2243] T b9841e711f8e4a019c2d0dec5409474c P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:23.602975 18186 tablet_copy_service.cc:434] P 10dfae53d0c941f08bded43539841761: ending tablet copy session d1a8f61d3323447282ee6068aa623216-b19b550093fb4ab181e62957d89460e7 on tablet b19b550093fb4ab181e62957d89460e7 with peer d1a8f61d3323447282ee6068aa623216
I20251023 07:59:23.603621 16888 raft_consensus.cc:2272] T b9841e711f8e4a019c2d0dec5409474c P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:23.610044 16888 tablet_replica.cc:333] T eb40d8c2f73d48868bfc3ef3889bea45 P b3a1328f9c8c484fab08292ce2171ec9: stopping tablet replica
I20251023 07:59:23.610785 16888 raft_consensus.cc:2243] T eb40d8c2f73d48868bfc3ef3889bea45 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:23.611272 16888 raft_consensus.cc:2272] T eb40d8c2f73d48868bfc3ef3889bea45 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:23.613780 16888 tablet_replica.cc:333] T fbc1ceb70a0c42c6871ea24480ee4221 P b3a1328f9c8c484fab08292ce2171ec9: stopping tablet replica
I20251023 07:59:23.614387 16888 raft_consensus.cc:2243] T fbc1ceb70a0c42c6871ea24480ee4221 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:23.615322 16888 raft_consensus.cc:2272] T fbc1ceb70a0c42c6871ea24480ee4221 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:23.618002 16888 tablet_replica.cc:333] T 1f184d89e4244f12af7afd690bc7027d P b3a1328f9c8c484fab08292ce2171ec9: stopping tablet replica
I20251023 07:59:23.618736 16888 raft_consensus.cc:2243] T 1f184d89e4244f12af7afd690bc7027d P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:23.619274 16888 raft_consensus.cc:2272] T 1f184d89e4244f12af7afd690bc7027d P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:23.626152 16888 tablet_replica.cc:333] T 231c8691a471417c859146b4e7b4b440 P b3a1328f9c8c484fab08292ce2171ec9: stopping tablet replica
I20251023 07:59:23.626963 16888 raft_consensus.cc:2243] T 231c8691a471417c859146b4e7b4b440 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:23.627502 16888 raft_consensus.cc:2272] T 231c8691a471417c859146b4e7b4b440 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:23.630242 16888 tablet_replica.cc:333] T c6022ad5a70c4b4f8f34339956122cb7 P b3a1328f9c8c484fab08292ce2171ec9: stopping tablet replica
I20251023 07:59:23.630985 16888 raft_consensus.cc:2243] T c6022ad5a70c4b4f8f34339956122cb7 P b3a1328f9c8c484fab08292ce2171ec9 [term 4 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:23.631516 16888 raft_consensus.cc:2272] T c6022ad5a70c4b4f8f34339956122cb7 P b3a1328f9c8c484fab08292ce2171ec9 [term 4 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:23.634644 16888 tablet_replica.cc:333] T a83dfc7a7d784b52b9c74bbc451ad603 P b3a1328f9c8c484fab08292ce2171ec9: stopping tablet replica
I20251023 07:59:23.635365 16888 raft_consensus.cc:2243] T a83dfc7a7d784b52b9c74bbc451ad603 P b3a1328f9c8c484fab08292ce2171ec9 [term 4 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:23.635913 16888 raft_consensus.cc:2272] T a83dfc7a7d784b52b9c74bbc451ad603 P b3a1328f9c8c484fab08292ce2171ec9 [term 4 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:23.638775 16888 tablet_replica.cc:333] T 5939b6a960ea4b0581b61ccdcdfa7c37 P b3a1328f9c8c484fab08292ce2171ec9: stopping tablet replica
I20251023 07:59:23.639523 16888 raft_consensus.cc:2243] T 5939b6a960ea4b0581b61ccdcdfa7c37 P b3a1328f9c8c484fab08292ce2171ec9 [term 4 LEADER]: Raft consensus shutting down.
I20251023 07:59:23.640494 16888 raft_consensus.cc:2272] T 5939b6a960ea4b0581b61ccdcdfa7c37 P b3a1328f9c8c484fab08292ce2171ec9 [term 4 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:23.643126 16888 tablet_replica.cc:333] T 732495dddec64a3aa196110bfda45b37 P b3a1328f9c8c484fab08292ce2171ec9: stopping tablet replica
I20251023 07:59:23.643844 16888 raft_consensus.cc:2243] T 732495dddec64a3aa196110bfda45b37 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:23.644868 16888 raft_consensus.cc:2272] T 732495dddec64a3aa196110bfda45b37 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:23.648092 18786 raft_consensus.cc:1217] T b19b550093fb4ab181e62957d89460e7 P d1a8f61d3323447282ee6068aa623216 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3] Dedup: 2.3->[]
I20251023 07:59:23.648200 16888 tablet_replica.cc:333] T 7fe190354178418bae8b7cc5abbb74ef P b3a1328f9c8c484fab08292ce2171ec9: stopping tablet replica
I20251023 07:59:23.649255 16888 raft_consensus.cc:2243] T 7fe190354178418bae8b7cc5abbb74ef P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:23.650385 16888 raft_consensus.cc:2272] T 7fe190354178418bae8b7cc5abbb74ef P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:23.654088 16888 tablet_replica.cc:333] T e4884051da6c4cdc9e0811e70667dd19 P b3a1328f9c8c484fab08292ce2171ec9: stopping tablet replica
I20251023 07:59:23.654930 16888 raft_consensus.cc:2243] T e4884051da6c4cdc9e0811e70667dd19 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:23.655470 16888 raft_consensus.cc:2272] T e4884051da6c4cdc9e0811e70667dd19 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:23.658497 16888 tablet_replica.cc:333] T 3c5c040d6ebe40e5a5be6be47de5a7bc P b3a1328f9c8c484fab08292ce2171ec9: stopping tablet replica
I20251023 07:59:23.659178 16888 raft_consensus.cc:2243] T 3c5c040d6ebe40e5a5be6be47de5a7bc P b3a1328f9c8c484fab08292ce2171ec9 [term 3 LEADER]: Raft consensus shutting down.
I20251023 07:59:23.660244 16888 raft_consensus.cc:2272] T 3c5c040d6ebe40e5a5be6be47de5a7bc P b3a1328f9c8c484fab08292ce2171ec9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:23.662770 16888 tablet_replica.cc:333] T 2d81605b8fe7427b94af7f3c481ed765 P b3a1328f9c8c484fab08292ce2171ec9: stopping tablet replica
I20251023 07:59:23.663493 16888 raft_consensus.cc:2243] T 2d81605b8fe7427b94af7f3c481ed765 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:23.664628 16888 raft_consensus.cc:2272] T 2d81605b8fe7427b94af7f3c481ed765 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:23.667582 16888 tablet_replica.cc:333] T 744a3368282b44d9b9618922875d20d3 P b3a1328f9c8c484fab08292ce2171ec9: stopping tablet replica
I20251023 07:59:23.668380 16888 raft_consensus.cc:2243] T 744a3368282b44d9b9618922875d20d3 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:23.669085 16888 raft_consensus.cc:2272] T 744a3368282b44d9b9618922875d20d3 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:23.672142 16888 tablet_replica.cc:333] T 5585a11a884140c7abc7d5a3b6ab86f3 P b3a1328f9c8c484fab08292ce2171ec9: stopping tablet replica
I20251023 07:59:23.674639 16888 raft_consensus.cc:2243] T 5585a11a884140c7abc7d5a3b6ab86f3 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:23.677307 16888 raft_consensus.cc:2272] T 5585a11a884140c7abc7d5a3b6ab86f3 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:23.680104 16888 tablet_replica.cc:333] T b19b550093fb4ab181e62957d89460e7 P b3a1328f9c8c484fab08292ce2171ec9: stopping tablet replica
I20251023 07:59:23.680872 16888 raft_consensus.cc:2243] T b19b550093fb4ab181e62957d89460e7 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:23.696882 16888 raft_consensus.cc:2272] T b19b550093fb4ab181e62957d89460e7 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:23.701381 16888 tablet_replica.cc:333] T c63b5a4dc8eb4b6e918608f281183068 P b3a1328f9c8c484fab08292ce2171ec9: stopping tablet replica
I20251023 07:59:23.702203 16888 raft_consensus.cc:2243] T c63b5a4dc8eb4b6e918608f281183068 P b3a1328f9c8c484fab08292ce2171ec9 [term 4 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:23.702775 16888 raft_consensus.cc:2272] T c63b5a4dc8eb4b6e918608f281183068 P b3a1328f9c8c484fab08292ce2171ec9 [term 4 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:23.706156 16888 tablet_replica.cc:333] T a939fd9e853a45d1aa626a4566c14abc P b3a1328f9c8c484fab08292ce2171ec9: stopping tablet replica
I20251023 07:59:23.706991 16888 raft_consensus.cc:2243] T a939fd9e853a45d1aa626a4566c14abc P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:23.708020 16888 raft_consensus.cc:2272] T a939fd9e853a45d1aa626a4566c14abc P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:23.710670 16888 tablet_replica.cc:333] T abefe27ebb4c4179a8620d4e638fe119 P b3a1328f9c8c484fab08292ce2171ec9: stopping tablet replica
I20251023 07:59:23.711395 16888 raft_consensus.cc:2243] T abefe27ebb4c4179a8620d4e638fe119 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:23.712186 16888 raft_consensus.cc:2272] T abefe27ebb4c4179a8620d4e638fe119 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:23.714381 16888 tablet_replica.cc:333] T 01f269ca63a8498498956fb3577f35d3 P b3a1328f9c8c484fab08292ce2171ec9: stopping tablet replica
I20251023 07:59:23.715442 16888 raft_consensus.cc:2243] T 01f269ca63a8498498956fb3577f35d3 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:23.720403 16888 raft_consensus.cc:2272] T 01f269ca63a8498498956fb3577f35d3 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:23.724498 16888 tablet_replica.cc:333] T 5d4096f60c864412bb51be0c52c22961 P b3a1328f9c8c484fab08292ce2171ec9: stopping tablet replica
I20251023 07:59:23.725198 16888 raft_consensus.cc:2243] T 5d4096f60c864412bb51be0c52c22961 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:23.725837 16888 raft_consensus.cc:2272] T 5d4096f60c864412bb51be0c52c22961 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:23.728574 16888 tablet_replica.cc:333] T ce0069d7c0cf4dee84a85731209358f7 P b3a1328f9c8c484fab08292ce2171ec9: stopping tablet replica
I20251023 07:59:23.729240 16888 raft_consensus.cc:2243] T ce0069d7c0cf4dee84a85731209358f7 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:23.729771 16888 raft_consensus.cc:2272] T ce0069d7c0cf4dee84a85731209358f7 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:23.733320 16888 tablet_replica.cc:333] T f90cf0955288472898eff5b7e6459195 P b3a1328f9c8c484fab08292ce2171ec9: stopping tablet replica
I20251023 07:59:23.734046 16888 raft_consensus.cc:2243] T f90cf0955288472898eff5b7e6459195 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:23.736013 16888 raft_consensus.cc:2272] T f90cf0955288472898eff5b7e6459195 P b3a1328f9c8c484fab08292ce2171ec9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:23.738775 16888 tablet_replica.cc:333] T 4117fd2188e14b9aacc56f82245a3cc6 P b3a1328f9c8c484fab08292ce2171ec9: stopping tablet replica
I20251023 07:59:23.739369 16888 raft_consensus.cc:2243] T 4117fd2188e14b9aacc56f82245a3cc6 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:23.740546 16888 raft_consensus.cc:2272] T 4117fd2188e14b9aacc56f82245a3cc6 P b3a1328f9c8c484fab08292ce2171ec9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:23.835960 19851 raft_consensus.cc:1064] T eb40d8c2f73d48868bfc3ef3889bea45 P 982df35c5b554a8fa64807352c4f34ee: attempting to promote NON_VOTER d1a8f61d3323447282ee6068aa623216 to VOTER
I20251023 07:59:23.839601 19851 consensus_queue.cc:237] T eb40d8c2f73d48868bfc3ef3889bea45 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:23.846104 18174 raft_consensus.cc:1275] T eb40d8c2f73d48868bfc3ef3889bea45 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:59:23.847568 19851 consensus_queue.cc:1048] T eb40d8c2f73d48868bfc3ef3889bea45 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:59:23.848217 18787 raft_consensus.cc:1275] T eb40d8c2f73d48868bfc3ef3889bea45 P d1a8f61d3323447282ee6068aa623216 [term 1 LEARNER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251023 07:59:23.850973 19782 consensus_queue.cc:1048] T eb40d8c2f73d48868bfc3ef3889bea45 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20251023 07:59:23.853184 16888 tablet_server.cc:195] TabletServer@127.16.126.1:0 shutdown complete.
I20251023 07:59:23.874897 19782 raft_consensus.cc:2955] T eb40d8c2f73d48868bfc3ef3889bea45 P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
W20251023 07:59:23.885095 18217 consensus_peers.cc:597] T eb40d8c2f73d48868bfc3ef3889bea45 P 982df35c5b554a8fa64807352c4f34ee -> Peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): Couldn't send request to peer b3a1328f9c8c484fab08292ce2171ec9. Status: Network error: Client connection negotiation failed: client connection to 127.16.126.1:44025: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:23.884641 18787 raft_consensus.cc:2955] T eb40d8c2f73d48868bfc3ef3889bea45 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:23.889739 18170 raft_consensus.cc:2955] T eb40d8c2f73d48868bfc3ef3889bea45 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:23.896797 17999 catalog_manager.cc:5649] T eb40d8c2f73d48868bfc3ef3889bea45 P 982df35c5b554a8fa64807352c4f34ee reported cstate change: config changed from index 2 to 3, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "982df35c5b554a8fa64807352c4f34ee" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251023 07:59:23.997936 18247 consensus_queue.cc:237] T eb40d8c2f73d48868bfc3ef3889bea45 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
W20251023 07:59:24.010071 19827 tablet_copy_client.cc:1131] T 25d22e66fcd6444a9b9c469acd781e59 P d1a8f61d3323447282ee6068aa623216: tablet copy: Unable to close tablet copy session: Network error: failure ending tablet copy session: Client connection negotiation failed: client connection to 127.16.126.1:44025: connect: Connection refused (error 111)
I20251023 07:59:24.010444 18786 raft_consensus.cc:1275] T eb40d8c2f73d48868bfc3ef3889bea45 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251023 07:59:24.015838 18174 raft_consensus.cc:1275] T eb40d8c2f73d48868bfc3ef3889bea45 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Refusing update from remote peer 982df35c5b554a8fa64807352c4f34ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251023 07:59:24.015865 19700 consensus_queue.cc:1048] T eb40d8c2f73d48868bfc3ef3889bea45 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20251023 07:59:24.017835 19700 consensus_queue.cc:1048] T eb40d8c2f73d48868bfc3ef3889bea45 P 982df35c5b554a8fa64807352c4f34ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 07:59:24.023355 19700 raft_consensus.cc:2955] T eb40d8c2f73d48868bfc3ef3889bea45 P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:24.025838 18786 raft_consensus.cc:2955] T eb40d8c2f73d48868bfc3ef3889bea45 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:24.026852 18174 raft_consensus.cc:2955] T eb40d8c2f73d48868bfc3ef3889bea45 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
W20251023 07:59:24.028491 19832 ts_tablet_manager.cc:1011] T 1178e2ed919b40f29672fc6233b71cf3 P d1a8f61d3323447282ee6068aa623216: Tablet Copy: Unable to fetch data from remote peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): Network error: Unable to download WAL segment with seq. number 1: unable to fetch data from remote: Client connection negotiation failed: client connection to 127.16.126.1:44025: connect: Connection refused (error 111)
I20251023 07:59:24.028936 19832 tablet_replica.cc:333] T 1178e2ed919b40f29672fc6233b71cf3 P d1a8f61d3323447282ee6068aa623216: stopping tablet replica
I20251023 07:59:24.029217 19832 raft_consensus.cc:2243] T 1178e2ed919b40f29672fc6233b71cf3 P d1a8f61d3323447282ee6068aa623216 [term 2 LEARNER]: Raft consensus shutting down.
I20251023 07:59:24.029580 19832 raft_consensus.cc:2272] T 1178e2ed919b40f29672fc6233b71cf3 P d1a8f61d3323447282ee6068aa623216 [term 2 LEARNER]: Raft consensus is shut down!
W20251023 07:59:24.033329 19832 tablet_copy_client.cc:1131] T 1178e2ed919b40f29672fc6233b71cf3 P d1a8f61d3323447282ee6068aa623216: tablet copy: Unable to close tablet copy session: Network error: failure ending tablet copy session: Client connection negotiation failed: client connection to 127.16.126.1:44025: connect: Connection refused (error 111)
W20251023 07:59:24.034873 19832 tablet_metadata.cc:476] failed to load DataDirGroup from superblock: Already present: tried to load directory group for tablet 1178e2ed919b40f29672fc6233b71cf3 but one is already registered
I20251023 07:59:24.035465 19832 ts_tablet_manager.cc:1916] T 1178e2ed919b40f29672fc6233b71cf3 P d1a8f61d3323447282ee6068aa623216: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251023 07:59:24.045953 17986 catalog_manager.cc:5162] ChangeConfig:REMOVE_PEER RPC for tablet eb40d8c2f73d48868bfc3ef3889bea45 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251023 07:59:24.055068 17999 catalog_manager.cc:5649] T eb40d8c2f73d48868bfc3ef3889bea45 P 10dfae53d0c941f08bded43539841761 reported cstate change: config changed from index 3 to 4, VOTER b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1) evicted. New cstate: current_term: 1 leader_uuid: "982df35c5b554a8fa64807352c4f34ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:24.068112 19832 ts_tablet_manager.cc:1929] T 1178e2ed919b40f29672fc6233b71cf3 P d1a8f61d3323447282ee6068aa623216: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.0
I20251023 07:59:24.068697 19832 log.cc:1199] T 1178e2ed919b40f29672fc6233b71cf3 P d1a8f61d3323447282ee6068aa623216: Deleting WAL directory at /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1761206251627710-16888-0/minicluster-data/ts-3-root/wals/1178e2ed919b40f29672fc6233b71cf3
W20251023 07:59:24.070116 17986 catalog_manager.cc:5172] ChangeConfig:REMOVE_PEER RPC for tablet eb40d8c2f73d48868bfc3ef3889bea45 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 3 but the committed config has opid_index of 4
I20251023 07:59:24.075695 19845 raft_consensus.cc:1064] T b19b550093fb4ab181e62957d89460e7 P 10dfae53d0c941f08bded43539841761: attempting to promote NON_VOTER d1a8f61d3323447282ee6068aa623216 to VOTER
I20251023 07:59:24.079150 19845 consensus_queue.cc:237] T b19b550093fb4ab181e62957d89460e7 P 10dfae53d0c941f08bded43539841761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:24.095605 18786 raft_consensus.cc:1275] T b19b550093fb4ab181e62957d89460e7 P d1a8f61d3323447282ee6068aa623216 [term 2 LEARNER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20251023 07:59:24.097743 19839 consensus_queue.cc:1048] T b19b550093fb4ab181e62957d89460e7 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20251023 07:59:24.114148 18251 raft_consensus.cc:1275] T b19b550093fb4ab181e62957d89460e7 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Refusing update from remote peer 10dfae53d0c941f08bded43539841761: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20251023 07:59:24.116227 19730 consensus_queue.cc:1048] T b19b550093fb4ab181e62957d89460e7 P 10dfae53d0c941f08bded43539841761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20251023 07:59:24.124380 18143 consensus_peers.cc:597] T b19b550093fb4ab181e62957d89460e7 P 10dfae53d0c941f08bded43539841761 -> Peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): Couldn't send request to peer b3a1328f9c8c484fab08292ce2171ec9. Status: Network error: Client connection negotiation failed: client connection to 127.16.126.1:44025: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251023 07:59:24.131489 17987 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.16.126.1:44025, user_credentials={real_user=slave}} blocked reactor thread for 44714.5us
I20251023 07:59:24.146045 16888 tablet_server.cc:178] TabletServer@127.16.126.2:0 shutting down...
W20251023 07:59:24.153226 17987 catalog_manager.cc:4712] TS b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet eb40d8c2f73d48868bfc3ef3889bea45: Network error: Client connection negotiation failed: client connection to 127.16.126.1:44025: connect: Connection refused (error 111)
W20251023 07:59:24.157218 18048 auto_rebalancer.cc:663] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20251023 07:59:24.157615 18048 auto_rebalancer.cc:264] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251023 07:59:24.162111 18787 raft_consensus.cc:2955] T b19b550093fb4ab181e62957d89460e7 P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:24.159958 19839 raft_consensus.cc:2955] T b19b550093fb4ab181e62957d89460e7 P 10dfae53d0c941f08bded43539841761 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:24.190196 17997 catalog_manager.cc:5649] T b19b550093fb4ab181e62957d89460e7 P d1a8f61d3323447282ee6068aa623216 reported cstate change: config changed from index 3 to 4, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "10dfae53d0c941f08bded43539841761" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
I20251023 07:59:24.193290 18251 raft_consensus.cc:2955] T b19b550093fb4ab181e62957d89460e7 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, d1a8f61d3323447282ee6068aa623216 (127.16.126.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } attrs { replace: true } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } } }
W20251023 07:59:24.221369 18753 consensus_peers.cc:597] T c6022ad5a70c4b4f8f34339956122cb7 P d1a8f61d3323447282ee6068aa623216 -> Peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Couldn't send request to peer 10dfae53d0c941f08bded43539841761. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251023 07:59:24.240291 18753 consensus_peers.cc:597] T f90cf0955288472898eff5b7e6459195 P d1a8f61d3323447282ee6068aa623216 -> Peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Couldn't send request to peer 10dfae53d0c941f08bded43539841761. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:24.242152 16888 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251023 07:59:24.243237 16888 tablet_replica.cc:333] T 8f25975c7ab4439c9975a5e5604727dc P 10dfae53d0c941f08bded43539841761: stopping tablet replica
I20251023 07:59:24.244172 16888 raft_consensus.cc:2243] T 8f25975c7ab4439c9975a5e5604727dc P 10dfae53d0c941f08bded43539841761 [term 2 LEADER]: Raft consensus shutting down.
I20251023 07:59:24.245318 16888 raft_consensus.cc:2272] T 8f25975c7ab4439c9975a5e5604727dc P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.247437 16888 tablet_replica.cc:333] T ce0cc368c5054eef9dca968072a2d4fd P 10dfae53d0c941f08bded43539841761: stopping tablet replica
I20251023 07:59:24.248119 16888 raft_consensus.cc:2243] T ce0cc368c5054eef9dca968072a2d4fd P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:24.248565 16888 raft_consensus.cc:2272] T ce0cc368c5054eef9dca968072a2d4fd P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.251224 16888 tablet_replica.cc:333] T 85799f6eb6ae41fa9620accb877d8708 P 10dfae53d0c941f08bded43539841761: stopping tablet replica
I20251023 07:59:24.251907 16888 raft_consensus.cc:2243] T 85799f6eb6ae41fa9620accb877d8708 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:24.252970 16888 raft_consensus.cc:2272] T 85799f6eb6ae41fa9620accb877d8708 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.255291 16888 tablet_replica.cc:333] T ae4437d151054b59a0e93ca01a9609c7 P 10dfae53d0c941f08bded43539841761: stopping tablet replica
I20251023 07:59:24.255939 16888 raft_consensus.cc:2243] T ae4437d151054b59a0e93ca01a9609c7 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:24.256412 16888 raft_consensus.cc:2272] T ae4437d151054b59a0e93ca01a9609c7 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.258458 16888 tablet_replica.cc:333] T 931f55bec99140c69a4b5654b691c861 P 10dfae53d0c941f08bded43539841761: stopping tablet replica
I20251023 07:59:24.258975 16888 raft_consensus.cc:2243] T 931f55bec99140c69a4b5654b691c861 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:24.259694 16888 raft_consensus.cc:2272] T 931f55bec99140c69a4b5654b691c861 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.261552 16888 tablet_replica.cc:333] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P 10dfae53d0c941f08bded43539841761: stopping tablet replica
I20251023 07:59:24.262143 16888 raft_consensus.cc:2243] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P 10dfae53d0c941f08bded43539841761 [term 2 LEADER]: Raft consensus shutting down.
I20251023 07:59:24.262877 16888 raft_consensus.cc:2272] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.264813 16888 tablet_replica.cc:333] T e25fd146cb564be69022d0f53010bbfa P 10dfae53d0c941f08bded43539841761: stopping tablet replica
I20251023 07:59:24.265349 16888 raft_consensus.cc:2243] T e25fd146cb564be69022d0f53010bbfa P 10dfae53d0c941f08bded43539841761 [term 2 LEADER]: Raft consensus shutting down.
I20251023 07:59:24.266081 16888 raft_consensus.cc:2272] T e25fd146cb564be69022d0f53010bbfa P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.267879 16888 tablet_replica.cc:333] T 063924334ed846f3bd41c36cc4651236 P 10dfae53d0c941f08bded43539841761: stopping tablet replica
I20251023 07:59:24.268532 16888 raft_consensus.cc:2243] T 063924334ed846f3bd41c36cc4651236 P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:24.268954 16888 raft_consensus.cc:2272] T 063924334ed846f3bd41c36cc4651236 P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.271035 16888 tablet_replica.cc:333] T 1f539da81d60449b9d96866c7ceee1be P 10dfae53d0c941f08bded43539841761: stopping tablet replica
I20251023 07:59:24.271530 16888 raft_consensus.cc:2243] T 1f539da81d60449b9d96866c7ceee1be P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:24.272135 16888 raft_consensus.cc:2272] T 1f539da81d60449b9d96866c7ceee1be P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.274240 16888 tablet_replica.cc:333] T 7a0f3569fcc34ba8b721d4ca9f31b6fa P 10dfae53d0c941f08bded43539841761: stopping tablet replica
W20251023 07:59:24.274220 18215 consensus_peers.cc:597] T 1f437560602a470ca62b7a1fa9471026 P 982df35c5b554a8fa64807352c4f34ee -> Peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Couldn't send request to peer 10dfae53d0c941f08bded43539841761. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:24.275053 16888 raft_consensus.cc:2243] T 7a0f3569fcc34ba8b721d4ca9f31b6fa P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:24.275794 16888 raft_consensus.cc:2272] T 7a0f3569fcc34ba8b721d4ca9f31b6fa P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.277801 16888 tablet_replica.cc:333] T 1f437560602a470ca62b7a1fa9471026 P 10dfae53d0c941f08bded43539841761: stopping tablet replica
I20251023 07:59:24.278457 16888 raft_consensus.cc:2243] T 1f437560602a470ca62b7a1fa9471026 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:24.279000 16888 raft_consensus.cc:2272] T 1f437560602a470ca62b7a1fa9471026 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.281378 16888 tablet_replica.cc:333] T 1178e2ed919b40f29672fc6233b71cf3 P 10dfae53d0c941f08bded43539841761: stopping tablet replica
I20251023 07:59:24.281946 16888 raft_consensus.cc:2243] T 1178e2ed919b40f29672fc6233b71cf3 P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:24.282356 16888 raft_consensus.cc:2272] T 1178e2ed919b40f29672fc6233b71cf3 P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.284150 16888 tablet_replica.cc:333] T 14e6f2c3d85b437cac3ead436d5494a7 P 10dfae53d0c941f08bded43539841761: stopping tablet replica
I20251023 07:59:24.284807 16888 raft_consensus.cc:2243] T 14e6f2c3d85b437cac3ead436d5494a7 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:24.285369 16888 raft_consensus.cc:2272] T 14e6f2c3d85b437cac3ead436d5494a7 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.287600 16888 tablet_replica.cc:333] T 5f7e006a09224285b1e5df5694ff72ae P 10dfae53d0c941f08bded43539841761: stopping tablet replica
I20251023 07:59:24.288129 16888 raft_consensus.cc:2243] T 5f7e006a09224285b1e5df5694ff72ae P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:24.288501 16888 raft_consensus.cc:2272] T 5f7e006a09224285b1e5df5694ff72ae P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.290349 16888 tablet_replica.cc:333] T 3e4d005972f44619b0cf23f4978f51c4 P 10dfae53d0c941f08bded43539841761: stopping tablet replica
I20251023 07:59:24.290958 16888 raft_consensus.cc:2243] T 3e4d005972f44619b0cf23f4978f51c4 P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:24.291378 16888 raft_consensus.cc:2272] T 3e4d005972f44619b0cf23f4978f51c4 P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.292984 16888 tablet_replica.cc:333] T ce0069d7c0cf4dee84a85731209358f7 P 10dfae53d0c941f08bded43539841761: stopping tablet replica
I20251023 07:59:24.293545 16888 raft_consensus.cc:2243] T ce0069d7c0cf4dee84a85731209358f7 P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:24.293936 16888 raft_consensus.cc:2272] T ce0069d7c0cf4dee84a85731209358f7 P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.295624 16888 tablet_replica.cc:333] T 07b28d84c73d42d583d6f80199700309 P 10dfae53d0c941f08bded43539841761: stopping tablet replica
I20251023 07:59:24.296262 16888 raft_consensus.cc:2243] T 07b28d84c73d42d583d6f80199700309 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:24.296636 16888 raft_consensus.cc:2272] T 07b28d84c73d42d583d6f80199700309 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.298564 16888 tablet_replica.cc:333] T 714c3ef74ecc47419a20ab7e23217e5e P 10dfae53d0c941f08bded43539841761: stopping tablet replica
I20251023 07:59:24.299170 16888 raft_consensus.cc:2243] T 714c3ef74ecc47419a20ab7e23217e5e P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:24.299623 16888 raft_consensus.cc:2272] T 714c3ef74ecc47419a20ab7e23217e5e P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Raft consensus is shut down!
W20251023 07:59:24.300323 18215 consensus_peers.cc:597] T a83dfc7a7d784b52b9c74bbc451ad603 P 982df35c5b554a8fa64807352c4f34ee -> Peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Couldn't send request to peer 10dfae53d0c941f08bded43539841761. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:24.301770 16888 tablet_replica.cc:333] T 55de6ceb03f343b09190cb2fb4bbe144 P 10dfae53d0c941f08bded43539841761: stopping tablet replica
I20251023 07:59:24.302384 16888 raft_consensus.cc:2243] T 55de6ceb03f343b09190cb2fb4bbe144 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:24.302888 16888 raft_consensus.cc:2272] T 55de6ceb03f343b09190cb2fb4bbe144 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.304867 16888 tablet_replica.cc:333] T fe0293c22cae49cfa7cd698f17626a35 P 10dfae53d0c941f08bded43539841761: stopping tablet replica
I20251023 07:59:24.305560 16888 raft_consensus.cc:2243] T fe0293c22cae49cfa7cd698f17626a35 P 10dfae53d0c941f08bded43539841761 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:24.306104 16888 raft_consensus.cc:2272] T fe0293c22cae49cfa7cd698f17626a35 P 10dfae53d0c941f08bded43539841761 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.308066 16888 tablet_replica.cc:333] T c63b5a4dc8eb4b6e918608f281183068 P 10dfae53d0c941f08bded43539841761: stopping tablet replica
I20251023 07:59:24.308539 16888 raft_consensus.cc:2243] T c63b5a4dc8eb4b6e918608f281183068 P 10dfae53d0c941f08bded43539841761 [term 4 LEADER]: Raft consensus shutting down.
I20251023 07:59:24.309281 16888 raft_consensus.cc:2272] T c63b5a4dc8eb4b6e918608f281183068 P 10dfae53d0c941f08bded43539841761 [term 4 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.311048 16888 tablet_replica.cc:333] T b19b550093fb4ab181e62957d89460e7 P 10dfae53d0c941f08bded43539841761: stopping tablet replica
I20251023 07:59:24.311530 16888 raft_consensus.cc:2243] T b19b550093fb4ab181e62957d89460e7 P 10dfae53d0c941f08bded43539841761 [term 2 LEADER]: Raft consensus shutting down.
I20251023 07:59:24.312435 16888 raft_consensus.cc:2272] T b19b550093fb4ab181e62957d89460e7 P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.314666 16888 tablet_replica.cc:333] T c6c529d344cc483a96dbb509ca4c5890 P 10dfae53d0c941f08bded43539841761: stopping tablet replica
I20251023 07:59:24.315147 16888 raft_consensus.cc:2243] T c6c529d344cc483a96dbb509ca4c5890 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:24.315522 16888 raft_consensus.cc:2272] T c6c529d344cc483a96dbb509ca4c5890 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.317379 16888 tablet_replica.cc:333] T 25d22e66fcd6444a9b9c469acd781e59 P 10dfae53d0c941f08bded43539841761: stopping tablet replica
I20251023 07:59:24.318104 16888 raft_consensus.cc:2243] T 25d22e66fcd6444a9b9c469acd781e59 P 10dfae53d0c941f08bded43539841761 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:24.318709 16888 raft_consensus.cc:2272] T 25d22e66fcd6444a9b9c469acd781e59 P 10dfae53d0c941f08bded43539841761 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.320665 16888 tablet_replica.cc:333] T 3d1032da07fd44be9c392e8f4cd2af1f P 10dfae53d0c941f08bded43539841761: stopping tablet replica
W20251023 07:59:24.320932 18215 consensus_peers.cc:597] T ce0cc368c5054eef9dca968072a2d4fd P 982df35c5b554a8fa64807352c4f34ee -> Peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Couldn't send request to peer 10dfae53d0c941f08bded43539841761. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:24.321372 16888 raft_consensus.cc:2243] T 3d1032da07fd44be9c392e8f4cd2af1f P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:24.322326 16888 raft_consensus.cc:2272] T 3d1032da07fd44be9c392e8f4cd2af1f P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.324541 16888 tablet_replica.cc:333] T 5585a11a884140c7abc7d5a3b6ab86f3 P 10dfae53d0c941f08bded43539841761: stopping tablet replica
I20251023 07:59:24.325222 16888 raft_consensus.cc:2243] T 5585a11a884140c7abc7d5a3b6ab86f3 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:24.326005 16888 raft_consensus.cc:2272] T 5585a11a884140c7abc7d5a3b6ab86f3 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.327610 16888 tablet_replica.cc:333] T 33ee36de303b458e88fa6bad4587c0e6 P 10dfae53d0c941f08bded43539841761: stopping tablet replica
I20251023 07:59:24.328051 16888 raft_consensus.cc:2243] T 33ee36de303b458e88fa6bad4587c0e6 P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:24.328408 16888 raft_consensus.cc:2272] T 33ee36de303b458e88fa6bad4587c0e6 P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.330005 16888 tablet_replica.cc:333] T a83dfc7a7d784b52b9c74bbc451ad603 P 10dfae53d0c941f08bded43539841761: stopping tablet replica
I20251023 07:59:24.330461 16888 raft_consensus.cc:2243] T a83dfc7a7d784b52b9c74bbc451ad603 P 10dfae53d0c941f08bded43539841761 [term 4 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:24.330811 16888 raft_consensus.cc:2272] T a83dfc7a7d784b52b9c74bbc451ad603 P 10dfae53d0c941f08bded43539841761 [term 4 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.332367 16888 tablet_replica.cc:333] T c6022ad5a70c4b4f8f34339956122cb7 P 10dfae53d0c941f08bded43539841761: stopping tablet replica
I20251023 07:59:24.332796 16888 raft_consensus.cc:2243] T c6022ad5a70c4b4f8f34339956122cb7 P 10dfae53d0c941f08bded43539841761 [term 4 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:24.333127 16888 raft_consensus.cc:2272] T c6022ad5a70c4b4f8f34339956122cb7 P 10dfae53d0c941f08bded43539841761 [term 4 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.334695 16888 tablet_replica.cc:333] T fbc1ceb70a0c42c6871ea24480ee4221 P 10dfae53d0c941f08bded43539841761: stopping tablet replica
I20251023 07:59:24.335175 16888 raft_consensus.cc:2243] T fbc1ceb70a0c42c6871ea24480ee4221 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:24.335736 16888 raft_consensus.cc:2272] T fbc1ceb70a0c42c6871ea24480ee4221 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.337947 16888 tablet_replica.cc:333] T eb40d8c2f73d48868bfc3ef3889bea45 P 10dfae53d0c941f08bded43539841761: stopping tablet replica
I20251023 07:59:24.338488 16888 raft_consensus.cc:2243] T eb40d8c2f73d48868bfc3ef3889bea45 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:24.339186 16888 raft_consensus.cc:2272] T eb40d8c2f73d48868bfc3ef3889bea45 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.341248 16888 tablet_replica.cc:333] T eeadb773c7dc416581b44225256a4c3b P 10dfae53d0c941f08bded43539841761: stopping tablet replica
I20251023 07:59:24.341898 16888 raft_consensus.cc:2243] T eeadb773c7dc416581b44225256a4c3b P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:24.342878 16888 raft_consensus.cc:2272] T eeadb773c7dc416581b44225256a4c3b P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Raft consensus is shut down!
W20251023 07:59:24.344528 18215 consensus_peers.cc:597] T 1f539da81d60449b9d96866c7ceee1be P 982df35c5b554a8fa64807352c4f34ee -> Peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Couldn't send request to peer 10dfae53d0c941f08bded43539841761. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:24.345467 16888 tablet_replica.cc:333] T f90cf0955288472898eff5b7e6459195 P 10dfae53d0c941f08bded43539841761: stopping tablet replica
I20251023 07:59:24.346081 16888 raft_consensus.cc:2243] T f90cf0955288472898eff5b7e6459195 P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:24.346462 16888 raft_consensus.cc:2272] T f90cf0955288472898eff5b7e6459195 P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.348829 16888 tablet_replica.cc:333] T dad81a56e87946cbb2a7f3e33c2e2bd4 P 10dfae53d0c941f08bded43539841761: stopping tablet replica
I20251023 07:59:24.349465 16888 raft_consensus.cc:2243] T dad81a56e87946cbb2a7f3e33c2e2bd4 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:24.350219 16888 raft_consensus.cc:2272] T dad81a56e87946cbb2a7f3e33c2e2bd4 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Raft consensus is shut down!
W20251023 07:59:24.350521 18753 consensus_peers.cc:597] T 7fe190354178418bae8b7cc5abbb74ef P d1a8f61d3323447282ee6068aa623216 -> Peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Couldn't send request to peer 10dfae53d0c941f08bded43539841761. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:24.352764 16888 tablet_replica.cc:333] T c8b2781a072e401dba80e2879748e681 P 10dfae53d0c941f08bded43539841761: stopping tablet replica
I20251023 07:59:24.353562 16888 raft_consensus.cc:2243] T c8b2781a072e401dba80e2879748e681 P 10dfae53d0c941f08bded43539841761 [term 2 LEADER]: Raft consensus shutting down.
I20251023 07:59:24.354598 16888 raft_consensus.cc:2272] T c8b2781a072e401dba80e2879748e681 P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Raft consensus is shut down!
W20251023 07:59:24.355603 18215 consensus_peers.cc:597] T e99e859ac34a47c4b2859ec2638d17e5 P 982df35c5b554a8fa64807352c4f34ee -> Peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Couldn't send request to peer 10dfae53d0c941f08bded43539841761. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:24.356460 16888 tablet_replica.cc:333] T 4117fd2188e14b9aacc56f82245a3cc6 P 10dfae53d0c941f08bded43539841761: stopping tablet replica
I20251023 07:59:24.357023 16888 raft_consensus.cc:2243] T 4117fd2188e14b9aacc56f82245a3cc6 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:24.357465 16888 raft_consensus.cc:2272] T 4117fd2188e14b9aacc56f82245a3cc6 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.359337 16888 tablet_replica.cc:333] T e99e859ac34a47c4b2859ec2638d17e5 P 10dfae53d0c941f08bded43539841761: stopping tablet replica
I20251023 07:59:24.359830 16888 raft_consensus.cc:2243] T e99e859ac34a47c4b2859ec2638d17e5 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:24.360242 16888 raft_consensus.cc:2272] T e99e859ac34a47c4b2859ec2638d17e5 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.362031 16888 tablet_replica.cc:333] T 33c314b036134d929890c744d68bc0cc P 10dfae53d0c941f08bded43539841761: stopping tablet replica
I20251023 07:59:24.362648 16888 raft_consensus.cc:2243] T 33c314b036134d929890c744d68bc0cc P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:24.363473 16888 raft_consensus.cc:2272] T 33c314b036134d929890c744d68bc0cc P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.365785 16888 tablet_replica.cc:333] T 5d4096f60c864412bb51be0c52c22961 P 10dfae53d0c941f08bded43539841761: stopping tablet replica
I20251023 07:59:24.366293 16888 raft_consensus.cc:2243] T 5d4096f60c864412bb51be0c52c22961 P 10dfae53d0c941f08bded43539841761 [term 2 LEADER]: Raft consensus shutting down.
I20251023 07:59:24.367053 16888 raft_consensus.cc:2272] T 5d4096f60c864412bb51be0c52c22961 P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.369233 16888 tablet_replica.cc:333] T 2d81605b8fe7427b94af7f3c481ed765 P 10dfae53d0c941f08bded43539841761: stopping tablet replica
I20251023 07:59:24.369813 16888 raft_consensus.cc:2243] T 2d81605b8fe7427b94af7f3c481ed765 P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:24.370303 16888 raft_consensus.cc:2272] T 2d81605b8fe7427b94af7f3c481ed765 P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.372328 16888 tablet_replica.cc:333] T 231c8691a471417c859146b4e7b4b440 P 10dfae53d0c941f08bded43539841761: stopping tablet replica
I20251023 07:59:24.372874 16888 raft_consensus.cc:2243] T 231c8691a471417c859146b4e7b4b440 P 10dfae53d0c941f08bded43539841761 [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:24.373754 16888 raft_consensus.cc:2272] T 231c8691a471417c859146b4e7b4b440 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Raft consensus is shut down!
W20251023 07:59:24.375070 18753 consensus_peers.cc:597] T fe0293c22cae49cfa7cd698f17626a35 P d1a8f61d3323447282ee6068aa623216 -> Peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Couldn't send request to peer 10dfae53d0c941f08bded43539841761. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:24.375917 16888 tablet_replica.cc:333] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 10dfae53d0c941f08bded43539841761: stopping tablet replica
I20251023 07:59:24.376520 16888 raft_consensus.cc:2243] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 10dfae53d0c941f08bded43539841761 [term 4 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:24.377002 16888 raft_consensus.cc:2272] T 5939b6a960ea4b0581b61ccdcdfa7c37 P 10dfae53d0c941f08bded43539841761 [term 4 FOLLOWER]: Raft consensus is shut down!
W20251023 07:59:24.378710 18753 consensus_peers.cc:597] T ce0069d7c0cf4dee84a85731209358f7 P d1a8f61d3323447282ee6068aa623216 -> Peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Couldn't send request to peer 10dfae53d0c941f08bded43539841761. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:24.379341 16888 tablet_replica.cc:333] T 732495dddec64a3aa196110bfda45b37 P 10dfae53d0c941f08bded43539841761: stopping tablet replica
I20251023 07:59:24.379794 16888 raft_consensus.cc:2243] T 732495dddec64a3aa196110bfda45b37 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:24.380191 16888 raft_consensus.cc:2272] T 732495dddec64a3aa196110bfda45b37 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.382184 16888 tablet_replica.cc:333] T 7fe190354178418bae8b7cc5abbb74ef P 10dfae53d0c941f08bded43539841761: stopping tablet replica
I20251023 07:59:24.382688 16888 raft_consensus.cc:2243] T 7fe190354178418bae8b7cc5abbb74ef P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:24.383113 16888 raft_consensus.cc:2272] T 7fe190354178418bae8b7cc5abbb74ef P 10dfae53d0c941f08bded43539841761 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.384815 16888 tablet_replica.cc:333] T e4884051da6c4cdc9e0811e70667dd19 P 10dfae53d0c941f08bded43539841761: stopping tablet replica
I20251023 07:59:24.385226 16888 raft_consensus.cc:2243] T e4884051da6c4cdc9e0811e70667dd19 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:24.385632 16888 raft_consensus.cc:2272] T e4884051da6c4cdc9e0811e70667dd19 P 10dfae53d0c941f08bded43539841761 [term 1 FOLLOWER]: Raft consensus is shut down!
W20251023 07:59:24.393180 18215 consensus_peers.cc:597] T 14e6f2c3d85b437cac3ead436d5494a7 P 982df35c5b554a8fa64807352c4f34ee -> Peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Couldn't send request to peer 10dfae53d0c941f08bded43539841761. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251023 07:59:24.487706 18753 consensus_peers.cc:597] T 2d81605b8fe7427b94af7f3c481ed765 P d1a8f61d3323447282ee6068aa623216 -> Peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Couldn't send request to peer 10dfae53d0c941f08bded43539841761. Status: Network error: Client connection negotiation failed: client connection to 127.16.126.2:45799: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:24.524219 16888 tablet_server.cc:195] TabletServer@127.16.126.2:0 shutdown complete.
W20251023 07:59:24.550637 18215 consensus_peers.cc:597] T e4884051da6c4cdc9e0811e70667dd19 P 982df35c5b554a8fa64807352c4f34ee -> Peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Couldn't send request to peer 10dfae53d0c941f08bded43539841761. Status: Network error: Client connection negotiation failed: client connection to 127.16.126.2:45799: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251023 07:59:24.552881 18215 consensus_peers.cc:597] T 714c3ef74ecc47419a20ab7e23217e5e P 982df35c5b554a8fa64807352c4f34ee -> Peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Couldn't send request to peer 10dfae53d0c941f08bded43539841761. Status: Network error: Client connection negotiation failed: client connection to 127.16.126.2:45799: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251023 07:59:24.561241 18215 consensus_peers.cc:597] T 5f7e006a09224285b1e5df5694ff72ae P 982df35c5b554a8fa64807352c4f34ee -> Peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Couldn't send request to peer 10dfae53d0c941f08bded43539841761. Status: Network error: Client connection negotiation failed: client connection to 127.16.126.2:45799: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251023 07:59:24.569595 18215 consensus_peers.cc:597] T eb40d8c2f73d48868bfc3ef3889bea45 P 982df35c5b554a8fa64807352c4f34ee -> Peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Couldn't send request to peer 10dfae53d0c941f08bded43539841761. Status: Network error: Client connection negotiation failed: client connection to 127.16.126.2:45799: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251023 07:59:24.587044 18753 consensus_peers.cc:597] T 063924334ed846f3bd41c36cc4651236 P d1a8f61d3323447282ee6068aa623216 -> Peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Couldn't send request to peer 10dfae53d0c941f08bded43539841761. Status: Network error: Client connection negotiation failed: client connection to 127.16.126.2:45799: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:24.601534 19851 raft_consensus.cc:493] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3a1328f9c8c484fab08292ce2171ec9)
I20251023 07:59:24.602188 19851 raft_consensus.cc:515] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:24.604184 19851 leader_election.cc:290] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), d1a8f61d3323447282ee6068aa623216 (127.16.126.4:33293)
I20251023 07:59:24.605497 18787 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3e78cdb4b2af4f5a855ec00a07f2cbc9" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d1a8f61d3323447282ee6068aa623216" is_pre_election: true
W20251023 07:59:24.608750 18217 leader_election.cc:336] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): Network error: Client connection negotiation failed: client connection to 127.16.126.1:44025: connect: Connection refused (error 111)
I20251023 07:59:24.609273 18217 leader_election.cc:304] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee; no voters: b3a1328f9c8c484fab08292ce2171ec9, d1a8f61d3323447282ee6068aa623216
I20251023 07:59:24.610098 19851 raft_consensus.cc:2749] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20251023 07:59:24.616698 18753 consensus_peers.cc:597] T 3e4d005972f44619b0cf23f4978f51c4 P d1a8f61d3323447282ee6068aa623216 -> Peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Couldn't send request to peer 10dfae53d0c941f08bded43539841761. Status: Network error: Client connection negotiation failed: client connection to 127.16.126.2:45799: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:24.624356 16888 tablet_server.cc:178] TabletServer@127.16.126.3:0 shutting down...
I20251023 07:59:24.658800 19851 raft_consensus.cc:493] T 94cd6588f7824a30ba02f891ae089671 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b3a1328f9c8c484fab08292ce2171ec9)
I20251023 07:59:24.661151 19851 raft_consensus.cc:515] T 94cd6588f7824a30ba02f891ae089671 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:24.663980 19851 leader_election.cc:290] T 94cd6588f7824a30ba02f891ae089671 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), d1a8f61d3323447282ee6068aa623216 (127.16.126.4:33293)
I20251023 07:59:24.665324 18787 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "94cd6588f7824a30ba02f891ae089671" candidate_uuid: "982df35c5b554a8fa64807352c4f34ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d1a8f61d3323447282ee6068aa623216" is_pre_election: true
W20251023 07:59:24.667544 18754 consensus_peers.cc:597] T 33ee36de303b458e88fa6bad4587c0e6 P d1a8f61d3323447282ee6068aa623216 -> Peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Couldn't send request to peer 982df35c5b554a8fa64807352c4f34ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251023 07:59:24.667712 18217 leader_election.cc:336] T 94cd6588f7824a30ba02f891ae089671 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): Network error: Client connection negotiation failed: client connection to 127.16.126.1:44025: connect: Connection refused (error 111)
I20251023 07:59:24.668210 18217 leader_election.cc:304] T 94cd6588f7824a30ba02f891ae089671 P 982df35c5b554a8fa64807352c4f34ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 982df35c5b554a8fa64807352c4f34ee; no voters: b3a1328f9c8c484fab08292ce2171ec9, d1a8f61d3323447282ee6068aa623216
I20251023 07:59:24.668745 19851 raft_consensus.cc:2749] T 94cd6588f7824a30ba02f891ae089671 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251023 07:59:24.672178 16888 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251023 07:59:24.673063 16888 tablet_replica.cc:333] T 9bc482083f3b4c9ba97b8769ece194ad P 982df35c5b554a8fa64807352c4f34ee: stopping tablet replica
I20251023 07:59:24.673756 16888 raft_consensus.cc:2243] T 9bc482083f3b4c9ba97b8769ece194ad P 982df35c5b554a8fa64807352c4f34ee [term 2 LEADER]: Raft consensus shutting down.
I20251023 07:59:24.674525 16888 raft_consensus.cc:2272] T 9bc482083f3b4c9ba97b8769ece194ad P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.676491 16888 tablet_replica.cc:333] T d3b72ceda32a4ebc8de6e7a7992498aa P 982df35c5b554a8fa64807352c4f34ee: stopping tablet replica
I20251023 07:59:24.677171 16888 raft_consensus.cc:2243] T d3b72ceda32a4ebc8de6e7a7992498aa P 982df35c5b554a8fa64807352c4f34ee [term 5 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:24.677701 16888 raft_consensus.cc:2272] T d3b72ceda32a4ebc8de6e7a7992498aa P 982df35c5b554a8fa64807352c4f34ee [term 5 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.679507 16888 tablet_replica.cc:333] T 8f25975c7ab4439c9975a5e5604727dc P 982df35c5b554a8fa64807352c4f34ee: stopping tablet replica
I20251023 07:59:24.680051 16888 raft_consensus.cc:2243] T 8f25975c7ab4439c9975a5e5604727dc P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:24.680532 16888 raft_consensus.cc:2272] T 8f25975c7ab4439c9975a5e5604727dc P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.682740 16888 tablet_replica.cc:333] T 85799f6eb6ae41fa9620accb877d8708 P 982df35c5b554a8fa64807352c4f34ee: stopping tablet replica
I20251023 07:59:24.683459 16888 raft_consensus.cc:2243] T 85799f6eb6ae41fa9620accb877d8708 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:24.684985 16888 raft_consensus.cc:2272] T 85799f6eb6ae41fa9620accb877d8708 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.687450 16888 tablet_replica.cc:333] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P 982df35c5b554a8fa64807352c4f34ee: stopping tablet replica
I20251023 07:59:24.688192 16888 raft_consensus.cc:2243] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:24.688751 16888 raft_consensus.cc:2272] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.691052 16888 tablet_replica.cc:333] T ce0cc368c5054eef9dca968072a2d4fd P 982df35c5b554a8fa64807352c4f34ee: stopping tablet replica
I20251023 07:59:24.691660 16888 raft_consensus.cc:2243] T ce0cc368c5054eef9dca968072a2d4fd P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:24.692351 16888 raft_consensus.cc:2272] T ce0cc368c5054eef9dca968072a2d4fd P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.694372 16888 tablet_replica.cc:333] T 3c5c040d6ebe40e5a5be6be47de5a7bc P 982df35c5b554a8fa64807352c4f34ee: stopping tablet replica
I20251023 07:59:24.694871 16888 raft_consensus.cc:2243] T 3c5c040d6ebe40e5a5be6be47de5a7bc P 982df35c5b554a8fa64807352c4f34ee [term 3 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:24.695235 16888 raft_consensus.cc:2272] T 3c5c040d6ebe40e5a5be6be47de5a7bc P 982df35c5b554a8fa64807352c4f34ee [term 3 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.696848 16888 tablet_replica.cc:333] T 063924334ed846f3bd41c36cc4651236 P 982df35c5b554a8fa64807352c4f34ee: stopping tablet replica
I20251023 07:59:24.697361 16888 raft_consensus.cc:2243] T 063924334ed846f3bd41c36cc4651236 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:24.697808 16888 raft_consensus.cc:2272] T 063924334ed846f3bd41c36cc4651236 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.699359 16888 tablet_replica.cc:333] T 94cd6588f7824a30ba02f891ae089671 P 982df35c5b554a8fa64807352c4f34ee: stopping tablet replica
I20251023 07:59:24.699817 16888 raft_consensus.cc:2243] T 94cd6588f7824a30ba02f891ae089671 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:24.700335 16888 raft_consensus.cc:2272] T 94cd6588f7824a30ba02f891ae089671 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.702100 16888 tablet_replica.cc:333] T 1f539da81d60449b9d96866c7ceee1be P 982df35c5b554a8fa64807352c4f34ee: stopping tablet replica
I20251023 07:59:24.702981 16888 raft_consensus.cc:2243] T 1f539da81d60449b9d96866c7ceee1be P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:24.704059 16888 raft_consensus.cc:2272] T 1f539da81d60449b9d96866c7ceee1be P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.706774 16888 tablet_replica.cc:333] T 7a0f3569fcc34ba8b721d4ca9f31b6fa P 982df35c5b554a8fa64807352c4f34ee: stopping tablet replica
I20251023 07:59:24.707517 16888 raft_consensus.cc:2243] T 7a0f3569fcc34ba8b721d4ca9f31b6fa P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:24.707950 19835 raft_consensus.cc:493] T fbc1ceb70a0c42c6871ea24480ee4221 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3a1328f9c8c484fab08292ce2171ec9)
I20251023 07:59:24.708076 16888 raft_consensus.cc:2272] T 7a0f3569fcc34ba8b721d4ca9f31b6fa P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.708411 19835 raft_consensus.cc:515] T fbc1ceb70a0c42c6871ea24480ee4221 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:24.710536 19835 leader_election.cc:290] T fbc1ceb70a0c42c6871ea24480ee4221 P d1a8f61d3323447282ee6068aa623216 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:59:24.710729 16888 tablet_replica.cc:333] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P 982df35c5b554a8fa64807352c4f34ee: stopping tablet replica
I20251023 07:59:24.711529 16888 raft_consensus.cc:2243] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:24.712055 16888 raft_consensus.cc:2272] T 0d6dd28a0f414e8e93fe9cf4c98ce4a2 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Raft consensus is shut down!
W20251023 07:59:24.713730 18754 consensus_peers.cc:597] T a939fd9e853a45d1aa626a4566c14abc P d1a8f61d3323447282ee6068aa623216 -> Peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Couldn't send request to peer 982df35c5b554a8fa64807352c4f34ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:24.714433 16888 tablet_replica.cc:333] T 79fcf5e4a38448ba95c62cc1ffe2823a P 982df35c5b554a8fa64807352c4f34ee: stopping tablet replica
W20251023 07:59:24.714589 18753 leader_election.cc:336] T fbc1ceb70a0c42c6871ea24480ee4221 P d1a8f61d3323447282ee6068aa623216 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Network error: Client connection negotiation failed: client connection to 127.16.126.2:45799: connect: Connection refused (error 111)
I20251023 07:59:24.715234 16888 raft_consensus.cc:2243] T 79fcf5e4a38448ba95c62cc1ffe2823a P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:24.715955 16888 raft_consensus.cc:2272] T 79fcf5e4a38448ba95c62cc1ffe2823a P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.718267 16888 tablet_replica.cc:333] T 1f437560602a470ca62b7a1fa9471026 P 982df35c5b554a8fa64807352c4f34ee: stopping tablet replica
I20251023 07:59:24.718953 16888 raft_consensus.cc:2243] T 1f437560602a470ca62b7a1fa9471026 P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:24.719887 16888 raft_consensus.cc:2272] T 1f437560602a470ca62b7a1fa9471026 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Raft consensus is shut down!
W20251023 07:59:24.720307 18753 consensus_peers.cc:597] T 33ee36de303b458e88fa6bad4587c0e6 P d1a8f61d3323447282ee6068aa623216 -> Peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Couldn't send request to peer 10dfae53d0c941f08bded43539841761. Status: Network error: Client connection negotiation failed: client connection to 127.16.126.2:45799: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:24.721742 16888 tablet_replica.cc:333] T 07b28d84c73d42d583d6f80199700309 P 982df35c5b554a8fa64807352c4f34ee: stopping tablet replica
I20251023 07:59:24.722309 16888 raft_consensus.cc:2243] T 07b28d84c73d42d583d6f80199700309 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:24.722729 16888 raft_consensus.cc:2272] T 07b28d84c73d42d583d6f80199700309 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.724912 16888 tablet_replica.cc:333] T 714c3ef74ecc47419a20ab7e23217e5e P 982df35c5b554a8fa64807352c4f34ee: stopping tablet replica
I20251023 07:59:24.725513 16888 raft_consensus.cc:2243] T 714c3ef74ecc47419a20ab7e23217e5e P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:24.726197 16888 raft_consensus.cc:2272] T 714c3ef74ecc47419a20ab7e23217e5e P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.727876 16888 tablet_replica.cc:333] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 982df35c5b554a8fa64807352c4f34ee: stopping tablet replica
I20251023 07:59:24.728367 16888 raft_consensus.cc:2243] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:24.729096 16888 raft_consensus.cc:2272] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.731012 16888 tablet_replica.cc:333] T 3e4d005972f44619b0cf23f4978f51c4 P 982df35c5b554a8fa64807352c4f34ee: stopping tablet replica
I20251023 07:59:24.731525 16888 raft_consensus.cc:2243] T 3e4d005972f44619b0cf23f4978f51c4 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:24.731958 16888 raft_consensus.cc:2272] T 3e4d005972f44619b0cf23f4978f51c4 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Raft consensus is shut down!
W20251023 07:59:24.732635 18754 consensus_peers.cc:597] T fe0293c22cae49cfa7cd698f17626a35 P d1a8f61d3323447282ee6068aa623216 -> Peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Couldn't send request to peer 982df35c5b554a8fa64807352c4f34ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:24.733623 16888 tablet_replica.cc:333] T 1178e2ed919b40f29672fc6233b71cf3 P 982df35c5b554a8fa64807352c4f34ee: stopping tablet replica
I20251023 07:59:24.734170 16888 raft_consensus.cc:2243] T 1178e2ed919b40f29672fc6233b71cf3 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:24.734587 16888 raft_consensus.cc:2272] T 1178e2ed919b40f29672fc6233b71cf3 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.736270 16888 tablet_replica.cc:333] T 14e6f2c3d85b437cac3ead436d5494a7 P 982df35c5b554a8fa64807352c4f34ee: stopping tablet replica
I20251023 07:59:24.736766 16888 raft_consensus.cc:2243] T 14e6f2c3d85b437cac3ead436d5494a7 P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:24.737501 16888 raft_consensus.cc:2272] T 14e6f2c3d85b437cac3ead436d5494a7 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.739302 16888 tablet_replica.cc:333] T 231c8691a471417c859146b4e7b4b440 P 982df35c5b554a8fa64807352c4f34ee: stopping tablet replica
I20251023 07:59:24.739825 16888 raft_consensus.cc:2243] T 231c8691a471417c859146b4e7b4b440 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:24.740191 16888 raft_consensus.cc:2272] T 231c8691a471417c859146b4e7b4b440 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.742266 16888 tablet_replica.cc:333] T 33ee36de303b458e88fa6bad4587c0e6 P 982df35c5b554a8fa64807352c4f34ee: stopping tablet replica
I20251023 07:59:24.742875 16888 raft_consensus.cc:2243] T 33ee36de303b458e88fa6bad4587c0e6 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:24.743590 16888 raft_consensus.cc:2272] T 33ee36de303b458e88fa6bad4587c0e6 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.745846 16888 tablet_replica.cc:333] T a83dfc7a7d784b52b9c74bbc451ad603 P 982df35c5b554a8fa64807352c4f34ee: stopping tablet replica
I20251023 07:59:24.746553 16888 raft_consensus.cc:2243] T a83dfc7a7d784b52b9c74bbc451ad603 P 982df35c5b554a8fa64807352c4f34ee [term 4 LEADER]: Raft consensus shutting down.
I20251023 07:59:24.747267 16888 raft_consensus.cc:2272] T a83dfc7a7d784b52b9c74bbc451ad603 P 982df35c5b554a8fa64807352c4f34ee [term 4 FOLLOWER]: Raft consensus is shut down!
W20251023 07:59:24.748066 18754 consensus_peers.cc:597] T 063924334ed846f3bd41c36cc4651236 P d1a8f61d3323447282ee6068aa623216 -> Peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Couldn't send request to peer 982df35c5b554a8fa64807352c4f34ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:24.749243 16888 tablet_replica.cc:333] T c63b5a4dc8eb4b6e918608f281183068 P 982df35c5b554a8fa64807352c4f34ee: stopping tablet replica
I20251023 07:59:24.749866 16888 raft_consensus.cc:2243] T c63b5a4dc8eb4b6e918608f281183068 P 982df35c5b554a8fa64807352c4f34ee [term 4 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:24.750270 16888 raft_consensus.cc:2272] T c63b5a4dc8eb4b6e918608f281183068 P 982df35c5b554a8fa64807352c4f34ee [term 4 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.752535 16888 tablet_replica.cc:333] T b19b550093fb4ab181e62957d89460e7 P 982df35c5b554a8fa64807352c4f34ee: stopping tablet replica
I20251023 07:59:24.753334 16888 raft_consensus.cc:2243] T b19b550093fb4ab181e62957d89460e7 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:24.754127 16888 raft_consensus.cc:2272] T b19b550093fb4ab181e62957d89460e7 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.756932 16888 tablet_replica.cc:333] T e85adbfd669946ce9f939c02865fea6a P 982df35c5b554a8fa64807352c4f34ee: stopping tablet replica
I20251023 07:59:24.761883 16888 raft_consensus.cc:2243] T e85adbfd669946ce9f939c02865fea6a P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:24.762751 16888 raft_consensus.cc:2272] T e85adbfd669946ce9f939c02865fea6a P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.764598 16888 tablet_replica.cc:333] T c6c529d344cc483a96dbb509ca4c5890 P 982df35c5b554a8fa64807352c4f34ee: stopping tablet replica
I20251023 07:59:24.765143 16888 raft_consensus.cc:2243] T c6c529d344cc483a96dbb509ca4c5890 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:24.765589 16888 raft_consensus.cc:2272] T c6c529d344cc483a96dbb509ca4c5890 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.767305 16888 tablet_replica.cc:333] T 3d1032da07fd44be9c392e8f4cd2af1f P 982df35c5b554a8fa64807352c4f34ee: stopping tablet replica
I20251023 07:59:24.767843 16888 raft_consensus.cc:2243] T 3d1032da07fd44be9c392e8f4cd2af1f P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:24.768205 16888 raft_consensus.cc:2272] T 3d1032da07fd44be9c392e8f4cd2af1f P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.770071 16888 tablet_replica.cc:333] T b9841e711f8e4a019c2d0dec5409474c P 982df35c5b554a8fa64807352c4f34ee: stopping tablet replica
I20251023 07:59:24.770565 16888 raft_consensus.cc:2243] T b9841e711f8e4a019c2d0dec5409474c P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:24.770948 16888 raft_consensus.cc:2272] T b9841e711f8e4a019c2d0dec5409474c P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.772591 16888 tablet_replica.cc:333] T 25d22e66fcd6444a9b9c469acd781e59 P 982df35c5b554a8fa64807352c4f34ee: stopping tablet replica
I20251023 07:59:24.773092 16888 raft_consensus.cc:2243] T 25d22e66fcd6444a9b9c469acd781e59 P 982df35c5b554a8fa64807352c4f34ee [term 3 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:24.773602 16888 raft_consensus.cc:2272] T 25d22e66fcd6444a9b9c469acd781e59 P 982df35c5b554a8fa64807352c4f34ee [term 3 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.775422 16888 tablet_replica.cc:333] T fe0293c22cae49cfa7cd698f17626a35 P 982df35c5b554a8fa64807352c4f34ee: stopping tablet replica
I20251023 07:59:24.775923 16888 raft_consensus.cc:2243] T fe0293c22cae49cfa7cd698f17626a35 P 982df35c5b554a8fa64807352c4f34ee [term 3 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:24.776430 16888 raft_consensus.cc:2272] T fe0293c22cae49cfa7cd698f17626a35 P 982df35c5b554a8fa64807352c4f34ee [term 3 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.778175 16888 tablet_replica.cc:333] T e99e859ac34a47c4b2859ec2638d17e5 P 982df35c5b554a8fa64807352c4f34ee: stopping tablet replica
I20251023 07:59:24.778677 16888 raft_consensus.cc:2243] T e99e859ac34a47c4b2859ec2638d17e5 P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:24.779439 16888 raft_consensus.cc:2272] T e99e859ac34a47c4b2859ec2638d17e5 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.781091 16888 tablet_replica.cc:333] T 33c314b036134d929890c744d68bc0cc P 982df35c5b554a8fa64807352c4f34ee: stopping tablet replica
I20251023 07:59:24.781651 16888 raft_consensus.cc:2243] T 33c314b036134d929890c744d68bc0cc P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:24.782051 16888 raft_consensus.cc:2272] T 33c314b036134d929890c744d68bc0cc P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.783754 16888 tablet_replica.cc:333] T eb40d8c2f73d48868bfc3ef3889bea45 P 982df35c5b554a8fa64807352c4f34ee: stopping tablet replica
I20251023 07:59:24.784237 16888 raft_consensus.cc:2243] T eb40d8c2f73d48868bfc3ef3889bea45 P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:24.784952 16888 raft_consensus.cc:2272] T eb40d8c2f73d48868bfc3ef3889bea45 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.787077 16888 tablet_replica.cc:333] T c8b2781a072e401dba80e2879748e681 P 982df35c5b554a8fa64807352c4f34ee: stopping tablet replica
I20251023 07:59:24.787572 16888 raft_consensus.cc:2243] T c8b2781a072e401dba80e2879748e681 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:24.787955 16888 raft_consensus.cc:2272] T c8b2781a072e401dba80e2879748e681 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.789603 16888 tablet_replica.cc:333] T 4117fd2188e14b9aacc56f82245a3cc6 P 982df35c5b554a8fa64807352c4f34ee: stopping tablet replica
I20251023 07:59:24.790102 16888 raft_consensus.cc:2243] T 4117fd2188e14b9aacc56f82245a3cc6 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:24.790489 16888 raft_consensus.cc:2272] T 4117fd2188e14b9aacc56f82245a3cc6 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.792228 16888 tablet_replica.cc:333] T eeadb773c7dc416581b44225256a4c3b P 982df35c5b554a8fa64807352c4f34ee: stopping tablet replica
I20251023 07:59:24.792721 16888 raft_consensus.cc:2243] T eeadb773c7dc416581b44225256a4c3b P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:24.793258 16888 raft_consensus.cc:2272] T eeadb773c7dc416581b44225256a4c3b P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.794947 16888 tablet_replica.cc:333] T 1f184d89e4244f12af7afd690bc7027d P 982df35c5b554a8fa64807352c4f34ee: stopping tablet replica
I20251023 07:59:24.795445 16888 raft_consensus.cc:2243] T 1f184d89e4244f12af7afd690bc7027d P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:24.795976 16888 raft_consensus.cc:2272] T 1f184d89e4244f12af7afd690bc7027d P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.797732 16888 tablet_replica.cc:333] T 01f269ca63a8498498956fb3577f35d3 P 982df35c5b554a8fa64807352c4f34ee: stopping tablet replica
I20251023 07:59:24.798211 16888 raft_consensus.cc:2243] T 01f269ca63a8498498956fb3577f35d3 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:24.798651 16888 raft_consensus.cc:2272] T 01f269ca63a8498498956fb3577f35d3 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.800202 16888 tablet_replica.cc:333] T 5d4096f60c864412bb51be0c52c22961 P 982df35c5b554a8fa64807352c4f34ee: stopping tablet replica
I20251023 07:59:24.800700 16888 raft_consensus.cc:2243] T 5d4096f60c864412bb51be0c52c22961 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:24.801082 16888 raft_consensus.cc:2272] T 5d4096f60c864412bb51be0c52c22961 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.802841 16888 tablet_replica.cc:333] T 5f7e006a09224285b1e5df5694ff72ae P 982df35c5b554a8fa64807352c4f34ee: stopping tablet replica
I20251023 07:59:24.803295 16888 raft_consensus.cc:2243] T 5f7e006a09224285b1e5df5694ff72ae P 982df35c5b554a8fa64807352c4f34ee [term 2 LEADER]: Raft consensus shutting down.
I20251023 07:59:24.804065 16888 raft_consensus.cc:2272] T 5f7e006a09224285b1e5df5694ff72ae P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.805743 16888 tablet_replica.cc:333] T 744a3368282b44d9b9618922875d20d3 P 982df35c5b554a8fa64807352c4f34ee: stopping tablet replica
I20251023 07:59:24.806201 16888 raft_consensus.cc:2243] T 744a3368282b44d9b9618922875d20d3 P 982df35c5b554a8fa64807352c4f34ee [term 2 LEADER]: Raft consensus shutting down.
I20251023 07:59:24.806960 16888 raft_consensus.cc:2272] T 744a3368282b44d9b9618922875d20d3 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.807221 19835 raft_consensus.cc:493] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3a1328f9c8c484fab08292ce2171ec9)
I20251023 07:59:24.807720 19835 raft_consensus.cc:515] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:24.808889 16888 tablet_replica.cc:333] T 732495dddec64a3aa196110bfda45b37 P 982df35c5b554a8fa64807352c4f34ee: stopping tablet replica
I20251023 07:59:24.809315 19835 leader_election.cc:290] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P d1a8f61d3323447282ee6068aa623216 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:59:24.809597 16888 raft_consensus.cc:2243] T 732495dddec64a3aa196110bfda45b37 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:24.810173 16888 raft_consensus.cc:2272] T 732495dddec64a3aa196110bfda45b37 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Raft consensus is shut down!
W20251023 07:59:24.812024 18754 leader_election.cc:336] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P d1a8f61d3323447282ee6068aa623216 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251023 07:59:24.812204 16888 tablet_replica.cc:333] T e4884051da6c4cdc9e0811e70667dd19 P 982df35c5b554a8fa64807352c4f34ee: stopping tablet replica
I20251023 07:59:24.812791 16888 raft_consensus.cc:2243] T e4884051da6c4cdc9e0811e70667dd19 P 982df35c5b554a8fa64807352c4f34ee [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:24.813539 16888 raft_consensus.cc:2272] T e4884051da6c4cdc9e0811e70667dd19 P 982df35c5b554a8fa64807352c4f34ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.815471 16888 tablet_replica.cc:333] T a939fd9e853a45d1aa626a4566c14abc P 982df35c5b554a8fa64807352c4f34ee: stopping tablet replica
I20251023 07:59:24.815969 16888 raft_consensus.cc:2243] T a939fd9e853a45d1aa626a4566c14abc P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:24.816365 16888 raft_consensus.cc:2272] T a939fd9e853a45d1aa626a4566c14abc P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.818251 16888 tablet_replica.cc:333] T abefe27ebb4c4179a8620d4e638fe119 P 982df35c5b554a8fa64807352c4f34ee: stopping tablet replica
I20251023 07:59:24.818642 16888 raft_consensus.cc:2243] T abefe27ebb4c4179a8620d4e638fe119 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:24.818979 16888 raft_consensus.cc:2272] T abefe27ebb4c4179a8620d4e638fe119 P 982df35c5b554a8fa64807352c4f34ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:24.821789 19835 raft_consensus.cc:493] T 94cd6588f7824a30ba02f891ae089671 P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b3a1328f9c8c484fab08292ce2171ec9)
I20251023 07:59:24.822260 19835 raft_consensus.cc:515] T 94cd6588f7824a30ba02f891ae089671 P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:24.823158 19837 raft_consensus.cc:493] T dad81a56e87946cbb2a7f3e33c2e2bd4 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3a1328f9c8c484fab08292ce2171ec9)
I20251023 07:59:24.823695 19837 raft_consensus.cc:515] T dad81a56e87946cbb2a7f3e33c2e2bd4 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:24.823930 19835 leader_election.cc:290] T 94cd6588f7824a30ba02f891ae089671 P d1a8f61d3323447282ee6068aa623216 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:59:24.824664 19835 raft_consensus.cc:493] T 55de6ceb03f343b09190cb2fb4bbe144 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3a1328f9c8c484fab08292ce2171ec9)
I20251023 07:59:24.825711 19837 leader_election.cc:290] T dad81a56e87946cbb2a7f3e33c2e2bd4 P d1a8f61d3323447282ee6068aa623216 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
I20251023 07:59:24.825142 19835 raft_consensus.cc:515] T 55de6ceb03f343b09190cb2fb4bbe144 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
W20251023 07:59:24.827538 18754 leader_election.cc:336] T 94cd6588f7824a30ba02f891ae089671 P d1a8f61d3323447282ee6068aa623216 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251023 07:59:24.827986 19835 leader_election.cc:290] T 55de6ceb03f343b09190cb2fb4bbe144 P d1a8f61d3323447282ee6068aa623216 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
W20251023 07:59:24.829907 18753 leader_election.cc:336] T dad81a56e87946cbb2a7f3e33c2e2bd4 P d1a8f61d3323447282ee6068aa623216 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Network error: Client connection negotiation failed: client connection to 127.16.126.2:45799: connect: Connection refused (error 111)
W20251023 07:59:24.832350 18753 leader_election.cc:336] T 55de6ceb03f343b09190cb2fb4bbe144 P d1a8f61d3323447282ee6068aa623216 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Network error: Client connection negotiation failed: client connection to 127.16.126.2:45799: connect: Connection refused (error 111)
I20251023 07:59:24.845327 19835 raft_consensus.cc:493] T ae4437d151054b59a0e93ca01a9609c7 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3a1328f9c8c484fab08292ce2171ec9)
I20251023 07:59:24.845856 19835 raft_consensus.cc:515] T ae4437d151054b59a0e93ca01a9609c7 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:24.847422 19835 leader_election.cc:290] T ae4437d151054b59a0e93ca01a9609c7 P d1a8f61d3323447282ee6068aa623216 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
W20251023 07:59:24.851249 18753 leader_election.cc:336] T ae4437d151054b59a0e93ca01a9609c7 P d1a8f61d3323447282ee6068aa623216 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Network error: Client connection negotiation failed: client connection to 127.16.126.2:45799: connect: Connection refused (error 111)
I20251023 07:59:24.855008 19837 raft_consensus.cc:493] T 5939b6a960ea4b0581b61ccdcdfa7c37 P d1a8f61d3323447282ee6068aa623216 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b3a1328f9c8c484fab08292ce2171ec9)
I20251023 07:59:24.855568 19837 raft_consensus.cc:515] T 5939b6a960ea4b0581b61ccdcdfa7c37 P d1a8f61d3323447282ee6068aa623216 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "10dfae53d0c941f08bded43539841761" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 45799 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:24.857522 19837 leader_election.cc:290] T 5939b6a960ea4b0581b61ccdcdfa7c37 P d1a8f61d3323447282ee6068aa623216 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799)
W20251023 07:59:24.858392 18754 consensus_peers.cc:597] T 1f184d89e4244f12af7afd690bc7027d P d1a8f61d3323447282ee6068aa623216 -> Peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Couldn't send request to peer 982df35c5b554a8fa64807352c4f34ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251023 07:59:24.861138 18753 leader_election.cc:336] T 5939b6a960ea4b0581b61ccdcdfa7c37 P d1a8f61d3323447282ee6068aa623216 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 10dfae53d0c941f08bded43539841761 (127.16.126.2:45799): Network error: Client connection negotiation failed: client connection to 127.16.126.2:45799: connect: Connection refused (error 111)
W20251023 07:59:24.873654 18754 consensus_peers.cc:597] T 3e4d005972f44619b0cf23f4978f51c4 P d1a8f61d3323447282ee6068aa623216 -> Peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Couldn't send request to peer 982df35c5b554a8fa64807352c4f34ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251023 07:59:24.892227 18754 consensus_peers.cc:597] T d3b72ceda32a4ebc8de6e7a7992498aa P d1a8f61d3323447282ee6068aa623216 -> Peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Couldn't send request to peer 982df35c5b554a8fa64807352c4f34ee. Status: Network error: Client connection negotiation failed: client connection to 127.16.126.3:46061: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:24.903219 16888 tablet_server.cc:195] TabletServer@127.16.126.3:0 shutdown complete.
W20251023 07:59:24.939273 18754 consensus_peers.cc:597] T abefe27ebb4c4179a8620d4e638fe119 P d1a8f61d3323447282ee6068aa623216 -> Peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Couldn't send request to peer 982df35c5b554a8fa64807352c4f34ee. Status: Network error: Client connection negotiation failed: client connection to 127.16.126.3:46061: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251023 07:59:24.976531 18754 consensus_peers.cc:597] T b9841e711f8e4a019c2d0dec5409474c P d1a8f61d3323447282ee6068aa623216 -> Peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Couldn't send request to peer 982df35c5b554a8fa64807352c4f34ee. Status: Network error: Client connection negotiation failed: client connection to 127.16.126.3:46061: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:24.991413 16888 tablet_server.cc:178] TabletServer@127.16.126.4:0 shutting down...
I20251023 07:59:25.032302 16888 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251023 07:59:25.033070 16888 tablet_replica.cc:333] T b19b550093fb4ab181e62957d89460e7 P d1a8f61d3323447282ee6068aa623216: stopping tablet replica
I20251023 07:59:25.033744 16888 raft_consensus.cc:2243] T b19b550093fb4ab181e62957d89460e7 P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:25.034370 16888 raft_consensus.cc:2272] T b19b550093fb4ab181e62957d89460e7 P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:25.037199 16888 tablet_replica.cc:333] T 33c314b036134d929890c744d68bc0cc P d1a8f61d3323447282ee6068aa623216: stopping tablet replica
I20251023 07:59:25.037866 16888 raft_consensus.cc:2243] T 33c314b036134d929890c744d68bc0cc P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:25.038463 16888 raft_consensus.cc:2272] T 33c314b036134d929890c744d68bc0cc P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:25.040319 16888 tablet_replica.cc:333] T e25fd146cb564be69022d0f53010bbfa P d1a8f61d3323447282ee6068aa623216: stopping tablet replica
I20251023 07:59:25.040940 16888 raft_consensus.cc:2243] T e25fd146cb564be69022d0f53010bbfa P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:25.041474 16888 raft_consensus.cc:2272] T e25fd146cb564be69022d0f53010bbfa P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:25.043165 16888 tablet_replica.cc:333] T 94cd6588f7824a30ba02f891ae089671 P d1a8f61d3323447282ee6068aa623216: stopping tablet replica
I20251023 07:59:25.043674 16888 raft_consensus.cc:2243] T 94cd6588f7824a30ba02f891ae089671 P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:25.044112 16888 raft_consensus.cc:2272] T 94cd6588f7824a30ba02f891ae089671 P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:25.045898 16888 tablet_replica.cc:333] T 01f269ca63a8498498956fb3577f35d3 P d1a8f61d3323447282ee6068aa623216: stopping tablet replica
I20251023 07:59:25.046391 16888 raft_consensus.cc:2243] T 01f269ca63a8498498956fb3577f35d3 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:25.046904 16888 raft_consensus.cc:2272] T 01f269ca63a8498498956fb3577f35d3 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:25.048820 16888 tablet_replica.cc:333] T d3b72ceda32a4ebc8de6e7a7992498aa P d1a8f61d3323447282ee6068aa623216: stopping tablet replica
I20251023 07:59:25.049352 16888 raft_consensus.cc:2243] T d3b72ceda32a4ebc8de6e7a7992498aa P d1a8f61d3323447282ee6068aa623216 [term 5 LEADER]: Raft consensus shutting down.
I20251023 07:59:25.050026 16888 raft_consensus.cc:2272] T d3b72ceda32a4ebc8de6e7a7992498aa P d1a8f61d3323447282ee6068aa623216 [term 5 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:25.051810 16888 tablet_replica.cc:333] T 1f539da81d60449b9d96866c7ceee1be P d1a8f61d3323447282ee6068aa623216: stopping tablet replica
I20251023 07:59:25.052433 16888 raft_consensus.cc:2243] T 1f539da81d60449b9d96866c7ceee1be P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:25.052335 19837 raft_consensus.cc:493] T 3c5c040d6ebe40e5a5be6be47de5a7bc P d1a8f61d3323447282ee6068aa623216 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b3a1328f9c8c484fab08292ce2171ec9)
I20251023 07:59:25.053205 16888 raft_consensus.cc:2272] T 1f539da81d60449b9d96866c7ceee1be P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:25.053013 19837 raft_consensus.cc:515] T 3c5c040d6ebe40e5a5be6be47de5a7bc P d1a8f61d3323447282ee6068aa623216 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3a1328f9c8c484fab08292ce2171ec9" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 44025 } } peers { permanent_uuid: "982df35c5b554a8fa64807352c4f34ee" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 46061 } } peers { permanent_uuid: "d1a8f61d3323447282ee6068aa623216" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 33293 } attrs { promote: false } }
I20251023 07:59:25.055244 19837 leader_election.cc:290] T 3c5c040d6ebe40e5a5be6be47de5a7bc P d1a8f61d3323447282ee6068aa623216 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025), 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061)
I20251023 07:59:25.056089 16888 tablet_replica.cc:333] T fbc1ceb70a0c42c6871ea24480ee4221 P d1a8f61d3323447282ee6068aa623216: stopping tablet replica
I20251023 07:59:25.056985 16888 raft_consensus.cc:2243] T fbc1ceb70a0c42c6871ea24480ee4221 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:25.057435 16888 raft_consensus.cc:2272] T fbc1ceb70a0c42c6871ea24480ee4221 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Raft consensus is shut down!
W20251023 07:59:25.059087 18754 leader_election.cc:336] T 3c5c040d6ebe40e5a5be6be47de5a7bc P d1a8f61d3323447282ee6068aa623216 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 982df35c5b554a8fa64807352c4f34ee (127.16.126.3:46061): Network error: Client connection negotiation failed: client connection to 127.16.126.3:46061: connect: Connection refused (error 111)
I20251023 07:59:25.059774 16888 tablet_replica.cc:333] T eb40d8c2f73d48868bfc3ef3889bea45 P d1a8f61d3323447282ee6068aa623216: stopping tablet replica
I20251023 07:59:25.060429 16888 raft_consensus.cc:2243] T eb40d8c2f73d48868bfc3ef3889bea45 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:25.060963 16888 raft_consensus.cc:2272] T eb40d8c2f73d48868bfc3ef3889bea45 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:25.062808 16888 tablet_replica.cc:333] T c6022ad5a70c4b4f8f34339956122cb7 P d1a8f61d3323447282ee6068aa623216: stopping tablet replica
I20251023 07:59:25.063364 16888 raft_consensus.cc:2243] T c6022ad5a70c4b4f8f34339956122cb7 P d1a8f61d3323447282ee6068aa623216 [term 4 LEADER]: Raft consensus shutting down.
I20251023 07:59:25.064013 16888 raft_consensus.cc:2272] T c6022ad5a70c4b4f8f34339956122cb7 P d1a8f61d3323447282ee6068aa623216 [term 4 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:25.065946 16888 tablet_replica.cc:333] T 5585a11a884140c7abc7d5a3b6ab86f3 P d1a8f61d3323447282ee6068aa623216: stopping tablet replica
I20251023 07:59:25.066488 16888 raft_consensus.cc:2243] T 5585a11a884140c7abc7d5a3b6ab86f3 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:25.066931 16888 raft_consensus.cc:2272] T 5585a11a884140c7abc7d5a3b6ab86f3 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:25.068598 16888 tablet_replica.cc:333] T fe0293c22cae49cfa7cd698f17626a35 P d1a8f61d3323447282ee6068aa623216: stopping tablet replica
I20251023 07:59:25.069110 16888 raft_consensus.cc:2243] T fe0293c22cae49cfa7cd698f17626a35 P d1a8f61d3323447282ee6068aa623216 [term 3 LEADER]: Raft consensus shutting down.
I20251023 07:59:25.069865 16888 raft_consensus.cc:2272] T fe0293c22cae49cfa7cd698f17626a35 P d1a8f61d3323447282ee6068aa623216 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:25.071525 16888 tablet_replica.cc:333] T 5939b6a960ea4b0581b61ccdcdfa7c37 P d1a8f61d3323447282ee6068aa623216: stopping tablet replica
I20251023 07:59:25.072031 16888 raft_consensus.cc:2243] T 5939b6a960ea4b0581b61ccdcdfa7c37 P d1a8f61d3323447282ee6068aa623216 [term 4 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:25.072397 16888 raft_consensus.cc:2272] T 5939b6a960ea4b0581b61ccdcdfa7c37 P d1a8f61d3323447282ee6068aa623216 [term 4 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:25.074113 16888 tablet_replica.cc:333] T 85799f6eb6ae41fa9620accb877d8708 P d1a8f61d3323447282ee6068aa623216: stopping tablet replica
I20251023 07:59:25.074635 16888 raft_consensus.cc:2243] T 85799f6eb6ae41fa9620accb877d8708 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Raft consensus shutting down.
W20251023 07:59:25.074766 18752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251023 07:59:25.075171 16888 raft_consensus.cc:2272] T 85799f6eb6ae41fa9620accb877d8708 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:25.077018 16888 tablet_replica.cc:333] T e99e859ac34a47c4b2859ec2638d17e5 P d1a8f61d3323447282ee6068aa623216: stopping tablet replica
I20251023 07:59:25.077797 16888 raft_consensus.cc:2243] T e99e859ac34a47c4b2859ec2638d17e5 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:25.078261 16888 raft_consensus.cc:2272] T e99e859ac34a47c4b2859ec2638d17e5 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:25.080504 16888 tablet_replica.cc:333] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P d1a8f61d3323447282ee6068aa623216: stopping tablet replica
I20251023 07:59:25.081291 16888 raft_consensus.cc:2243] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:25.081828 16888 raft_consensus.cc:2272] T 290b1b1fd4ef42cf9f0b285d4bf5ed36 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:25.083499 16888 tablet_replica.cc:333] T ce0069d7c0cf4dee84a85731209358f7 P d1a8f61d3323447282ee6068aa623216: stopping tablet replica
I20251023 07:59:25.083979 16888 raft_consensus.cc:2243] T ce0069d7c0cf4dee84a85731209358f7 P d1a8f61d3323447282ee6068aa623216 [term 2 LEADER]: Raft consensus shutting down.
I20251023 07:59:25.084542 16888 raft_consensus.cc:2272] T ce0069d7c0cf4dee84a85731209358f7 P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:25.086308 16888 tablet_replica.cc:333] T 931f55bec99140c69a4b5654b691c861 P d1a8f61d3323447282ee6068aa623216: stopping tablet replica
I20251023 07:59:25.086815 16888 raft_consensus.cc:2243] T 931f55bec99140c69a4b5654b691c861 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:25.087263 16888 raft_consensus.cc:2272] T 931f55bec99140c69a4b5654b691c861 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:25.088953 16888 tablet_replica.cc:333] T 1f437560602a470ca62b7a1fa9471026 P d1a8f61d3323447282ee6068aa623216: stopping tablet replica
I20251023 07:59:25.089494 16888 raft_consensus.cc:2243] T 1f437560602a470ca62b7a1fa9471026 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:25.089959 16888 raft_consensus.cc:2272] T 1f437560602a470ca62b7a1fa9471026 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:25.091677 16888 tablet_replica.cc:333] T 3c5c040d6ebe40e5a5be6be47de5a7bc P d1a8f61d3323447282ee6068aa623216: stopping tablet replica
I20251023 07:59:25.092180 16888 raft_consensus.cc:2243] T 3c5c040d6ebe40e5a5be6be47de5a7bc P d1a8f61d3323447282ee6068aa623216 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:25.092690 16888 raft_consensus.cc:2272] T 3c5c040d6ebe40e5a5be6be47de5a7bc P d1a8f61d3323447282ee6068aa623216 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:25.094359 16888 tablet_replica.cc:333] T eeadb773c7dc416581b44225256a4c3b P d1a8f61d3323447282ee6068aa623216: stopping tablet replica
I20251023 07:59:25.094863 16888 raft_consensus.cc:2243] T eeadb773c7dc416581b44225256a4c3b P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:25.095247 16888 raft_consensus.cc:2272] T eeadb773c7dc416581b44225256a4c3b P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:25.096892 16888 tablet_replica.cc:333] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P d1a8f61d3323447282ee6068aa623216: stopping tablet replica
I20251023 07:59:25.097381 16888 raft_consensus.cc:2243] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:25.097887 16888 raft_consensus.cc:2272] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:25.099565 16888 tablet_replica.cc:333] T a939fd9e853a45d1aa626a4566c14abc P d1a8f61d3323447282ee6068aa623216: stopping tablet replica
I20251023 07:59:25.100069 16888 raft_consensus.cc:2243] T a939fd9e853a45d1aa626a4566c14abc P d1a8f61d3323447282ee6068aa623216 [term 2 LEADER]: Raft consensus shutting down.
I20251023 07:59:25.100723 16888 raft_consensus.cc:2272] T a939fd9e853a45d1aa626a4566c14abc P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:25.102479 16888 tablet_replica.cc:333] T abefe27ebb4c4179a8620d4e638fe119 P d1a8f61d3323447282ee6068aa623216: stopping tablet replica
I20251023 07:59:25.102959 16888 raft_consensus.cc:2243] T abefe27ebb4c4179a8620d4e638fe119 P d1a8f61d3323447282ee6068aa623216 [term 2 LEADER]: Raft consensus shutting down.
I20251023 07:59:25.103534 16888 raft_consensus.cc:2272] T abefe27ebb4c4179a8620d4e638fe119 P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:25.105121 16888 tablet_replica.cc:333] T 063924334ed846f3bd41c36cc4651236 P d1a8f61d3323447282ee6068aa623216: stopping tablet replica
I20251023 07:59:25.105667 16888 raft_consensus.cc:2243] T 063924334ed846f3bd41c36cc4651236 P d1a8f61d3323447282ee6068aa623216 [term 2 LEADER]: Raft consensus shutting down.
I20251023 07:59:25.106329 16888 raft_consensus.cc:2272] T 063924334ed846f3bd41c36cc4651236 P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:25.107995 16888 tablet_replica.cc:333] T 744a3368282b44d9b9618922875d20d3 P d1a8f61d3323447282ee6068aa623216: stopping tablet replica
I20251023 07:59:25.108489 16888 raft_consensus.cc:2243] T 744a3368282b44d9b9618922875d20d3 P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:25.108870 16888 raft_consensus.cc:2272] T 744a3368282b44d9b9618922875d20d3 P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:25.110476 16888 tablet_replica.cc:333] T 2d81605b8fe7427b94af7f3c481ed765 P d1a8f61d3323447282ee6068aa623216: stopping tablet replica
I20251023 07:59:25.110984 16888 raft_consensus.cc:2243] T 2d81605b8fe7427b94af7f3c481ed765 P d1a8f61d3323447282ee6068aa623216 [term 2 LEADER]: Raft consensus shutting down.
I20251023 07:59:25.111603 16888 raft_consensus.cc:2272] T 2d81605b8fe7427b94af7f3c481ed765 P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:25.113828 16888 tablet_replica.cc:333] T 79fcf5e4a38448ba95c62cc1ffe2823a P d1a8f61d3323447282ee6068aa623216: stopping tablet replica
I20251023 07:59:25.114351 16888 raft_consensus.cc:2243] T 79fcf5e4a38448ba95c62cc1ffe2823a P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:25.114842 16888 raft_consensus.cc:2272] T 79fcf5e4a38448ba95c62cc1ffe2823a P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:25.116544 16888 tablet_replica.cc:333] T ae4437d151054b59a0e93ca01a9609c7 P d1a8f61d3323447282ee6068aa623216: stopping tablet replica
I20251023 07:59:25.117069 16888 raft_consensus.cc:2243] T ae4437d151054b59a0e93ca01a9609c7 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:25.117527 16888 raft_consensus.cc:2272] T ae4437d151054b59a0e93ca01a9609c7 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:25.119277 16888 tablet_replica.cc:333] T 25d22e66fcd6444a9b9c469acd781e59 P d1a8f61d3323447282ee6068aa623216: stopping tablet replica
I20251023 07:59:25.119801 16888 raft_consensus.cc:2243] T 25d22e66fcd6444a9b9c469acd781e59 P d1a8f61d3323447282ee6068aa623216 [term 3 LEARNER]: Raft consensus shutting down.
I20251023 07:59:25.120149 16888 raft_consensus.cc:2272] T 25d22e66fcd6444a9b9c469acd781e59 P d1a8f61d3323447282ee6068aa623216 [term 3 LEARNER]: Raft consensus is shut down!
I20251023 07:59:25.121851 16888 tablet_replica.cc:333] T e85adbfd669946ce9f939c02865fea6a P d1a8f61d3323447282ee6068aa623216: stopping tablet replica
I20251023 07:59:25.122380 16888 raft_consensus.cc:2243] T e85adbfd669946ce9f939c02865fea6a P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:25.122859 16888 raft_consensus.cc:2272] T e85adbfd669946ce9f939c02865fea6a P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:25.124501 16888 tablet_replica.cc:333] T b9841e711f8e4a019c2d0dec5409474c P d1a8f61d3323447282ee6068aa623216: stopping tablet replica
I20251023 07:59:25.125031 16888 raft_consensus.cc:2243] T b9841e711f8e4a019c2d0dec5409474c P d1a8f61d3323447282ee6068aa623216 [term 2 LEADER]: Raft consensus shutting down.
I20251023 07:59:25.125674 16888 raft_consensus.cc:2272] T b9841e711f8e4a019c2d0dec5409474c P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:25.127439 16888 tablet_replica.cc:333] T 9bc482083f3b4c9ba97b8769ece194ad P d1a8f61d3323447282ee6068aa623216: stopping tablet replica
I20251023 07:59:25.127956 16888 raft_consensus.cc:2243] T 9bc482083f3b4c9ba97b8769ece194ad P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:25.128443 16888 raft_consensus.cc:2272] T 9bc482083f3b4c9ba97b8769ece194ad P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:25.130218 16888 tablet_replica.cc:333] T c8b2781a072e401dba80e2879748e681 P d1a8f61d3323447282ee6068aa623216: stopping tablet replica
I20251023 07:59:25.130725 16888 raft_consensus.cc:2243] T c8b2781a072e401dba80e2879748e681 P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:25.131203 16888 raft_consensus.cc:2272] T c8b2781a072e401dba80e2879748e681 P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:25.132933 16888 tablet_replica.cc:333] T f90cf0955288472898eff5b7e6459195 P d1a8f61d3323447282ee6068aa623216: stopping tablet replica
I20251023 07:59:25.133467 16888 raft_consensus.cc:2243] T f90cf0955288472898eff5b7e6459195 P d1a8f61d3323447282ee6068aa623216 [term 2 LEADER]: Raft consensus shutting down.
I20251023 07:59:25.134083 16888 raft_consensus.cc:2272] T f90cf0955288472898eff5b7e6459195 P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:25.135819 16888 tablet_replica.cc:333] T dad81a56e87946cbb2a7f3e33c2e2bd4 P d1a8f61d3323447282ee6068aa623216: stopping tablet replica
I20251023 07:59:25.136284 16888 raft_consensus.cc:2243] T dad81a56e87946cbb2a7f3e33c2e2bd4 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:25.136744 16888 raft_consensus.cc:2272] T dad81a56e87946cbb2a7f3e33c2e2bd4 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:25.138455 16888 tablet_replica.cc:333] T 3e4d005972f44619b0cf23f4978f51c4 P d1a8f61d3323447282ee6068aa623216: stopping tablet replica
I20251023 07:59:25.138947 16888 raft_consensus.cc:2243] T 3e4d005972f44619b0cf23f4978f51c4 P d1a8f61d3323447282ee6068aa623216 [term 2 LEADER]: Raft consensus shutting down.
I20251023 07:59:25.139655 16888 raft_consensus.cc:2272] T 3e4d005972f44619b0cf23f4978f51c4 P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:25.141294 16888 tablet_replica.cc:333] T 8f25975c7ab4439c9975a5e5604727dc P d1a8f61d3323447282ee6068aa623216: stopping tablet replica
I20251023 07:59:25.141785 16888 raft_consensus.cc:2243] T 8f25975c7ab4439c9975a5e5604727dc P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:25.142153 16888 raft_consensus.cc:2272] T 8f25975c7ab4439c9975a5e5604727dc P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:25.143784 16888 tablet_replica.cc:333] T 1f184d89e4244f12af7afd690bc7027d P d1a8f61d3323447282ee6068aa623216: stopping tablet replica
I20251023 07:59:25.144230 16888 raft_consensus.cc:2243] T 1f184d89e4244f12af7afd690bc7027d P d1a8f61d3323447282ee6068aa623216 [term 2 LEADER]: Raft consensus shutting down.
I20251023 07:59:25.144836 16888 raft_consensus.cc:2272] T 1f184d89e4244f12af7afd690bc7027d P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:25.146420 16888 tablet_replica.cc:333] T 55de6ceb03f343b09190cb2fb4bbe144 P d1a8f61d3323447282ee6068aa623216: stopping tablet replica
I20251023 07:59:25.146878 16888 raft_consensus.cc:2243] T 55de6ceb03f343b09190cb2fb4bbe144 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:25.147302 16888 raft_consensus.cc:2272] T 55de6ceb03f343b09190cb2fb4bbe144 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:25.148890 16888 tablet_replica.cc:333] T 33ee36de303b458e88fa6bad4587c0e6 P d1a8f61d3323447282ee6068aa623216: stopping tablet replica
I20251023 07:59:25.149325 16888 raft_consensus.cc:2243] T 33ee36de303b458e88fa6bad4587c0e6 P d1a8f61d3323447282ee6068aa623216 [term 2 LEADER]: Raft consensus shutting down.
I20251023 07:59:25.150111 16888 raft_consensus.cc:2272] T 33ee36de303b458e88fa6bad4587c0e6 P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:25.151772 16888 tablet_replica.cc:333] T 7fe190354178418bae8b7cc5abbb74ef P d1a8f61d3323447282ee6068aa623216: stopping tablet replica
I20251023 07:59:25.152197 16888 raft_consensus.cc:2243] T 7fe190354178418bae8b7cc5abbb74ef P d1a8f61d3323447282ee6068aa623216 [term 2 LEADER]: Raft consensus shutting down.
I20251023 07:59:25.152760 16888 raft_consensus.cc:2272] T 7fe190354178418bae8b7cc5abbb74ef P d1a8f61d3323447282ee6068aa623216 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:25.154379 16888 tablet_replica.cc:333] T 14e6f2c3d85b437cac3ead436d5494a7 P d1a8f61d3323447282ee6068aa623216: stopping tablet replica
I20251023 07:59:25.154798 16888 raft_consensus.cc:2243] T 14e6f2c3d85b437cac3ead436d5494a7 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:25.155265 16888 raft_consensus.cc:2272] T 14e6f2c3d85b437cac3ead436d5494a7 P d1a8f61d3323447282ee6068aa623216 [term 1 FOLLOWER]: Raft consensus is shut down!
W20251023 07:59:25.194528 18754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251023 07:59:25.230484 18048 auto_rebalancer.cc:254] failed to send replica move request: Network error: Client connection negotiation failed: client connection to 127.16.126.2:45799: connect: Connection refused (error 111)
W20251023 07:59:25.236347 18048 auto_rebalancer.cc:663] Could not move replica: Network error: Client connection negotiation failed: client connection to 127.16.126.2:45799: connect: Connection refused (error 111)
W20251023 07:59:25.236634 18048 auto_rebalancer.cc:264] scheduled replica move failed to complete: Network error: Client connection negotiation failed: client connection to 127.16.126.2:45799: connect: Connection refused (error 111)
W20251023 07:59:25.240949 18048 auto_rebalancer.cc:663] Could not move replica: Network error: Client connection negotiation failed: client connection to 127.16.126.1:44025: connect: Connection refused (error 111)
W20251023 07:59:25.241184 18048 auto_rebalancer.cc:264] scheduled replica move failed to complete: Network error: Client connection negotiation failed: client connection to 127.16.126.1:44025: connect: Connection refused (error 111)
W20251023 07:59:25.275074 18752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251023 07:59:25.299749 17987 catalog_manager.cc:4712] TS b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet eb40d8c2f73d48868bfc3ef3889bea45: Network error: Client connection negotiation failed: client connection to 127.16.126.1:44025: connect: Connection refused (error 111)
W20251023 07:59:25.302924 18753 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251023 07:59:25.410569 18753 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251023 07:59:25.412954 19841 leader_election.cc:336] T dad81a56e87946cbb2a7f3e33c2e2bd4 P d1a8f61d3323447282ee6068aa623216 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): Service unavailable: reactor is shutting down (error 108)
I20251023 07:59:25.413467 19841 leader_election.cc:304] T dad81a56e87946cbb2a7f3e33c2e2bd4 P d1a8f61d3323447282ee6068aa623216 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d1a8f61d3323447282ee6068aa623216; no voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9
W20251023 07:59:25.414126 19841 raft_consensus.cc:2686] T dad81a56e87946cbb2a7f3e33c2e2bd4 P d1a8f61d3323447282ee6068aa623216: unable to run election callback: Service unavailable: Thread pool token was shut down
W20251023 07:59:25.414759 16888 leader_election.cc:336] T 3c5c040d6ebe40e5a5be6be47de5a7bc P d1a8f61d3323447282ee6068aa623216 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): Aborted: reactor is shutting down (error 108)
I20251023 07:59:25.415143 16888 leader_election.cc:304] T 3c5c040d6ebe40e5a5be6be47de5a7bc P d1a8f61d3323447282ee6068aa623216 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d1a8f61d3323447282ee6068aa623216; no voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9
W20251023 07:59:25.415639 16888 raft_consensus.cc:2686] T 3c5c040d6ebe40e5a5be6be47de5a7bc P d1a8f61d3323447282ee6068aa623216: unable to run election callback: Service unavailable: Thread pool token was shut down
W20251023 07:59:25.416126 19841 leader_election.cc:336] T 94cd6588f7824a30ba02f891ae089671 P d1a8f61d3323447282ee6068aa623216 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): Service unavailable: reactor is shutting down (error 108)
I20251023 07:59:25.416527 19841 leader_election.cc:304] T 94cd6588f7824a30ba02f891ae089671 P d1a8f61d3323447282ee6068aa623216 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d1a8f61d3323447282ee6068aa623216; no voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9
W20251023 07:59:25.416926 16888 leader_election.cc:336] T 5939b6a960ea4b0581b61ccdcdfa7c37 P d1a8f61d3323447282ee6068aa623216 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): Aborted: reactor is shutting down (error 108)
W20251023 07:59:25.417004 19841 raft_consensus.cc:2686] T 94cd6588f7824a30ba02f891ae089671 P d1a8f61d3323447282ee6068aa623216: unable to run election callback: Service unavailable: Thread pool token was shut down
I20251023 07:59:25.417306 16888 leader_election.cc:304] T 5939b6a960ea4b0581b61ccdcdfa7c37 P d1a8f61d3323447282ee6068aa623216 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d1a8f61d3323447282ee6068aa623216; no voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9
W20251023 07:59:25.417799 16888 raft_consensus.cc:2686] T 5939b6a960ea4b0581b61ccdcdfa7c37 P d1a8f61d3323447282ee6068aa623216: unable to run election callback: Service unavailable: Thread pool token was shut down
W20251023 07:59:25.418859 19841 leader_election.cc:336] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P d1a8f61d3323447282ee6068aa623216 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): Service unavailable: reactor is shutting down (error 108)
W20251023 07:59:25.419054 16888 leader_election.cc:336] T ae4437d151054b59a0e93ca01a9609c7 P d1a8f61d3323447282ee6068aa623216 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): Aborted: reactor is shutting down (error 108)
I20251023 07:59:25.419170 19841 leader_election.cc:304] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P d1a8f61d3323447282ee6068aa623216 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d1a8f61d3323447282ee6068aa623216; no voters: 982df35c5b554a8fa64807352c4f34ee, b3a1328f9c8c484fab08292ce2171ec9
I20251023 07:59:25.419416 16888 leader_election.cc:304] T ae4437d151054b59a0e93ca01a9609c7 P d1a8f61d3323447282ee6068aa623216 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d1a8f61d3323447282ee6068aa623216; no voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9
W20251023 07:59:25.419775 19841 raft_consensus.cc:2686] T 3e78cdb4b2af4f5a855ec00a07f2cbc9 P d1a8f61d3323447282ee6068aa623216: unable to run election callback: Service unavailable: Thread pool token was shut down
W20251023 07:59:25.419886 16888 raft_consensus.cc:2686] T ae4437d151054b59a0e93ca01a9609c7 P d1a8f61d3323447282ee6068aa623216: unable to run election callback: Service unavailable: Thread pool token was shut down
W20251023 07:59:25.421254 16888 leader_election.cc:336] T 55de6ceb03f343b09190cb2fb4bbe144 P d1a8f61d3323447282ee6068aa623216 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): Aborted: reactor is shutting down (error 108)
I20251023 07:59:25.421584 16888 leader_election.cc:304] T 55de6ceb03f343b09190cb2fb4bbe144 P d1a8f61d3323447282ee6068aa623216 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d1a8f61d3323447282ee6068aa623216; no voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9
W20251023 07:59:25.421810 19841 leader_election.cc:336] T fbc1ceb70a0c42c6871ea24480ee4221 P d1a8f61d3323447282ee6068aa623216 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): Service unavailable: reactor is shutting down (error 108)
W20251023 07:59:25.421981 16888 raft_consensus.cc:2686] T 55de6ceb03f343b09190cb2fb4bbe144 P d1a8f61d3323447282ee6068aa623216: unable to run election callback: Service unavailable: Thread pool token was shut down
I20251023 07:59:25.422201 19841 leader_election.cc:304] T fbc1ceb70a0c42c6871ea24480ee4221 P d1a8f61d3323447282ee6068aa623216 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d1a8f61d3323447282ee6068aa623216; no voters: 10dfae53d0c941f08bded43539841761, b3a1328f9c8c484fab08292ce2171ec9
W20251023 07:59:25.422683 19841 raft_consensus.cc:2686] T fbc1ceb70a0c42c6871ea24480ee4221 P d1a8f61d3323447282ee6068aa623216: unable to run election callback: Service unavailable: Thread pool token was shut down
I20251023 07:59:25.437826 16888 tablet_server.cc:195] TabletServer@127.16.126.4:0 shutdown complete.
I20251023 07:59:25.497808 16888 master.cc:561] Master@127.16.126.62:34671 shutting down...
W20251023 07:59:26.361627 17987 catalog_manager.cc:4712] TS b3a1328f9c8c484fab08292ce2171ec9 (127.16.126.1:44025): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet eb40d8c2f73d48868bfc3ef3889bea45: Network error: Client connection negotiation failed: client connection to 127.16.126.1:44025: connect: Connection refused (error 111)
I20251023 07:59:26.714706 16888 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 16353da55f05411089bb7a6142d6c048 [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:26.715351 16888 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 16353da55f05411089bb7a6142d6c048 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:26.715687 16888 tablet_replica.cc:333] T 00000000000000000000000000000000 P 16353da55f05411089bb7a6142d6c048: stopping tablet replica
I20251023 07:59:26.768253 16888 master.cc:583] Master@127.16.126.62:34671 shutdown complete.
[ OK ] LeaderRebalancerTest.AddTserver (52897 ms)
[ RUN ] LeaderRebalancerTest.RestartTserver
I20251023 07:59:26.859197 16888 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.16.126.62:42363
I20251023 07:59:26.860320 16888 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251023 07:59:26.865787 19876 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251023 07:59:26.865912 19877 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251023 07:59:26.868211 19879 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251023 07:59:26.868706 16888 server_base.cc:1047] running on GCE node
I20251023 07:59:26.870064 16888 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251023 07:59:26.870253 16888 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251023 07:59:26.870405 16888 hybrid_clock.cc:648] HybridClock initialized: now 1761206366870386 us; error 0 us; skew 500 ppm
I20251023 07:59:26.870954 16888 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20251023 07:59:26.873235 16888 webserver.cc:492] Webserver started at http://127.16.126.62:43711/ using document root <none> and password file <none>
I20251023 07:59:26.873715 16888 fs_manager.cc:362] Metadata directory not provided
I20251023 07:59:26.873888 16888 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251023 07:59:26.874153 16888 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251023 07:59:26.875242 16888 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1761206251627710-16888-0/minicluster-data/master-0-root/instance:
uuid: "e4ebfcaa20f24435b44962310834cb71"
format_stamp: "Formatted at 2025-10-23 07:59:26 on dist-test-slave-m488"
I20251023 07:59:26.879674 16888 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20251023 07:59:26.883095 19884 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251023 07:59:26.883886 16888 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20251023 07:59:26.884161 16888 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1761206251627710-16888-0/minicluster-data/master-0-root
uuid: "e4ebfcaa20f24435b44962310834cb71"
format_stamp: "Formatted at 2025-10-23 07:59:26 on dist-test-slave-m488"
I20251023 07:59:26.884408 16888 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1761206251627710-16888-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1761206251627710-16888-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1761206251627710-16888-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251023 07:59:26.893930 16888 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251023 07:59:26.895084 16888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251023 07:59:26.934219 16888 rpc_server.cc:307] RPC server started. Bound to: 127.16.126.62:42363
I20251023 07:59:26.934321 19935 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.126.62:42363 every 8 connection(s)
I20251023 07:59:26.938066 19936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:26.948236 19936 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e4ebfcaa20f24435b44962310834cb71: Bootstrap starting.
I20251023 07:59:26.953080 19936 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e4ebfcaa20f24435b44962310834cb71: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:26.957312 19936 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e4ebfcaa20f24435b44962310834cb71: No bootstrap required, opened a new log
I20251023 07:59:26.959370 19936 raft_consensus.cc:359] T 00000000000000000000000000000000 P e4ebfcaa20f24435b44962310834cb71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4ebfcaa20f24435b44962310834cb71" member_type: VOTER }
I20251023 07:59:26.959743 19936 raft_consensus.cc:385] T 00000000000000000000000000000000 P e4ebfcaa20f24435b44962310834cb71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:26.959936 19936 raft_consensus.cc:740] T 00000000000000000000000000000000 P e4ebfcaa20f24435b44962310834cb71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4ebfcaa20f24435b44962310834cb71, State: Initialized, Role: FOLLOWER
I20251023 07:59:26.960373 19936 consensus_queue.cc:260] T 00000000000000000000000000000000 P e4ebfcaa20f24435b44962310834cb71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4ebfcaa20f24435b44962310834cb71" member_type: VOTER }
I20251023 07:59:26.960804 19936 raft_consensus.cc:399] T 00000000000000000000000000000000 P e4ebfcaa20f24435b44962310834cb71 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251023 07:59:26.960987 19936 raft_consensus.cc:493] T 00000000000000000000000000000000 P e4ebfcaa20f24435b44962310834cb71 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251023 07:59:26.961192 19936 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e4ebfcaa20f24435b44962310834cb71 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:26.965724 19936 raft_consensus.cc:515] T 00000000000000000000000000000000 P e4ebfcaa20f24435b44962310834cb71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4ebfcaa20f24435b44962310834cb71" member_type: VOTER }
I20251023 07:59:26.966197 19936 leader_election.cc:304] T 00000000000000000000000000000000 P e4ebfcaa20f24435b44962310834cb71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e4ebfcaa20f24435b44962310834cb71; no voters:
I20251023 07:59:26.967278 19936 leader_election.cc:290] T 00000000000000000000000000000000 P e4ebfcaa20f24435b44962310834cb71 [CANDIDATE]: Term 1 election: Requested vote from peers
I20251023 07:59:26.967590 19939 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e4ebfcaa20f24435b44962310834cb71 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:59:26.968945 19939 raft_consensus.cc:697] T 00000000000000000000000000000000 P e4ebfcaa20f24435b44962310834cb71 [term 1 LEADER]: Becoming Leader. State: Replica: e4ebfcaa20f24435b44962310834cb71, State: Running, Role: LEADER
I20251023 07:59:26.969624 19939 consensus_queue.cc:237] T 00000000000000000000000000000000 P e4ebfcaa20f24435b44962310834cb71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4ebfcaa20f24435b44962310834cb71" member_type: VOTER }
I20251023 07:59:26.970296 19936 sys_catalog.cc:565] T 00000000000000000000000000000000 P e4ebfcaa20f24435b44962310834cb71 [sys.catalog]: configured and running, proceeding with master startup.
I20251023 07:59:26.974745 19941 sys_catalog.cc:455] T 00000000000000000000000000000000 P e4ebfcaa20f24435b44962310834cb71 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e4ebfcaa20f24435b44962310834cb71. Latest consensus state: current_term: 1 leader_uuid: "e4ebfcaa20f24435b44962310834cb71" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4ebfcaa20f24435b44962310834cb71" member_type: VOTER } }
I20251023 07:59:26.975529 19941 sys_catalog.cc:458] T 00000000000000000000000000000000 P e4ebfcaa20f24435b44962310834cb71 [sys.catalog]: This master's current role is: LEADER
I20251023 07:59:26.976061 19940 sys_catalog.cc:455] T 00000000000000000000000000000000 P e4ebfcaa20f24435b44962310834cb71 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e4ebfcaa20f24435b44962310834cb71" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4ebfcaa20f24435b44962310834cb71" member_type: VOTER } }
I20251023 07:59:26.976679 19940 sys_catalog.cc:458] T 00000000000000000000000000000000 P e4ebfcaa20f24435b44962310834cb71 [sys.catalog]: This master's current role is: LEADER
I20251023 07:59:26.979468 19946 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251023 07:59:26.985968 19946 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251023 07:59:26.987226 16888 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20251023 07:59:26.994702 19946 catalog_manager.cc:1357] Generated new cluster ID: 3ea6f9f4dcb9474aac53eb299863b20f
I20251023 07:59:26.994995 19946 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251023 07:59:27.012465 19946 catalog_manager.cc:1380] Generated new certificate authority record
I20251023 07:59:27.013746 19946 catalog_manager.cc:1514] Loading token signing keys...
I20251023 07:59:27.024891 19946 catalog_manager.cc:6022] T 00000000000000000000000000000000 P e4ebfcaa20f24435b44962310834cb71: Generated new TSK 0
I20251023 07:59:27.025552 19946 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251023 07:59:27.053994 16888 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251023 07:59:27.059852 19957 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251023 07:59:27.061311 19958 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251023 07:59:27.062445 19960 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251023 07:59:27.062870 16888 server_base.cc:1047] running on GCE node
I20251023 07:59:27.064054 16888 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251023 07:59:27.064280 16888 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251023 07:59:27.064437 16888 hybrid_clock.cc:648] HybridClock initialized: now 1761206367064420 us; error 0 us; skew 500 ppm
I20251023 07:59:27.064973 16888 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20251023 07:59:27.067199 16888 webserver.cc:492] Webserver started at http://127.16.126.1:39943/ using document root <none> and password file <none>
I20251023 07:59:27.067652 16888 fs_manager.cc:362] Metadata directory not provided
I20251023 07:59:27.067819 16888 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251023 07:59:27.068078 16888 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251023 07:59:27.069139 16888 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1761206251627710-16888-0/minicluster-data/ts-0-root/instance:
uuid: "d1379e91aa9c41629cd25262571beb2c"
format_stamp: "Formatted at 2025-10-23 07:59:27 on dist-test-slave-m488"
I20251023 07:59:27.073827 16888 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20251023 07:59:27.078153 19965 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251023 07:59:27.079089 16888 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20251023 07:59:27.079473 16888 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1761206251627710-16888-0/minicluster-data/ts-0-root
uuid: "d1379e91aa9c41629cd25262571beb2c"
format_stamp: "Formatted at 2025-10-23 07:59:27 on dist-test-slave-m488"
I20251023 07:59:27.079869 16888 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1761206251627710-16888-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1761206251627710-16888-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1761206251627710-16888-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251023 07:59:27.097841 16888 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251023 07:59:27.099611 16888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251023 07:59:27.101720 16888 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251023 07:59:27.104766 16888 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251023 07:59:27.105018 16888 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251023 07:59:27.105271 16888 ts_tablet_manager.cc:616] Registered 0 tablets
I20251023 07:59:27.105422 16888 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251023 07:59:27.150874 16888 rpc_server.cc:307] RPC server started. Bound to: 127.16.126.1:37865
I20251023 07:59:27.151005 20027 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.126.1:37865 every 8 connection(s)
I20251023 07:59:27.155932 16888 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251023 07:59:27.162350 20032 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251023 07:59:27.163395 20033 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251023 07:59:27.166157 20035 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251023 07:59:27.168540 16888 server_base.cc:1047] running on GCE node
I20251023 07:59:27.169236 20028 heartbeater.cc:344] Connected to a master server at 127.16.126.62:42363
I20251023 07:59:27.169616 20028 heartbeater.cc:461] Registering TS with master...
I20251023 07:59:27.170023 16888 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251023 07:59:27.170258 16888 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251023 07:59:27.170348 20028 heartbeater.cc:507] Master 127.16.126.62:42363 requested a full tablet report, sending...
I20251023 07:59:27.170413 16888 hybrid_clock.cc:648] HybridClock initialized: now 1761206367170395 us; error 0 us; skew 500 ppm
I20251023 07:59:27.171196 16888 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20251023 07:59:27.172833 19901 ts_manager.cc:194] Registered new tserver with Master: d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:27.173913 16888 webserver.cc:492] Webserver started at http://127.16.126.2:34301/ using document root <none> and password file <none>
I20251023 07:59:27.174437 16888 fs_manager.cc:362] Metadata directory not provided
I20251023 07:59:27.174620 16888 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251023 07:59:27.174862 16888 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251023 07:59:27.174813 19901 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45564
I20251023 07:59:27.176245 16888 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1761206251627710-16888-0/minicluster-data/ts-1-root/instance:
uuid: "35e7d1ade024444486e63cf1b81e9626"
format_stamp: "Formatted at 2025-10-23 07:59:27 on dist-test-slave-m488"
I20251023 07:59:27.180787 16888 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.004s sys 0.003s
I20251023 07:59:27.184121 20040 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251023 07:59:27.184926 16888 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20251023 07:59:27.185220 16888 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1761206251627710-16888-0/minicluster-data/ts-1-root
uuid: "35e7d1ade024444486e63cf1b81e9626"
format_stamp: "Formatted at 2025-10-23 07:59:27 on dist-test-slave-m488"
I20251023 07:59:27.185508 16888 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1761206251627710-16888-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1761206251627710-16888-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1761206251627710-16888-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251023 07:59:27.202674 16888 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251023 07:59:27.203949 16888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251023 07:59:27.205474 16888 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251023 07:59:27.207733 16888 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251023 07:59:27.207938 16888 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251023 07:59:27.208165 16888 ts_tablet_manager.cc:616] Registered 0 tablets
I20251023 07:59:27.208316 16888 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251023 07:59:27.248572 16888 rpc_server.cc:307] RPC server started. Bound to: 127.16.126.2:42309
I20251023 07:59:27.248690 20102 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.126.2:42309 every 8 connection(s)
I20251023 07:59:27.253379 16888 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251023 07:59:27.260026 20106 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251023 07:59:27.263046 20109 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251023 07:59:27.263243 20107 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251023 07:59:27.264350 20103 heartbeater.cc:344] Connected to a master server at 127.16.126.62:42363
I20251023 07:59:27.264626 16888 server_base.cc:1047] running on GCE node
I20251023 07:59:27.264796 20103 heartbeater.cc:461] Registering TS with master...
I20251023 07:59:27.265725 16888 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20251023 07:59:27.265725 20103 heartbeater.cc:507] Master 127.16.126.62:42363 requested a full tablet report, sending...
W20251023 07:59:27.266165 16888 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251023 07:59:27.266383 16888 hybrid_clock.cc:648] HybridClock initialized: now 1761206367266367 us; error 0 us; skew 500 ppm
I20251023 07:59:27.267067 16888 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20251023 07:59:27.268152 19901 ts_manager.cc:194] Registered new tserver with Master: 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309)
I20251023 07:59:27.269727 16888 webserver.cc:492] Webserver started at http://127.16.126.3:38313/ using document root <none> and password file <none>
I20251023 07:59:27.269837 19901 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45568
I20251023 07:59:27.270258 16888 fs_manager.cc:362] Metadata directory not provided
I20251023 07:59:27.270473 16888 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251023 07:59:27.270789 16888 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251023 07:59:27.272054 16888 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1761206251627710-16888-0/minicluster-data/ts-2-root/instance:
uuid: "0f412334fb994ff0ab492afde64f5855"
format_stamp: "Formatted at 2025-10-23 07:59:27 on dist-test-slave-m488"
I20251023 07:59:27.276357 16888 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20251023 07:59:27.279667 20114 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251023 07:59:27.280387 16888 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20251023 07:59:27.280691 16888 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1761206251627710-16888-0/minicluster-data/ts-2-root
uuid: "0f412334fb994ff0ab492afde64f5855"
format_stamp: "Formatted at 2025-10-23 07:59:27 on dist-test-slave-m488"
I20251023 07:59:27.280961 16888 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1761206251627710-16888-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1761206251627710-16888-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1761206251627710-16888-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251023 07:59:27.314234 16888 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251023 07:59:27.315466 16888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251023 07:59:27.316933 16888 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251023 07:59:27.319161 16888 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251023 07:59:27.319366 16888 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251023 07:59:27.319597 16888 ts_tablet_manager.cc:616] Registered 0 tablets
I20251023 07:59:27.319763 16888 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251023 07:59:27.359766 16888 rpc_server.cc:307] RPC server started. Bound to: 127.16.126.3:33287
I20251023 07:59:27.359864 20176 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.126.3:33287 every 8 connection(s)
I20251023 07:59:27.364511 16888 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251023 07:59:27.371563 20180 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251023 07:59:27.372920 20181 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251023 07:59:27.376230 20183 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251023 07:59:27.376571 16888 server_base.cc:1047] running on GCE node
I20251023 07:59:27.376708 20177 heartbeater.cc:344] Connected to a master server at 127.16.126.62:42363
I20251023 07:59:27.377261 20177 heartbeater.cc:461] Registering TS with master...
I20251023 07:59:27.377595 16888 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251023 07:59:27.377842 16888 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251023 07:59:27.377986 16888 hybrid_clock.cc:648] HybridClock initialized: now 1761206367377975 us; error 0 us; skew 500 ppm
I20251023 07:59:27.378027 20177 heartbeater.cc:507] Master 127.16.126.62:42363 requested a full tablet report, sending...
I20251023 07:59:27.378500 16888 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20251023 07:59:27.380242 19901 ts_manager.cc:194] Registered new tserver with Master: 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287)
I20251023 07:59:27.381376 16888 webserver.cc:492] Webserver started at http://127.16.126.4:41255/ using document root <none> and password file <none>
I20251023 07:59:27.382062 16888 fs_manager.cc:362] Metadata directory not provided
I20251023 07:59:27.382344 16888 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251023 07:59:27.382258 19901 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45580
I20251023 07:59:27.382912 16888 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251023 07:59:27.384225 16888 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1761206251627710-16888-0/minicluster-data/ts-3-root/instance:
uuid: "65876a2b197c4ea6918f5cab47ded25c"
format_stamp: "Formatted at 2025-10-23 07:59:27 on dist-test-slave-m488"
I20251023 07:59:27.388775 16888 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20251023 07:59:27.392030 20188 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251023 07:59:27.392781 16888 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20251023 07:59:27.393071 16888 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1761206251627710-16888-0/minicluster-data/ts-3-root
uuid: "65876a2b197c4ea6918f5cab47ded25c"
format_stamp: "Formatted at 2025-10-23 07:59:27 on dist-test-slave-m488"
I20251023 07:59:27.393327 16888 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1761206251627710-16888-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1761206251627710-16888-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1761206251627710-16888-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251023 07:59:27.421839 16888 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251023 07:59:27.423097 16888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251023 07:59:27.424588 16888 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251023 07:59:27.426946 16888 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251023 07:59:27.427141 16888 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251023 07:59:27.427359 16888 ts_tablet_manager.cc:616] Registered 0 tablets
I20251023 07:59:27.427510 16888 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251023 07:59:27.468461 16888 rpc_server.cc:307] RPC server started. Bound to: 127.16.126.4:34955
I20251023 07:59:27.468564 20250 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.126.4:34955 every 8 connection(s)
I20251023 07:59:27.481891 20251 heartbeater.cc:344] Connected to a master server at 127.16.126.62:42363
I20251023 07:59:27.482352 20251 heartbeater.cc:461] Registering TS with master...
I20251023 07:59:27.483071 20251 heartbeater.cc:507] Master 127.16.126.62:42363 requested a full tablet report, sending...
I20251023 07:59:27.484848 19901 ts_manager.cc:194] Registered new tserver with Master: 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955)
I20251023 07:59:27.485128 16888 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.013553444s
I20251023 07:59:27.486296 19901 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45588
I20251023 07:59:27.487876 16888 test_util.cc:276] Using random seed: -806811796
I20251023 07:59:27.511171 19901 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45592:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251023 07:59:27.764539 20140 tablet_service.cc:1505] Processing CreateTablet for tablet c6b6d87c63ca43999bf97916bd589275 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20251023 07:59:27.766261 20140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6b6d87c63ca43999bf97916bd589275. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:27.766381 20141 tablet_service.cc:1505] Processing CreateTablet for tablet a9d3294d54be4be29569a460be5c8887 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20251023 07:59:27.767753 20141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9d3294d54be4be29569a460be5c8887. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:27.765061 20142 tablet_service.cc:1505] Processing CreateTablet for tablet d214412da5754dd0a08f25d50b5584f1 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION VALUES < 36398027
I20251023 07:59:27.770700 20142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d214412da5754dd0a08f25d50b5584f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:27.770604 20139 tablet_service.cc:1505] Processing CreateTablet for tablet c6fd96e3f93945f7828a9a8593490daa (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20251023 07:59:27.772099 20139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6fd96e3f93945f7828a9a8593490daa. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:27.779484 20216 tablet_service.cc:1505] Processing CreateTablet for tablet 62e73cfc2bbc459aba34186c3231ed87 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20251023 07:59:27.781003 20216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62e73cfc2bbc459aba34186c3231ed87. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:27.788389 20215 tablet_service.cc:1505] Processing CreateTablet for tablet a9d3294d54be4be29569a460be5c8887 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20251023 07:59:27.789830 20215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9d3294d54be4be29569a460be5c8887. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:27.796347 20138 tablet_service.cc:1505] Processing CreateTablet for tablet 5bc7d7ca172742d1b528af8659661c2a (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20251023 07:59:27.797765 20138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bc7d7ca172742d1b528af8659661c2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:27.802697 20137 tablet_service.cc:1505] Processing CreateTablet for tablet 1fa44f181e6e44bfb1e566ef7b0778a0 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20251023 07:59:27.804128 20137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fa44f181e6e44bfb1e566ef7b0778a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:27.807344 20214 tablet_service.cc:1505] Processing CreateTablet for tablet c6b6d87c63ca43999bf97916bd589275 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20251023 07:59:27.808794 20214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6b6d87c63ca43999bf97916bd589275. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:27.815281 20213 tablet_service.cc:1505] Processing CreateTablet for tablet a9f4a5a96a444c099e7cefb12fe4c288 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20251023 07:59:27.816776 20213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9f4a5a96a444c099e7cefb12fe4c288. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:27.817382 20068 tablet_service.cc:1505] Processing CreateTablet for tablet d214412da5754dd0a08f25d50b5584f1 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION VALUES < 36398027
I20251023 07:59:27.818789 20068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d214412da5754dd0a08f25d50b5584f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:27.821718 20067 tablet_service.cc:1505] Processing CreateTablet for tablet 62e73cfc2bbc459aba34186c3231ed87 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20251023 07:59:27.823128 20067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62e73cfc2bbc459aba34186c3231ed87. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:27.824013 19993 tablet_service.cc:1505] Processing CreateTablet for tablet d214412da5754dd0a08f25d50b5584f1 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION VALUES < 36398027
I20251023 07:59:27.824496 20212 tablet_service.cc:1505] Processing CreateTablet for tablet 5bc7d7ca172742d1b528af8659661c2a (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20251023 07:59:27.825466 19993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d214412da5754dd0a08f25d50b5584f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:27.826308 20212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bc7d7ca172742d1b528af8659661c2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:27.826655 20066 tablet_service.cc:1505] Processing CreateTablet for tablet c6b6d87c63ca43999bf97916bd589275 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20251023 07:59:27.827986 20066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6b6d87c63ca43999bf97916bd589275. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:27.830643 20065 tablet_service.cc:1505] Processing CreateTablet for tablet c6fd96e3f93945f7828a9a8593490daa (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20251023 07:59:27.832190 20065 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6fd96e3f93945f7828a9a8593490daa. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:27.832489 19991 tablet_service.cc:1505] Processing CreateTablet for tablet a9d3294d54be4be29569a460be5c8887 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20251023 07:59:27.833842 19991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9d3294d54be4be29569a460be5c8887. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:27.834654 20064 tablet_service.cc:1505] Processing CreateTablet for tablet a9f4a5a96a444c099e7cefb12fe4c288 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20251023 07:59:27.836100 20064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9f4a5a96a444c099e7cefb12fe4c288. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:27.836865 20211 tablet_service.cc:1505] Processing CreateTablet for tablet 1fa44f181e6e44bfb1e566ef7b0778a0 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20251023 07:59:27.838759 20211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fa44f181e6e44bfb1e566ef7b0778a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:27.838673 19989 tablet_service.cc:1505] Processing CreateTablet for tablet a9f4a5a96a444c099e7cefb12fe4c288 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20251023 07:59:27.839834 19988 tablet_service.cc:1505] Processing CreateTablet for tablet 5bc7d7ca172742d1b528af8659661c2a (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20251023 07:59:27.840449 19989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9f4a5a96a444c099e7cefb12fe4c288. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:27.841192 19988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bc7d7ca172742d1b528af8659661c2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:27.830780 19992 tablet_service.cc:1505] Processing CreateTablet for tablet 62e73cfc2bbc459aba34186c3231ed87 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20251023 07:59:27.842186 19992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62e73cfc2bbc459aba34186c3231ed87. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:27.843336 19990 tablet_service.cc:1505] Processing CreateTablet for tablet c6fd96e3f93945f7828a9a8593490daa (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20251023 07:59:27.838657 20063 tablet_service.cc:1505] Processing CreateTablet for tablet 1fa44f181e6e44bfb1e566ef7b0778a0 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20251023 07:59:27.844727 19990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6fd96e3f93945f7828a9a8593490daa. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:27.845230 20063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fa44f181e6e44bfb1e566ef7b0778a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:27.868506 19987 tablet_service.cc:1505] Processing CreateTablet for tablet 12b8704d81fe4e3cb14bfa975c73df29 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20251023 07:59:27.877027 19987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12b8704d81fe4e3cb14bfa975c73df29. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:27.889540 20137 tablet_service.cc:1505] Processing CreateTablet for tablet 12b8704d81fe4e3cb14bfa975c73df29 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20251023 07:59:27.890931 20137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12b8704d81fe4e3cb14bfa975c73df29. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:27.892627 20062 tablet_service.cc:1505] Processing CreateTablet for tablet 12b8704d81fe4e3cb14bfa975c73df29 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20251023 07:59:27.893975 20062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12b8704d81fe4e3cb14bfa975c73df29. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:27.900862 20210 tablet_service.cc:1505] Processing CreateTablet for tablet db045d1b86484fe9987f82ce426362e5 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20251023 07:59:27.902340 20210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db045d1b86484fe9987f82ce426362e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:27.925146 19986 tablet_service.cc:1505] Processing CreateTablet for tablet db045d1b86484fe9987f82ce426362e5 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20251023 07:59:27.926204 20061 tablet_service.cc:1505] Processing CreateTablet for tablet db045d1b86484fe9987f82ce426362e5 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20251023 07:59:27.926707 19986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db045d1b86484fe9987f82ce426362e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:27.927659 20061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db045d1b86484fe9987f82ce426362e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:27.942482 20209 tablet_service.cc:1505] Processing CreateTablet for tablet ccba7896b7e1413293428358ffd0f8a0 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20251023 07:59:27.943924 20209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccba7896b7e1413293428358ffd0f8a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:27.948230 20273 tablet_bootstrap.cc:492] T a9f4a5a96a444c099e7cefb12fe4c288 P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:27.967767 20271 tablet_bootstrap.cc:492] T a9d3294d54be4be29569a460be5c8887 P 0f412334fb994ff0ab492afde64f5855: Bootstrap starting.
I20251023 07:59:27.978909 20141 tablet_service.cc:1505] Processing CreateTablet for tablet 7d599e4b62364f04b966ca88e16b560a (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20251023 07:59:27.980304 20141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d599e4b62364f04b966ca88e16b560a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:27.989215 20065 tablet_service.cc:1505] Processing CreateTablet for tablet 7d599e4b62364f04b966ca88e16b560a (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20251023 07:59:27.996441 20065 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d599e4b62364f04b966ca88e16b560a. 1 dirs total, 0 dirs full, 0 dirs failed
W20251023 07:59:28.000195 19949 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20251023 07:59:27.954007 20208 tablet_service.cc:1505] Processing CreateTablet for tablet 7d599e4b62364f04b966ca88e16b560a (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20251023 07:59:28.007953 20208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d599e4b62364f04b966ca88e16b560a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.014410 20274 tablet_bootstrap.cc:492] T 1fa44f181e6e44bfb1e566ef7b0778a0 P 65876a2b197c4ea6918f5cab47ded25c: Bootstrap starting.
I20251023 07:59:28.014075 20137 tablet_service.cc:1505] Processing CreateTablet for tablet ccba7896b7e1413293428358ffd0f8a0 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20251023 07:59:28.015486 20137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccba7896b7e1413293428358ffd0f8a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.018277 19992 tablet_service.cc:1505] Processing CreateTablet for tablet 82812175f15d4d3dae73f31641a1e583 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20251023 07:59:28.019464 19992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82812175f15d4d3dae73f31641a1e583. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.023109 20066 tablet_service.cc:1505] Processing CreateTablet for tablet 82812175f15d4d3dae73f31641a1e583 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20251023 07:59:28.025985 20212 tablet_service.cc:1505] Processing CreateTablet for tablet 92fae2a393404d8998ad2747fbd08cc9 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20251023 07:59:28.027347 20212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92fae2a393404d8998ad2747fbd08cc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.027611 20066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82812175f15d4d3dae73f31641a1e583. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.031493 20141 tablet_service.cc:1505] Processing CreateTablet for tablet 82812175f15d4d3dae73f31641a1e583 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20251023 07:59:28.032203 19990 tablet_service.cc:1505] Processing CreateTablet for tablet 92fae2a393404d8998ad2747fbd08cc9 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20251023 07:59:28.033529 19990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92fae2a393404d8998ad2747fbd08cc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.034072 19989 tablet_service.cc:1505] Processing CreateTablet for tablet ccba7896b7e1413293428358ffd0f8a0 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20251023 07:59:28.035281 19989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccba7896b7e1413293428358ffd0f8a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.037683 20141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82812175f15d4d3dae73f31641a1e583. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.044133 20271 tablet_bootstrap.cc:654] T a9d3294d54be4be29569a460be5c8887 P 0f412334fb994ff0ab492afde64f5855: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:28.046110 20063 tablet_service.cc:1505] Processing CreateTablet for tablet 92fae2a393404d8998ad2747fbd08cc9 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20251023 07:59:28.047372 20063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92fae2a393404d8998ad2747fbd08cc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.046146 20272 tablet_bootstrap.cc:492] T 62e73cfc2bbc459aba34186c3231ed87 P 35e7d1ade024444486e63cf1b81e9626: Bootstrap starting.
I20251023 07:59:28.054455 20273 tablet_bootstrap.cc:654] T a9f4a5a96a444c099e7cefb12fe4c288 P d1379e91aa9c41629cd25262571beb2c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:28.055130 20272 tablet_bootstrap.cc:654] T 62e73cfc2bbc459aba34186c3231ed87 P 35e7d1ade024444486e63cf1b81e9626: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:28.065476 20137 tablet_service.cc:1505] Processing CreateTablet for tablet 076aca7c8ecb4f34af0d457fcee0e585 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20251023 07:59:28.066618 20216 tablet_service.cc:1505] Processing CreateTablet for tablet 076aca7c8ecb4f34af0d457fcee0e585 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20251023 07:59:28.067024 20137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 076aca7c8ecb4f34af0d457fcee0e585. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.067906 20216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 076aca7c8ecb4f34af0d457fcee0e585. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.076411 19989 tablet_service.cc:1505] Processing CreateTablet for tablet 076aca7c8ecb4f34af0d457fcee0e585 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20251023 07:59:28.077816 19989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 076aca7c8ecb4f34af0d457fcee0e585. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.080664 20274 tablet_bootstrap.cc:654] T 1fa44f181e6e44bfb1e566ef7b0778a0 P 65876a2b197c4ea6918f5cab47ded25c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:28.088625 20064 tablet_service.cc:1505] Processing CreateTablet for tablet 7062462192fc4895b5a9f6a34c4a132a (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20251023 07:59:28.090224 20064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7062462192fc4895b5a9f6a34c4a132a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.095176 20137 tablet_service.cc:1505] Processing CreateTablet for tablet 7062462192fc4895b5a9f6a34c4a132a (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20251023 07:59:28.102239 20137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7062462192fc4895b5a9f6a34c4a132a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.105031 19990 tablet_service.cc:1505] Processing CreateTablet for tablet aa253535ba594367a12fda3dea3b75d4 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20251023 07:59:28.105540 20065 tablet_service.cc:1505] Processing CreateTablet for tablet aa253535ba594367a12fda3dea3b75d4 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20251023 07:59:28.106422 19990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa253535ba594367a12fda3dea3b75d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.106755 20065 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa253535ba594367a12fda3dea3b75d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.098444 20213 tablet_service.cc:1505] Processing CreateTablet for tablet 7062462192fc4895b5a9f6a34c4a132a (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20251023 07:59:28.108727 20213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7062462192fc4895b5a9f6a34c4a132a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.117141 20141 tablet_service.cc:1505] Processing CreateTablet for tablet aa253535ba594367a12fda3dea3b75d4 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20251023 07:59:28.118513 20141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa253535ba594367a12fda3dea3b75d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.120314 20212 tablet_service.cc:1505] Processing CreateTablet for tablet e2c26d408ee04105bd615b58287c82f9 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20251023 07:59:28.121829 20212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2c26d408ee04105bd615b58287c82f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.133244 19989 tablet_service.cc:1505] Processing CreateTablet for tablet e2c26d408ee04105bd615b58287c82f9 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20251023 07:59:28.134670 19989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2c26d408ee04105bd615b58287c82f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.139549 20273 tablet_bootstrap.cc:492] T a9f4a5a96a444c099e7cefb12fe4c288 P d1379e91aa9c41629cd25262571beb2c: No bootstrap required, opened a new log
I20251023 07:59:28.140153 20273 ts_tablet_manager.cc:1403] T a9f4a5a96a444c099e7cefb12fe4c288 P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.192s user 0.004s sys 0.015s
I20251023 07:59:28.140530 20061 tablet_service.cc:1505] Processing CreateTablet for tablet e2c26d408ee04105bd615b58287c82f9 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20251023 07:59:28.141909 20061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2c26d408ee04105bd615b58287c82f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.143144 20273 raft_consensus.cc:359] T a9f4a5a96a444c099e7cefb12fe4c288 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:28.143853 20273 raft_consensus.cc:385] T a9f4a5a96a444c099e7cefb12fe4c288 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:28.144141 20273 raft_consensus.cc:740] T a9f4a5a96a444c099e7cefb12fe4c288 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:28.146309 20274 tablet_bootstrap.cc:492] T 1fa44f181e6e44bfb1e566ef7b0778a0 P 65876a2b197c4ea6918f5cab47ded25c: No bootstrap required, opened a new log
I20251023 07:59:28.146831 20274 ts_tablet_manager.cc:1403] T 1fa44f181e6e44bfb1e566ef7b0778a0 P 65876a2b197c4ea6918f5cab47ded25c: Time spent bootstrapping tablet: real 0.133s user 0.001s sys 0.010s
I20251023 07:59:28.153113 20138 tablet_service.cc:1505] Processing CreateTablet for tablet fa36a9cfa4fe43418245de193502470f (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20251023 07:59:28.154518 20138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa36a9cfa4fe43418245de193502470f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.159431 20271 tablet_bootstrap.cc:492] T a9d3294d54be4be29569a460be5c8887 P 0f412334fb994ff0ab492afde64f5855: No bootstrap required, opened a new log
I20251023 07:59:28.159878 20271 ts_tablet_manager.cc:1403] T a9d3294d54be4be29569a460be5c8887 P 0f412334fb994ff0ab492afde64f5855: Time spent bootstrapping tablet: real 0.193s user 0.012s sys 0.000s
I20251023 07:59:28.161720 20273 consensus_queue.cc:260] T a9f4a5a96a444c099e7cefb12fe4c288 P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:28.162173 20209 tablet_service.cc:1505] Processing CreateTablet for tablet fa36a9cfa4fe43418245de193502470f (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20251023 07:59:28.163697 20209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa36a9cfa4fe43418245de193502470f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.166509 20028 heartbeater.cc:499] Master 127.16.126.62:42363 was elected leader, sending a full tablet report...
I20251023 07:59:28.167764 19986 tablet_service.cc:1505] Processing CreateTablet for tablet fa36a9cfa4fe43418245de193502470f (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20251023 07:59:28.169716 20274 raft_consensus.cc:359] T 1fa44f181e6e44bfb1e566ef7b0778a0 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:28.170486 20274 raft_consensus.cc:385] T 1fa44f181e6e44bfb1e566ef7b0778a0 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:28.170810 20274 raft_consensus.cc:740] T 1fa44f181e6e44bfb1e566ef7b0778a0 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65876a2b197c4ea6918f5cab47ded25c, State: Initialized, Role: FOLLOWER
I20251023 07:59:28.171712 20274 consensus_queue.cc:260] T 1fa44f181e6e44bfb1e566ef7b0778a0 P 65876a2b197c4ea6918f5cab47ded25c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:28.172403 20137 tablet_service.cc:1505] Processing CreateTablet for tablet 791953f9d44946eaa145c5857557a5e4 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20251023 07:59:28.173887 20137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 791953f9d44946eaa145c5857557a5e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.182312 19986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa36a9cfa4fe43418245de193502470f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.182919 20271 raft_consensus.cc:359] T a9d3294d54be4be29569a460be5c8887 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:28.183770 20271 raft_consensus.cc:385] T a9d3294d54be4be29569a460be5c8887 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:28.184063 20271 raft_consensus.cc:740] T a9d3294d54be4be29569a460be5c8887 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Initialized, Role: FOLLOWER
I20251023 07:59:28.184796 20271 consensus_queue.cc:260] T a9d3294d54be4be29569a460be5c8887 P 0f412334fb994ff0ab492afde64f5855 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:28.188591 20210 tablet_service.cc:1505] Processing CreateTablet for tablet 791953f9d44946eaa145c5857557a5e4 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20251023 07:59:28.199698 20210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 791953f9d44946eaa145c5857557a5e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.199775 20272 tablet_bootstrap.cc:492] T 62e73cfc2bbc459aba34186c3231ed87 P 35e7d1ade024444486e63cf1b81e9626: No bootstrap required, opened a new log
I20251023 07:59:28.200300 20272 ts_tablet_manager.cc:1403] T 62e73cfc2bbc459aba34186c3231ed87 P 35e7d1ade024444486e63cf1b81e9626: Time spent bootstrapping tablet: real 0.154s user 0.029s sys 0.035s
I20251023 07:59:28.200986 20274 ts_tablet_manager.cc:1434] T 1fa44f181e6e44bfb1e566ef7b0778a0 P 65876a2b197c4ea6918f5cab47ded25c: Time spent starting tablet: real 0.054s user 0.005s sys 0.002s
I20251023 07:59:28.202059 20274 tablet_bootstrap.cc:492] T c6b6d87c63ca43999bf97916bd589275 P 65876a2b197c4ea6918f5cab47ded25c: Bootstrap starting.
I20251023 07:59:28.203222 20272 raft_consensus.cc:359] T 62e73cfc2bbc459aba34186c3231ed87 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:28.204003 20272 raft_consensus.cc:385] T 62e73cfc2bbc459aba34186c3231ed87 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:28.204301 20272 raft_consensus.cc:740] T 62e73cfc2bbc459aba34186c3231ed87 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e7d1ade024444486e63cf1b81e9626, State: Initialized, Role: FOLLOWER
I20251023 07:59:28.205128 20272 consensus_queue.cc:260] T 62e73cfc2bbc459aba34186c3231ed87 P 35e7d1ade024444486e63cf1b81e9626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:28.214691 20272 ts_tablet_manager.cc:1434] T 62e73cfc2bbc459aba34186c3231ed87 P 35e7d1ade024444486e63cf1b81e9626: Time spent starting tablet: real 0.014s user 0.009s sys 0.005s
I20251023 07:59:28.215452 20103 heartbeater.cc:499] Master 127.16.126.62:42363 was elected leader, sending a full tablet report...
I20251023 07:59:28.188795 20066 tablet_service.cc:1505] Processing CreateTablet for tablet 791953f9d44946eaa145c5857557a5e4 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20251023 07:59:28.189935 20273 ts_tablet_manager.cc:1434] T a9f4a5a96a444c099e7cefb12fe4c288 P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.049s user 0.007s sys 0.001s
I20251023 07:59:28.197377 20251 heartbeater.cc:499] Master 127.16.126.62:42363 was elected leader, sending a full tablet report...
I20251023 07:59:28.219430 20273 tablet_bootstrap.cc:492] T d214412da5754dd0a08f25d50b5584f1 P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:28.223013 20274 tablet_bootstrap.cc:654] T c6b6d87c63ca43999bf97916bd589275 P 65876a2b197c4ea6918f5cab47ded25c: Neither blocks nor log segments found. Creating new log.
W20251023 07:59:28.223974 20252 tablet.cc:2378] T 1fa44f181e6e44bfb1e566ef7b0778a0 P 65876a2b197c4ea6918f5cab47ded25c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251023 07:59:28.231550 19992 tablet_service.cc:1505] Processing CreateTablet for tablet 7060af9ee4a34ecca18900b2f272e1d1 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20251023 07:59:28.231997 20065 tablet_service.cc:1505] Processing CreateTablet for tablet 7060af9ee4a34ecca18900b2f272e1d1 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20251023 07:59:28.232949 19992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7060af9ee4a34ecca18900b2f272e1d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.233603 20066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 791953f9d44946eaa145c5857557a5e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.234294 20065 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7060af9ee4a34ecca18900b2f272e1d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.237938 20272 tablet_bootstrap.cc:492] T c6fd96e3f93945f7828a9a8593490daa P 35e7d1ade024444486e63cf1b81e9626: Bootstrap starting.
I20251023 07:59:28.244978 20213 tablet_service.cc:1505] Processing CreateTablet for tablet 0229047af3034761a2bf168928917afb (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20251023 07:59:28.246860 20213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0229047af3034761a2bf168928917afb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.250461 20271 ts_tablet_manager.cc:1434] T a9d3294d54be4be29569a460be5c8887 P 0f412334fb994ff0ab492afde64f5855: Time spent starting tablet: real 0.090s user 0.007s sys 0.002s
I20251023 07:59:28.251300 20177 heartbeater.cc:499] Master 127.16.126.62:42363 was elected leader, sending a full tablet report...
I20251023 07:59:28.251533 20271 tablet_bootstrap.cc:492] T d214412da5754dd0a08f25d50b5584f1 P 0f412334fb994ff0ab492afde64f5855: Bootstrap starting.
I20251023 07:59:28.254734 20138 tablet_service.cc:1505] Processing CreateTablet for tablet 7060af9ee4a34ecca18900b2f272e1d1 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20251023 07:59:28.258217 20138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7060af9ee4a34ecca18900b2f272e1d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.260044 20273 tablet_bootstrap.cc:654] T d214412da5754dd0a08f25d50b5584f1 P d1379e91aa9c41629cd25262571beb2c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:28.280359 20061 tablet_service.cc:1505] Processing CreateTablet for tablet 0229047af3034761a2bf168928917afb (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20251023 07:59:28.279886 20137 tablet_service.cc:1505] Processing CreateTablet for tablet 5855488965da49f4a33c7516f6a5596a (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20251023 07:59:28.274986 19986 tablet_service.cc:1505] Processing CreateTablet for tablet 0229047af3034761a2bf168928917afb (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20251023 07:59:28.284657 20280 raft_consensus.cc:493] T 1fa44f181e6e44bfb1e566ef7b0778a0 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:28.285236 20280 raft_consensus.cc:515] T 1fa44f181e6e44bfb1e566ef7b0778a0 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:28.285706 19986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0229047af3034761a2bf168928917afb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.287232 20271 tablet_bootstrap.cc:654] T d214412da5754dd0a08f25d50b5584f1 P 0f412334fb994ff0ab492afde64f5855: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:28.287750 20280 leader_election.cc:290] T 1fa44f181e6e44bfb1e566ef7b0778a0 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309), 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287)
I20251023 07:59:28.284657 20061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0229047af3034761a2bf168928917afb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.294312 20210 tablet_service.cc:1505] Processing CreateTablet for tablet 5855488965da49f4a33c7516f6a5596a (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20251023 07:59:28.295696 20210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5855488965da49f4a33c7516f6a5596a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.321491 20274 tablet_bootstrap.cc:492] T c6b6d87c63ca43999bf97916bd589275 P 65876a2b197c4ea6918f5cab47ded25c: No bootstrap required, opened a new log
I20251023 07:59:28.322113 20274 ts_tablet_manager.cc:1403] T c6b6d87c63ca43999bf97916bd589275 P 65876a2b197c4ea6918f5cab47ded25c: Time spent bootstrapping tablet: real 0.120s user 0.024s sys 0.032s
I20251023 07:59:28.323195 20273 tablet_bootstrap.cc:492] T d214412da5754dd0a08f25d50b5584f1 P d1379e91aa9c41629cd25262571beb2c: No bootstrap required, opened a new log
I20251023 07:59:28.326390 20272 tablet_bootstrap.cc:654] T c6fd96e3f93945f7828a9a8593490daa P 35e7d1ade024444486e63cf1b81e9626: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:28.326835 20137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5855488965da49f4a33c7516f6a5596a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.326853 20274 raft_consensus.cc:359] T c6b6d87c63ca43999bf97916bd589275 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:28.330775 20273 ts_tablet_manager.cc:1403] T d214412da5754dd0a08f25d50b5584f1 P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.112s user 0.018s sys 0.000s
I20251023 07:59:28.333099 19989 tablet_service.cc:1505] Processing CreateTablet for tablet 5855488965da49f4a33c7516f6a5596a (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20251023 07:59:28.350245 19989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5855488965da49f4a33c7516f6a5596a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.352165 20273 raft_consensus.cc:359] T d214412da5754dd0a08f25d50b5584f1 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:28.353050 20273 raft_consensus.cc:385] T d214412da5754dd0a08f25d50b5584f1 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:28.338107 20063 tablet_service.cc:1505] Processing CreateTablet for tablet e08e797f71f1483a9c2b5899554a6dec (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20251023 07:59:28.340257 20138 tablet_service.cc:1505] Processing CreateTablet for tablet e08e797f71f1483a9c2b5899554a6dec (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20251023 07:59:28.342402 20213 tablet_service.cc:1505] Processing CreateTablet for tablet e08e797f71f1483a9c2b5899554a6dec (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20251023 07:59:28.343513 20281 raft_consensus.cc:493] T a9d3294d54be4be29569a460be5c8887 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:28.353400 20273 raft_consensus.cc:740] T d214412da5754dd0a08f25d50b5584f1 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:28.353947 20281 raft_consensus.cc:515] T a9d3294d54be4be29569a460be5c8887 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:28.355459 20138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e08e797f71f1483a9c2b5899554a6dec. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.357355 20063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e08e797f71f1483a9c2b5899554a6dec. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.358698 20281 leader_election.cc:290] T a9d3294d54be4be29569a460be5c8887 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:28.348340 19992 tablet_service.cc:1505] Processing CreateTablet for tablet e813343bd62640cc9976d0ae394aa315 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20251023 07:59:28.365710 20274 raft_consensus.cc:385] T c6b6d87c63ca43999bf97916bd589275 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:28.382974 20271 tablet_bootstrap.cc:492] T d214412da5754dd0a08f25d50b5584f1 P 0f412334fb994ff0ab492afde64f5855: No bootstrap required, opened a new log
I20251023 07:59:28.380793 20274 raft_consensus.cc:740] T c6b6d87c63ca43999bf97916bd589275 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65876a2b197c4ea6918f5cab47ded25c, State: Initialized, Role: FOLLOWER
I20251023 07:59:28.388092 20078 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1fa44f181e6e44bfb1e566ef7b0778a0" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
I20251023 07:59:28.390070 20274 consensus_queue.cc:260] T c6b6d87c63ca43999bf97916bd589275 P 65876a2b197c4ea6918f5cab47ded25c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:28.393682 20274 ts_tablet_manager.cc:1434] T c6b6d87c63ca43999bf97916bd589275 P 65876a2b197c4ea6918f5cab47ded25c: Time spent starting tablet: real 0.071s user 0.008s sys 0.001s
W20251023 07:59:28.394513 20190 leader_election.cc:343] T 1fa44f181e6e44bfb1e566ef7b0778a0 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:28.384373 20273 consensus_queue.cc:260] T d214412da5754dd0a08f25d50b5584f1 P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:28.402803 20271 ts_tablet_manager.cc:1403] T d214412da5754dd0a08f25d50b5584f1 P 0f412334fb994ff0ab492afde64f5855: Time spent bootstrapping tablet: real 0.152s user 0.012s sys 0.011s
I20251023 07:59:28.414193 20066 tablet_service.cc:1505] Processing CreateTablet for tablet e813343bd62640cc9976d0ae394aa315 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20251023 07:59:28.416322 20271 raft_consensus.cc:359] T d214412da5754dd0a08f25d50b5584f1 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:28.417136 20271 raft_consensus.cc:385] T d214412da5754dd0a08f25d50b5584f1 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:28.405413 20213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e08e797f71f1483a9c2b5899554a6dec. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.417861 20141 tablet_service.cc:1505] Processing CreateTablet for tablet e813343bd62640cc9976d0ae394aa315 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20251023 07:59:28.455017 19988 tablet_service.cc:1505] Processing CreateTablet for tablet a468f7a5913245b58705dc4f8560dade (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20251023 07:59:28.455502 20141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e813343bd62640cc9976d0ae394aa315. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.459717 20068 tablet_service.cc:1505] Processing CreateTablet for tablet a468f7a5913245b58705dc4f8560dade (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20251023 07:59:28.418642 20274 tablet_bootstrap.cc:492] T 5bc7d7ca172742d1b528af8659661c2a P 65876a2b197c4ea6918f5cab47ded25c: Bootstrap starting.
I20251023 07:59:28.461257 20142 tablet_service.cc:1505] Processing CreateTablet for tablet a468f7a5913245b58705dc4f8560dade (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20251023 07:59:28.462646 20142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a468f7a5913245b58705dc4f8560dade. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.418812 20065 tablet_service.cc:1505] Processing CreateTablet for tablet c52243b5fda44e2fba36f6319b4c13e3 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20251023 07:59:28.426844 20272 tablet_bootstrap.cc:492] T c6fd96e3f93945f7828a9a8593490daa P 35e7d1ade024444486e63cf1b81e9626: No bootstrap required, opened a new log
I20251023 07:59:28.429217 20209 tablet_service.cc:1505] Processing CreateTablet for tablet a0ff2fc9a3c04716ab748f95a00dec76 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20251023 07:59:28.467343 20272 ts_tablet_manager.cc:1403] T c6fd96e3f93945f7828a9a8593490daa P 35e7d1ade024444486e63cf1b81e9626: Time spent bootstrapping tablet: real 0.230s user 0.015s sys 0.018s
I20251023 07:59:28.468147 20209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0ff2fc9a3c04716ab748f95a00dec76. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.468962 20274 tablet_bootstrap.cc:654] T 5bc7d7ca172742d1b528af8659661c2a P 65876a2b197c4ea6918f5cab47ded25c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:28.433156 19992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e813343bd62640cc9976d0ae394aa315. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.438112 20064 tablet_service.cc:1505] Processing CreateTablet for tablet b4b44015a24e47ddae24244c3fb1fff1 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20251023 07:59:28.433935 19990 tablet_service.cc:1505] Processing CreateTablet for tablet a0ff2fc9a3c04716ab748f95a00dec76 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20251023 07:59:28.473263 19990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0ff2fc9a3c04716ab748f95a00dec76. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.417407 20271 raft_consensus.cc:740] T d214412da5754dd0a08f25d50b5584f1 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Initialized, Role: FOLLOWER
I20251023 07:59:28.481665 19988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a468f7a5913245b58705dc4f8560dade. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.482550 20272 raft_consensus.cc:359] T c6fd96e3f93945f7828a9a8593490daa P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:28.483325 20272 raft_consensus.cc:385] T c6fd96e3f93945f7828a9a8593490daa P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:28.483618 20272 raft_consensus.cc:740] T c6fd96e3f93945f7828a9a8593490daa P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e7d1ade024444486e63cf1b81e9626, State: Initialized, Role: FOLLOWER
I20251023 07:59:28.480178 20271 consensus_queue.cc:260] T d214412da5754dd0a08f25d50b5584f1 P 0f412334fb994ff0ab492afde64f5855 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:28.484309 20272 consensus_queue.cc:260] T c6fd96e3f93945f7828a9a8593490daa P 35e7d1ade024444486e63cf1b81e9626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:28.486284 20271 ts_tablet_manager.cc:1434] T d214412da5754dd0a08f25d50b5584f1 P 0f412334fb994ff0ab492afde64f5855: Time spent starting tablet: real 0.073s user 0.002s sys 0.005s
I20251023 07:59:28.448340 20138 tablet_service.cc:1505] Processing CreateTablet for tablet a0ff2fc9a3c04716ab748f95a00dec76 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20251023 07:59:28.489136 20138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0ff2fc9a3c04716ab748f95a00dec76. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.449589 20137 tablet_service.cc:1505] Processing CreateTablet for tablet b4b44015a24e47ddae24244c3fb1fff1 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20251023 07:59:28.492974 20137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4b44015a24e47ddae24244c3fb1fff1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.452016 20208 tablet_service.cc:1505] Processing CreateTablet for tablet b4b44015a24e47ddae24244c3fb1fff1 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20251023 07:59:28.498903 20208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4b44015a24e47ddae24244c3fb1fff1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.450490 20210 tablet_service.cc:1505] Processing CreateTablet for tablet c52243b5fda44e2fba36f6319b4c13e3 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20251023 07:59:28.502517 20003 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a9d3294d54be4be29569a460be5c8887" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:28.502910 20210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c52243b5fda44e2fba36f6319b4c13e3. 1 dirs total, 0 dirs full, 0 dirs failed
W20251023 07:59:28.504796 20118 leader_election.cc:343] T a9d3294d54be4be29569a460be5c8887 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:28.442476 20273 ts_tablet_manager.cc:1434] T d214412da5754dd0a08f25d50b5584f1 P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.093s user 0.014s sys 0.000s
I20251023 07:59:28.454066 20066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e813343bd62640cc9976d0ae394aa315. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.505781 19989 tablet_service.cc:1505] Processing CreateTablet for tablet 0a62e9fdd3de46bcb61bebafbf9f7a2c (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20251023 07:59:28.507133 20152 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1fa44f181e6e44bfb1e566ef7b0778a0" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855" is_pre_election: true
I20251023 07:59:28.508821 19989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a62e9fdd3de46bcb61bebafbf9f7a2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.511554 20064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4b44015a24e47ddae24244c3fb1fff1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.438218 19986 tablet_service.cc:1505] Processing CreateTablet for tablet c52243b5fda44e2fba36f6319b4c13e3 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20251023 07:59:28.515005 19986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c52243b5fda44e2fba36f6319b4c13e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.515558 20068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a468f7a5913245b58705dc4f8560dade. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.518496 20272 ts_tablet_manager.cc:1434] T c6fd96e3f93945f7828a9a8593490daa P 35e7d1ade024444486e63cf1b81e9626: Time spent starting tablet: real 0.051s user 0.006s sys 0.000s
I20251023 07:59:28.519560 20272 tablet_bootstrap.cc:492] T c6b6d87c63ca43999bf97916bd589275 P 35e7d1ade024444486e63cf1b81e9626: Bootstrap starting.
I20251023 07:59:28.524052 20061 tablet_service.cc:1505] Processing CreateTablet for tablet 0a62e9fdd3de46bcb61bebafbf9f7a2c (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20251023 07:59:28.525468 20061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a62e9fdd3de46bcb61bebafbf9f7a2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.530078 20065 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c52243b5fda44e2fba36f6319b4c13e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.530792 20282 raft_consensus.cc:493] T c6fd96e3f93945f7828a9a8593490daa P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:28.531328 20282 raft_consensus.cc:515] T c6fd96e3f93945f7828a9a8593490daa P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:28.532384 20274 tablet_bootstrap.cc:492] T 5bc7d7ca172742d1b528af8659661c2a P 65876a2b197c4ea6918f5cab47ded25c: No bootstrap required, opened a new log
I20251023 07:59:28.532900 20274 ts_tablet_manager.cc:1403] T 5bc7d7ca172742d1b528af8659661c2a P 65876a2b197c4ea6918f5cab47ded25c: Time spent bootstrapping tablet: real 0.115s user 0.010s sys 0.000s
I20251023 07:59:28.535566 20140 tablet_service.cc:1505] Processing CreateTablet for tablet 58cef989d86d4b0c8401b4d6b2f890c0 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20251023 07:59:28.536010 20274 raft_consensus.cc:359] T 5bc7d7ca172742d1b528af8659661c2a P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:28.536734 20274 raft_consensus.cc:385] T 5bc7d7ca172742d1b528af8659661c2a P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:28.536940 20140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58cef989d86d4b0c8401b4d6b2f890c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.537037 20274 raft_consensus.cc:740] T 5bc7d7ca172742d1b528af8659661c2a P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65876a2b197c4ea6918f5cab47ded25c, State: Initialized, Role: FOLLOWER
I20251023 07:59:28.537569 20271 tablet_bootstrap.cc:492] T c6fd96e3f93945f7828a9a8593490daa P 0f412334fb994ff0ab492afde64f5855: Bootstrap starting.
I20251023 07:59:28.537667 20216 tablet_service.cc:1505] Processing CreateTablet for tablet 58cef989d86d4b0c8401b4d6b2f890c0 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20251023 07:59:28.507400 20273 tablet_bootstrap.cc:492] T 62e73cfc2bbc459aba34186c3231ed87 P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:28.539907 20216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58cef989d86d4b0c8401b4d6b2f890c0. 1 dirs total, 0 dirs full, 0 dirs failed
W20251023 07:59:28.549387 20189 leader_election.cc:343] T 1fa44f181e6e44bfb1e566ef7b0778a0 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:28.549962 20189 leader_election.cc:304] T 1fa44f181e6e44bfb1e566ef7b0778a0 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65876a2b197c4ea6918f5cab47ded25c; no voters: 0f412334fb994ff0ab492afde64f5855, 35e7d1ade024444486e63cf1b81e9626
I20251023 07:59:28.551033 20280 raft_consensus.cc:2749] T 1fa44f181e6e44bfb1e566ef7b0778a0 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:59:28.553107 19987 tablet_service.cc:1505] Processing CreateTablet for tablet 58cef989d86d4b0c8401b4d6b2f890c0 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20251023 07:59:28.554505 19987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58cef989d86d4b0c8401b4d6b2f890c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.560573 20274 consensus_queue.cc:260] T 5bc7d7ca172742d1b528af8659661c2a P 65876a2b197c4ea6918f5cab47ded25c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:28.540181 20282 leader_election.cc:290] T c6fd96e3f93945f7828a9a8593490daa P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865), 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287)
I20251023 07:59:28.564169 20213 tablet_service.cc:1505] Processing CreateTablet for tablet 0a62e9fdd3de46bcb61bebafbf9f7a2c (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20251023 07:59:28.568354 20213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a62e9fdd3de46bcb61bebafbf9f7a2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.573287 20272 tablet_bootstrap.cc:654] T c6b6d87c63ca43999bf97916bd589275 P 35e7d1ade024444486e63cf1b81e9626: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:28.569267 20271 tablet_bootstrap.cc:654] T c6fd96e3f93945f7828a9a8593490daa P 0f412334fb994ff0ab492afde64f5855: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:28.588579 20142 tablet_service.cc:1505] Processing CreateTablet for tablet ae516c440b7749f388e0e2f89a6a81b7 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20251023 07:59:28.588639 20273 tablet_bootstrap.cc:654] T 62e73cfc2bbc459aba34186c3231ed87 P d1379e91aa9c41629cd25262571beb2c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:28.603176 20226 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a9d3294d54be4be29569a460be5c8887" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c" is_pre_election: true
W20251023 07:59:28.608008 20117 leader_election.cc:343] T a9d3294d54be4be29569a460be5c8887 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:28.608517 20117 leader_election.cc:304] T a9d3294d54be4be29569a460be5c8887 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855; no voters: 65876a2b197c4ea6918f5cab47ded25c, d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:28.609608 20281 raft_consensus.cc:2749] T a9d3294d54be4be29569a460be5c8887 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:59:28.613299 20282 raft_consensus.cc:493] T 62e73cfc2bbc459aba34186c3231ed87 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:28.618674 20282 raft_consensus.cc:515] T 62e73cfc2bbc459aba34186c3231ed87 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:28.628669 20138 tablet_service.cc:1505] Processing CreateTablet for tablet cfbe734be0c84115840c7c45f3398002 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20251023 07:59:28.630232 20279 raft_consensus.cc:493] T a9f4a5a96a444c099e7cefb12fe4c288 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:28.630460 20213 tablet_service.cc:1505] Processing CreateTablet for tablet ae516c440b7749f388e0e2f89a6a81b7 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20251023 07:59:28.630798 20279 raft_consensus.cc:515] T a9f4a5a96a444c099e7cefb12fe4c288 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:28.631189 20282 leader_election.cc:290] T 62e73cfc2bbc459aba34186c3231ed87 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:28.631769 20213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae516c440b7749f388e0e2f89a6a81b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.649688 20064 tablet_service.cc:1505] Processing CreateTablet for tablet ae516c440b7749f388e0e2f89a6a81b7 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20251023 07:59:28.651224 20137 tablet_service.cc:1505] Processing CreateTablet for tablet 13d572956c644586b0efbe8f63aecae5 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20251023 07:59:28.653309 20142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae516c440b7749f388e0e2f89a6a81b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.634286 20279 leader_election.cc:290] T a9f4a5a96a444c099e7cefb12fe4c288 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955), 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309)
I20251023 07:59:28.655128 20064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae516c440b7749f388e0e2f89a6a81b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.682291 20061 tablet_service.cc:1505] Processing CreateTablet for tablet cfbe734be0c84115840c7c45f3398002 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20251023 07:59:28.683627 20061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfbe734be0c84115840c7c45f3398002. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.637591 20210 tablet_service.cc:1505] Processing CreateTablet for tablet f8ceeb2a7d7d45629aee9466b149251b (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20251023 07:59:28.686405 20210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8ceeb2a7d7d45629aee9466b149251b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.663208 20274 ts_tablet_manager.cc:1434] T 5bc7d7ca172742d1b528af8659661c2a P 65876a2b197c4ea6918f5cab47ded25c: Time spent starting tablet: real 0.130s user 0.007s sys 0.003s
I20251023 07:59:28.664465 20209 tablet_service.cc:1505] Processing CreateTablet for tablet 13d572956c644586b0efbe8f63aecae5 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20251023 07:59:28.698493 20068 tablet_service.cc:1505] Processing CreateTablet for tablet f8ceeb2a7d7d45629aee9466b149251b (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20251023 07:59:28.699329 20274 tablet_bootstrap.cc:492] T 62e73cfc2bbc459aba34186c3231ed87 P 65876a2b197c4ea6918f5cab47ded25c: Bootstrap starting.
I20251023 07:59:28.699512 20209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13d572956c644586b0efbe8f63aecae5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.699877 20068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8ceeb2a7d7d45629aee9466b149251b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.675136 20139 tablet_service.cc:1505] Processing CreateTablet for tablet 8b6aca6db6ab43e8be0b6ec22dc96700 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20251023 07:59:28.706269 20139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b6aca6db6ab43e8be0b6ec22dc96700. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.678081 19987 tablet_service.cc:1505] Processing CreateTablet for tablet cfbe734be0c84115840c7c45f3398002 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20251023 07:59:28.711012 19987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfbe734be0c84115840c7c45f3398002. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.713061 20152 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6fd96e3f93945f7828a9a8593490daa" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855" is_pre_election: true
W20251023 07:59:28.714712 20041 leader_election.cc:343] T c6fd96e3f93945f7828a9a8593490daa P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:28.738982 20137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13d572956c644586b0efbe8f63aecae5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.740151 20003 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6fd96e3f93945f7828a9a8593490daa" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:28.741825 20138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfbe734be0c84115840c7c45f3398002. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.741948 20002 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "62e73cfc2bbc459aba34186c3231ed87" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
W20251023 07:59:28.743535 20044 leader_election.cc:343] T c6fd96e3f93945f7828a9a8593490daa P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:28.745468 20044 leader_election.cc:304] T c6fd96e3f93945f7828a9a8593490daa P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35e7d1ade024444486e63cf1b81e9626; no voters: 0f412334fb994ff0ab492afde64f5855, d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:28.746245 20282 raft_consensus.cc:2749] T c6fd96e3f93945f7828a9a8593490daa P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251023 07:59:28.747386 20044 leader_election.cc:343] T 62e73cfc2bbc459aba34186c3231ed87 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:28.748939 20271 tablet_bootstrap.cc:492] T c6fd96e3f93945f7828a9a8593490daa P 0f412334fb994ff0ab492afde64f5855: No bootstrap required, opened a new log
I20251023 07:59:28.753986 20271 ts_tablet_manager.cc:1403] T c6fd96e3f93945f7828a9a8593490daa P 0f412334fb994ff0ab492afde64f5855: Time spent bootstrapping tablet: real 0.267s user 0.036s sys 0.008s
I20251023 07:59:28.756353 20274 tablet_bootstrap.cc:654] T 62e73cfc2bbc459aba34186c3231ed87 P 65876a2b197c4ea6918f5cab47ded25c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:28.741218 20065 tablet_service.cc:1505] Processing CreateTablet for tablet 8b6aca6db6ab43e8be0b6ec22dc96700 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20251023 07:59:28.760059 20273 tablet_bootstrap.cc:492] T 62e73cfc2bbc459aba34186c3231ed87 P d1379e91aa9c41629cd25262571beb2c: No bootstrap required, opened a new log
I20251023 07:59:28.763542 20273 ts_tablet_manager.cc:1403] T 62e73cfc2bbc459aba34186c3231ed87 P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.256s user 0.024s sys 0.025s
I20251023 07:59:28.771392 20273 raft_consensus.cc:359] T 62e73cfc2bbc459aba34186c3231ed87 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:28.772213 20273 raft_consensus.cc:385] T 62e73cfc2bbc459aba34186c3231ed87 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:28.772511 20273 raft_consensus.cc:740] T 62e73cfc2bbc459aba34186c3231ed87 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:28.773231 20273 consensus_queue.cc:260] T 62e73cfc2bbc459aba34186c3231ed87 P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:28.774940 20065 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b6aca6db6ab43e8be0b6ec22dc96700. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.775447 20272 tablet_bootstrap.cc:492] T c6b6d87c63ca43999bf97916bd589275 P 35e7d1ade024444486e63cf1b81e9626: No bootstrap required, opened a new log
I20251023 07:59:28.775554 20273 ts_tablet_manager.cc:1434] T 62e73cfc2bbc459aba34186c3231ed87 P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.012s user 0.005s sys 0.000s
I20251023 07:59:28.776013 20272 ts_tablet_manager.cc:1403] T c6b6d87c63ca43999bf97916bd589275 P 35e7d1ade024444486e63cf1b81e9626: Time spent bootstrapping tablet: real 0.257s user 0.006s sys 0.005s
I20251023 07:59:28.777817 20273 tablet_bootstrap.cc:492] T a9d3294d54be4be29569a460be5c8887 P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:28.779347 19988 tablet_service.cc:1505] Processing CreateTablet for tablet d6cbef26ab7c4389b265743ae018e227 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20251023 07:59:28.780678 19988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6cbef26ab7c4389b265743ae018e227. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.771299 20208 tablet_service.cc:1505] Processing CreateTablet for tablet 8b6aca6db6ab43e8be0b6ec22dc96700 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20251023 07:59:28.782116 20208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b6aca6db6ab43e8be0b6ec22dc96700. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.785418 20272 raft_consensus.cc:359] T c6b6d87c63ca43999bf97916bd589275 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:28.786324 20272 raft_consensus.cc:385] T c6b6d87c63ca43999bf97916bd589275 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:28.786587 20272 raft_consensus.cc:740] T c6b6d87c63ca43999bf97916bd589275 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e7d1ade024444486e63cf1b81e9626, State: Initialized, Role: FOLLOWER
I20251023 07:59:28.787345 20272 consensus_queue.cc:260] T c6b6d87c63ca43999bf97916bd589275 P 35e7d1ade024444486e63cf1b81e9626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:28.790393 20271 raft_consensus.cc:359] T c6fd96e3f93945f7828a9a8593490daa P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:28.791496 20271 raft_consensus.cc:385] T c6fd96e3f93945f7828a9a8593490daa P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:28.791932 20271 raft_consensus.cc:740] T c6fd96e3f93945f7828a9a8593490daa P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Initialized, Role: FOLLOWER
I20251023 07:59:28.792712 20271 consensus_queue.cc:260] T c6fd96e3f93945f7828a9a8593490daa P 0f412334fb994ff0ab492afde64f5855 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:28.797116 20272 ts_tablet_manager.cc:1434] T c6b6d87c63ca43999bf97916bd589275 P 35e7d1ade024444486e63cf1b81e9626: Time spent starting tablet: real 0.021s user 0.008s sys 0.000s
I20251023 07:59:28.800611 19989 tablet_service.cc:1505] Processing CreateTablet for tablet 13d572956c644586b0efbe8f63aecae5 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20251023 07:59:28.803484 19989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13d572956c644586b0efbe8f63aecae5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.801383 20274 tablet_bootstrap.cc:492] T 62e73cfc2bbc459aba34186c3231ed87 P 65876a2b197c4ea6918f5cab47ded25c: No bootstrap required, opened a new log
I20251023 07:59:28.804097 20274 ts_tablet_manager.cc:1403] T 62e73cfc2bbc459aba34186c3231ed87 P 65876a2b197c4ea6918f5cab47ded25c: Time spent bootstrapping tablet: real 0.105s user 0.009s sys 0.008s
I20251023 07:59:28.805745 20138 tablet_service.cc:1505] Processing CreateTablet for tablet d6cbef26ab7c4389b265743ae018e227 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20251023 07:59:28.807039 20138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6cbef26ab7c4389b265743ae018e227. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.806828 20274 raft_consensus.cc:359] T 62e73cfc2bbc459aba34186c3231ed87 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:28.807627 20274 raft_consensus.cc:385] T 62e73cfc2bbc459aba34186c3231ed87 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:28.807934 20274 raft_consensus.cc:740] T 62e73cfc2bbc459aba34186c3231ed87 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65876a2b197c4ea6918f5cab47ded25c, State: Initialized, Role: FOLLOWER
I20251023 07:59:28.808619 20274 consensus_queue.cc:260] T 62e73cfc2bbc459aba34186c3231ed87 P 65876a2b197c4ea6918f5cab47ded25c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:28.765306 19986 tablet_service.cc:1505] Processing CreateTablet for tablet f8ceeb2a7d7d45629aee9466b149251b (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20251023 07:59:28.810739 19987 tablet_service.cc:1505] Processing CreateTablet for tablet c3527495b334413f82d0eca2c4d117b1 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20251023 07:59:28.811757 19986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8ceeb2a7d7d45629aee9466b149251b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.796933 20068 tablet_service.cc:1505] Processing CreateTablet for tablet d6cbef26ab7c4389b265743ae018e227 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20251023 07:59:28.815325 20226 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "62e73cfc2bbc459aba34186c3231ed87" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c" is_pre_election: true
I20251023 07:59:28.816032 20226 raft_consensus.cc:2468] T 62e73cfc2bbc459aba34186c3231ed87 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35e7d1ade024444486e63cf1b81e9626 in term 0.
I20251023 07:59:28.817950 20043 leader_election.cc:304] T 62e73cfc2bbc459aba34186c3231ed87 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35e7d1ade024444486e63cf1b81e9626, 65876a2b197c4ea6918f5cab47ded25c; no voters: d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:28.822443 20282 raft_consensus.cc:2804] T 62e73cfc2bbc459aba34186c3231ed87 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:28.822219 20209 tablet_service.cc:1505] Processing CreateTablet for tablet f20a7a673ce6433eac41600d3573e314 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20251023 07:59:28.822866 20282 raft_consensus.cc:493] T 62e73cfc2bbc459aba34186c3231ed87 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:28.823264 20282 raft_consensus.cc:3060] T 62e73cfc2bbc459aba34186c3231ed87 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:28.823585 20209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f20a7a673ce6433eac41600d3573e314. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.826261 20280 raft_consensus.cc:493] T c6b6d87c63ca43999bf97916bd589275 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:28.826741 20280 raft_consensus.cc:515] T c6b6d87c63ca43999bf97916bd589275 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:28.828822 20280 leader_election.cc:290] T c6b6d87c63ca43999bf97916bd589275 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309), 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287)
I20251023 07:59:28.831601 20282 raft_consensus.cc:515] T 62e73cfc2bbc459aba34186c3231ed87 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:28.833775 20152 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6b6d87c63ca43999bf97916bd589275" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855" is_pre_election: true
W20251023 07:59:28.835614 20189 leader_election.cc:343] T c6b6d87c63ca43999bf97916bd589275 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:28.836005 20279 raft_consensus.cc:493] T d214412da5754dd0a08f25d50b5584f1 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:28.836455 20279 raft_consensus.cc:515] T d214412da5754dd0a08f25d50b5584f1 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:28.838397 20279 leader_election.cc:290] T d214412da5754dd0a08f25d50b5584f1 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287), 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309)
I20251023 07:59:28.838910 20142 tablet_service.cc:1505] Processing CreateTablet for tablet f20a7a673ce6433eac41600d3573e314 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20251023 07:59:28.839147 20226 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a9f4a5a96a444c099e7cefb12fe4c288" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c" is_pre_election: true
I20251023 07:59:28.842402 20142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f20a7a673ce6433eac41600d3573e314. 1 dirs total, 0 dirs full, 0 dirs failed
W20251023 07:59:28.842768 19968 leader_election.cc:343] T a9f4a5a96a444c099e7cefb12fe4c288 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:28.840478 19987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3527495b334413f82d0eca2c4d117b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.845837 19992 tablet_service.cc:1505] Processing CreateTablet for tablet f20a7a673ce6433eac41600d3573e314 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20251023 07:59:28.847112 19992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f20a7a673ce6433eac41600d3573e314. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.849606 20066 tablet_service.cc:1505] Processing CreateTablet for tablet dc81e0e89365425793f2851459b7e892 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20251023 07:59:28.851305 20216 tablet_service.cc:1505] Processing CreateTablet for tablet dc81e0e89365425793f2851459b7e892 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20251023 07:59:28.852586 20216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc81e0e89365425793f2851459b7e892. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.857540 20063 tablet_service.cc:1505] Processing CreateTablet for tablet fb985a87f45d43d68b172b937404e770 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20251023 07:59:28.857770 20140 tablet_service.cc:1505] Processing CreateTablet for tablet dc81e0e89365425793f2851459b7e892 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20251023 07:59:28.858614 20139 tablet_service.cc:1505] Processing CreateTablet for tablet fb985a87f45d43d68b172b937404e770 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20251023 07:59:28.859992 19990 tablet_service.cc:1505] Processing CreateTablet for tablet fb985a87f45d43d68b172b937404e770 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20251023 07:59:28.842074 20064 tablet_service.cc:1505] Processing CreateTablet for tablet c3527495b334413f82d0eca2c4d117b1 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20251023 07:59:28.861553 20140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc81e0e89365425793f2851459b7e892. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.862208 20139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb985a87f45d43d68b172b937404e770. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.861285 19990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb985a87f45d43d68b172b937404e770. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.862768 20271 ts_tablet_manager.cc:1434] T c6fd96e3f93945f7828a9a8593490daa P 0f412334fb994ff0ab492afde64f5855: Time spent starting tablet: real 0.107s user 0.003s sys 0.004s
I20251023 07:59:28.833864 20213 tablet_service.cc:1505] Processing CreateTablet for tablet c3527495b334413f82d0eca2c4d117b1 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20251023 07:59:28.866183 20213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3527495b334413f82d0eca2c4d117b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.870846 20078 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6b6d87c63ca43999bf97916bd589275" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
I20251023 07:59:28.871567 20078 raft_consensus.cc:2468] T c6b6d87c63ca43999bf97916bd589275 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65876a2b197c4ea6918f5cab47ded25c in term 0.
I20251023 07:59:28.872722 20190 leader_election.cc:304] T c6b6d87c63ca43999bf97916bd589275 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35e7d1ade024444486e63cf1b81e9626, 65876a2b197c4ea6918f5cab47ded25c; no voters: 0f412334fb994ff0ab492afde64f5855
I20251023 07:59:28.874013 20280 raft_consensus.cc:2804] T c6b6d87c63ca43999bf97916bd589275 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:28.874192 20272 tablet_bootstrap.cc:492] T a9f4a5a96a444c099e7cefb12fe4c288 P 35e7d1ade024444486e63cf1b81e9626: Bootstrap starting.
I20251023 07:59:28.874389 20280 raft_consensus.cc:493] T c6b6d87c63ca43999bf97916bd589275 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:28.871098 20068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6cbef26ab7c4389b265743ae018e227. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.874759 20280 raft_consensus.cc:3060] T c6b6d87c63ca43999bf97916bd589275 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:28.878353 20273 tablet_bootstrap.cc:654] T a9d3294d54be4be29569a460be5c8887 P d1379e91aa9c41629cd25262571beb2c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:28.879087 20274 ts_tablet_manager.cc:1434] T 62e73cfc2bbc459aba34186c3231ed87 P 65876a2b197c4ea6918f5cab47ded25c: Time spent starting tablet: real 0.075s user 0.006s sys 0.000s
I20251023 07:59:28.880267 20274 tablet_bootstrap.cc:492] T a9f4a5a96a444c099e7cefb12fe4c288 P 65876a2b197c4ea6918f5cab47ded25c: Bootstrap starting.
I20251023 07:59:28.882552 20226 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "62e73cfc2bbc459aba34186c3231ed87" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c"
I20251023 07:59:28.882812 20282 leader_election.cc:290] T 62e73cfc2bbc459aba34186c3231ed87 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 election: Requested vote from peers 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:28.883153 20226 raft_consensus.cc:3060] T 62e73cfc2bbc459aba34186c3231ed87 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:28.883487 20002 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "62e73cfc2bbc459aba34186c3231ed87" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c"
I20251023 07:59:28.884086 20002 raft_consensus.cc:3060] T 62e73cfc2bbc459aba34186c3231ed87 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:28.891244 20281 raft_consensus.cc:493] T d214412da5754dd0a08f25d50b5584f1 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:28.888396 20271 tablet_bootstrap.cc:492] T c6b6d87c63ca43999bf97916bd589275 P 0f412334fb994ff0ab492afde64f5855: Bootstrap starting.
I20251023 07:59:28.891876 20281 raft_consensus.cc:515] T d214412da5754dd0a08f25d50b5584f1 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:28.895262 20077 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d214412da5754dd0a08f25d50b5584f1" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
I20251023 07:59:28.896400 20078 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a9f4a5a96a444c099e7cefb12fe4c288" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
I20251023 07:59:28.897043 20281 leader_election.cc:290] T d214412da5754dd0a08f25d50b5584f1 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865), 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309)
I20251023 07:59:28.894179 20066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc81e0e89365425793f2851459b7e892. 1 dirs total, 0 dirs full, 0 dirs failed
W20251023 07:59:28.906136 19967 leader_election.cc:343] T d214412da5754dd0a08f25d50b5584f1 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:28.906239 20003 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d214412da5754dd0a08f25d50b5584f1" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:28.906961 20003 raft_consensus.cc:2468] T d214412da5754dd0a08f25d50b5584f1 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f412334fb994ff0ab492afde64f5855 in term 0.
I20251023 07:59:28.908761 20152 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d214412da5754dd0a08f25d50b5584f1" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855" is_pre_election: true
I20251023 07:59:28.909421 20152 raft_consensus.cc:2468] T d214412da5754dd0a08f25d50b5584f1 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 0.
I20251023 07:59:28.909715 20118 leader_election.cc:304] T d214412da5754dd0a08f25d50b5584f1 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, d1379e91aa9c41629cd25262571beb2c; no voters:
I20251023 07:59:28.910885 19966 leader_election.cc:304] T d214412da5754dd0a08f25d50b5584f1 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, d1379e91aa9c41629cd25262571beb2c; no voters: 35e7d1ade024444486e63cf1b81e9626
I20251023 07:59:28.912045 20279 raft_consensus.cc:2804] T d214412da5754dd0a08f25d50b5584f1 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:28.912395 20279 raft_consensus.cc:493] T d214412da5754dd0a08f25d50b5584f1 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:28.912737 20279 raft_consensus.cc:3060] T d214412da5754dd0a08f25d50b5584f1 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Advancing to term 1
W20251023 07:59:28.907032 19967 leader_election.cc:343] T a9f4a5a96a444c099e7cefb12fe4c288 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:28.913674 19967 leader_election.cc:304] T a9f4a5a96a444c099e7cefb12fe4c288 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d1379e91aa9c41629cd25262571beb2c; no voters: 35e7d1ade024444486e63cf1b81e9626, 65876a2b197c4ea6918f5cab47ded25c
I20251023 07:59:28.914767 20281 raft_consensus.cc:2804] T d214412da5754dd0a08f25d50b5584f1 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:28.915189 20281 raft_consensus.cc:493] T d214412da5754dd0a08f25d50b5584f1 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:28.915527 20281 raft_consensus.cc:3060] T d214412da5754dd0a08f25d50b5584f1 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:28.917786 20063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb985a87f45d43d68b172b937404e770. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.924316 20064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3527495b334413f82d0eca2c4d117b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.930879 20065 tablet_service.cc:1505] Processing CreateTablet for tablet 382a939856194537b68f791851ceaa65 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20251023 07:59:28.932418 20065 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 382a939856194537b68f791851ceaa65. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.939250 20210 tablet_service.cc:1505] Processing CreateTablet for tablet 382a939856194537b68f791851ceaa65 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20251023 07:59:28.940637 20210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 382a939856194537b68f791851ceaa65. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.940371 20137 tablet_service.cc:1505] Processing CreateTablet for tablet 20f681957fa04333b8a04cbad085db57 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20251023 07:59:28.941565 20137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20f681957fa04333b8a04cbad085db57. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.944221 20078 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d214412da5754dd0a08f25d50b5584f1" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
W20251023 07:59:28.946033 20116 leader_election.cc:343] T d214412da5754dd0a08f25d50b5584f1 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:28.940647 20279 raft_consensus.cc:515] T d214412da5754dd0a08f25d50b5584f1 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:28.951660 20212 tablet_service.cc:1505] Processing CreateTablet for tablet 20f681957fa04333b8a04cbad085db57 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20251023 07:59:28.952265 20152 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d214412da5754dd0a08f25d50b5584f1" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855"
I20251023 07:59:28.952981 20212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20f681957fa04333b8a04cbad085db57. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.953344 20279 leader_election.cc:290] T d214412da5754dd0a08f25d50b5584f1 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 election: Requested vote from peers 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287), 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309)
I20251023 07:59:28.954007 20279 raft_consensus.cc:2749] T a9f4a5a96a444c099e7cefb12fe4c288 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:59:28.975358 20226 raft_consensus.cc:2468] T 62e73cfc2bbc459aba34186c3231ed87 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35e7d1ade024444486e63cf1b81e9626 in term 1.
I20251023 07:59:28.987620 20209 tablet_service.cc:1505] Processing CreateTablet for tablet c469a3ace4204641be00f1b797fbffe9 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20251023 07:59:28.989061 20209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c469a3ace4204641be00f1b797fbffe9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:28.976773 20043 leader_election.cc:304] T 62e73cfc2bbc459aba34186c3231ed87 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35e7d1ade024444486e63cf1b81e9626, 65876a2b197c4ea6918f5cab47ded25c; no voters:
I20251023 07:59:28.992866 20282 raft_consensus.cc:2804] T 62e73cfc2bbc459aba34186c3231ed87 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:59:28.995373 20066 tablet_service.cc:1505] Processing CreateTablet for tablet c469a3ace4204641be00f1b797fbffe9 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
W20251023 07:59:29.011703 19949 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20251023 07:59:29.012365 20066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c469a3ace4204641be00f1b797fbffe9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:29.029827 20002 raft_consensus.cc:2468] T 62e73cfc2bbc459aba34186c3231ed87 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35e7d1ade024444486e63cf1b81e9626 in term 1.
I20251023 07:59:29.038327 20061 tablet_service.cc:1505] Processing CreateTablet for tablet bd5baee3419c4a7aa0def773845ac48a (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20251023 07:59:29.039711 20061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd5baee3419c4a7aa0def773845ac48a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:29.035046 20280 raft_consensus.cc:515] T c6b6d87c63ca43999bf97916bd589275 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:29.044282 20078 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6b6d87c63ca43999bf97916bd589275" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626"
I20251023 07:59:29.044889 20078 raft_consensus.cc:3060] T c6b6d87c63ca43999bf97916bd589275 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:29.046769 20273 tablet_bootstrap.cc:492] T a9d3294d54be4be29569a460be5c8887 P d1379e91aa9c41629cd25262571beb2c: No bootstrap required, opened a new log
I20251023 07:59:29.047298 20273 ts_tablet_manager.cc:1403] T a9d3294d54be4be29569a460be5c8887 P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.270s user 0.017s sys 0.000s
W20251023 07:59:29.024184 19967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.126.2:42309, user_credentials={real_user=slave}} blocked reactor thread for 117186us
I20251023 07:59:29.048094 20281 raft_consensus.cc:515] T d214412da5754dd0a08f25d50b5584f1 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:29.049405 20152 raft_consensus.cc:2393] T d214412da5754dd0a08f25d50b5584f1 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d1379e91aa9c41629cd25262571beb2c in current term 1: Already voted for candidate 0f412334fb994ff0ab492afde64f5855 in this term.
I20251023 07:59:29.050354 20280 leader_election.cc:290] T c6b6d87c63ca43999bf97916bd589275 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 election: Requested vote from peers 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309), 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287)
I20251023 07:59:29.050949 20280 raft_consensus.cc:493] T 5bc7d7ca172742d1b528af8659661c2a P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:29.051182 20151 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6b6d87c63ca43999bf97916bd589275" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855"
I20251023 07:59:29.051414 20280 raft_consensus.cc:515] T 5bc7d7ca172742d1b528af8659661c2a P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
W20251023 07:59:29.052582 20189 leader_election.cc:343] T c6b6d87c63ca43999bf97916bd589275 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:29.053207 20273 raft_consensus.cc:359] T a9d3294d54be4be29569a460be5c8887 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:29.053973 20273 raft_consensus.cc:385] T a9d3294d54be4be29569a460be5c8887 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:29.054243 20273 raft_consensus.cc:740] T a9d3294d54be4be29569a460be5c8887 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:29.054752 20002 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d214412da5754dd0a08f25d50b5584f1" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c"
I20251023 07:59:29.055035 20273 consensus_queue.cc:260] T a9d3294d54be4be29569a460be5c8887 P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:29.055541 20002 raft_consensus.cc:2393] T d214412da5754dd0a08f25d50b5584f1 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f412334fb994ff0ab492afde64f5855 in current term 1: Already voted for candidate d1379e91aa9c41629cd25262571beb2c in this term.
I20251023 07:59:29.057468 20077 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d214412da5754dd0a08f25d50b5584f1" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626"
W20251023 07:59:29.058877 20116 leader_election.cc:343] T d214412da5754dd0a08f25d50b5584f1 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:29.059342 20116 leader_election.cc:304] T d214412da5754dd0a08f25d50b5584f1 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855; no voters: 35e7d1ade024444486e63cf1b81e9626, d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:29.060673 20078 raft_consensus.cc:2468] T c6b6d87c63ca43999bf97916bd589275 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65876a2b197c4ea6918f5cab47ded25c in term 1.
I20251023 07:59:29.061875 20190 leader_election.cc:304] T c6b6d87c63ca43999bf97916bd589275 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35e7d1ade024444486e63cf1b81e9626, 65876a2b197c4ea6918f5cab47ded25c; no voters: 0f412334fb994ff0ab492afde64f5855
I20251023 07:59:29.062145 20273 ts_tablet_manager.cc:1434] T a9d3294d54be4be29569a460be5c8887 P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.015s user 0.006s sys 0.003s
I20251023 07:59:29.060333 20281 leader_election.cc:290] T d214412da5754dd0a08f25d50b5584f1 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 election: Requested vote from peers d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865), 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309)
I20251023 07:59:29.067124 20281 raft_consensus.cc:2749] T d214412da5754dd0a08f25d50b5584f1 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20251023 07:59:29.033807 20271 tablet_bootstrap.cc:654] T c6b6d87c63ca43999bf97916bd589275 P 0f412334fb994ff0ab492afde64f5855: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:29.070509 19988 tablet_service.cc:1505] Processing CreateTablet for tablet 382a939856194537b68f791851ceaa65 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20251023 07:59:29.072364 19988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 382a939856194537b68f791851ceaa65. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:29.061314 20274 tablet_bootstrap.cc:654] T a9f4a5a96a444c099e7cefb12fe4c288 P 65876a2b197c4ea6918f5cab47ded25c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:29.017292 20282 raft_consensus.cc:697] T 62e73cfc2bbc459aba34186c3231ed87 P 35e7d1ade024444486e63cf1b81e9626 [term 1 LEADER]: Becoming Leader. State: Replica: 35e7d1ade024444486e63cf1b81e9626, State: Running, Role: LEADER
I20251023 07:59:29.075256 20273 tablet_bootstrap.cc:492] T 12b8704d81fe4e3cb14bfa975c73df29 P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:28.993570 20138 tablet_service.cc:1505] Processing CreateTablet for tablet c469a3ace4204641be00f1b797fbffe9 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20251023 07:59:29.076314 20138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c469a3ace4204641be00f1b797fbffe9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:29.076359 20142 tablet_service.cc:1505] Processing CreateTablet for tablet bd5baee3419c4a7aa0def773845ac48a (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20251023 07:59:29.077764 20142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd5baee3419c4a7aa0def773845ac48a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:29.069113 20078 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d214412da5754dd0a08f25d50b5584f1" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626"
I20251023 07:59:29.089881 20282 consensus_queue.cc:237] T 62e73cfc2bbc459aba34186c3231ed87 P 35e7d1ade024444486e63cf1b81e9626 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:29.091542 20272 tablet_bootstrap.cc:654] T a9f4a5a96a444c099e7cefb12fe4c288 P 35e7d1ade024444486e63cf1b81e9626: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:29.092483 20152 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5bc7d7ca172742d1b528af8659661c2a" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855" is_pre_election: true
W20251023 07:59:29.097101 20189 leader_election.cc:343] T 5bc7d7ca172742d1b528af8659661c2a P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:29.098027 20280 leader_election.cc:290] T 5bc7d7ca172742d1b528af8659661c2a P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:29.098541 20280 raft_consensus.cc:2804] T c6b6d87c63ca43999bf97916bd589275 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:59:29.098982 20280 raft_consensus.cc:697] T c6b6d87c63ca43999bf97916bd589275 P 65876a2b197c4ea6918f5cab47ded25c [term 1 LEADER]: Becoming Leader. State: Replica: 65876a2b197c4ea6918f5cab47ded25c, State: Running, Role: LEADER
I20251023 07:59:29.099825 20280 consensus_queue.cc:237] T c6b6d87c63ca43999bf97916bd589275 P 65876a2b197c4ea6918f5cab47ded25c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:29.110240 20281 raft_consensus.cc:493] T c6fd96e3f93945f7828a9a8593490daa P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:29.119040 20061 tablet_service.cc:1505] Processing CreateTablet for tablet 2ff74dfb94334c20b99ea84b985a27a5 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20251023 07:59:29.120484 20061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ff74dfb94334c20b99ea84b985a27a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:29.120962 19986 tablet_service.cc:1505] Processing CreateTablet for tablet 20f681957fa04333b8a04cbad085db57 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20251023 07:59:29.122262 19986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20f681957fa04333b8a04cbad085db57. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:29.121949 20281 raft_consensus.cc:515] T c6fd96e3f93945f7828a9a8593490daa P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:29.122455 20208 tablet_service.cc:1505] Processing CreateTablet for tablet 2ff74dfb94334c20b99ea84b985a27a5 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20251023 07:59:29.123759 20208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ff74dfb94334c20b99ea84b985a27a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:29.124015 20281 leader_election.cc:290] T c6fd96e3f93945f7828a9a8593490daa P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865), 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309)
I20251023 07:59:29.128304 20140 tablet_service.cc:1505] Processing CreateTablet for tablet a1c85032f5ef4634a35c20eec56ae62f (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20251023 07:59:29.129647 20140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1c85032f5ef4634a35c20eec56ae62f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:29.137221 20002 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6fd96e3f93945f7828a9a8593490daa" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:29.138823 19989 tablet_service.cc:1505] Processing CreateTablet for tablet bd5baee3419c4a7aa0def773845ac48a (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
W20251023 07:59:29.139488 20118 leader_election.cc:343] T c6fd96e3f93945f7828a9a8593490daa P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:29.140167 19989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd5baee3419c4a7aa0def773845ac48a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:29.139775 20213 tablet_service.cc:1505] Processing CreateTablet for tablet a1c85032f5ef4634a35c20eec56ae62f (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
W20251023 07:59:29.135982 20116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.126.2:42309, user_credentials={real_user=slave}} blocked reactor thread for 77136.5us
I20251023 07:59:29.142860 20078 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6fd96e3f93945f7828a9a8593490daa" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
I20251023 07:59:29.143515 20078 raft_consensus.cc:2468] T c6fd96e3f93945f7828a9a8593490daa P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f412334fb994ff0ab492afde64f5855 in term 0.
I20251023 07:59:29.144762 20116 leader_election.cc:304] T c6fd96e3f93945f7828a9a8593490daa P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, 35e7d1ade024444486e63cf1b81e9626; no voters: d1379e91aa9c41629cd25262571beb2c
W20251023 07:59:29.147758 19967 leader_election.cc:343] T d214412da5754dd0a08f25d50b5584f1 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:29.147684 19990 tablet_service.cc:1505] Processing CreateTablet for tablet 2ff74dfb94334c20b99ea84b985a27a5 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20251023 07:59:29.148335 19967 leader_election.cc:304] T d214412da5754dd0a08f25d50b5584f1 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d1379e91aa9c41629cd25262571beb2c; no voters: 0f412334fb994ff0ab492afde64f5855, 35e7d1ade024444486e63cf1b81e9626
I20251023 07:59:29.149096 19990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ff74dfb94334c20b99ea84b985a27a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:29.150449 20306 raft_consensus.cc:2749] T d214412da5754dd0a08f25d50b5584f1 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20251023 07:59:29.150712 20273 tablet_bootstrap.cc:654] T 12b8704d81fe4e3cb14bfa975c73df29 P d1379e91aa9c41629cd25262571beb2c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:29.150472 19992 tablet_service.cc:1505] Processing CreateTablet for tablet a1c85032f5ef4634a35c20eec56ae62f (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20251023 07:59:29.152419 19992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1c85032f5ef4634a35c20eec56ae62f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:29.155731 20213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1c85032f5ef4634a35c20eec56ae62f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:29.157756 19900 catalog_manager.cc:5649] T 62e73cfc2bbc459aba34186c3231ed87 P 35e7d1ade024444486e63cf1b81e9626 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2). New cstate: current_term: 1 leader_uuid: "35e7d1ade024444486e63cf1b81e9626" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } health_report { overall_health: HEALTHY } } }
I20251023 07:59:29.165088 20281 raft_consensus.cc:2804] T c6fd96e3f93945f7828a9a8593490daa P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:29.169775 20281 raft_consensus.cc:493] T c6fd96e3f93945f7828a9a8593490daa P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:29.170167 20281 raft_consensus.cc:3060] T c6fd96e3f93945f7828a9a8593490daa P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:29.170727 20067 tablet_service.cc:1505] Processing CreateTablet for tablet 090551fa29ba48dd8d41263e14b8ec3c (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20251023 07:59:29.172014 20067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 090551fa29ba48dd8d41263e14b8ec3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:29.181686 20306 raft_consensus.cc:493] T a9d3294d54be4be29569a460be5c8887 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:29.182289 20306 raft_consensus.cc:515] T a9d3294d54be4be29569a460be5c8887 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:29.186151 20152 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a9d3294d54be4be29569a460be5c8887" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855" is_pre_election: true
I20251023 07:59:29.186841 20152 raft_consensus.cc:2468] T a9d3294d54be4be29569a460be5c8887 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 0.
I20251023 07:59:29.190375 20209 tablet_service.cc:1505] Processing CreateTablet for tablet 090551fa29ba48dd8d41263e14b8ec3c (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20251023 07:59:29.191736 20209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 090551fa29ba48dd8d41263e14b8ec3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:29.191769 19987 tablet_service.cc:1505] Processing CreateTablet for tablet 09f7b5cd377e45be8bbd85052c93dcb3 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20251023 07:59:29.192481 20271 tablet_bootstrap.cc:492] T c6b6d87c63ca43999bf97916bd589275 P 0f412334fb994ff0ab492afde64f5855: No bootstrap required, opened a new log
I20251023 07:59:29.192991 20271 ts_tablet_manager.cc:1403] T c6b6d87c63ca43999bf97916bd589275 P 0f412334fb994ff0ab492afde64f5855: Time spent bootstrapping tablet: real 0.306s user 0.021s sys 0.009s
I20251023 07:59:29.193120 19987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09f7b5cd377e45be8bbd85052c93dcb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:29.195279 19966 leader_election.cc:304] T a9d3294d54be4be29569a460be5c8887 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, d1379e91aa9c41629cd25262571beb2c; no voters:
I20251023 07:59:29.196960 20306 leader_election.cc:290] T a9d3294d54be4be29569a460be5c8887 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287), 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955)
I20251023 07:59:29.197499 20306 raft_consensus.cc:2804] T a9d3294d54be4be29569a460be5c8887 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:29.197813 20306 raft_consensus.cc:493] T a9d3294d54be4be29569a460be5c8887 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:29.198136 20306 raft_consensus.cc:3060] T a9d3294d54be4be29569a460be5c8887 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:29.198163 20226 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a9d3294d54be4be29569a460be5c8887" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c" is_pre_election: true
W20251023 07:59:29.203944 19968 leader_election.cc:343] T a9d3294d54be4be29569a460be5c8887 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:29.203866 20142 tablet_service.cc:1505] Processing CreateTablet for tablet 090551fa29ba48dd8d41263e14b8ec3c (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20251023 07:59:29.205216 20142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 090551fa29ba48dd8d41263e14b8ec3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:29.210433 20064 tablet_service.cc:1505] Processing CreateTablet for tablet 09f7b5cd377e45be8bbd85052c93dcb3 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20251023 07:59:29.211838 20064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09f7b5cd377e45be8bbd85052c93dcb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:29.212440 20306 raft_consensus.cc:515] T a9d3294d54be4be29569a460be5c8887 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:29.230244 20272 tablet_bootstrap.cc:492] T a9f4a5a96a444c099e7cefb12fe4c288 P 35e7d1ade024444486e63cf1b81e9626: No bootstrap required, opened a new log
I20251023 07:59:29.230837 20272 ts_tablet_manager.cc:1403] T a9f4a5a96a444c099e7cefb12fe4c288 P 35e7d1ade024444486e63cf1b81e9626: Time spent bootstrapping tablet: real 0.357s user 0.021s sys 0.019s
I20251023 07:59:29.237339 20139 tablet_service.cc:1505] Processing CreateTablet for tablet 09f7b5cd377e45be8bbd85052c93dcb3 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20251023 07:59:29.238725 20139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09f7b5cd377e45be8bbd85052c93dcb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:29.242530 20213 tablet_service.cc:1505] Processing CreateTablet for tablet 0973ba22912840bd9bded8b0376fa1e7 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20251023 07:59:29.243572 20213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0973ba22912840bd9bded8b0376fa1e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:29.255323 19989 tablet_service.cc:1505] Processing CreateTablet for tablet 0973ba22912840bd9bded8b0376fa1e7 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20251023 07:59:29.256296 19989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0973ba22912840bd9bded8b0376fa1e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:29.233906 20272 raft_consensus.cc:359] T a9f4a5a96a444c099e7cefb12fe4c288 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:29.257710 20272 raft_consensus.cc:385] T a9f4a5a96a444c099e7cefb12fe4c288 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:29.259575 20063 tablet_service.cc:1505] Processing CreateTablet for tablet 0973ba22912840bd9bded8b0376fa1e7 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20251023 07:59:29.259843 20271 raft_consensus.cc:359] T c6b6d87c63ca43999bf97916bd589275 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:29.260604 20271 raft_consensus.cc:385] T c6b6d87c63ca43999bf97916bd589275 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:29.260897 20063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0973ba22912840bd9bded8b0376fa1e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:29.260912 20271 raft_consensus.cc:740] T c6b6d87c63ca43999bf97916bd589275 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Initialized, Role: FOLLOWER
I20251023 07:59:29.266949 20281 raft_consensus.cc:515] T c6fd96e3f93945f7828a9a8593490daa P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:29.267066 20271 consensus_queue.cc:260] T c6b6d87c63ca43999bf97916bd589275 P 0f412334fb994ff0ab492afde64f5855 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:29.269079 20281 leader_election.cc:290] T c6fd96e3f93945f7828a9a8593490daa P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 election: Requested vote from peers d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865), 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309)
I20251023 07:59:29.270243 20078 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6fd96e3f93945f7828a9a8593490daa" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626"
I20251023 07:59:29.270597 20002 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6fd96e3f93945f7828a9a8593490daa" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c"
I20251023 07:59:29.270875 20078 raft_consensus.cc:3060] T c6fd96e3f93945f7828a9a8593490daa P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Advancing to term 1
W20251023 07:59:29.272042 20118 leader_election.cc:343] T c6fd96e3f93945f7828a9a8593490daa P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:29.274158 20306 leader_election.cc:290] T a9d3294d54be4be29569a460be5c8887 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 election: Requested vote from peers 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287), 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955)
I20251023 07:59:29.275254 20226 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a9d3294d54be4be29569a460be5c8887" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c"
I20251023 07:59:29.276373 20152 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a9d3294d54be4be29569a460be5c8887" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855"
I20251023 07:59:29.276948 20152 raft_consensus.cc:3060] T a9d3294d54be4be29569a460be5c8887 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:29.277853 19898 catalog_manager.cc:5649] T c6b6d87c63ca43999bf97916bd589275 P 65876a2b197c4ea6918f5cab47ded25c reported cstate change: term changed from 0 to 1, leader changed from <none> to 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4). New cstate: current_term: 1 leader_uuid: "65876a2b197c4ea6918f5cab47ded25c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } health_report { overall_health: HEALTHY } } }
I20251023 07:59:29.279559 20078 raft_consensus.cc:2468] T c6fd96e3f93945f7828a9a8593490daa P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f412334fb994ff0ab492afde64f5855 in term 1.
I20251023 07:59:29.281010 20116 leader_election.cc:304] T c6fd96e3f93945f7828a9a8593490daa P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, 35e7d1ade024444486e63cf1b81e9626; no voters: d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:29.282219 20309 raft_consensus.cc:2804] T c6fd96e3f93945f7828a9a8593490daa P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Leader election won for term 1
W20251023 07:59:29.282898 19968 leader_election.cc:343] T a9d3294d54be4be29569a460be5c8887 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:29.287122 20152 raft_consensus.cc:2468] T a9d3294d54be4be29569a460be5c8887 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 1.
I20251023 07:59:29.288337 19966 leader_election.cc:304] T a9d3294d54be4be29569a460be5c8887 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, d1379e91aa9c41629cd25262571beb2c; no voters: 65876a2b197c4ea6918f5cab47ded25c
I20251023 07:59:29.288560 20274 tablet_bootstrap.cc:492] T a9f4a5a96a444c099e7cefb12fe4c288 P 65876a2b197c4ea6918f5cab47ded25c: No bootstrap required, opened a new log
I20251023 07:59:29.289733 20274 ts_tablet_manager.cc:1403] T a9f4a5a96a444c099e7cefb12fe4c288 P 65876a2b197c4ea6918f5cab47ded25c: Time spent bootstrapping tablet: real 0.410s user 0.008s sys 0.012s
I20251023 07:59:29.292780 20274 raft_consensus.cc:359] T a9f4a5a96a444c099e7cefb12fe4c288 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:29.294157 20274 raft_consensus.cc:385] T a9f4a5a96a444c099e7cefb12fe4c288 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:29.294462 20274 raft_consensus.cc:740] T a9f4a5a96a444c099e7cefb12fe4c288 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65876a2b197c4ea6918f5cab47ded25c, State: Initialized, Role: FOLLOWER
I20251023 07:59:29.293704 20306 raft_consensus.cc:2804] T a9d3294d54be4be29569a460be5c8887 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:59:29.296087 20306 raft_consensus.cc:697] T a9d3294d54be4be29569a460be5c8887 P d1379e91aa9c41629cd25262571beb2c [term 1 LEADER]: Becoming Leader. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Running, Role: LEADER
I20251023 07:59:29.296970 20306 consensus_queue.cc:237] T a9d3294d54be4be29569a460be5c8887 P d1379e91aa9c41629cd25262571beb2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:29.258355 20272 raft_consensus.cc:740] T a9f4a5a96a444c099e7cefb12fe4c288 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e7d1ade024444486e63cf1b81e9626, State: Initialized, Role: FOLLOWER
I20251023 07:59:29.299059 20272 consensus_queue.cc:260] T a9f4a5a96a444c099e7cefb12fe4c288 P 35e7d1ade024444486e63cf1b81e9626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:29.302484 20272 ts_tablet_manager.cc:1434] T a9f4a5a96a444c099e7cefb12fe4c288 P 35e7d1ade024444486e63cf1b81e9626: Time spent starting tablet: real 0.071s user 0.005s sys 0.004s
I20251023 07:59:29.300613 20274 consensus_queue.cc:260] T a9f4a5a96a444c099e7cefb12fe4c288 P 65876a2b197c4ea6918f5cab47ded25c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:29.323819 20272 tablet_bootstrap.cc:492] T 12b8704d81fe4e3cb14bfa975c73df29 P 35e7d1ade024444486e63cf1b81e9626: Bootstrap starting.
I20251023 07:59:29.324326 20209 tablet_service.cc:1505] Processing CreateTablet for tablet f1da9b379f264014adfbf37b2660285b (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20251023 07:59:29.328176 20209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1da9b379f264014adfbf37b2660285b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:29.338454 19986 tablet_service.cc:1505] Processing CreateTablet for tablet f1da9b379f264014adfbf37b2660285b (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20251023 07:59:29.338909 20061 tablet_service.cc:1505] Processing CreateTablet for tablet 6db769d91ae244679bcea825f9763446 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20251023 07:59:29.339993 19986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1da9b379f264014adfbf37b2660285b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:29.340754 20061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6db769d91ae244679bcea825f9763446. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:29.341374 20274 ts_tablet_manager.cc:1434] T a9f4a5a96a444c099e7cefb12fe4c288 P 65876a2b197c4ea6918f5cab47ded25c: Time spent starting tablet: real 0.051s user 0.007s sys 0.000s
I20251023 07:59:29.342540 20274 tablet_bootstrap.cc:492] T 92fae2a393404d8998ad2747fbd08cc9 P 65876a2b197c4ea6918f5cab47ded25c: Bootstrap starting.
I20251023 07:59:29.354559 20142 tablet_service.cc:1505] Processing CreateTablet for tablet f1da9b379f264014adfbf37b2660285b (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20251023 07:59:29.356006 20142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1da9b379f264014adfbf37b2660285b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:29.359546 20138 tablet_service.cc:1505] Processing CreateTablet for tablet 6db769d91ae244679bcea825f9763446 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20251023 07:59:29.360759 20138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6db769d91ae244679bcea825f9763446. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:29.371434 20002 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5bc7d7ca172742d1b528af8659661c2a" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:29.372200 20212 tablet_service.cc:1505] Processing CreateTablet for tablet 6db769d91ae244679bcea825f9763446 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20251023 07:59:29.372315 19988 tablet_service.cc:1505] Processing CreateTablet for tablet 0fead0c9b2cd4e6cabadb0fe1cd8324b (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
W20251023 07:59:29.373546 20192 leader_election.cc:343] T 5bc7d7ca172742d1b528af8659661c2a P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:29.373785 20212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6db769d91ae244679bcea825f9763446. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:29.373780 19988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fead0c9b2cd4e6cabadb0fe1cd8324b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:29.374176 20192 leader_election.cc:304] T 5bc7d7ca172742d1b528af8659661c2a P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65876a2b197c4ea6918f5cab47ded25c; no voters: 0f412334fb994ff0ab492afde64f5855, d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:29.375394 20280 raft_consensus.cc:2749] T 5bc7d7ca172742d1b528af8659661c2a P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:59:29.378772 20067 tablet_service.cc:1505] Processing CreateTablet for tablet 0fead0c9b2cd4e6cabadb0fe1cd8324b (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20251023 07:59:29.380223 20067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fead0c9b2cd4e6cabadb0fe1cd8324b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:29.362439 20309 raft_consensus.cc:697] T c6fd96e3f93945f7828a9a8593490daa P 0f412334fb994ff0ab492afde64f5855 [term 1 LEADER]: Becoming Leader. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Running, Role: LEADER
I20251023 07:59:29.398599 20273 tablet_bootstrap.cc:492] T 12b8704d81fe4e3cb14bfa975c73df29 P d1379e91aa9c41629cd25262571beb2c: No bootstrap required, opened a new log
I20251023 07:59:29.399232 20273 ts_tablet_manager.cc:1403] T 12b8704d81fe4e3cb14bfa975c73df29 P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.324s user 0.015s sys 0.014s
I20251023 07:59:29.399876 20137 tablet_service.cc:1505] Processing CreateTablet for tablet 0fead0c9b2cd4e6cabadb0fe1cd8324b (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20251023 07:59:29.400197 19901 catalog_manager.cc:5649] T a9d3294d54be4be29569a460be5c8887 P d1379e91aa9c41629cd25262571beb2c reported cstate change: term changed from 0 to 1, leader changed from <none> to d1379e91aa9c41629cd25262571beb2c (127.16.126.1). New cstate: current_term: 1 leader_uuid: "d1379e91aa9c41629cd25262571beb2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: HEALTHY } } }
I20251023 07:59:29.402189 20273 raft_consensus.cc:359] T 12b8704d81fe4e3cb14bfa975c73df29 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:29.402920 20273 raft_consensus.cc:385] T 12b8704d81fe4e3cb14bfa975c73df29 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:29.395143 20271 ts_tablet_manager.cc:1434] T c6b6d87c63ca43999bf97916bd589275 P 0f412334fb994ff0ab492afde64f5855: Time spent starting tablet: real 0.202s user 0.009s sys 0.002s
I20251023 07:59:29.395800 20274 tablet_bootstrap.cc:654] T 92fae2a393404d8998ad2747fbd08cc9 P 65876a2b197c4ea6918f5cab47ded25c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:29.403215 20273 raft_consensus.cc:740] T 12b8704d81fe4e3cb14bfa975c73df29 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:29.394395 20309 consensus_queue.cc:237] T c6fd96e3f93945f7828a9a8593490daa P 0f412334fb994ff0ab492afde64f5855 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:29.414973 20273 consensus_queue.cc:260] T 12b8704d81fe4e3cb14bfa975c73df29 P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:29.420348 20306 raft_consensus.cc:493] T 12b8704d81fe4e3cb14bfa975c73df29 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:29.420846 20306 raft_consensus.cc:515] T 12b8704d81fe4e3cb14bfa975c73df29 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:29.421262 20271 tablet_bootstrap.cc:492] T 1fa44f181e6e44bfb1e566ef7b0778a0 P 0f412334fb994ff0ab492afde64f5855: Bootstrap starting.
I20251023 07:59:29.426353 19986 tablet_service.cc:1505] Processing CreateTablet for tablet cb866838666745f0a4462f124ac22f72 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20251023 07:59:29.429553 19986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb866838666745f0a4462f124ac22f72. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:29.430394 20078 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "12b8704d81fe4e3cb14bfa975c73df29" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
W20251023 07:59:29.432710 19967 leader_election.cc:343] T 12b8704d81fe4e3cb14bfa975c73df29 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:29.417780 20212 tablet_service.cc:1505] Processing CreateTablet for tablet cb866838666745f0a4462f124ac22f72 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20251023 07:59:29.418586 20137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fead0c9b2cd4e6cabadb0fe1cd8324b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:29.439744 20271 tablet_bootstrap.cc:654] T 1fa44f181e6e44bfb1e566ef7b0778a0 P 0f412334fb994ff0ab492afde64f5855: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:29.418979 20061 tablet_service.cc:1505] Processing CreateTablet for tablet cb866838666745f0a4462f124ac22f72 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20251023 07:59:29.427722 20152 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "12b8704d81fe4e3cb14bfa975c73df29" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855" is_pre_election: true
W20251023 07:59:29.442840 19966 leader_election.cc:343] T 12b8704d81fe4e3cb14bfa975c73df29 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:29.443284 19966 leader_election.cc:304] T 12b8704d81fe4e3cb14bfa975c73df29 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d1379e91aa9c41629cd25262571beb2c; no voters: 0f412334fb994ff0ab492afde64f5855, 35e7d1ade024444486e63cf1b81e9626
I20251023 07:59:29.444154 20279 raft_consensus.cc:2749] T 12b8704d81fe4e3cb14bfa975c73df29 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:59:29.445518 20061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb866838666745f0a4462f124ac22f72. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:29.448016 20063 tablet_service.cc:1505] Processing CreateTablet for tablet 01844334149649bb83991b613a695fe2 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20251023 07:59:29.428244 20306 leader_election.cc:290] T 12b8704d81fe4e3cb14bfa975c73df29 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309), 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287)
I20251023 07:59:29.428097 20140 tablet_service.cc:1505] Processing CreateTablet for tablet f524e775b99147de99cfb27d3785965d (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20251023 07:59:29.449312 20063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01844334149649bb83991b613a695fe2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:29.449752 20140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f524e775b99147de99cfb27d3785965d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:29.450042 20142 tablet_service.cc:1505] Processing CreateTablet for tablet 01844334149649bb83991b613a695fe2 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20251023 07:59:29.451336 20142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01844334149649bb83991b613a695fe2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:29.452998 20213 tablet_service.cc:1505] Processing CreateTablet for tablet 01844334149649bb83991b613a695fe2 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20251023 07:59:29.433202 20209 tablet_service.cc:1505] Processing CreateTablet for tablet f524e775b99147de99cfb27d3785965d (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20251023 07:59:29.454190 20213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01844334149649bb83991b613a695fe2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:29.458014 20209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f524e775b99147de99cfb27d3785965d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:29.466421 19992 tablet_service.cc:1505] Processing CreateTablet for tablet f524e775b99147de99cfb27d3785965d (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20251023 07:59:29.467891 19992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f524e775b99147de99cfb27d3785965d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:29.474959 20273 ts_tablet_manager.cc:1434] T 12b8704d81fe4e3cb14bfa975c73df29 P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.075s user 0.006s sys 0.000s
I20251023 07:59:29.476162 20273 tablet_bootstrap.cc:492] T 5bc7d7ca172742d1b528af8659661c2a P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:29.482179 20212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb866838666745f0a4462f124ac22f72. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:29.415829 20272 tablet_bootstrap.cc:654] T 12b8704d81fe4e3cb14bfa975c73df29 P 35e7d1ade024444486e63cf1b81e9626: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:29.487002 19986 tablet_service.cc:1505] Processing CreateTablet for tablet d51f1c713224480980c425d473226a02 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20251023 07:59:29.488677 19986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d51f1c713224480980c425d473226a02. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:29.493189 20273 tablet_bootstrap.cc:654] T 5bc7d7ca172742d1b528af8659661c2a P d1379e91aa9c41629cd25262571beb2c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:29.510417 20274 tablet_bootstrap.cc:492] T 92fae2a393404d8998ad2747fbd08cc9 P 65876a2b197c4ea6918f5cab47ded25c: No bootstrap required, opened a new log
I20251023 07:59:29.510962 20274 ts_tablet_manager.cc:1403] T 92fae2a393404d8998ad2747fbd08cc9 P 65876a2b197c4ea6918f5cab47ded25c: Time spent bootstrapping tablet: real 0.169s user 0.006s sys 0.006s
I20251023 07:59:29.515344 20063 tablet_service.cc:1505] Processing CreateTablet for tablet d51f1c713224480980c425d473226a02 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20251023 07:59:29.516896 20063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d51f1c713224480980c425d473226a02. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:29.521673 20274 raft_consensus.cc:359] T 92fae2a393404d8998ad2747fbd08cc9 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:29.529597 20274 raft_consensus.cc:385] T 92fae2a393404d8998ad2747fbd08cc9 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:29.530032 20274 raft_consensus.cc:740] T 92fae2a393404d8998ad2747fbd08cc9 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65876a2b197c4ea6918f5cab47ded25c, State: Initialized, Role: FOLLOWER
I20251023 07:59:29.530974 20274 consensus_queue.cc:260] T 92fae2a393404d8998ad2747fbd08cc9 P 65876a2b197c4ea6918f5cab47ded25c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:29.535315 20274 ts_tablet_manager.cc:1434] T 92fae2a393404d8998ad2747fbd08cc9 P 65876a2b197c4ea6918f5cab47ded25c: Time spent starting tablet: real 0.024s user 0.005s sys 0.001s
I20251023 07:59:29.536394 20274 tablet_bootstrap.cc:492] T a9d3294d54be4be29569a460be5c8887 P 65876a2b197c4ea6918f5cab47ded25c: Bootstrap starting.
I20251023 07:59:29.539496 20137 tablet_service.cc:1505] Processing CreateTablet for tablet d51f1c713224480980c425d473226a02 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20251023 07:59:29.540172 20213 tablet_service.cc:1505] Processing CreateTablet for tablet 35c1ea979bda45aead7d1b8539f37637 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20251023 07:59:29.541795 20137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d51f1c713224480980c425d473226a02. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:29.541813 20213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35c1ea979bda45aead7d1b8539f37637. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:29.570299 19986 tablet_service.cc:1505] Processing CreateTablet for tablet 35c1ea979bda45aead7d1b8539f37637 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20251023 07:59:29.571504 19986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35c1ea979bda45aead7d1b8539f37637. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:29.568295 20309 raft_consensus.cc:493] T c6b6d87c63ca43999bf97916bd589275 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:29.573233 20309 raft_consensus.cc:515] T c6b6d87c63ca43999bf97916bd589275 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:29.575383 20309 leader_election.cc:290] T c6b6d87c63ca43999bf97916bd589275 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309), 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955)
I20251023 07:59:29.576082 20078 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6b6d87c63ca43999bf97916bd589275" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
I20251023 07:59:29.576871 20078 raft_consensus.cc:2393] T c6b6d87c63ca43999bf97916bd589275 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f412334fb994ff0ab492afde64f5855 in current term 1: Already voted for candidate 65876a2b197c4ea6918f5cab47ded25c in this term.
I20251023 07:59:29.577683 20226 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6b6d87c63ca43999bf97916bd589275" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c" is_pre_election: true
I20251023 07:59:29.578806 20142 tablet_service.cc:1505] Processing CreateTablet for tablet b7dcf1850ca541d6ab42bd11de70d8f4 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20251023 07:59:29.579195 20117 leader_election.cc:304] T c6b6d87c63ca43999bf97916bd589275 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855; no voters: 35e7d1ade024444486e63cf1b81e9626, 65876a2b197c4ea6918f5cab47ded25c
I20251023 07:59:29.579984 20142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7dcf1850ca541d6ab42bd11de70d8f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:29.580487 20309 raft_consensus.cc:3060] T c6b6d87c63ca43999bf97916bd589275 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:29.588482 20309 raft_consensus.cc:2749] T c6b6d87c63ca43999bf97916bd589275 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:59:29.573664 20272 tablet_bootstrap.cc:492] T 12b8704d81fe4e3cb14bfa975c73df29 P 35e7d1ade024444486e63cf1b81e9626: No bootstrap required, opened a new log
I20251023 07:59:29.591725 20273 tablet_bootstrap.cc:492] T 5bc7d7ca172742d1b528af8659661c2a P d1379e91aa9c41629cd25262571beb2c: No bootstrap required, opened a new log
I20251023 07:59:29.591917 19988 tablet_service.cc:1505] Processing CreateTablet for tablet b7dcf1850ca541d6ab42bd11de70d8f4 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20251023 07:59:29.592276 20212 tablet_service.cc:1505] Processing CreateTablet for tablet b7dcf1850ca541d6ab42bd11de70d8f4 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20251023 07:59:29.592329 20273 ts_tablet_manager.cc:1403] T 5bc7d7ca172742d1b528af8659661c2a P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.116s user 0.015s sys 0.015s
I20251023 07:59:29.593761 20212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7dcf1850ca541d6ab42bd11de70d8f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:29.595328 20272 ts_tablet_manager.cc:1403] T 12b8704d81fe4e3cb14bfa975c73df29 P 35e7d1ade024444486e63cf1b81e9626: Time spent bootstrapping tablet: real 0.272s user 0.020s sys 0.003s
I20251023 07:59:29.596652 20273 raft_consensus.cc:359] T 5bc7d7ca172742d1b528af8659661c2a P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:29.597456 20273 raft_consensus.cc:385] T 5bc7d7ca172742d1b528af8659661c2a P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:29.597797 20273 raft_consensus.cc:740] T 5bc7d7ca172742d1b528af8659661c2a P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:29.598341 20272 raft_consensus.cc:359] T 12b8704d81fe4e3cb14bfa975c73df29 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:29.598536 20273 consensus_queue.cc:260] T 5bc7d7ca172742d1b528af8659661c2a P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:29.593190 20274 tablet_bootstrap.cc:654] T a9d3294d54be4be29569a460be5c8887 P 65876a2b197c4ea6918f5cab47ded25c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:29.601123 20271 tablet_bootstrap.cc:492] T 1fa44f181e6e44bfb1e566ef7b0778a0 P 0f412334fb994ff0ab492afde64f5855: No bootstrap required, opened a new log
I20251023 07:59:29.601711 20271 ts_tablet_manager.cc:1403] T 1fa44f181e6e44bfb1e566ef7b0778a0 P 0f412334fb994ff0ab492afde64f5855: Time spent bootstrapping tablet: real 0.181s user 0.035s sys 0.041s
I20251023 07:59:29.593243 19988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7dcf1850ca541d6ab42bd11de70d8f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:29.604652 20271 raft_consensus.cc:359] T 1fa44f181e6e44bfb1e566ef7b0778a0 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:29.605381 20271 raft_consensus.cc:385] T 1fa44f181e6e44bfb1e566ef7b0778a0 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:29.605710 20271 raft_consensus.cc:740] T 1fa44f181e6e44bfb1e566ef7b0778a0 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Initialized, Role: FOLLOWER
I20251023 07:59:29.605767 20273 ts_tablet_manager.cc:1434] T 5bc7d7ca172742d1b528af8659661c2a P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.012s user 0.006s sys 0.001s
I20251023 07:59:29.606554 20271 consensus_queue.cc:260] T 1fa44f181e6e44bfb1e566ef7b0778a0 P 0f412334fb994ff0ab492afde64f5855 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:29.609231 20271 ts_tablet_manager.cc:1434] T 1fa44f181e6e44bfb1e566ef7b0778a0 P 0f412334fb994ff0ab492afde64f5855: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20251023 07:59:29.610275 20271 tablet_bootstrap.cc:492] T 5bc7d7ca172742d1b528af8659661c2a P 0f412334fb994ff0ab492afde64f5855: Bootstrap starting.
I20251023 07:59:29.577783 20061 tablet_service.cc:1505] Processing CreateTablet for tablet 35c1ea979bda45aead7d1b8539f37637 (DEFAULT_TABLE table=test-workload [id=3ee448ad27f7467e904ac2a8d17a6bc0]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20251023 07:59:29.614745 20061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35c1ea979bda45aead7d1b8539f37637. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:29.599143 20272 raft_consensus.cc:385] T 12b8704d81fe4e3cb14bfa975c73df29 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:29.616957 20272 raft_consensus.cc:740] T 12b8704d81fe4e3cb14bfa975c73df29 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e7d1ade024444486e63cf1b81e9626, State: Initialized, Role: FOLLOWER
I20251023 07:59:29.617841 20272 consensus_queue.cc:260] T 12b8704d81fe4e3cb14bfa975c73df29 P 35e7d1ade024444486e63cf1b81e9626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:29.623072 20272 ts_tablet_manager.cc:1434] T 12b8704d81fe4e3cb14bfa975c73df29 P 35e7d1ade024444486e63cf1b81e9626: Time spent starting tablet: real 0.027s user 0.006s sys 0.000s
I20251023 07:59:29.622911 20280 raft_consensus.cc:493] T 92fae2a393404d8998ad2747fbd08cc9 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:29.624234 20272 tablet_bootstrap.cc:492] T 1fa44f181e6e44bfb1e566ef7b0778a0 P 35e7d1ade024444486e63cf1b81e9626: Bootstrap starting.
I20251023 07:59:29.623744 20280 raft_consensus.cc:515] T 92fae2a393404d8998ad2747fbd08cc9 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:29.575799 19899 catalog_manager.cc:5649] T c6fd96e3f93945f7828a9a8593490daa P 0f412334fb994ff0ab492afde64f5855 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f412334fb994ff0ab492afde64f5855 (127.16.126.3). New cstate: current_term: 1 leader_uuid: "0f412334fb994ff0ab492afde64f5855" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } health_report { overall_health: HEALTHY } } }
I20251023 07:59:29.627967 20078 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "92fae2a393404d8998ad2747fbd08cc9" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
W20251023 07:59:29.629987 20190 leader_election.cc:343] T 92fae2a393404d8998ad2747fbd08cc9 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:29.631248 20271 tablet_bootstrap.cc:654] T 5bc7d7ca172742d1b528af8659661c2a P 0f412334fb994ff0ab492afde64f5855: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:29.636889 20282 consensus_queue.cc:1048] T 62e73cfc2bbc459aba34186c3231ed87 P 35e7d1ade024444486e63cf1b81e9626 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:59:29.638847 20272 tablet_bootstrap.cc:654] T 1fa44f181e6e44bfb1e566ef7b0778a0 P 35e7d1ade024444486e63cf1b81e9626: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:29.639549 20280 leader_election.cc:290] T 92fae2a393404d8998ad2747fbd08cc9 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865), 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309)
I20251023 07:59:29.665225 20306 raft_consensus.cc:493] T 5bc7d7ca172742d1b528af8659661c2a P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:29.665851 20306 raft_consensus.cc:515] T 5bc7d7ca172742d1b528af8659661c2a P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:29.667884 20306 leader_election.cc:290] T 5bc7d7ca172742d1b528af8659661c2a P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287), 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955)
I20251023 07:59:29.668865 20152 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5bc7d7ca172742d1b528af8659661c2a" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855" is_pre_election: true
I20251023 07:59:29.669394 20226 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5bc7d7ca172742d1b528af8659661c2a" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c" is_pre_election: true
I20251023 07:59:29.670189 20226 raft_consensus.cc:2468] T 5bc7d7ca172742d1b528af8659661c2a P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 0.
W20251023 07:59:29.670632 19966 leader_election.cc:343] T 5bc7d7ca172742d1b528af8659661c2a P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:29.671425 19968 leader_election.cc:304] T 5bc7d7ca172742d1b528af8659661c2a P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65876a2b197c4ea6918f5cab47ded25c, d1379e91aa9c41629cd25262571beb2c; no voters: 0f412334fb994ff0ab492afde64f5855
I20251023 07:59:29.672627 20306 raft_consensus.cc:2804] T 5bc7d7ca172742d1b528af8659661c2a P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:29.672972 20306 raft_consensus.cc:493] T 5bc7d7ca172742d1b528af8659661c2a P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:29.673285 20306 raft_consensus.cc:3060] T 5bc7d7ca172742d1b528af8659661c2a P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:29.677202 20282 raft_consensus.cc:493] T a9f4a5a96a444c099e7cefb12fe4c288 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:29.677806 20282 raft_consensus.cc:515] T a9f4a5a96a444c099e7cefb12fe4c288 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:29.681007 20002 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "92fae2a393404d8998ad2747fbd08cc9" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
W20251023 07:59:29.687650 20192 leader_election.cc:343] T 92fae2a393404d8998ad2747fbd08cc9 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:29.688254 20192 leader_election.cc:304] T 92fae2a393404d8998ad2747fbd08cc9 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65876a2b197c4ea6918f5cab47ded25c; no voters: 35e7d1ade024444486e63cf1b81e9626, d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:29.689498 20280 raft_consensus.cc:2749] T 92fae2a393404d8998ad2747fbd08cc9 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:59:29.696424 20273 tablet_bootstrap.cc:492] T c6fd96e3f93945f7828a9a8593490daa P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:29.697654 20330 consensus_queue.cc:1048] T 62e73cfc2bbc459aba34186c3231ed87 P 35e7d1ade024444486e63cf1b81e9626 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20251023 07:59:29.711918 19968 consensus_peers.cc:597] T a9d3294d54be4be29569a460be5c8887 P d1379e91aa9c41629cd25262571beb2c -> Peer 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955): Couldn't send request to peer 65876a2b197c4ea6918f5cab47ded25c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:29.726287 20309 raft_consensus.cc:493] T 1fa44f181e6e44bfb1e566ef7b0778a0 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:29.726883 20309 raft_consensus.cc:515] T 1fa44f181e6e44bfb1e566ef7b0778a0 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:29.742401 20282 leader_election.cc:290] T a9f4a5a96a444c099e7cefb12fe4c288 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:29.742786 20225 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a9f4a5a96a444c099e7cefb12fe4c288" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c" is_pre_election: true
I20251023 07:59:29.743491 20225 raft_consensus.cc:2468] T a9f4a5a96a444c099e7cefb12fe4c288 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35e7d1ade024444486e63cf1b81e9626 in term 0.
I20251023 07:59:29.743643 20078 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1fa44f181e6e44bfb1e566ef7b0778a0" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
I20251023 07:59:29.728875 20309 leader_election.cc:290] T 1fa44f181e6e44bfb1e566ef7b0778a0 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309), 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955)
I20251023 07:59:29.744489 20002 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a9f4a5a96a444c099e7cefb12fe4c288" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:29.737825 20280 consensus_queue.cc:1048] T c6b6d87c63ca43999bf97916bd589275 P 65876a2b197c4ea6918f5cab47ded25c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20251023 07:59:29.745178 20002 raft_consensus.cc:2468] T a9f4a5a96a444c099e7cefb12fe4c288 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35e7d1ade024444486e63cf1b81e9626 in term 0.
I20251023 07:59:29.746166 20043 leader_election.cc:304] T a9f4a5a96a444c099e7cefb12fe4c288 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35e7d1ade024444486e63cf1b81e9626, 65876a2b197c4ea6918f5cab47ded25c; no voters:
I20251023 07:59:29.746873 20273 tablet_bootstrap.cc:654] T c6fd96e3f93945f7828a9a8593490daa P d1379e91aa9c41629cd25262571beb2c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:29.747032 20282 raft_consensus.cc:2804] T a9f4a5a96a444c099e7cefb12fe4c288 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:29.747452 20282 raft_consensus.cc:493] T a9f4a5a96a444c099e7cefb12fe4c288 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:29.747820 20282 raft_consensus.cc:3060] T a9f4a5a96a444c099e7cefb12fe4c288 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:29.747860 20306 raft_consensus.cc:515] T 5bc7d7ca172742d1b528af8659661c2a P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
W20251023 07:59:29.749518 20116 leader_election.cc:343] T 1fa44f181e6e44bfb1e566ef7b0778a0 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:29.748068 20279 consensus_queue.cc:1048] T a9d3294d54be4be29569a460be5c8887 P d1379e91aa9c41629cd25262571beb2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20251023 07:59:29.758416 20225 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1fa44f181e6e44bfb1e566ef7b0778a0" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c" is_pre_election: true
I20251023 07:59:29.760054 20225 raft_consensus.cc:2468] T 1fa44f181e6e44bfb1e566ef7b0778a0 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f412334fb994ff0ab492afde64f5855 in term 0.
I20251023 07:59:29.759980 20152 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5bc7d7ca172742d1b528af8659661c2a" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855"
W20251023 07:59:29.766892 19966 leader_election.cc:343] T 5bc7d7ca172742d1b528af8659661c2a P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:29.766860 20117 leader_election.cc:304] T 1fa44f181e6e44bfb1e566ef7b0778a0 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, 65876a2b197c4ea6918f5cab47ded25c; no voters: 35e7d1ade024444486e63cf1b81e9626
I20251023 07:59:29.767736 20225 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5bc7d7ca172742d1b528af8659661c2a" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c"
I20251023 07:59:29.768451 20309 raft_consensus.cc:2804] T 1fa44f181e6e44bfb1e566ef7b0778a0 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:29.769019 20309 raft_consensus.cc:493] T 1fa44f181e6e44bfb1e566ef7b0778a0 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:29.769379 20309 raft_consensus.cc:3060] T 1fa44f181e6e44bfb1e566ef7b0778a0 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:29.768515 20225 raft_consensus.cc:3060] T 5bc7d7ca172742d1b528af8659661c2a P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:29.775369 20272 tablet_bootstrap.cc:492] T 1fa44f181e6e44bfb1e566ef7b0778a0 P 35e7d1ade024444486e63cf1b81e9626: No bootstrap required, opened a new log
I20251023 07:59:29.770200 20306 leader_election.cc:290] T 5bc7d7ca172742d1b528af8659661c2a P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 election: Requested vote from peers 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287), 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955)
I20251023 07:59:29.775970 20272 ts_tablet_manager.cc:1403] T 1fa44f181e6e44bfb1e566ef7b0778a0 P 35e7d1ade024444486e63cf1b81e9626: Time spent bootstrapping tablet: real 0.152s user 0.022s sys 0.023s
I20251023 07:59:29.776535 20271 tablet_bootstrap.cc:492] T 5bc7d7ca172742d1b528af8659661c2a P 0f412334fb994ff0ab492afde64f5855: No bootstrap required, opened a new log
I20251023 07:59:29.777077 20271 ts_tablet_manager.cc:1403] T 5bc7d7ca172742d1b528af8659661c2a P 0f412334fb994ff0ab492afde64f5855: Time spent bootstrapping tablet: real 0.167s user 0.005s sys 0.053s
I20251023 07:59:29.782197 20272 raft_consensus.cc:359] T 1fa44f181e6e44bfb1e566ef7b0778a0 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:29.782989 20272 raft_consensus.cc:385] T 1fa44f181e6e44bfb1e566ef7b0778a0 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:29.783254 20273 tablet_bootstrap.cc:492] T c6fd96e3f93945f7828a9a8593490daa P d1379e91aa9c41629cd25262571beb2c: No bootstrap required, opened a new log
I20251023 07:59:29.783424 20274 tablet_bootstrap.cc:492] T a9d3294d54be4be29569a460be5c8887 P 65876a2b197c4ea6918f5cab47ded25c: No bootstrap required, opened a new log
I20251023 07:59:29.783273 20272 raft_consensus.cc:740] T 1fa44f181e6e44bfb1e566ef7b0778a0 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e7d1ade024444486e63cf1b81e9626, State: Initialized, Role: FOLLOWER
I20251023 07:59:29.783972 20273 ts_tablet_manager.cc:1403] T c6fd96e3f93945f7828a9a8593490daa P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.088s user 0.012s sys 0.004s
I20251023 07:59:29.784066 20274 ts_tablet_manager.cc:1403] T a9d3294d54be4be29569a460be5c8887 P 65876a2b197c4ea6918f5cab47ded25c: Time spent bootstrapping tablet: real 0.248s user 0.041s sys 0.049s
I20251023 07:59:29.784413 20272 consensus_queue.cc:260] T 1fa44f181e6e44bfb1e566ef7b0778a0 P 35e7d1ade024444486e63cf1b81e9626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:29.793267 20274 raft_consensus.cc:359] T a9d3294d54be4be29569a460be5c8887 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:29.794085 20274 raft_consensus.cc:385] T a9d3294d54be4be29569a460be5c8887 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:29.794374 20274 raft_consensus.cc:740] T a9d3294d54be4be29569a460be5c8887 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65876a2b197c4ea6918f5cab47ded25c, State: Initialized, Role: FOLLOWER
I20251023 07:59:29.795078 20274 consensus_queue.cc:260] T a9d3294d54be4be29569a460be5c8887 P 65876a2b197c4ea6918f5cab47ded25c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:29.795732 20273 raft_consensus.cc:359] T c6fd96e3f93945f7828a9a8593490daa P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:29.796738 20273 raft_consensus.cc:385] T c6fd96e3f93945f7828a9a8593490daa P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:29.797111 20273 raft_consensus.cc:740] T c6fd96e3f93945f7828a9a8593490daa P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:29.802135 20273 consensus_queue.cc:260] T c6fd96e3f93945f7828a9a8593490daa P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:29.779878 20271 raft_consensus.cc:359] T 5bc7d7ca172742d1b528af8659661c2a P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:29.811367 20280 consensus_queue.cc:1048] T c6b6d87c63ca43999bf97916bd589275 P 65876a2b197c4ea6918f5cab47ded25c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:59:29.810572 20271 raft_consensus.cc:385] T 5bc7d7ca172742d1b528af8659661c2a P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:29.828327 20225 raft_consensus.cc:2468] T 5bc7d7ca172742d1b528af8659661c2a P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 1.
I20251023 07:59:29.834220 20274 ts_tablet_manager.cc:1434] T a9d3294d54be4be29569a460be5c8887 P 65876a2b197c4ea6918f5cab47ded25c: Time spent starting tablet: real 0.050s user 0.006s sys 0.004s
I20251023 07:59:29.835958 20274 tablet_bootstrap.cc:492] T db045d1b86484fe9987f82ce426362e5 P 65876a2b197c4ea6918f5cab47ded25c: Bootstrap starting.
I20251023 07:59:29.841687 20282 raft_consensus.cc:515] T a9f4a5a96a444c099e7cefb12fe4c288 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:29.844625 20282 leader_election.cc:290] T a9f4a5a96a444c099e7cefb12fe4c288 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 election: Requested vote from peers 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:29.845237 20224 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a9f4a5a96a444c099e7cefb12fe4c288" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c"
I20251023 07:59:29.845909 20224 raft_consensus.cc:3060] T a9f4a5a96a444c099e7cefb12fe4c288 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:29.846019 20002 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a9f4a5a96a444c099e7cefb12fe4c288" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c"
I20251023 07:59:29.846660 20002 raft_consensus.cc:3060] T a9f4a5a96a444c099e7cefb12fe4c288 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:29.847012 20309 raft_consensus.cc:515] T 1fa44f181e6e44bfb1e566ef7b0778a0 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:29.849177 20309 leader_election.cc:290] T 1fa44f181e6e44bfb1e566ef7b0778a0 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 election: Requested vote from peers 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309), 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955)
I20251023 07:59:29.842481 20274 tablet_bootstrap.cc:654] T db045d1b86484fe9987f82ce426362e5 P 65876a2b197c4ea6918f5cab47ded25c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:29.855384 20226 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1fa44f181e6e44bfb1e566ef7b0778a0" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c"
I20251023 07:59:29.855805 19968 leader_election.cc:304] T 5bc7d7ca172742d1b528af8659661c2a P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65876a2b197c4ea6918f5cab47ded25c, d1379e91aa9c41629cd25262571beb2c; no voters: 0f412334fb994ff0ab492afde64f5855
I20251023 07:59:29.856145 20226 raft_consensus.cc:3060] T 1fa44f181e6e44bfb1e566ef7b0778a0 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:29.856884 20279 raft_consensus.cc:2804] T 5bc7d7ca172742d1b528af8659661c2a P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:59:29.831318 20271 raft_consensus.cc:740] T 5bc7d7ca172742d1b528af8659661c2a P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Initialized, Role: FOLLOWER
I20251023 07:59:29.850045 20273 ts_tablet_manager.cc:1434] T c6fd96e3f93945f7828a9a8593490daa P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.066s user 0.009s sys 0.001s
I20251023 07:59:29.861855 20273 tablet_bootstrap.cc:492] T ccba7896b7e1413293428358ffd0f8a0 P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:29.866096 20226 raft_consensus.cc:2468] T 1fa44f181e6e44bfb1e566ef7b0778a0 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f412334fb994ff0ab492afde64f5855 in term 1.
I20251023 07:59:29.867411 20117 leader_election.cc:304] T 1fa44f181e6e44bfb1e566ef7b0778a0 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, 65876a2b197c4ea6918f5cab47ded25c; no voters:
I20251023 07:59:29.868153 20273 tablet_bootstrap.cc:654] T ccba7896b7e1413293428358ffd0f8a0 P d1379e91aa9c41629cd25262571beb2c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:29.868505 20309 raft_consensus.cc:2804] T 1fa44f181e6e44bfb1e566ef7b0778a0 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:59:29.869036 20309 raft_consensus.cc:697] T 1fa44f181e6e44bfb1e566ef7b0778a0 P 0f412334fb994ff0ab492afde64f5855 [term 1 LEADER]: Becoming Leader. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Running, Role: LEADER
I20251023 07:59:29.870200 20309 consensus_queue.cc:237] T 1fa44f181e6e44bfb1e566ef7b0778a0 P 0f412334fb994ff0ab492afde64f5855 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:29.878980 20077 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1fa44f181e6e44bfb1e566ef7b0778a0" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626"
I20251023 07:59:29.880213 20077 raft_consensus.cc:3060] T 1fa44f181e6e44bfb1e566ef7b0778a0 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:29.878227 20271 consensus_queue.cc:260] T 5bc7d7ca172742d1b528af8659661c2a P 0f412334fb994ff0ab492afde64f5855 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:29.905689 20271 ts_tablet_manager.cc:1434] T 5bc7d7ca172742d1b528af8659661c2a P 0f412334fb994ff0ab492afde64f5855: Time spent starting tablet: real 0.128s user 0.010s sys 0.001s
I20251023 07:59:29.906705 20271 tablet_bootstrap.cc:492] T 12b8704d81fe4e3cb14bfa975c73df29 P 0f412334fb994ff0ab492afde64f5855: Bootstrap starting.
I20251023 07:59:29.912024 20272 ts_tablet_manager.cc:1434] T 1fa44f181e6e44bfb1e566ef7b0778a0 P 35e7d1ade024444486e63cf1b81e9626: Time spent starting tablet: real 0.136s user 0.008s sys 0.004s
I20251023 07:59:29.913408 20272 tablet_bootstrap.cc:492] T d214412da5754dd0a08f25d50b5584f1 P 35e7d1ade024444486e63cf1b81e9626: Bootstrap starting.
I20251023 07:59:29.918987 20279 raft_consensus.cc:697] T 5bc7d7ca172742d1b528af8659661c2a P d1379e91aa9c41629cd25262571beb2c [term 1 LEADER]: Becoming Leader. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Running, Role: LEADER
I20251023 07:59:29.934021 20224 raft_consensus.cc:2468] T a9f4a5a96a444c099e7cefb12fe4c288 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35e7d1ade024444486e63cf1b81e9626 in term 1.
I20251023 07:59:29.942176 20002 raft_consensus.cc:2468] T a9f4a5a96a444c099e7cefb12fe4c288 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35e7d1ade024444486e63cf1b81e9626 in term 1.
I20251023 07:59:29.945214 20044 leader_election.cc:304] T a9f4a5a96a444c099e7cefb12fe4c288 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35e7d1ade024444486e63cf1b81e9626, d1379e91aa9c41629cd25262571beb2c; no voters:
I20251023 07:59:29.941155 20279 consensus_queue.cc:237] T 5bc7d7ca172742d1b528af8659661c2a P d1379e91aa9c41629cd25262571beb2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:29.950552 20271 tablet_bootstrap.cc:654] T 12b8704d81fe4e3cb14bfa975c73df29 P 0f412334fb994ff0ab492afde64f5855: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:29.956815 20336 raft_consensus.cc:2804] T a9f4a5a96a444c099e7cefb12fe4c288 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:59:29.957999 20272 tablet_bootstrap.cc:654] T d214412da5754dd0a08f25d50b5584f1 P 35e7d1ade024444486e63cf1b81e9626: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:29.958746 20273 tablet_bootstrap.cc:492] T ccba7896b7e1413293428358ffd0f8a0 P d1379e91aa9c41629cd25262571beb2c: No bootstrap required, opened a new log
I20251023 07:59:29.959295 20273 ts_tablet_manager.cc:1403] T ccba7896b7e1413293428358ffd0f8a0 P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.098s user 0.018s sys 0.019s
I20251023 07:59:29.954291 20077 raft_consensus.cc:2468] T 1fa44f181e6e44bfb1e566ef7b0778a0 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f412334fb994ff0ab492afde64f5855 in term 1.
I20251023 07:59:29.963637 20273 raft_consensus.cc:359] T ccba7896b7e1413293428358ffd0f8a0 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:29.964352 20273 raft_consensus.cc:385] T ccba7896b7e1413293428358ffd0f8a0 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:29.964638 20273 raft_consensus.cc:740] T ccba7896b7e1413293428358ffd0f8a0 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:29.965242 20273 consensus_queue.cc:260] T ccba7896b7e1413293428358ffd0f8a0 P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:29.962234 20274 tablet_bootstrap.cc:492] T db045d1b86484fe9987f82ce426362e5 P 65876a2b197c4ea6918f5cab47ded25c: No bootstrap required, opened a new log
I20251023 07:59:29.966310 20274 ts_tablet_manager.cc:1403] T db045d1b86484fe9987f82ce426362e5 P 65876a2b197c4ea6918f5cab47ded25c: Time spent bootstrapping tablet: real 0.131s user 0.019s sys 0.009s
I20251023 07:59:29.961030 20336 raft_consensus.cc:697] T a9f4a5a96a444c099e7cefb12fe4c288 P 35e7d1ade024444486e63cf1b81e9626 [term 1 LEADER]: Becoming Leader. State: Replica: 35e7d1ade024444486e63cf1b81e9626, State: Running, Role: LEADER
I20251023 07:59:29.972740 20336 consensus_queue.cc:237] T a9f4a5a96a444c099e7cefb12fe4c288 P 35e7d1ade024444486e63cf1b81e9626 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:29.975528 20273 ts_tablet_manager.cc:1434] T ccba7896b7e1413293428358ffd0f8a0 P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.016s user 0.008s sys 0.000s
I20251023 07:59:29.976331 20273 tablet_bootstrap.cc:492] T 92fae2a393404d8998ad2747fbd08cc9 P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:29.980963 20318 raft_consensus.cc:493] T 5bc7d7ca172742d1b528af8659661c2a P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:29.981496 20318 raft_consensus.cc:515] T 5bc7d7ca172742d1b528af8659661c2a P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:29.983666 20318 leader_election.cc:290] T 5bc7d7ca172742d1b528af8659661c2a P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:29.985098 20002 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5bc7d7ca172742d1b528af8659661c2a" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:29.986506 20224 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5bc7d7ca172742d1b528af8659661c2a" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c" is_pre_election: true
I20251023 07:59:29.987267 20224 raft_consensus.cc:2393] T 5bc7d7ca172742d1b528af8659661c2a P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f412334fb994ff0ab492afde64f5855 in current term 1: Already voted for candidate d1379e91aa9c41629cd25262571beb2c in this term.
I20251023 07:59:29.987376 20337 raft_consensus.cc:493] T 12b8704d81fe4e3cb14bfa975c73df29 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:29.988093 20337 raft_consensus.cc:515] T 12b8704d81fe4e3cb14bfa975c73df29 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:29.990505 20271 tablet_bootstrap.cc:492] T 12b8704d81fe4e3cb14bfa975c73df29 P 0f412334fb994ff0ab492afde64f5855: No bootstrap required, opened a new log
I20251023 07:59:29.991045 20271 ts_tablet_manager.cc:1403] T 12b8704d81fe4e3cb14bfa975c73df29 P 0f412334fb994ff0ab492afde64f5855: Time spent bootstrapping tablet: real 0.085s user 0.020s sys 0.000s
I20251023 07:59:29.997745 20279 raft_consensus.cc:493] T c6fd96e3f93945f7828a9a8593490daa P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:29.997594 20318 consensus_queue.cc:1048] T c6fd96e3f93945f7828a9a8593490daa P 0f412334fb994ff0ab492afde64f5855 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:59:29.998536 20279 raft_consensus.cc:515] T c6fd96e3f93945f7828a9a8593490daa P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:29.999711 20118 leader_election.cc:304] T 5bc7d7ca172742d1b528af8659661c2a P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855; no voters: 65876a2b197c4ea6918f5cab47ded25c, d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:29.993173 20337 leader_election.cc:290] T 12b8704d81fe4e3cb14bfa975c73df29 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865), 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287)
I20251023 07:59:30.002816 20152 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "12b8704d81fe4e3cb14bfa975c73df29" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855" is_pre_election: true
I20251023 07:59:30.003978 20309 raft_consensus.cc:3060] T 5bc7d7ca172742d1b528af8659661c2a P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:30.004120 20002 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "12b8704d81fe4e3cb14bfa975c73df29" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:30.005149 20002 raft_consensus.cc:2468] T 12b8704d81fe4e3cb14bfa975c73df29 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35e7d1ade024444486e63cf1b81e9626 in term 0.
I20251023 07:59:30.008985 20273 tablet_bootstrap.cc:654] T 92fae2a393404d8998ad2747fbd08cc9 P d1379e91aa9c41629cd25262571beb2c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:30.006151 20150 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6fd96e3f93945f7828a9a8593490daa" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855" is_pre_election: true
I20251023 07:59:30.010633 20274 raft_consensus.cc:359] T db045d1b86484fe9987f82ce426362e5 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:30.011868 20274 raft_consensus.cc:385] T db045d1b86484fe9987f82ce426362e5 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:30.012205 20274 raft_consensus.cc:740] T db045d1b86484fe9987f82ce426362e5 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65876a2b197c4ea6918f5cab47ded25c, State: Initialized, Role: FOLLOWER
I20251023 07:59:30.007887 20279 leader_election.cc:290] T c6fd96e3f93945f7828a9a8593490daa P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309), 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287)
I20251023 07:59:30.011905 20044 leader_election.cc:304] T 12b8704d81fe4e3cb14bfa975c73df29 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35e7d1ade024444486e63cf1b81e9626, d1379e91aa9c41629cd25262571beb2c; no voters:
I20251023 07:59:30.012889 20274 consensus_queue.cc:260] T db045d1b86484fe9987f82ce426362e5 P 65876a2b197c4ea6918f5cab47ded25c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:30.014214 20077 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6fd96e3f93945f7828a9a8593490daa" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
I20251023 07:59:30.014942 20077 raft_consensus.cc:2393] T c6fd96e3f93945f7828a9a8593490daa P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d1379e91aa9c41629cd25262571beb2c in current term 1: Already voted for candidate 0f412334fb994ff0ab492afde64f5855 in this term.
I20251023 07:59:30.015321 20274 ts_tablet_manager.cc:1434] T db045d1b86484fe9987f82ce426362e5 P 65876a2b197c4ea6918f5cab47ded25c: Time spent starting tablet: real 0.049s user 0.006s sys 0.000s
W20251023 07:59:30.017570 19949 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20251023 07:59:30.017643 20337 raft_consensus.cc:2804] T 12b8704d81fe4e3cb14bfa975c73df29 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:30.018256 20337 raft_consensus.cc:493] T 12b8704d81fe4e3cb14bfa975c73df29 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:30.018656 19966 leader_election.cc:304] T c6fd96e3f93945f7828a9a8593490daa P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d1379e91aa9c41629cd25262571beb2c; no voters: 0f412334fb994ff0ab492afde64f5855, 35e7d1ade024444486e63cf1b81e9626
I20251023 07:59:30.018695 20337 raft_consensus.cc:3060] T 12b8704d81fe4e3cb14bfa975c73df29 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:30.026014 20279 raft_consensus.cc:3060] T c6fd96e3f93945f7828a9a8593490daa P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:30.027155 19898 catalog_manager.cc:5649] T 1fa44f181e6e44bfb1e566ef7b0778a0 P 0f412334fb994ff0ab492afde64f5855 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f412334fb994ff0ab492afde64f5855 (127.16.126.3). New cstate: current_term: 1 leader_uuid: "0f412334fb994ff0ab492afde64f5855" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } health_report { overall_health: UNKNOWN } } }
W20251023 07:59:30.029556 20041 leader_election.cc:343] T 12b8704d81fe4e3cb14bfa975c73df29 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:30.031817 20309 raft_consensus.cc:2749] T 5bc7d7ca172742d1b528af8659661c2a P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:59:30.026037 20271 raft_consensus.cc:359] T 12b8704d81fe4e3cb14bfa975c73df29 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:30.034281 20271 raft_consensus.cc:385] T 12b8704d81fe4e3cb14bfa975c73df29 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:30.034567 20271 raft_consensus.cc:740] T 12b8704d81fe4e3cb14bfa975c73df29 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Initialized, Role: FOLLOWER
I20251023 07:59:30.035302 20272 tablet_bootstrap.cc:492] T d214412da5754dd0a08f25d50b5584f1 P 35e7d1ade024444486e63cf1b81e9626: No bootstrap required, opened a new log
I20251023 07:59:30.035849 20272 ts_tablet_manager.cc:1403] T d214412da5754dd0a08f25d50b5584f1 P 35e7d1ade024444486e63cf1b81e9626: Time spent bootstrapping tablet: real 0.123s user 0.017s sys 0.017s
I20251023 07:59:30.037779 20271 consensus_queue.cc:260] T 12b8704d81fe4e3cb14bfa975c73df29 P 0f412334fb994ff0ab492afde64f5855 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:30.038694 20272 raft_consensus.cc:359] T d214412da5754dd0a08f25d50b5584f1 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:30.039418 20272 raft_consensus.cc:385] T d214412da5754dd0a08f25d50b5584f1 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:30.039701 20272 raft_consensus.cc:740] T d214412da5754dd0a08f25d50b5584f1 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e7d1ade024444486e63cf1b81e9626, State: Initialized, Role: FOLLOWER
I20251023 07:59:30.040235 20271 ts_tablet_manager.cc:1434] T 12b8704d81fe4e3cb14bfa975c73df29 P 0f412334fb994ff0ab492afde64f5855: Time spent starting tablet: real 0.047s user 0.000s sys 0.006s
I20251023 07:59:30.040575 20272 consensus_queue.cc:260] T d214412da5754dd0a08f25d50b5584f1 P 35e7d1ade024444486e63cf1b81e9626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:30.041301 20271 tablet_bootstrap.cc:492] T 7d599e4b62364f04b966ca88e16b560a P 0f412334fb994ff0ab492afde64f5855: Bootstrap starting.
I20251023 07:59:30.042435 20337 raft_consensus.cc:515] T 12b8704d81fe4e3cb14bfa975c73df29 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:30.043488 20272 ts_tablet_manager.cc:1434] T d214412da5754dd0a08f25d50b5584f1 P 35e7d1ade024444486e63cf1b81e9626: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20251023 07:59:30.044629 20272 tablet_bootstrap.cc:492] T db045d1b86484fe9987f82ce426362e5 P 35e7d1ade024444486e63cf1b81e9626: Bootstrap starting.
I20251023 07:59:30.045295 20003 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "12b8704d81fe4e3cb14bfa975c73df29" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c"
I20251023 07:59:30.045945 20003 raft_consensus.cc:3060] T 12b8704d81fe4e3cb14bfa975c73df29 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:30.048660 20271 tablet_bootstrap.cc:654] T 7d599e4b62364f04b966ca88e16b560a P 0f412334fb994ff0ab492afde64f5855: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:30.050856 20279 raft_consensus.cc:2749] T c6fd96e3f93945f7828a9a8593490daa P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:59:30.052600 20337 leader_election.cc:290] T 12b8704d81fe4e3cb14bfa975c73df29 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 election: Requested vote from peers d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865), 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287)
I20251023 07:59:30.054376 20003 raft_consensus.cc:2468] T 12b8704d81fe4e3cb14bfa975c73df29 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35e7d1ade024444486e63cf1b81e9626 in term 1.
I20251023 07:59:30.055529 20044 leader_election.cc:304] T 12b8704d81fe4e3cb14bfa975c73df29 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35e7d1ade024444486e63cf1b81e9626, d1379e91aa9c41629cd25262571beb2c; no voters:
I20251023 07:59:30.056437 20337 raft_consensus.cc:2804] T 12b8704d81fe4e3cb14bfa975c73df29 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:59:30.056455 20152 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "12b8704d81fe4e3cb14bfa975c73df29" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855"
I20251023 07:59:30.057015 20337 raft_consensus.cc:697] T 12b8704d81fe4e3cb14bfa975c73df29 P 35e7d1ade024444486e63cf1b81e9626 [term 1 LEADER]: Becoming Leader. State: Replica: 35e7d1ade024444486e63cf1b81e9626, State: Running, Role: LEADER
I20251023 07:59:30.057168 20152 raft_consensus.cc:3060] T 12b8704d81fe4e3cb14bfa975c73df29 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:30.058125 20318 consensus_queue.cc:1048] T c6fd96e3f93945f7828a9a8593490daa P 0f412334fb994ff0ab492afde64f5855 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:59:30.063220 20274 tablet_bootstrap.cc:492] T ccba7896b7e1413293428358ffd0f8a0 P 65876a2b197c4ea6918f5cab47ded25c: Bootstrap starting.
I20251023 07:59:30.065412 20337 consensus_queue.cc:237] T 12b8704d81fe4e3cb14bfa975c73df29 P 35e7d1ade024444486e63cf1b81e9626 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:30.068019 20360 raft_consensus.cc:493] T a9d3294d54be4be29569a460be5c8887 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:30.065469 19901 catalog_manager.cc:5649] T 5bc7d7ca172742d1b528af8659661c2a P d1379e91aa9c41629cd25262571beb2c reported cstate change: term changed from 0 to 1, leader changed from <none> to d1379e91aa9c41629cd25262571beb2c (127.16.126.1). New cstate: current_term: 1 leader_uuid: "d1379e91aa9c41629cd25262571beb2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: HEALTHY } } }
I20251023 07:59:30.068517 20360 raft_consensus.cc:515] T a9d3294d54be4be29569a460be5c8887 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:30.073004 20274 tablet_bootstrap.cc:654] T ccba7896b7e1413293428358ffd0f8a0 P 65876a2b197c4ea6918f5cab47ded25c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:30.072850 20150 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a9d3294d54be4be29569a460be5c8887" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855" is_pre_election: true
I20251023 07:59:30.084008 20273 tablet_bootstrap.cc:492] T 92fae2a393404d8998ad2747fbd08cc9 P d1379e91aa9c41629cd25262571beb2c: No bootstrap required, opened a new log
I20251023 07:59:30.082538 20360 leader_election.cc:290] T a9d3294d54be4be29569a460be5c8887 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:30.087232 20273 ts_tablet_manager.cc:1403] T 92fae2a393404d8998ad2747fbd08cc9 P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.111s user 0.007s sys 0.021s
I20251023 07:59:30.092772 20271 tablet_bootstrap.cc:492] T 7d599e4b62364f04b966ca88e16b560a P 0f412334fb994ff0ab492afde64f5855: No bootstrap required, opened a new log
I20251023 07:59:30.093323 20271 ts_tablet_manager.cc:1403] T 7d599e4b62364f04b966ca88e16b560a P 0f412334fb994ff0ab492afde64f5855: Time spent bootstrapping tablet: real 0.052s user 0.014s sys 0.022s
I20251023 07:59:30.093586 20272 tablet_bootstrap.cc:654] T db045d1b86484fe9987f82ce426362e5 P 35e7d1ade024444486e63cf1b81e9626: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:30.090152 20003 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a9d3294d54be4be29569a460be5c8887" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:30.096009 20192 leader_election.cc:304] T a9d3294d54be4be29569a460be5c8887 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65876a2b197c4ea6918f5cab47ded25c; no voters: 0f412334fb994ff0ab492afde64f5855, d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:30.096130 20271 raft_consensus.cc:359] T 7d599e4b62364f04b966ca88e16b560a P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:30.097057 20271 raft_consensus.cc:385] T 7d599e4b62364f04b966ca88e16b560a P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:30.097429 20271 raft_consensus.cc:740] T 7d599e4b62364f04b966ca88e16b560a P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Initialized, Role: FOLLOWER
I20251023 07:59:30.098284 20271 consensus_queue.cc:260] T 7d599e4b62364f04b966ca88e16b560a P 0f412334fb994ff0ab492afde64f5855 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:30.100061 20360 raft_consensus.cc:2749] T a9d3294d54be4be29569a460be5c8887 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:59:30.100790 20271 ts_tablet_manager.cc:1434] T 7d599e4b62364f04b966ca88e16b560a P 0f412334fb994ff0ab492afde64f5855: Time spent starting tablet: real 0.007s user 0.004s sys 0.000s
I20251023 07:59:30.101302 20152 raft_consensus.cc:2468] T 12b8704d81fe4e3cb14bfa975c73df29 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35e7d1ade024444486e63cf1b81e9626 in term 1.
I20251023 07:59:30.104352 20273 raft_consensus.cc:359] T 92fae2a393404d8998ad2747fbd08cc9 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:30.106179 20273 raft_consensus.cc:385] T 92fae2a393404d8998ad2747fbd08cc9 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:30.106454 20273 raft_consensus.cc:740] T 92fae2a393404d8998ad2747fbd08cc9 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:30.107463 20274 tablet_bootstrap.cc:492] T ccba7896b7e1413293428358ffd0f8a0 P 65876a2b197c4ea6918f5cab47ded25c: No bootstrap required, opened a new log
I20251023 07:59:30.107259 20273 consensus_queue.cc:260] T 92fae2a393404d8998ad2747fbd08cc9 P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:30.108114 20274 ts_tablet_manager.cc:1403] T ccba7896b7e1413293428358ffd0f8a0 P 65876a2b197c4ea6918f5cab47ded25c: Time spent bootstrapping tablet: real 0.075s user 0.012s sys 0.007s
I20251023 07:59:30.109603 20273 ts_tablet_manager.cc:1434] T 92fae2a393404d8998ad2747fbd08cc9 P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.021s user 0.005s sys 0.001s
I20251023 07:59:30.118432 20274 raft_consensus.cc:359] T ccba7896b7e1413293428358ffd0f8a0 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:30.119251 20274 raft_consensus.cc:385] T ccba7896b7e1413293428358ffd0f8a0 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:30.119529 20274 raft_consensus.cc:740] T ccba7896b7e1413293428358ffd0f8a0 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65876a2b197c4ea6918f5cab47ded25c, State: Initialized, Role: FOLLOWER
I20251023 07:59:30.120108 20274 consensus_queue.cc:260] T ccba7896b7e1413293428358ffd0f8a0 P 65876a2b197c4ea6918f5cab47ded25c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:30.121176 20341 raft_consensus.cc:493] T db045d1b86484fe9987f82ce426362e5 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:30.121580 20341 raft_consensus.cc:515] T db045d1b86484fe9987f82ce426362e5 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:30.122874 20273 tablet_bootstrap.cc:492] T 076aca7c8ecb4f34af0d457fcee0e585 P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:30.123307 20341 leader_election.cc:290] T db045d1b86484fe9987f82ce426362e5 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865), 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309)
I20251023 07:59:30.124046 20002 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "db045d1b86484fe9987f82ce426362e5" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:30.124375 20078 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "db045d1b86484fe9987f82ce426362e5" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
I20251023 07:59:30.125236 20274 ts_tablet_manager.cc:1434] T ccba7896b7e1413293428358ffd0f8a0 P 65876a2b197c4ea6918f5cab47ded25c: Time spent starting tablet: real 0.017s user 0.007s sys 0.002s
W20251023 07:59:30.125494 20192 leader_election.cc:343] T db045d1b86484fe9987f82ce426362e5 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Illegal state: must be running to vote when last-logged opid is not known
W20251023 07:59:30.126050 20190 leader_election.cc:343] T db045d1b86484fe9987f82ce426362e5 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:30.126507 20190 leader_election.cc:304] T db045d1b86484fe9987f82ce426362e5 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65876a2b197c4ea6918f5cab47ded25c; no voters: 35e7d1ade024444486e63cf1b81e9626, d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:30.126200 20274 tablet_bootstrap.cc:492] T 076aca7c8ecb4f34af0d457fcee0e585 P 65876a2b197c4ea6918f5cab47ded25c: Bootstrap starting.
I20251023 07:59:30.127877 20272 tablet_bootstrap.cc:492] T db045d1b86484fe9987f82ce426362e5 P 35e7d1ade024444486e63cf1b81e9626: No bootstrap required, opened a new log
I20251023 07:59:30.128353 20272 ts_tablet_manager.cc:1403] T db045d1b86484fe9987f82ce426362e5 P 35e7d1ade024444486e63cf1b81e9626: Time spent bootstrapping tablet: real 0.084s user 0.010s sys 0.009s
I20251023 07:59:30.130826 20272 raft_consensus.cc:359] T db045d1b86484fe9987f82ce426362e5 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:30.131351 20273 tablet_bootstrap.cc:654] T 076aca7c8ecb4f34af0d457fcee0e585 P d1379e91aa9c41629cd25262571beb2c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:30.131526 20272 raft_consensus.cc:385] T db045d1b86484fe9987f82ce426362e5 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:30.131870 20272 raft_consensus.cc:740] T db045d1b86484fe9987f82ce426362e5 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e7d1ade024444486e63cf1b81e9626, State: Initialized, Role: FOLLOWER
I20251023 07:59:30.132501 20272 consensus_queue.cc:260] T db045d1b86484fe9987f82ce426362e5 P 35e7d1ade024444486e63cf1b81e9626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:30.102062 20271 tablet_bootstrap.cc:492] T ccba7896b7e1413293428358ffd0f8a0 P 0f412334fb994ff0ab492afde64f5855: Bootstrap starting.
I20251023 07:59:30.133448 20274 tablet_bootstrap.cc:654] T 076aca7c8ecb4f34af0d457fcee0e585 P 65876a2b197c4ea6918f5cab47ded25c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:30.139959 20271 tablet_bootstrap.cc:654] T ccba7896b7e1413293428358ffd0f8a0 P 0f412334fb994ff0ab492afde64f5855: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:30.140326 20341 raft_consensus.cc:2749] T db045d1b86484fe9987f82ce426362e5 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:59:30.142521 20273 tablet_bootstrap.cc:492] T 076aca7c8ecb4f34af0d457fcee0e585 P d1379e91aa9c41629cd25262571beb2c: No bootstrap required, opened a new log
I20251023 07:59:30.143011 20273 ts_tablet_manager.cc:1403] T 076aca7c8ecb4f34af0d457fcee0e585 P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.020s user 0.010s sys 0.005s
I20251023 07:59:30.144474 20272 ts_tablet_manager.cc:1434] T db045d1b86484fe9987f82ce426362e5 P 35e7d1ade024444486e63cf1b81e9626: Time spent starting tablet: real 0.016s user 0.006s sys 0.001s
I20251023 07:59:30.145512 20272 tablet_bootstrap.cc:492] T 7d599e4b62364f04b966ca88e16b560a P 35e7d1ade024444486e63cf1b81e9626: Bootstrap starting.
I20251023 07:59:30.145571 20273 raft_consensus.cc:359] T 076aca7c8ecb4f34af0d457fcee0e585 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:30.146354 20273 raft_consensus.cc:385] T 076aca7c8ecb4f34af0d457fcee0e585 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:30.146624 20273 raft_consensus.cc:740] T 076aca7c8ecb4f34af0d457fcee0e585 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:30.146015 19898 catalog_manager.cc:5649] T a9f4a5a96a444c099e7cefb12fe4c288 P 35e7d1ade024444486e63cf1b81e9626 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2). New cstate: current_term: 1 leader_uuid: "35e7d1ade024444486e63cf1b81e9626" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } health_report { overall_health: HEALTHY } } }
I20251023 07:59:30.147387 20273 consensus_queue.cc:260] T 076aca7c8ecb4f34af0d457fcee0e585 P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:30.148102 19898 catalog_manager.cc:5649] T 12b8704d81fe4e3cb14bfa975c73df29 P 35e7d1ade024444486e63cf1b81e9626 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2). New cstate: current_term: 1 leader_uuid: "35e7d1ade024444486e63cf1b81e9626" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:30.150200 20273 ts_tablet_manager.cc:1434] T 076aca7c8ecb4f34af0d457fcee0e585 P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.007s user 0.005s sys 0.003s
I20251023 07:59:30.151475 20273 tablet_bootstrap.cc:492] T db045d1b86484fe9987f82ce426362e5 P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:30.151520 20272 tablet_bootstrap.cc:654] T 7d599e4b62364f04b966ca88e16b560a P 35e7d1ade024444486e63cf1b81e9626: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:30.159962 20273 tablet_bootstrap.cc:654] T db045d1b86484fe9987f82ce426362e5 P d1379e91aa9c41629cd25262571beb2c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:30.165019 20274 tablet_bootstrap.cc:492] T 076aca7c8ecb4f34af0d457fcee0e585 P 65876a2b197c4ea6918f5cab47ded25c: No bootstrap required, opened a new log
I20251023 07:59:30.165573 20274 ts_tablet_manager.cc:1403] T 076aca7c8ecb4f34af0d457fcee0e585 P 65876a2b197c4ea6918f5cab47ded25c: Time spent bootstrapping tablet: real 0.040s user 0.010s sys 0.003s
I20251023 07:59:30.168468 20272 tablet_bootstrap.cc:492] T 7d599e4b62364f04b966ca88e16b560a P 35e7d1ade024444486e63cf1b81e9626: No bootstrap required, opened a new log
I20251023 07:59:30.168970 20272 ts_tablet_manager.cc:1403] T 7d599e4b62364f04b966ca88e16b560a P 35e7d1ade024444486e63cf1b81e9626: Time spent bootstrapping tablet: real 0.024s user 0.010s sys 0.002s
I20251023 07:59:30.168197 20274 raft_consensus.cc:359] T 076aca7c8ecb4f34af0d457fcee0e585 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:30.170828 20274 raft_consensus.cc:385] T 076aca7c8ecb4f34af0d457fcee0e585 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:30.171337 20274 raft_consensus.cc:740] T 076aca7c8ecb4f34af0d457fcee0e585 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65876a2b197c4ea6918f5cab47ded25c, State: Initialized, Role: FOLLOWER
I20251023 07:59:30.171587 20272 raft_consensus.cc:359] T 7d599e4b62364f04b966ca88e16b560a P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:30.172336 20272 raft_consensus.cc:385] T 7d599e4b62364f04b966ca88e16b560a P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:30.172590 20272 raft_consensus.cc:740] T 7d599e4b62364f04b966ca88e16b560a P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e7d1ade024444486e63cf1b81e9626, State: Initialized, Role: FOLLOWER
I20251023 07:59:30.173333 20272 consensus_queue.cc:260] T 7d599e4b62364f04b966ca88e16b560a P 35e7d1ade024444486e63cf1b81e9626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:30.175751 20272 ts_tablet_manager.cc:1434] T 7d599e4b62364f04b966ca88e16b560a P 35e7d1ade024444486e63cf1b81e9626: Time spent starting tablet: real 0.006s user 0.003s sys 0.004s
I20251023 07:59:30.176687 20272 tablet_bootstrap.cc:492] T 7062462192fc4895b5a9f6a34c4a132a P 35e7d1ade024444486e63cf1b81e9626: Bootstrap starting.
I20251023 07:59:30.180467 20273 tablet_bootstrap.cc:492] T db045d1b86484fe9987f82ce426362e5 P d1379e91aa9c41629cd25262571beb2c: No bootstrap required, opened a new log
I20251023 07:59:30.180922 20273 ts_tablet_manager.cc:1403] T db045d1b86484fe9987f82ce426362e5 P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.030s user 0.016s sys 0.012s
I20251023 07:59:30.182860 20271 tablet_bootstrap.cc:492] T ccba7896b7e1413293428358ffd0f8a0 P 0f412334fb994ff0ab492afde64f5855: No bootstrap required, opened a new log
I20251023 07:59:30.183410 20271 ts_tablet_manager.cc:1403] T ccba7896b7e1413293428358ffd0f8a0 P 0f412334fb994ff0ab492afde64f5855: Time spent bootstrapping tablet: real 0.082s user 0.013s sys 0.003s
I20251023 07:59:30.183385 20273 raft_consensus.cc:359] T db045d1b86484fe9987f82ce426362e5 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:30.184252 20273 raft_consensus.cc:385] T db045d1b86484fe9987f82ce426362e5 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:30.184226 20274 consensus_queue.cc:260] T 076aca7c8ecb4f34af0d457fcee0e585 P 65876a2b197c4ea6918f5cab47ded25c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:30.184724 20273 raft_consensus.cc:740] T db045d1b86484fe9987f82ce426362e5 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:30.186467 20271 raft_consensus.cc:359] T ccba7896b7e1413293428358ffd0f8a0 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:30.186936 20274 ts_tablet_manager.cc:1434] T 076aca7c8ecb4f34af0d457fcee0e585 P 65876a2b197c4ea6918f5cab47ded25c: Time spent starting tablet: real 0.021s user 0.005s sys 0.001s
I20251023 07:59:30.187161 20271 raft_consensus.cc:385] T ccba7896b7e1413293428358ffd0f8a0 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:30.187896 20271 raft_consensus.cc:740] T ccba7896b7e1413293428358ffd0f8a0 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Initialized, Role: FOLLOWER
I20251023 07:59:30.188268 20274 tablet_bootstrap.cc:492] T 7062462192fc4895b5a9f6a34c4a132a P 65876a2b197c4ea6918f5cab47ded25c: Bootstrap starting.
I20251023 07:59:30.188761 20271 consensus_queue.cc:260] T ccba7896b7e1413293428358ffd0f8a0 P 0f412334fb994ff0ab492afde64f5855 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:30.189514 20273 consensus_queue.cc:260] T db045d1b86484fe9987f82ce426362e5 P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:30.191785 20273 ts_tablet_manager.cc:1434] T db045d1b86484fe9987f82ce426362e5 P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.011s user 0.003s sys 0.003s
I20251023 07:59:30.192862 20273 tablet_bootstrap.cc:492] T aa253535ba594367a12fda3dea3b75d4 P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:30.194679 20271 ts_tablet_manager.cc:1434] T ccba7896b7e1413293428358ffd0f8a0 P 0f412334fb994ff0ab492afde64f5855: Time spent starting tablet: real 0.011s user 0.006s sys 0.000s
I20251023 07:59:30.195734 20271 tablet_bootstrap.cc:492] T 82812175f15d4d3dae73f31641a1e583 P 0f412334fb994ff0ab492afde64f5855: Bootstrap starting.
I20251023 07:59:30.196364 20272 tablet_bootstrap.cc:654] T 7062462192fc4895b5a9f6a34c4a132a P 35e7d1ade024444486e63cf1b81e9626: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:30.198674 20273 tablet_bootstrap.cc:654] T aa253535ba594367a12fda3dea3b75d4 P d1379e91aa9c41629cd25262571beb2c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:30.200604 20341 raft_consensus.cc:493] T ccba7896b7e1413293428358ffd0f8a0 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:30.201120 20341 raft_consensus.cc:515] T ccba7896b7e1413293428358ffd0f8a0 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:30.201913 20271 tablet_bootstrap.cc:654] T 82812175f15d4d3dae73f31641a1e583 P 0f412334fb994ff0ab492afde64f5855: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:30.203233 20341 leader_election.cc:290] T ccba7896b7e1413293428358ffd0f8a0 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:30.204974 20152 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ccba7896b7e1413293428358ffd0f8a0" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855" is_pre_election: true
I20251023 07:59:30.205941 20152 raft_consensus.cc:2468] T ccba7896b7e1413293428358ffd0f8a0 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65876a2b197c4ea6918f5cab47ded25c in term 0.
I20251023 07:59:30.207024 20002 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ccba7896b7e1413293428358ffd0f8a0" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:30.207363 20189 leader_election.cc:304] T ccba7896b7e1413293428358ffd0f8a0 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, 65876a2b197c4ea6918f5cab47ded25c; no voters:
I20251023 07:59:30.207764 20002 raft_consensus.cc:2468] T ccba7896b7e1413293428358ffd0f8a0 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65876a2b197c4ea6918f5cab47ded25c in term 0.
I20251023 07:59:30.208673 20341 raft_consensus.cc:2804] T ccba7896b7e1413293428358ffd0f8a0 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:30.209165 20341 raft_consensus.cc:493] T ccba7896b7e1413293428358ffd0f8a0 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:30.209602 20341 raft_consensus.cc:3060] T ccba7896b7e1413293428358ffd0f8a0 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:30.209764 20274 tablet_bootstrap.cc:654] T 7062462192fc4895b5a9f6a34c4a132a P 65876a2b197c4ea6918f5cab47ded25c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:30.210989 20224 raft_consensus.cc:3060] T a9d3294d54be4be29569a460be5c8887 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:30.220388 20341 raft_consensus.cc:515] T ccba7896b7e1413293428358ffd0f8a0 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:30.224372 20152 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ccba7896b7e1413293428358ffd0f8a0" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855"
I20251023 07:59:30.225180 20152 raft_consensus.cc:3060] T ccba7896b7e1413293428358ffd0f8a0 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:30.226871 20337 raft_consensus.cc:493] T db045d1b86484fe9987f82ce426362e5 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:30.227609 20337 raft_consensus.cc:515] T db045d1b86484fe9987f82ce426362e5 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:30.232367 20226 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "db045d1b86484fe9987f82ce426362e5" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c" is_pre_election: true
I20251023 07:59:30.233299 20226 raft_consensus.cc:2468] T db045d1b86484fe9987f82ce426362e5 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35e7d1ade024444486e63cf1b81e9626 in term 0.
I20251023 07:59:30.234874 20337 leader_election.cc:290] T db045d1b86484fe9987f82ce426362e5 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:30.236390 20043 leader_election.cc:304] T db045d1b86484fe9987f82ce426362e5 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35e7d1ade024444486e63cf1b81e9626, 65876a2b197c4ea6918f5cab47ded25c; no voters:
I20251023 07:59:30.237943 20002 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "db045d1b86484fe9987f82ce426362e5" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:30.238699 20002 raft_consensus.cc:2468] T db045d1b86484fe9987f82ce426362e5 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35e7d1ade024444486e63cf1b81e9626 in term 0.
I20251023 07:59:30.241516 20337 raft_consensus.cc:2804] T db045d1b86484fe9987f82ce426362e5 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:30.242084 20337 raft_consensus.cc:493] T db045d1b86484fe9987f82ce426362e5 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:30.242511 20337 raft_consensus.cc:3060] T db045d1b86484fe9987f82ce426362e5 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:30.250357 20341 leader_election.cc:290] T ccba7896b7e1413293428358ffd0f8a0 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 election: Requested vote from peers 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:30.251607 20002 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ccba7896b7e1413293428358ffd0f8a0" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c"
I20251023 07:59:30.252512 20002 raft_consensus.cc:3060] T ccba7896b7e1413293428358ffd0f8a0 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:30.268131 20152 raft_consensus.cc:2468] T ccba7896b7e1413293428358ffd0f8a0 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65876a2b197c4ea6918f5cab47ded25c in term 1.
I20251023 07:59:30.281243 20272 tablet_bootstrap.cc:492] T 7062462192fc4895b5a9f6a34c4a132a P 35e7d1ade024444486e63cf1b81e9626: No bootstrap required, opened a new log
I20251023 07:59:30.282090 20272 ts_tablet_manager.cc:1403] T 7062462192fc4895b5a9f6a34c4a132a P 35e7d1ade024444486e63cf1b81e9626: Time spent bootstrapping tablet: real 0.106s user 0.012s sys 0.000s
I20251023 07:59:30.288857 20189 leader_election.cc:304] T ccba7896b7e1413293428358ffd0f8a0 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, 65876a2b197c4ea6918f5cab47ded25c; no voters:
I20251023 07:59:30.290308 20341 raft_consensus.cc:2804] T ccba7896b7e1413293428358ffd0f8a0 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:59:30.291244 20341 raft_consensus.cc:697] T ccba7896b7e1413293428358ffd0f8a0 P 65876a2b197c4ea6918f5cab47ded25c [term 1 LEADER]: Becoming Leader. State: Replica: 65876a2b197c4ea6918f5cab47ded25c, State: Running, Role: LEADER
I20251023 07:59:30.292770 20273 tablet_bootstrap.cc:492] T aa253535ba594367a12fda3dea3b75d4 P d1379e91aa9c41629cd25262571beb2c: No bootstrap required, opened a new log
I20251023 07:59:30.292454 20341 consensus_queue.cc:237] T ccba7896b7e1413293428358ffd0f8a0 P 65876a2b197c4ea6918f5cab47ded25c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:30.293365 20273 ts_tablet_manager.cc:1403] T aa253535ba594367a12fda3dea3b75d4 P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.101s user 0.024s sys 0.025s
I20251023 07:59:30.296209 20273 raft_consensus.cc:359] T aa253535ba594367a12fda3dea3b75d4 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:30.296916 20273 raft_consensus.cc:385] T aa253535ba594367a12fda3dea3b75d4 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:30.297170 20273 raft_consensus.cc:740] T aa253535ba594367a12fda3dea3b75d4 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:30.297899 20273 consensus_queue.cc:260] T aa253535ba594367a12fda3dea3b75d4 P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:30.305492 20271 tablet_bootstrap.cc:492] T 82812175f15d4d3dae73f31641a1e583 P 0f412334fb994ff0ab492afde64f5855: No bootstrap required, opened a new log
I20251023 07:59:30.306142 20271 ts_tablet_manager.cc:1403] T 82812175f15d4d3dae73f31641a1e583 P 0f412334fb994ff0ab492afde64f5855: Time spent bootstrapping tablet: real 0.111s user 0.024s sys 0.027s
I20251023 07:59:30.307436 20273 ts_tablet_manager.cc:1434] T aa253535ba594367a12fda3dea3b75d4 P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.014s user 0.005s sys 0.000s
I20251023 07:59:30.308445 20273 tablet_bootstrap.cc:492] T e2c26d408ee04105bd615b58287c82f9 P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:30.308285 20002 raft_consensus.cc:2468] T ccba7896b7e1413293428358ffd0f8a0 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65876a2b197c4ea6918f5cab47ded25c in term 1.
I20251023 07:59:30.308943 20271 raft_consensus.cc:359] T 82812175f15d4d3dae73f31641a1e583 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:30.286419 20272 raft_consensus.cc:359] T 7062462192fc4895b5a9f6a34c4a132a P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:30.310007 20271 raft_consensus.cc:385] T 82812175f15d4d3dae73f31641a1e583 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:30.310500 20271 raft_consensus.cc:740] T 82812175f15d4d3dae73f31641a1e583 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Initialized, Role: FOLLOWER
I20251023 07:59:30.310439 20337 raft_consensus.cc:515] T db045d1b86484fe9987f82ce426362e5 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:30.311503 20271 consensus_queue.cc:260] T 82812175f15d4d3dae73f31641a1e583 P 0f412334fb994ff0ab492afde64f5855 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:30.312561 20337 leader_election.cc:290] T db045d1b86484fe9987f82ce426362e5 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 election: Requested vote from peers 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:30.314052 20226 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "db045d1b86484fe9987f82ce426362e5" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c"
I20251023 07:59:30.314842 20226 raft_consensus.cc:3060] T db045d1b86484fe9987f82ce426362e5 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:30.317373 20274 tablet_bootstrap.cc:492] T 7062462192fc4895b5a9f6a34c4a132a P 65876a2b197c4ea6918f5cab47ded25c: No bootstrap required, opened a new log
I20251023 07:59:30.317927 20274 ts_tablet_manager.cc:1403] T 7062462192fc4895b5a9f6a34c4a132a P 65876a2b197c4ea6918f5cab47ded25c: Time spent bootstrapping tablet: real 0.130s user 0.045s sys 0.065s
I20251023 07:59:30.319550 20271 ts_tablet_manager.cc:1434] T 82812175f15d4d3dae73f31641a1e583 P 0f412334fb994ff0ab492afde64f5855: Time spent starting tablet: real 0.013s user 0.005s sys 0.000s
I20251023 07:59:30.310043 20272 raft_consensus.cc:385] T 7062462192fc4895b5a9f6a34c4a132a P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:30.320873 20272 raft_consensus.cc:740] T 7062462192fc4895b5a9f6a34c4a132a P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e7d1ade024444486e63cf1b81e9626, State: Initialized, Role: FOLLOWER
I20251023 07:59:30.320611 20274 raft_consensus.cc:359] T 7062462192fc4895b5a9f6a34c4a132a P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:30.321420 20274 raft_consensus.cc:385] T 7062462192fc4895b5a9f6a34c4a132a P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:30.321744 20274 raft_consensus.cc:740] T 7062462192fc4895b5a9f6a34c4a132a P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65876a2b197c4ea6918f5cab47ded25c, State: Initialized, Role: FOLLOWER
I20251023 07:59:30.321879 20272 consensus_queue.cc:260] T 7062462192fc4895b5a9f6a34c4a132a P 35e7d1ade024444486e63cf1b81e9626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:30.322399 20274 consensus_queue.cc:260] T 7062462192fc4895b5a9f6a34c4a132a P 65876a2b197c4ea6918f5cab47ded25c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:30.324579 20274 ts_tablet_manager.cc:1434] T 7062462192fc4895b5a9f6a34c4a132a P 65876a2b197c4ea6918f5cab47ded25c: Time spent starting tablet: real 0.006s user 0.003s sys 0.001s
I20251023 07:59:30.324915 20272 ts_tablet_manager.cc:1434] T 7062462192fc4895b5a9f6a34c4a132a P 35e7d1ade024444486e63cf1b81e9626: Time spent starting tablet: real 0.042s user 0.007s sys 0.000s
I20251023 07:59:30.320667 20271 tablet_bootstrap.cc:492] T 076aca7c8ecb4f34af0d457fcee0e585 P 0f412334fb994ff0ab492afde64f5855: Bootstrap starting.
I20251023 07:59:30.326035 20272 tablet_bootstrap.cc:492] T 92fae2a393404d8998ad2747fbd08cc9 P 35e7d1ade024444486e63cf1b81e9626: Bootstrap starting.
I20251023 07:59:30.326411 20273 tablet_bootstrap.cc:654] T e2c26d408ee04105bd615b58287c82f9 P d1379e91aa9c41629cd25262571beb2c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:30.331781 20271 tablet_bootstrap.cc:654] T 076aca7c8ecb4f34af0d457fcee0e585 P 0f412334fb994ff0ab492afde64f5855: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:30.334440 20274 tablet_bootstrap.cc:492] T e2c26d408ee04105bd615b58287c82f9 P 65876a2b197c4ea6918f5cab47ded25c: Bootstrap starting.
I20251023 07:59:30.340610 20274 tablet_bootstrap.cc:654] T e2c26d408ee04105bd615b58287c82f9 P 65876a2b197c4ea6918f5cab47ded25c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:30.342473 20226 raft_consensus.cc:2468] T db045d1b86484fe9987f82ce426362e5 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35e7d1ade024444486e63cf1b81e9626 in term 1.
I20251023 07:59:30.343962 20043 leader_election.cc:304] T db045d1b86484fe9987f82ce426362e5 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35e7d1ade024444486e63cf1b81e9626, 65876a2b197c4ea6918f5cab47ded25c; no voters:
I20251023 07:59:30.344820 20272 tablet_bootstrap.cc:654] T 92fae2a393404d8998ad2747fbd08cc9 P 35e7d1ade024444486e63cf1b81e9626: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:30.345329 20279 raft_consensus.cc:493] T 92fae2a393404d8998ad2747fbd08cc9 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:30.346055 20279 raft_consensus.cc:515] T 92fae2a393404d8998ad2747fbd08cc9 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:30.349850 20337 raft_consensus.cc:2804] T db045d1b86484fe9987f82ce426362e5 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:59:30.350158 20078 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "92fae2a393404d8998ad2747fbd08cc9" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
I20251023 07:59:30.350598 20337 raft_consensus.cc:697] T db045d1b86484fe9987f82ce426362e5 P 35e7d1ade024444486e63cf1b81e9626 [term 1 LEADER]: Becoming Leader. State: Replica: 35e7d1ade024444486e63cf1b81e9626, State: Running, Role: LEADER
I20251023 07:59:30.351778 20337 consensus_queue.cc:237] T db045d1b86484fe9987f82ce426362e5 P 35e7d1ade024444486e63cf1b81e9626 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:30.354141 20273 tablet_bootstrap.cc:492] T e2c26d408ee04105bd615b58287c82f9 P d1379e91aa9c41629cd25262571beb2c: No bootstrap required, opened a new log
I20251023 07:59:30.354277 20336 raft_consensus.cc:493] T 7062462192fc4895b5a9f6a34c4a132a P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:30.354707 20273 ts_tablet_manager.cc:1403] T e2c26d408ee04105bd615b58287c82f9 P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.046s user 0.009s sys 0.021s
I20251023 07:59:30.355067 20271 tablet_bootstrap.cc:492] T 076aca7c8ecb4f34af0d457fcee0e585 P 0f412334fb994ff0ab492afde64f5855: No bootstrap required, opened a new log
I20251023 07:59:30.354815 20336 raft_consensus.cc:515] T 7062462192fc4895b5a9f6a34c4a132a P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:30.355515 20271 ts_tablet_manager.cc:1403] T 076aca7c8ecb4f34af0d457fcee0e585 P 0f412334fb994ff0ab492afde64f5855: Time spent bootstrapping tablet: real 0.035s user 0.011s sys 0.003s
I20251023 07:59:30.356673 20272 tablet_bootstrap.cc:492] T 92fae2a393404d8998ad2747fbd08cc9 P 35e7d1ade024444486e63cf1b81e9626: No bootstrap required, opened a new log
I20251023 07:59:30.356935 20336 leader_election.cc:290] T 7062462192fc4895b5a9f6a34c4a132a P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287), 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955)
I20251023 07:59:30.357172 20272 ts_tablet_manager.cc:1403] T 92fae2a393404d8998ad2747fbd08cc9 P 35e7d1ade024444486e63cf1b81e9626: Time spent bootstrapping tablet: real 0.031s user 0.013s sys 0.000s
I20251023 07:59:30.357393 20273 raft_consensus.cc:359] T e2c26d408ee04105bd615b58287c82f9 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
W20251023 07:59:30.357681 19967 leader_election.cc:343] T 92fae2a393404d8998ad2747fbd08cc9 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:30.358070 20279 leader_election.cc:290] T 92fae2a393404d8998ad2747fbd08cc9 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955), 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309)
I20251023 07:59:30.358186 20271 raft_consensus.cc:359] T 076aca7c8ecb4f34af0d457fcee0e585 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:30.358496 20273 raft_consensus.cc:385] T e2c26d408ee04105bd615b58287c82f9 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:30.358889 20271 raft_consensus.cc:385] T 076aca7c8ecb4f34af0d457fcee0e585 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:30.359000 20273 raft_consensus.cc:740] T e2c26d408ee04105bd615b58287c82f9 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:30.359257 20271 raft_consensus.cc:740] T 076aca7c8ecb4f34af0d457fcee0e585 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Initialized, Role: FOLLOWER
I20251023 07:59:30.359752 20224 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "92fae2a393404d8998ad2747fbd08cc9" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c" is_pre_election: true
I20251023 07:59:30.359977 20271 consensus_queue.cc:260] T 076aca7c8ecb4f34af0d457fcee0e585 P 0f412334fb994ff0ab492afde64f5855 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:30.360424 20224 raft_consensus.cc:2468] T 92fae2a393404d8998ad2747fbd08cc9 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 0.
I20251023 07:59:30.360003 20273 consensus_queue.cc:260] T e2c26d408ee04105bd615b58287c82f9 P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:30.362324 20271 ts_tablet_manager.cc:1434] T 076aca7c8ecb4f34af0d457fcee0e585 P 0f412334fb994ff0ab492afde64f5855: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20251023 07:59:30.363507 20224 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7062462192fc4895b5a9f6a34c4a132a" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c" is_pre_election: true
I20251023 07:59:30.363348 19968 leader_election.cc:304] T 92fae2a393404d8998ad2747fbd08cc9 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65876a2b197c4ea6918f5cab47ded25c, d1379e91aa9c41629cd25262571beb2c; no voters: 35e7d1ade024444486e63cf1b81e9626
I20251023 07:59:30.364259 20224 raft_consensus.cc:2468] T 7062462192fc4895b5a9f6a34c4a132a P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35e7d1ade024444486e63cf1b81e9626 in term 0.
I20251023 07:59:30.365464 20350 raft_consensus.cc:2804] T 92fae2a393404d8998ad2747fbd08cc9 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:30.365837 20350 raft_consensus.cc:493] T 92fae2a393404d8998ad2747fbd08cc9 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:30.365939 20271 tablet_bootstrap.cc:492] T 7062462192fc4895b5a9f6a34c4a132a P 0f412334fb994ff0ab492afde64f5855: Bootstrap starting.
I20251023 07:59:30.366199 20350 raft_consensus.cc:3060] T 92fae2a393404d8998ad2747fbd08cc9 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:30.370285 20043 leader_election.cc:304] T 7062462192fc4895b5a9f6a34c4a132a P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35e7d1ade024444486e63cf1b81e9626, 65876a2b197c4ea6918f5cab47ded25c; no voters:
I20251023 07:59:30.370616 20272 raft_consensus.cc:359] T 92fae2a393404d8998ad2747fbd08cc9 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:30.371366 20272 raft_consensus.cc:385] T 92fae2a393404d8998ad2747fbd08cc9 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:30.371658 20272 raft_consensus.cc:740] T 92fae2a393404d8998ad2747fbd08cc9 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e7d1ade024444486e63cf1b81e9626, State: Initialized, Role: FOLLOWER
I20251023 07:59:30.373320 20336 raft_consensus.cc:2804] T 7062462192fc4895b5a9f6a34c4a132a P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:30.373895 20336 raft_consensus.cc:493] T 7062462192fc4895b5a9f6a34c4a132a P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:30.374337 20336 raft_consensus.cc:3060] T 7062462192fc4895b5a9f6a34c4a132a P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:30.375556 20350 raft_consensus.cc:515] T 92fae2a393404d8998ad2747fbd08cc9 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:30.377573 20318 consensus_queue.cc:1048] T 1fa44f181e6e44bfb1e566ef7b0778a0 P 0f412334fb994ff0ab492afde64f5855 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:59:30.366153 20273 ts_tablet_manager.cc:1434] T e2c26d408ee04105bd615b58287c82f9 P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.011s user 0.001s sys 0.007s
I20251023 07:59:30.378949 20347 raft_consensus.cc:493] T d214412da5754dd0a08f25d50b5584f1 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:30.379452 20347 raft_consensus.cc:515] T d214412da5754dd0a08f25d50b5584f1 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:30.379832 20152 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7062462192fc4895b5a9f6a34c4a132a" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855" is_pre_election: true
I20251023 07:59:30.381677 20347 leader_election.cc:290] T d214412da5754dd0a08f25d50b5584f1 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
W20251023 07:59:30.384209 20041 leader_election.cc:343] T 7062462192fc4895b5a9f6a34c4a132a P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:30.385960 20224 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "92fae2a393404d8998ad2747fbd08cc9" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c"
I20251023 07:59:30.386758 20003 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d214412da5754dd0a08f25d50b5584f1" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:30.387256 20152 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d214412da5754dd0a08f25d50b5584f1" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855" is_pre_election: true
I20251023 07:59:30.387619 20003 raft_consensus.cc:2393] T d214412da5754dd0a08f25d50b5584f1 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35e7d1ade024444486e63cf1b81e9626 in current term 1: Already voted for candidate d1379e91aa9c41629cd25262571beb2c in this term.
I20251023 07:59:30.386787 20224 raft_consensus.cc:3060] T 92fae2a393404d8998ad2747fbd08cc9 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:30.388404 20273 tablet_bootstrap.cc:492] T 82812175f15d4d3dae73f31641a1e583 P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:30.390853 20346 raft_consensus.cc:493] T e2c26d408ee04105bd615b58287c82f9 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:30.391357 20346 raft_consensus.cc:515] T e2c26d408ee04105bd615b58287c82f9 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:30.394156 20225 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2c26d408ee04105bd615b58287c82f9" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c" is_pre_election: true
I20251023 07:59:30.394501 20346 leader_election.cc:290] T e2c26d408ee04105bd615b58287c82f9 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955), 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309)
I20251023 07:59:30.385875 20002 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "db045d1b86484fe9987f82ce426362e5" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c"
I20251023 07:59:30.395066 20350 leader_election.cc:290] T 92fae2a393404d8998ad2747fbd08cc9 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 election: Requested vote from peers 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955), 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309)
I20251023 07:59:30.395296 20002 raft_consensus.cc:3060] T db045d1b86484fe9987f82ce426362e5 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:30.395313 20077 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2c26d408ee04105bd615b58287c82f9" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
W20251023 07:59:30.396888 19967 leader_election.cc:343] T e2c26d408ee04105bd615b58287c82f9 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309): Illegal state: must be running to vote when last-logged opid is not known
W20251023 07:59:30.397857 19968 leader_election.cc:343] T e2c26d408ee04105bd615b58287c82f9 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:30.398303 19968 leader_election.cc:304] T e2c26d408ee04105bd615b58287c82f9 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d1379e91aa9c41629cd25262571beb2c; no voters: 35e7d1ade024444486e63cf1b81e9626, 65876a2b197c4ea6918f5cab47ded25c
I20251023 07:59:30.399376 20350 raft_consensus.cc:2749] T e2c26d408ee04105bd615b58287c82f9 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:59:30.394431 20078 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "92fae2a393404d8998ad2747fbd08cc9" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626"
I20251023 07:59:30.400730 20273 tablet_bootstrap.cc:654] T 82812175f15d4d3dae73f31641a1e583 P d1379e91aa9c41629cd25262571beb2c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:30.377781 20279 raft_consensus.cc:493] T 076aca7c8ecb4f34af0d457fcee0e585 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:30.403568 20279 raft_consensus.cc:515] T 076aca7c8ecb4f34af0d457fcee0e585 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:30.405129 19898 catalog_manager.cc:5649] T ccba7896b7e1413293428358ffd0f8a0 P 65876a2b197c4ea6918f5cab47ded25c reported cstate change: term changed from 0 to 1, leader changed from <none> to 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4). New cstate: current_term: 1 leader_uuid: "65876a2b197c4ea6918f5cab47ded25c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:30.408766 19896 catalog_manager.cc:5649] T db045d1b86484fe9987f82ce426362e5 P 35e7d1ade024444486e63cf1b81e9626 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2). New cstate: current_term: 1 leader_uuid: "35e7d1ade024444486e63cf1b81e9626" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } health_report { overall_health: HEALTHY } } }
I20251023 07:59:30.414285 20150 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "076aca7c8ecb4f34af0d457fcee0e585" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855" is_pre_election: true
I20251023 07:59:30.409722 20282 consensus_queue.cc:1048] T a9f4a5a96a444c099e7cefb12fe4c288 P 35e7d1ade024444486e63cf1b81e9626 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:59:30.415244 20150 raft_consensus.cc:2468] T 076aca7c8ecb4f34af0d457fcee0e585 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 0.
I20251023 07:59:30.415828 20279 leader_election.cc:290] T 076aca7c8ecb4f34af0d457fcee0e585 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287), 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955)
I20251023 07:59:30.416970 19966 leader_election.cc:304] T 076aca7c8ecb4f34af0d457fcee0e585 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, d1379e91aa9c41629cd25262571beb2c; no voters:
I20251023 07:59:30.394433 20152 raft_consensus.cc:2393] T d214412da5754dd0a08f25d50b5584f1 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35e7d1ade024444486e63cf1b81e9626 in current term 1: Already voted for candidate 0f412334fb994ff0ab492afde64f5855 in this term.
I20251023 07:59:30.425803 20041 leader_election.cc:304] T d214412da5754dd0a08f25d50b5584f1 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35e7d1ade024444486e63cf1b81e9626; no voters: 0f412334fb994ff0ab492afde64f5855, d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:30.426685 20282 raft_consensus.cc:3060] T d214412da5754dd0a08f25d50b5584f1 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:30.430673 20318 consensus_queue.cc:1048] T 1fa44f181e6e44bfb1e566ef7b0778a0 P 0f412334fb994ff0ab492afde64f5855 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:59:30.418064 20226 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "076aca7c8ecb4f34af0d457fcee0e585" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c" is_pre_election: true
I20251023 07:59:30.432296 20226 raft_consensus.cc:2468] T 076aca7c8ecb4f34af0d457fcee0e585 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 0.
I20251023 07:59:30.434628 20279 raft_consensus.cc:2804] T 076aca7c8ecb4f34af0d457fcee0e585 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:30.435213 20279 raft_consensus.cc:493] T 076aca7c8ecb4f34af0d457fcee0e585 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:30.435639 20279 raft_consensus.cc:3060] T 076aca7c8ecb4f34af0d457fcee0e585 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:30.438512 20282 raft_consensus.cc:2749] T d214412da5754dd0a08f25d50b5584f1 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:59:30.412268 20336 raft_consensus.cc:515] T 7062462192fc4895b5a9f6a34c4a132a P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:30.440698 20274 tablet_bootstrap.cc:492] T e2c26d408ee04105bd615b58287c82f9 P 65876a2b197c4ea6918f5cab47ded25c: No bootstrap required, opened a new log
I20251023 07:59:30.441213 20274 ts_tablet_manager.cc:1403] T e2c26d408ee04105bd615b58287c82f9 P 65876a2b197c4ea6918f5cab47ded25c: Time spent bootstrapping tablet: real 0.116s user 0.028s sys 0.040s
I20251023 07:59:30.443954 20274 raft_consensus.cc:359] T e2c26d408ee04105bd615b58287c82f9 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:30.444576 20274 raft_consensus.cc:385] T e2c26d408ee04105bd615b58287c82f9 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:30.444855 20274 raft_consensus.cc:740] T e2c26d408ee04105bd615b58287c82f9 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65876a2b197c4ea6918f5cab47ded25c, State: Initialized, Role: FOLLOWER
I20251023 07:59:30.445506 20274 consensus_queue.cc:260] T e2c26d408ee04105bd615b58287c82f9 P 65876a2b197c4ea6918f5cab47ded25c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:30.447690 20274 ts_tablet_manager.cc:1434] T e2c26d408ee04105bd615b58287c82f9 P 65876a2b197c4ea6918f5cab47ded25c: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20251023 07:59:30.448622 20274 tablet_bootstrap.cc:492] T 791953f9d44946eaa145c5857557a5e4 P 65876a2b197c4ea6918f5cab47ded25c: Bootstrap starting.
I20251023 07:59:30.449882 20152 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7062462192fc4895b5a9f6a34c4a132a" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855"
I20251023 07:59:30.451141 20226 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7062462192fc4895b5a9f6a34c4a132a" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c"
I20251023 07:59:30.453873 20226 raft_consensus.cc:3060] T 7062462192fc4895b5a9f6a34c4a132a P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:30.454203 20274 tablet_bootstrap.cc:654] T 791953f9d44946eaa145c5857557a5e4 P 65876a2b197c4ea6918f5cab47ded25c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:30.455360 20337 consensus_queue.cc:1048] T 12b8704d81fe4e3cb14bfa975c73df29 P 35e7d1ade024444486e63cf1b81e9626 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:59:30.458212 20271 tablet_bootstrap.cc:654] T 7062462192fc4895b5a9f6a34c4a132a P 0f412334fb994ff0ab492afde64f5855: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:30.451462 20002 raft_consensus.cc:2468] T db045d1b86484fe9987f82ce426362e5 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35e7d1ade024444486e63cf1b81e9626 in term 1.
I20251023 07:59:30.461539 20341 raft_consensus.cc:493] T e2c26d408ee04105bd615b58287c82f9 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:30.449923 20336 leader_election.cc:290] T 7062462192fc4895b5a9f6a34c4a132a P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 election: Requested vote from peers 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287), 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955)
I20251023 07:59:30.451113 20272 consensus_queue.cc:260] T 92fae2a393404d8998ad2747fbd08cc9 P 35e7d1ade024444486e63cf1b81e9626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:30.463095 20078 raft_consensus.cc:3060] T 92fae2a393404d8998ad2747fbd08cc9 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:30.463181 20350 consensus_queue.cc:1048] T 5bc7d7ca172742d1b528af8659661c2a P d1379e91aa9c41629cd25262571beb2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251023 07:59:30.463862 20041 leader_election.cc:343] T 7062462192fc4895b5a9f6a34c4a132a P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:30.471175 20224 raft_consensus.cc:2468] T 92fae2a393404d8998ad2747fbd08cc9 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 1.
I20251023 07:59:30.468919 20341 raft_consensus.cc:515] T e2c26d408ee04105bd615b58287c82f9 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:30.508046 19968 leader_election.cc:304] T 92fae2a393404d8998ad2747fbd08cc9 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65876a2b197c4ea6918f5cab47ded25c, d1379e91aa9c41629cd25262571beb2c; no voters:
I20251023 07:59:30.472294 20078 raft_consensus.cc:2468] T 92fae2a393404d8998ad2747fbd08cc9 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 1.
I20251023 07:59:30.448937 20279 raft_consensus.cc:515] T 076aca7c8ecb4f34af0d457fcee0e585 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:30.509186 20392 raft_consensus.cc:2804] T 92fae2a393404d8998ad2747fbd08cc9 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:59:30.496294 20318 raft_consensus.cc:493] T 82812175f15d4d3dae73f31641a1e583 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:30.510183 20318 raft_consensus.cc:515] T 82812175f15d4d3dae73f31641a1e583 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:30.510967 20279 leader_election.cc:290] T 076aca7c8ecb4f34af0d457fcee0e585 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 election: Requested vote from peers 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287), 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955)
I20251023 07:59:30.511752 20152 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "076aca7c8ecb4f34af0d457fcee0e585" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855"
I20251023 07:59:30.512159 20318 leader_election.cc:290] T 82812175f15d4d3dae73f31641a1e583 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865), 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309)
I20251023 07:59:30.512432 20152 raft_consensus.cc:3060] T 076aca7c8ecb4f34af0d457fcee0e585 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:30.501314 20350 consensus_queue.cc:1048] T 5bc7d7ca172742d1b528af8659661c2a P d1379e91aa9c41629cd25262571beb2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:59:30.472950 20273 tablet_bootstrap.cc:492] T 82812175f15d4d3dae73f31641a1e583 P d1379e91aa9c41629cd25262571beb2c: No bootstrap required, opened a new log
I20251023 07:59:30.513878 20273 ts_tablet_manager.cc:1403] T 82812175f15d4d3dae73f31641a1e583 P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.126s user 0.007s sys 0.009s
I20251023 07:59:30.514788 20341 leader_election.cc:290] T e2c26d408ee04105bd615b58287c82f9 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865), 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309)
I20251023 07:59:30.513031 20272 ts_tablet_manager.cc:1434] T 92fae2a393404d8998ad2747fbd08cc9 P 35e7d1ade024444486e63cf1b81e9626: Time spent starting tablet: real 0.155s user 0.007s sys 0.000s
I20251023 07:59:30.515925 20078 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2c26d408ee04105bd615b58287c82f9" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
I20251023 07:59:30.516547 20272 tablet_bootstrap.cc:492] T 82812175f15d4d3dae73f31641a1e583 P 35e7d1ade024444486e63cf1b81e9626: Bootstrap starting.
I20251023 07:59:30.509239 20002 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2c26d408ee04105bd615b58287c82f9" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
W20251023 07:59:30.517302 20190 leader_election.cc:343] T e2c26d408ee04105bd615b58287c82f9 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:30.517820 20002 raft_consensus.cc:2468] T e2c26d408ee04105bd615b58287c82f9 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65876a2b197c4ea6918f5cab47ded25c in term 0.
I20251023 07:59:30.519048 20192 leader_election.cc:304] T e2c26d408ee04105bd615b58287c82f9 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65876a2b197c4ea6918f5cab47ded25c, d1379e91aa9c41629cd25262571beb2c; no voters: 35e7d1ade024444486e63cf1b81e9626
I20251023 07:59:30.519426 20392 raft_consensus.cc:697] T 92fae2a393404d8998ad2747fbd08cc9 P d1379e91aa9c41629cd25262571beb2c [term 1 LEADER]: Becoming Leader. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Running, Role: LEADER
I20251023 07:59:30.520351 20392 consensus_queue.cc:237] T 92fae2a393404d8998ad2747fbd08cc9 P d1379e91aa9c41629cd25262571beb2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:30.521353 20002 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82812175f15d4d3dae73f31641a1e583" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:30.521621 20341 raft_consensus.cc:2804] T e2c26d408ee04105bd615b58287c82f9 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:30.522994 20341 raft_consensus.cc:493] T e2c26d408ee04105bd615b58287c82f9 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:30.523391 20341 raft_consensus.cc:3060] T e2c26d408ee04105bd615b58287c82f9 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:30.484475 20271 tablet_bootstrap.cc:492] T 7062462192fc4895b5a9f6a34c4a132a P 0f412334fb994ff0ab492afde64f5855: No bootstrap required, opened a new log
I20251023 07:59:30.482839 20337 consensus_queue.cc:1048] T a9f4a5a96a444c099e7cefb12fe4c288 P 35e7d1ade024444486e63cf1b81e9626 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.042s
I20251023 07:59:30.525286 20271 ts_tablet_manager.cc:1403] T 7062462192fc4895b5a9f6a34c4a132a P 0f412334fb994ff0ab492afde64f5855: Time spent bootstrapping tablet: real 0.160s user 0.007s sys 0.004s
I20251023 07:59:30.525733 20224 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "076aca7c8ecb4f34af0d457fcee0e585" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c"
I20251023 07:59:30.526435 20224 raft_consensus.cc:3060] T 076aca7c8ecb4f34af0d457fcee0e585 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:30.528213 20271 raft_consensus.cc:359] T 7062462192fc4895b5a9f6a34c4a132a P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:30.528966 20271 raft_consensus.cc:385] T 7062462192fc4895b5a9f6a34c4a132a P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:30.529222 20271 raft_consensus.cc:740] T 7062462192fc4895b5a9f6a34c4a132a P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Initialized, Role: FOLLOWER
I20251023 07:59:30.529531 20078 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82812175f15d4d3dae73f31641a1e583" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
I20251023 07:59:30.530041 20271 consensus_queue.cc:260] T 7062462192fc4895b5a9f6a34c4a132a P 0f412334fb994ff0ab492afde64f5855 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
W20251023 07:59:30.534049 20116 leader_election.cc:343] T 82812175f15d4d3dae73f31641a1e583 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:30.484251 20274 tablet_bootstrap.cc:492] T 791953f9d44946eaa145c5857557a5e4 P 65876a2b197c4ea6918f5cab47ded25c: No bootstrap required, opened a new log
I20251023 07:59:30.535378 20271 ts_tablet_manager.cc:1434] T 7062462192fc4895b5a9f6a34c4a132a P 0f412334fb994ff0ab492afde64f5855: Time spent starting tablet: real 0.010s user 0.007s sys 0.000s
I20251023 07:59:30.541380 20274 ts_tablet_manager.cc:1403] T 791953f9d44946eaa145c5857557a5e4 P 65876a2b197c4ea6918f5cab47ded25c: Time spent bootstrapping tablet: real 0.093s user 0.013s sys 0.005s
I20251023 07:59:30.542340 20271 tablet_bootstrap.cc:492] T aa253535ba594367a12fda3dea3b75d4 P 0f412334fb994ff0ab492afde64f5855: Bootstrap starting.
I20251023 07:59:30.537845 20336 consensus_queue.cc:1048] T 12b8704d81fe4e3cb14bfa975c73df29 P 35e7d1ade024444486e63cf1b81e9626 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20251023 07:59:30.475684 20226 raft_consensus.cc:2468] T 7062462192fc4895b5a9f6a34c4a132a P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35e7d1ade024444486e63cf1b81e9626 in term 1.
I20251023 07:59:30.544872 20043 leader_election.cc:304] T 7062462192fc4895b5a9f6a34c4a132a P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35e7d1ade024444486e63cf1b81e9626, 65876a2b197c4ea6918f5cab47ded25c; no voters: 0f412334fb994ff0ab492afde64f5855
I20251023 07:59:30.546180 20336 raft_consensus.cc:2804] T 7062462192fc4895b5a9f6a34c4a132a P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:59:30.546972 20336 raft_consensus.cc:697] T 7062462192fc4895b5a9f6a34c4a132a P 35e7d1ade024444486e63cf1b81e9626 [term 1 LEADER]: Becoming Leader. State: Replica: 35e7d1ade024444486e63cf1b81e9626, State: Running, Role: LEADER
I20251023 07:59:30.547950 20336 consensus_queue.cc:237] T 7062462192fc4895b5a9f6a34c4a132a P 35e7d1ade024444486e63cf1b81e9626 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:30.558152 20318 raft_consensus.cc:493] T 7d599e4b62364f04b966ca88e16b560a P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:30.566341 20318 raft_consensus.cc:515] T 7d599e4b62364f04b966ca88e16b560a P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:30.567346 20341 raft_consensus.cc:515] T e2c26d408ee04105bd615b58287c82f9 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
W20251023 07:59:30.558938 20118 leader_election.cc:343] T 82812175f15d4d3dae73f31641a1e583 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:30.568300 20118 leader_election.cc:304] T 82812175f15d4d3dae73f31641a1e583 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855; no voters: 35e7d1ade024444486e63cf1b81e9626, d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:30.569963 20309 raft_consensus.cc:2749] T 82812175f15d4d3dae73f31641a1e583 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:59:30.570168 20272 tablet_bootstrap.cc:654] T 82812175f15d4d3dae73f31641a1e583 P 35e7d1ade024444486e63cf1b81e9626: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:30.570559 20002 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2c26d408ee04105bd615b58287c82f9" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c"
I20251023 07:59:30.571318 20002 raft_consensus.cc:3060] T e2c26d408ee04105bd615b58287c82f9 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:30.572278 20078 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7d599e4b62364f04b966ca88e16b560a" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
I20251023 07:59:30.573025 20078 raft_consensus.cc:2468] T 7d599e4b62364f04b966ca88e16b560a P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f412334fb994ff0ab492afde64f5855 in term 0.
I20251023 07:59:30.560737 20273 raft_consensus.cc:359] T 82812175f15d4d3dae73f31641a1e583 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:30.562539 20274 raft_consensus.cc:359] T 791953f9d44946eaa145c5857557a5e4 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:30.574473 20116 leader_election.cc:304] T 7d599e4b62364f04b966ca88e16b560a P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, 35e7d1ade024444486e63cf1b81e9626; no voters:
I20251023 07:59:30.574973 20274 raft_consensus.cc:385] T 791953f9d44946eaa145c5857557a5e4 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:30.575259 20274 raft_consensus.cc:740] T 791953f9d44946eaa145c5857557a5e4 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65876a2b197c4ea6918f5cab47ded25c, State: Initialized, Role: FOLLOWER
I20251023 07:59:30.575680 20271 tablet_bootstrap.cc:654] T aa253535ba594367a12fda3dea3b75d4 P 0f412334fb994ff0ab492afde64f5855: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:30.575583 20309 raft_consensus.cc:2804] T 7d599e4b62364f04b966ca88e16b560a P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:30.576139 20309 raft_consensus.cc:493] T 7d599e4b62364f04b966ca88e16b560a P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:30.576040 20274 consensus_queue.cc:260] T 791953f9d44946eaa145c5857557a5e4 P 65876a2b197c4ea6918f5cab47ded25c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:30.576566 20309 raft_consensus.cc:3060] T 7d599e4b62364f04b966ca88e16b560a P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:30.577682 20318 leader_election.cc:290] T 7d599e4b62364f04b966ca88e16b560a P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309), 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955)
I20251023 07:59:30.578466 20223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7d599e4b62364f04b966ca88e16b560a" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c" is_pre_election: true
I20251023 07:59:30.578722 20274 ts_tablet_manager.cc:1434] T 791953f9d44946eaa145c5857557a5e4 P 65876a2b197c4ea6918f5cab47ded25c: Time spent starting tablet: real 0.037s user 0.003s sys 0.007s
I20251023 07:59:30.579706 20274 tablet_bootstrap.cc:492] T 7d599e4b62364f04b966ca88e16b560a P 65876a2b197c4ea6918f5cab47ded25c: Bootstrap starting.
W20251023 07:59:30.579725 20117 leader_election.cc:343] T 7d599e4b62364f04b966ca88e16b560a P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:30.584617 20309 raft_consensus.cc:515] T 7d599e4b62364f04b966ca88e16b560a P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:30.589764 20273 raft_consensus.cc:385] T 82812175f15d4d3dae73f31641a1e583 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:30.591463 20273 raft_consensus.cc:740] T 82812175f15d4d3dae73f31641a1e583 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:30.597019 20350 raft_consensus.cc:493] T aa253535ba594367a12fda3dea3b75d4 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:30.597733 20350 raft_consensus.cc:515] T aa253535ba594367a12fda3dea3b75d4 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:30.602149 20078 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aa253535ba594367a12fda3dea3b75d4" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
I20251023 07:59:30.597113 20273 consensus_queue.cc:260] T 82812175f15d4d3dae73f31641a1e583 P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
W20251023 07:59:30.603487 19967 leader_election.cc:343] T aa253535ba594367a12fda3dea3b75d4 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:30.604012 20350 leader_election.cc:290] T aa253535ba594367a12fda3dea3b75d4 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309), 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287)
I20251023 07:59:30.604683 20150 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aa253535ba594367a12fda3dea3b75d4" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855" is_pre_election: true
I20251023 07:59:30.606158 20152 raft_consensus.cc:2468] T 076aca7c8ecb4f34af0d457fcee0e585 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 1.
I20251023 07:59:30.606326 20078 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7d599e4b62364f04b966ca88e16b560a" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626"
I20251023 07:59:30.614457 20078 raft_consensus.cc:3060] T 7d599e4b62364f04b966ca88e16b560a P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:30.621919 20272 tablet_bootstrap.cc:492] T 82812175f15d4d3dae73f31641a1e583 P 35e7d1ade024444486e63cf1b81e9626: No bootstrap required, opened a new log
I20251023 07:59:30.625473 20078 raft_consensus.cc:2468] T 7d599e4b62364f04b966ca88e16b560a P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f412334fb994ff0ab492afde64f5855 in term 1.
I20251023 07:59:30.628091 20002 raft_consensus.cc:2468] T e2c26d408ee04105bd615b58287c82f9 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65876a2b197c4ea6918f5cab47ded25c in term 1.
I20251023 07:59:30.629317 20341 leader_election.cc:290] T e2c26d408ee04105bd615b58287c82f9 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 election: Requested vote from peers d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865), 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309)
I20251023 07:59:30.633263 20272 ts_tablet_manager.cc:1403] T 82812175f15d4d3dae73f31641a1e583 P 35e7d1ade024444486e63cf1b81e9626: Time spent bootstrapping tablet: real 0.117s user 0.012s sys 0.000s
I20251023 07:59:30.629539 20271 tablet_bootstrap.cc:492] T aa253535ba594367a12fda3dea3b75d4 P 0f412334fb994ff0ab492afde64f5855: No bootstrap required, opened a new log
I20251023 07:59:30.629199 20077 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2c26d408ee04105bd615b58287c82f9" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626"
I20251023 07:59:30.633823 20116 leader_election.cc:304] T 7d599e4b62364f04b966ca88e16b560a P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, 35e7d1ade024444486e63cf1b81e9626; no voters:
I20251023 07:59:30.634938 20399 raft_consensus.cc:2804] T 7d599e4b62364f04b966ca88e16b560a P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:59:30.635197 20271 ts_tablet_manager.cc:1403] T aa253535ba594367a12fda3dea3b75d4 P 0f412334fb994ff0ab492afde64f5855: Time spent bootstrapping tablet: real 0.093s user 0.013s sys 0.012s
I20251023 07:59:30.635428 20399 raft_consensus.cc:697] T 7d599e4b62364f04b966ca88e16b560a P 0f412334fb994ff0ab492afde64f5855 [term 1 LEADER]: Becoming Leader. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Running, Role: LEADER
I20251023 07:59:30.635953 20272 raft_consensus.cc:359] T 82812175f15d4d3dae73f31641a1e583 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:30.636647 20272 raft_consensus.cc:385] T 82812175f15d4d3dae73f31641a1e583 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:30.636363 20399 consensus_queue.cc:237] T 7d599e4b62364f04b966ca88e16b560a P 0f412334fb994ff0ab492afde64f5855 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
W20251023 07:59:30.609902 19966 leader_election.cc:343] T aa253535ba594367a12fda3dea3b75d4 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:30.637722 19966 leader_election.cc:304] T aa253535ba594367a12fda3dea3b75d4 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d1379e91aa9c41629cd25262571beb2c; no voters: 0f412334fb994ff0ab492afde64f5855, 35e7d1ade024444486e63cf1b81e9626
I20251023 07:59:30.638106 20400 raft_consensus.cc:493] T d214412da5754dd0a08f25d50b5584f1 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:30.637815 20271 raft_consensus.cc:359] T aa253535ba594367a12fda3dea3b75d4 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:30.613545 20309 leader_election.cc:290] T 7d599e4b62364f04b966ca88e16b560a P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 election: Requested vote from peers 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309), 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955)
I20251023 07:59:30.638625 20400 raft_consensus.cc:515] T d214412da5754dd0a08f25d50b5584f1 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
W20251023 07:59:30.634932 20190 leader_election.cc:343] T e2c26d408ee04105bd615b58287c82f9 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:30.639343 19966 leader_election.cc:304] T 076aca7c8ecb4f34af0d457fcee0e585 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, d1379e91aa9c41629cd25262571beb2c; no voters:
I20251023 07:59:30.608361 20226 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7d599e4b62364f04b966ca88e16b560a" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c"
I20251023 07:59:30.640236 20350 raft_consensus.cc:2749] T aa253535ba594367a12fda3dea3b75d4 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:59:30.608007 20224 raft_consensus.cc:2468] T 076aca7c8ecb4f34af0d457fcee0e585 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 1.
I20251023 07:59:30.611666 20274 tablet_bootstrap.cc:654] T 7d599e4b62364f04b966ca88e16b560a P 65876a2b197c4ea6918f5cab47ded25c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:30.638631 20271 raft_consensus.cc:385] T aa253535ba594367a12fda3dea3b75d4 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:30.641968 20271 raft_consensus.cc:740] T aa253535ba594367a12fda3dea3b75d4 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Initialized, Role: FOLLOWER
W20251023 07:59:30.642676 20117 leader_election.cc:343] T 7d599e4b62364f04b966ca88e16b560a P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:30.642807 20271 consensus_queue.cc:260] T aa253535ba594367a12fda3dea3b75d4 P 0f412334fb994ff0ab492afde64f5855 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:30.641769 20192 leader_election.cc:304] T e2c26d408ee04105bd615b58287c82f9 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65876a2b197c4ea6918f5cab47ded25c, d1379e91aa9c41629cd25262571beb2c; no voters: 35e7d1ade024444486e63cf1b81e9626
I20251023 07:59:30.640976 20350 raft_consensus.cc:2804] T 076aca7c8ecb4f34af0d457fcee0e585 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:59:30.636927 20272 raft_consensus.cc:740] T 82812175f15d4d3dae73f31641a1e583 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e7d1ade024444486e63cf1b81e9626, State: Initialized, Role: FOLLOWER
I20251023 07:59:30.644318 20350 raft_consensus.cc:697] T 076aca7c8ecb4f34af0d457fcee0e585 P d1379e91aa9c41629cd25262571beb2c [term 1 LEADER]: Becoming Leader. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Running, Role: LEADER
I20251023 07:59:30.644522 20341 raft_consensus.cc:2804] T e2c26d408ee04105bd615b58287c82f9 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:59:30.645061 20341 raft_consensus.cc:697] T e2c26d408ee04105bd615b58287c82f9 P 65876a2b197c4ea6918f5cab47ded25c [term 1 LEADER]: Becoming Leader. State: Replica: 65876a2b197c4ea6918f5cab47ded25c, State: Running, Role: LEADER
I20251023 07:59:30.644819 20272 consensus_queue.cc:260] T 82812175f15d4d3dae73f31641a1e583 P 35e7d1ade024444486e63cf1b81e9626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:30.645269 20350 consensus_queue.cc:237] T 076aca7c8ecb4f34af0d457fcee0e585 P d1379e91aa9c41629cd25262571beb2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:30.646050 20341 consensus_queue.cc:237] T e2c26d408ee04105bd615b58287c82f9 P 65876a2b197c4ea6918f5cab47ded25c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:30.648545 20272 ts_tablet_manager.cc:1434] T 82812175f15d4d3dae73f31641a1e583 P 35e7d1ade024444486e63cf1b81e9626: Time spent starting tablet: real 0.015s user 0.005s sys 0.000s
I20251023 07:59:30.647565 19896 catalog_manager.cc:5649] T 92fae2a393404d8998ad2747fbd08cc9 P d1379e91aa9c41629cd25262571beb2c reported cstate change: term changed from 0 to 1, leader changed from <none> to d1379e91aa9c41629cd25262571beb2c (127.16.126.1). New cstate: current_term: 1 leader_uuid: "d1379e91aa9c41629cd25262571beb2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:30.649580 20002 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d214412da5754dd0a08f25d50b5584f1" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:30.651166 20002 raft_consensus.cc:2468] T d214412da5754dd0a08f25d50b5584f1 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f412334fb994ff0ab492afde64f5855 in term 1.
I20251023 07:59:30.644312 20400 leader_election.cc:290] T d214412da5754dd0a08f25d50b5584f1 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865), 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309)
I20251023 07:59:30.652506 20118 leader_election.cc:304] T d214412da5754dd0a08f25d50b5584f1 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, d1379e91aa9c41629cd25262571beb2c; no voters:
I20251023 07:59:30.653405 20271 ts_tablet_manager.cc:1434] T aa253535ba594367a12fda3dea3b75d4 P 0f412334fb994ff0ab492afde64f5855: Time spent starting tablet: real 0.018s user 0.006s sys 0.000s
I20251023 07:59:30.612365 20273 ts_tablet_manager.cc:1434] T 82812175f15d4d3dae73f31641a1e583 P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.098s user 0.006s sys 0.002s
I20251023 07:59:30.654446 20271 tablet_bootstrap.cc:492] T fa36a9cfa4fe43418245de193502470f P 0f412334fb994ff0ab492afde64f5855: Bootstrap starting.
I20251023 07:59:30.653613 20400 raft_consensus.cc:2804] T d214412da5754dd0a08f25d50b5584f1 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251023 07:59:30.655048 20400 raft_consensus.cc:493] T d214412da5754dd0a08f25d50b5584f1 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:30.655164 20273 tablet_bootstrap.cc:492] T fa36a9cfa4fe43418245de193502470f P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:30.656461 20400 raft_consensus.cc:3060] T d214412da5754dd0a08f25d50b5584f1 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:30.659283 20077 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d214412da5754dd0a08f25d50b5584f1" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
I20251023 07:59:30.660203 20077 raft_consensus.cc:2468] T d214412da5754dd0a08f25d50b5584f1 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f412334fb994ff0ab492afde64f5855 in term 1.
I20251023 07:59:30.664234 19899 catalog_manager.cc:5649] T 7062462192fc4895b5a9f6a34c4a132a P 35e7d1ade024444486e63cf1b81e9626 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2). New cstate: current_term: 1 leader_uuid: "35e7d1ade024444486e63cf1b81e9626" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:30.665688 20273 tablet_bootstrap.cc:654] T fa36a9cfa4fe43418245de193502470f P d1379e91aa9c41629cd25262571beb2c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:30.671011 20271 tablet_bootstrap.cc:654] T fa36a9cfa4fe43418245de193502470f P 0f412334fb994ff0ab492afde64f5855: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:30.674096 19900 catalog_manager.cc:5649] T e2c26d408ee04105bd615b58287c82f9 P 65876a2b197c4ea6918f5cab47ded25c reported cstate change: term changed from 0 to 1, leader changed from <none> to 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4). New cstate: current_term: 1 leader_uuid: "65876a2b197c4ea6918f5cab47ded25c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:30.680459 20272 tablet_bootstrap.cc:492] T aa253535ba594367a12fda3dea3b75d4 P 35e7d1ade024444486e63cf1b81e9626: Bootstrap starting.
I20251023 07:59:30.684432 20274 tablet_bootstrap.cc:492] T 7d599e4b62364f04b966ca88e16b560a P 65876a2b197c4ea6918f5cab47ded25c: No bootstrap required, opened a new log
I20251023 07:59:30.685127 20274 ts_tablet_manager.cc:1403] T 7d599e4b62364f04b966ca88e16b560a P 65876a2b197c4ea6918f5cab47ded25c: Time spent bootstrapping tablet: real 0.106s user 0.011s sys 0.001s
I20251023 07:59:30.688189 20400 raft_consensus.cc:515] T d214412da5754dd0a08f25d50b5584f1 P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:30.690419 20400 leader_election.cc:290] T d214412da5754dd0a08f25d50b5584f1 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 2 election: Requested vote from peers d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865), 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309)
I20251023 07:59:30.691146 20002 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d214412da5754dd0a08f25d50b5584f1" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c"
I20251023 07:59:30.691685 20077 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d214412da5754dd0a08f25d50b5584f1" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626"
I20251023 07:59:30.692276 20077 raft_consensus.cc:3060] T d214412da5754dd0a08f25d50b5584f1 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:30.691699 20002 raft_consensus.cc:3060] T d214412da5754dd0a08f25d50b5584f1 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:30.699775 20077 raft_consensus.cc:2468] T d214412da5754dd0a08f25d50b5584f1 P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f412334fb994ff0ab492afde64f5855 in term 2.
I20251023 07:59:30.702939 20116 leader_election.cc:304] T d214412da5754dd0a08f25d50b5584f1 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, 35e7d1ade024444486e63cf1b81e9626; no voters:
I20251023 07:59:30.703871 20399 raft_consensus.cc:2804] T d214412da5754dd0a08f25d50b5584f1 P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:59:30.704344 20399 raft_consensus.cc:697] T d214412da5754dd0a08f25d50b5584f1 P 0f412334fb994ff0ab492afde64f5855 [term 2 LEADER]: Becoming Leader. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Running, Role: LEADER
I20251023 07:59:30.692691 19896 catalog_manager.cc:5649] T 7d599e4b62364f04b966ca88e16b560a P 0f412334fb994ff0ab492afde64f5855 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f412334fb994ff0ab492afde64f5855 (127.16.126.3). New cstate: current_term: 1 leader_uuid: "0f412334fb994ff0ab492afde64f5855" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:30.705289 20399 consensus_queue.cc:237] T d214412da5754dd0a08f25d50b5584f1 P 0f412334fb994ff0ab492afde64f5855 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:30.703444 20002 raft_consensus.cc:2468] T d214412da5754dd0a08f25d50b5584f1 P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f412334fb994ff0ab492afde64f5855 in term 2.
I20251023 07:59:30.715920 20273 tablet_bootstrap.cc:492] T fa36a9cfa4fe43418245de193502470f P d1379e91aa9c41629cd25262571beb2c: No bootstrap required, opened a new log
I20251023 07:59:30.716374 20273 ts_tablet_manager.cc:1403] T fa36a9cfa4fe43418245de193502470f P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.061s user 0.013s sys 0.004s
I20251023 07:59:30.718888 20393 raft_consensus.cc:493] T 82812175f15d4d3dae73f31641a1e583 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:30.718942 20273 raft_consensus.cc:359] T fa36a9cfa4fe43418245de193502470f P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:30.719542 20393 raft_consensus.cc:515] T 82812175f15d4d3dae73f31641a1e583 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:30.720000 20273 raft_consensus.cc:385] T fa36a9cfa4fe43418245de193502470f P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:30.719681 20274 raft_consensus.cc:359] T 7d599e4b62364f04b966ca88e16b560a P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:30.720283 20273 raft_consensus.cc:740] T fa36a9cfa4fe43418245de193502470f P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:30.720464 20274 raft_consensus.cc:385] T 7d599e4b62364f04b966ca88e16b560a P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:30.723326 20152 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82812175f15d4d3dae73f31641a1e583" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855" is_pre_election: true
I20251023 07:59:30.723831 20274 raft_consensus.cc:740] T 7d599e4b62364f04b966ca88e16b560a P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65876a2b197c4ea6918f5cab47ded25c, State: Initialized, Role: FOLLOWER
I20251023 07:59:30.724058 20152 raft_consensus.cc:2468] T 82812175f15d4d3dae73f31641a1e583 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35e7d1ade024444486e63cf1b81e9626 in term 0.
I20251023 07:59:30.724534 20274 consensus_queue.cc:260] T 7d599e4b62364f04b966ca88e16b560a P 65876a2b197c4ea6918f5cab47ded25c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:30.725534 20041 leader_election.cc:304] T 82812175f15d4d3dae73f31641a1e583 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, 35e7d1ade024444486e63cf1b81e9626; no voters:
I20251023 07:59:30.726382 20336 raft_consensus.cc:2804] T 82812175f15d4d3dae73f31641a1e583 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:30.726719 20336 raft_consensus.cc:493] T 82812175f15d4d3dae73f31641a1e583 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:30.727032 20336 raft_consensus.cc:3060] T 82812175f15d4d3dae73f31641a1e583 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:30.727130 20274 ts_tablet_manager.cc:1434] T 7d599e4b62364f04b966ca88e16b560a P 65876a2b197c4ea6918f5cab47ded25c: Time spent starting tablet: real 0.042s user 0.003s sys 0.002s
I20251023 07:59:30.727933 20273 consensus_queue.cc:260] T fa36a9cfa4fe43418245de193502470f P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:30.730077 20273 ts_tablet_manager.cc:1434] T fa36a9cfa4fe43418245de193502470f P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.013s user 0.007s sys 0.001s
I20251023 07:59:30.730906 20272 tablet_bootstrap.cc:654] T aa253535ba594367a12fda3dea3b75d4 P 35e7d1ade024444486e63cf1b81e9626: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:30.721544 20393 leader_election.cc:290] T 82812175f15d4d3dae73f31641a1e583 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865), 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287)
I20251023 07:59:30.722324 20341 consensus_queue.cc:1048] T ccba7896b7e1413293428358ffd0f8a0 P 65876a2b197c4ea6918f5cab47ded25c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:59:30.731554 20002 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82812175f15d4d3dae73f31641a1e583" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:30.732182 20002 raft_consensus.cc:2468] T 82812175f15d4d3dae73f31641a1e583 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35e7d1ade024444486e63cf1b81e9626 in term 0.
I20251023 07:59:30.740031 20341 raft_consensus.cc:493] T 791953f9d44946eaa145c5857557a5e4 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:30.740578 20341 raft_consensus.cc:515] T 791953f9d44946eaa145c5857557a5e4 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:30.741171 20336 raft_consensus.cc:515] T 82812175f15d4d3dae73f31641a1e583 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:30.744105 20077 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "791953f9d44946eaa145c5857557a5e4" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
I20251023 07:59:30.744563 20152 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "791953f9d44946eaa145c5857557a5e4" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855" is_pre_election: true
I20251023 07:59:30.745550 20002 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82812175f15d4d3dae73f31641a1e583" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c"
I20251023 07:59:30.746209 20002 raft_consensus.cc:3060] T 82812175f15d4d3dae73f31641a1e583 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Advancing to term 1
W20251023 07:59:30.746253 20190 leader_election.cc:343] T 791953f9d44946eaa145c5857557a5e4 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309): Illegal state: must be running to vote when last-logged opid is not known
W20251023 07:59:30.747090 20189 leader_election.cc:343] T 791953f9d44946eaa145c5857557a5e4 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:30.747515 20189 leader_election.cc:304] T 791953f9d44946eaa145c5857557a5e4 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65876a2b197c4ea6918f5cab47ded25c; no voters: 0f412334fb994ff0ab492afde64f5855, 35e7d1ade024444486e63cf1b81e9626
I20251023 07:59:30.748327 20360 raft_consensus.cc:2749] T 791953f9d44946eaa145c5857557a5e4 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:59:30.748746 20336 leader_election.cc:290] T 82812175f15d4d3dae73f31641a1e583 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 election: Requested vote from peers d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865), 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287)
I20251023 07:59:30.749270 20152 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82812175f15d4d3dae73f31641a1e583" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855"
I20251023 07:59:30.753988 20152 raft_consensus.cc:3060] T 82812175f15d4d3dae73f31641a1e583 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:30.749766 20341 leader_election.cc:290] T 791953f9d44946eaa145c5857557a5e4 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309), 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287)
I20251023 07:59:30.757324 20002 raft_consensus.cc:2468] T 82812175f15d4d3dae73f31641a1e583 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35e7d1ade024444486e63cf1b81e9626 in term 1.
I20251023 07:59:30.758630 20044 leader_election.cc:304] T 82812175f15d4d3dae73f31641a1e583 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35e7d1ade024444486e63cf1b81e9626, d1379e91aa9c41629cd25262571beb2c; no voters:
I20251023 07:59:30.759668 20336 raft_consensus.cc:2804] T 82812175f15d4d3dae73f31641a1e583 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:59:30.760186 20271 tablet_bootstrap.cc:492] T fa36a9cfa4fe43418245de193502470f P 0f412334fb994ff0ab492afde64f5855: No bootstrap required, opened a new log
I20251023 07:59:30.760151 20336 raft_consensus.cc:697] T 82812175f15d4d3dae73f31641a1e583 P 35e7d1ade024444486e63cf1b81e9626 [term 1 LEADER]: Becoming Leader. State: Replica: 35e7d1ade024444486e63cf1b81e9626, State: Running, Role: LEADER
I20251023 07:59:30.761210 20336 consensus_queue.cc:237] T 82812175f15d4d3dae73f31641a1e583 P 35e7d1ade024444486e63cf1b81e9626 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:30.761857 20152 raft_consensus.cc:2468] T 82812175f15d4d3dae73f31641a1e583 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35e7d1ade024444486e63cf1b81e9626 in term 1.
I20251023 07:59:30.765158 20271 ts_tablet_manager.cc:1403] T fa36a9cfa4fe43418245de193502470f P 0f412334fb994ff0ab492afde64f5855: Time spent bootstrapping tablet: real 0.111s user 0.032s sys 0.046s
I20251023 07:59:30.768317 20274 tablet_bootstrap.cc:492] T fa36a9cfa4fe43418245de193502470f P 65876a2b197c4ea6918f5cab47ded25c: Bootstrap starting.
I20251023 07:59:30.768208 20271 raft_consensus.cc:359] T fa36a9cfa4fe43418245de193502470f P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:30.769107 20271 raft_consensus.cc:385] T fa36a9cfa4fe43418245de193502470f P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:30.769565 20271 raft_consensus.cc:740] T fa36a9cfa4fe43418245de193502470f P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Initialized, Role: FOLLOWER
I20251023 07:59:30.770265 20271 consensus_queue.cc:260] T fa36a9cfa4fe43418245de193502470f P 0f412334fb994ff0ab492afde64f5855 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:30.772604 20271 ts_tablet_manager.cc:1434] T fa36a9cfa4fe43418245de193502470f P 0f412334fb994ff0ab492afde64f5855: Time spent starting tablet: real 0.007s user 0.003s sys 0.002s
I20251023 07:59:30.773662 20271 tablet_bootstrap.cc:492] T 791953f9d44946eaa145c5857557a5e4 P 0f412334fb994ff0ab492afde64f5855: Bootstrap starting.
I20251023 07:59:30.730962 20273 tablet_bootstrap.cc:492] T 7060af9ee4a34ecca18900b2f272e1d1 P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:30.779508 20271 tablet_bootstrap.cc:654] T 791953f9d44946eaa145c5857557a5e4 P 0f412334fb994ff0ab492afde64f5855: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:30.780234 19898 catalog_manager.cc:5649] T 076aca7c8ecb4f34af0d457fcee0e585 P d1379e91aa9c41629cd25262571beb2c reported cstate change: term changed from 0 to 1, leader changed from <none> to d1379e91aa9c41629cd25262571beb2c (127.16.126.1). New cstate: current_term: 1 leader_uuid: "d1379e91aa9c41629cd25262571beb2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: HEALTHY } } }
I20251023 07:59:30.787174 20341 consensus_queue.cc:1048] T ccba7896b7e1413293428358ffd0f8a0 P 65876a2b197c4ea6918f5cab47ded25c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:59:30.790815 20271 tablet_bootstrap.cc:492] T 791953f9d44946eaa145c5857557a5e4 P 0f412334fb994ff0ab492afde64f5855: No bootstrap required, opened a new log
I20251023 07:59:30.791290 20271 ts_tablet_manager.cc:1403] T 791953f9d44946eaa145c5857557a5e4 P 0f412334fb994ff0ab492afde64f5855: Time spent bootstrapping tablet: real 0.018s user 0.012s sys 0.003s
I20251023 07:59:30.793958 20271 raft_consensus.cc:359] T 791953f9d44946eaa145c5857557a5e4 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:30.794669 20271 raft_consensus.cc:385] T 791953f9d44946eaa145c5857557a5e4 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:30.795045 20271 raft_consensus.cc:740] T 791953f9d44946eaa145c5857557a5e4 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Initialized, Role: FOLLOWER
I20251023 07:59:30.793753 19899 catalog_manager.cc:5649] T 82812175f15d4d3dae73f31641a1e583 P 35e7d1ade024444486e63cf1b81e9626 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2). New cstate: current_term: 1 leader_uuid: "35e7d1ade024444486e63cf1b81e9626" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:30.794704 19896 catalog_manager.cc:5649] T d214412da5754dd0a08f25d50b5584f1 P 0f412334fb994ff0ab492afde64f5855 reported cstate change: term changed from 0 to 2, leader changed from <none> to 0f412334fb994ff0ab492afde64f5855 (127.16.126.3). New cstate: current_term: 2 leader_uuid: "0f412334fb994ff0ab492afde64f5855" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:30.795857 20271 consensus_queue.cc:260] T 791953f9d44946eaa145c5857557a5e4 P 0f412334fb994ff0ab492afde64f5855 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:30.798341 20271 ts_tablet_manager.cc:1434] T 791953f9d44946eaa145c5857557a5e4 P 0f412334fb994ff0ab492afde64f5855: Time spent starting tablet: real 0.007s user 0.006s sys 0.001s
I20251023 07:59:30.798909 20274 tablet_bootstrap.cc:654] T fa36a9cfa4fe43418245de193502470f P 65876a2b197c4ea6918f5cab47ded25c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:30.799227 20271 tablet_bootstrap.cc:492] T 7060af9ee4a34ecca18900b2f272e1d1 P 0f412334fb994ff0ab492afde64f5855: Bootstrap starting.
I20251023 07:59:30.805302 20271 tablet_bootstrap.cc:654] T 7060af9ee4a34ecca18900b2f272e1d1 P 0f412334fb994ff0ab492afde64f5855: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:30.807135 20350 raft_consensus.cc:493] T fa36a9cfa4fe43418245de193502470f P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:30.807683 20350 raft_consensus.cc:515] T fa36a9cfa4fe43418245de193502470f P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:30.810788 20350 leader_election.cc:290] T fa36a9cfa4fe43418245de193502470f P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287), 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955)
I20251023 07:59:30.811173 20150 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fa36a9cfa4fe43418245de193502470f" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855" is_pre_election: true
I20251023 07:59:30.811895 20150 raft_consensus.cc:2468] T fa36a9cfa4fe43418245de193502470f P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 0.
I20251023 07:59:30.812311 20224 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fa36a9cfa4fe43418245de193502470f" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c" is_pre_election: true
I20251023 07:59:30.813068 20399 raft_consensus.cc:493] T 7062462192fc4895b5a9f6a34c4a132a P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20251023 07:59:30.813724 19968 leader_election.cc:343] T fa36a9cfa4fe43418245de193502470f P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:30.813571 20399 raft_consensus.cc:515] T 7062462192fc4895b5a9f6a34c4a132a P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:30.815608 20399 leader_election.cc:290] T 7062462192fc4895b5a9f6a34c4a132a P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309), 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955)
I20251023 07:59:30.817118 19966 leader_election.cc:304] T fa36a9cfa4fe43418245de193502470f P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, d1379e91aa9c41629cd25262571beb2c; no voters: 65876a2b197c4ea6918f5cab47ded25c
I20251023 07:59:30.817184 20077 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7062462192fc4895b5a9f6a34c4a132a" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
I20251023 07:59:30.819809 20224 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7062462192fc4895b5a9f6a34c4a132a" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c" is_pre_election: true
I20251023 07:59:30.820461 20224 raft_consensus.cc:2393] T 7062462192fc4895b5a9f6a34c4a132a P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f412334fb994ff0ab492afde64f5855 in current term 1: Already voted for candidate 35e7d1ade024444486e63cf1b81e9626 in this term.
I20251023 07:59:30.821470 20271 tablet_bootstrap.cc:492] T 7060af9ee4a34ecca18900b2f272e1d1 P 0f412334fb994ff0ab492afde64f5855: No bootstrap required, opened a new log
I20251023 07:59:30.821514 20117 leader_election.cc:304] T 7062462192fc4895b5a9f6a34c4a132a P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855; no voters: 35e7d1ade024444486e63cf1b81e9626, 65876a2b197c4ea6918f5cab47ded25c
I20251023 07:59:30.822072 20271 ts_tablet_manager.cc:1403] T 7060af9ee4a34ecca18900b2f272e1d1 P 0f412334fb994ff0ab492afde64f5855: Time spent bootstrapping tablet: real 0.023s user 0.012s sys 0.004s
I20251023 07:59:30.822826 20399 raft_consensus.cc:3060] T 7062462192fc4895b5a9f6a34c4a132a P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:30.825039 20350 raft_consensus.cc:2804] T fa36a9cfa4fe43418245de193502470f P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:30.824757 20271 raft_consensus.cc:359] T 7060af9ee4a34ecca18900b2f272e1d1 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:30.825474 20350 raft_consensus.cc:493] T fa36a9cfa4fe43418245de193502470f P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:30.825621 20271 raft_consensus.cc:385] T 7060af9ee4a34ecca18900b2f272e1d1 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:30.825912 20350 raft_consensus.cc:3060] T fa36a9cfa4fe43418245de193502470f P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:30.825965 20271 raft_consensus.cc:740] T 7060af9ee4a34ecca18900b2f272e1d1 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Initialized, Role: FOLLOWER
I20251023 07:59:30.826864 20271 consensus_queue.cc:260] T 7060af9ee4a34ecca18900b2f272e1d1 P 0f412334fb994ff0ab492afde64f5855 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:30.830062 20271 ts_tablet_manager.cc:1434] T 7060af9ee4a34ecca18900b2f272e1d1 P 0f412334fb994ff0ab492afde64f5855: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s
I20251023 07:59:30.831120 20271 tablet_bootstrap.cc:492] T 5855488965da49f4a33c7516f6a5596a P 0f412334fb994ff0ab492afde64f5855: Bootstrap starting.
I20251023 07:59:30.831238 20399 raft_consensus.cc:2749] T 7062462192fc4895b5a9f6a34c4a132a P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:59:30.832764 20272 tablet_bootstrap.cc:492] T aa253535ba594367a12fda3dea3b75d4 P 35e7d1ade024444486e63cf1b81e9626: No bootstrap required, opened a new log
I20251023 07:59:30.835001 20272 ts_tablet_manager.cc:1403] T aa253535ba594367a12fda3dea3b75d4 P 35e7d1ade024444486e63cf1b81e9626: Time spent bootstrapping tablet: real 0.155s user 0.014s sys 0.001s
I20251023 07:59:30.837606 20271 tablet_bootstrap.cc:654] T 5855488965da49f4a33c7516f6a5596a P 0f412334fb994ff0ab492afde64f5855: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:30.837392 20272 raft_consensus.cc:359] T aa253535ba594367a12fda3dea3b75d4 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:30.838114 20272 raft_consensus.cc:385] T aa253535ba594367a12fda3dea3b75d4 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:30.838384 20272 raft_consensus.cc:740] T aa253535ba594367a12fda3dea3b75d4 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e7d1ade024444486e63cf1b81e9626, State: Initialized, Role: FOLLOWER
I20251023 07:59:30.833608 20350 raft_consensus.cc:515] T fa36a9cfa4fe43418245de193502470f P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:30.841737 20150 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fa36a9cfa4fe43418245de193502470f" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855"
I20251023 07:59:30.841889 20272 consensus_queue.cc:260] T aa253535ba594367a12fda3dea3b75d4 P 35e7d1ade024444486e63cf1b81e9626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:30.842337 20150 raft_consensus.cc:3060] T fa36a9cfa4fe43418245de193502470f P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:30.844276 20224 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fa36a9cfa4fe43418245de193502470f" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c"
W20251023 07:59:30.845666 19968 leader_election.cc:343] T fa36a9cfa4fe43418245de193502470f P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:30.846210 20350 leader_election.cc:290] T fa36a9cfa4fe43418245de193502470f P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 election: Requested vote from peers 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287), 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955)
I20251023 07:59:30.846629 20273 tablet_bootstrap.cc:654] T 7060af9ee4a34ecca18900b2f272e1d1 P d1379e91aa9c41629cd25262571beb2c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:30.855760 20272 ts_tablet_manager.cc:1434] T aa253535ba594367a12fda3dea3b75d4 P 35e7d1ade024444486e63cf1b81e9626: Time spent starting tablet: real 0.021s user 0.001s sys 0.004s
I20251023 07:59:30.856761 20272 tablet_bootstrap.cc:492] T e2c26d408ee04105bd615b58287c82f9 P 35e7d1ade024444486e63cf1b81e9626: Bootstrap starting.
I20251023 07:59:30.863024 20272 tablet_bootstrap.cc:654] T e2c26d408ee04105bd615b58287c82f9 P 35e7d1ade024444486e63cf1b81e9626: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:30.864223 20150 raft_consensus.cc:2468] T fa36a9cfa4fe43418245de193502470f P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 1.
I20251023 07:59:30.875062 20336 consensus_queue.cc:1048] T db045d1b86484fe9987f82ce426362e5 P 35e7d1ade024444486e63cf1b81e9626 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:59:30.891974 19966 leader_election.cc:304] T fa36a9cfa4fe43418245de193502470f P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, d1379e91aa9c41629cd25262571beb2c; no voters: 65876a2b197c4ea6918f5cab47ded25c
I20251023 07:59:30.893234 20350 raft_consensus.cc:2804] T fa36a9cfa4fe43418245de193502470f P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:59:30.894833 20350 raft_consensus.cc:697] T fa36a9cfa4fe43418245de193502470f P d1379e91aa9c41629cd25262571beb2c [term 1 LEADER]: Becoming Leader. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Running, Role: LEADER
I20251023 07:59:30.895690 20350 consensus_queue.cc:237] T fa36a9cfa4fe43418245de193502470f P d1379e91aa9c41629cd25262571beb2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:30.918725 20274 tablet_bootstrap.cc:492] T fa36a9cfa4fe43418245de193502470f P 65876a2b197c4ea6918f5cab47ded25c: No bootstrap required, opened a new log
I20251023 07:59:30.919003 20272 tablet_bootstrap.cc:492] T e2c26d408ee04105bd615b58287c82f9 P 35e7d1ade024444486e63cf1b81e9626: No bootstrap required, opened a new log
I20251023 07:59:30.919529 20272 ts_tablet_manager.cc:1403] T e2c26d408ee04105bd615b58287c82f9 P 35e7d1ade024444486e63cf1b81e9626: Time spent bootstrapping tablet: real 0.063s user 0.024s sys 0.014s
I20251023 07:59:30.919426 20274 ts_tablet_manager.cc:1403] T fa36a9cfa4fe43418245de193502470f P 65876a2b197c4ea6918f5cab47ded25c: Time spent bootstrapping tablet: real 0.151s user 0.027s sys 0.016s
I20251023 07:59:30.922461 20272 raft_consensus.cc:359] T e2c26d408ee04105bd615b58287c82f9 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:30.923143 20272 raft_consensus.cc:385] T e2c26d408ee04105bd615b58287c82f9 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:30.923394 20272 raft_consensus.cc:740] T e2c26d408ee04105bd615b58287c82f9 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e7d1ade024444486e63cf1b81e9626, State: Initialized, Role: FOLLOWER
I20251023 07:59:30.924126 20272 consensus_queue.cc:260] T e2c26d408ee04105bd615b58287c82f9 P 35e7d1ade024444486e63cf1b81e9626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:30.924981 20274 raft_consensus.cc:359] T fa36a9cfa4fe43418245de193502470f P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:30.925951 20274 raft_consensus.cc:385] T fa36a9cfa4fe43418245de193502470f P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:30.926280 20274 raft_consensus.cc:740] T fa36a9cfa4fe43418245de193502470f P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65876a2b197c4ea6918f5cab47ded25c, State: Initialized, Role: FOLLOWER
I20251023 07:59:30.927105 20274 consensus_queue.cc:260] T fa36a9cfa4fe43418245de193502470f P 65876a2b197c4ea6918f5cab47ded25c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:30.931476 20272 ts_tablet_manager.cc:1434] T e2c26d408ee04105bd615b58287c82f9 P 35e7d1ade024444486e63cf1b81e9626: Time spent starting tablet: real 0.011s user 0.006s sys 0.001s
I20251023 07:59:30.932693 20272 tablet_bootstrap.cc:492] T 7060af9ee4a34ecca18900b2f272e1d1 P 35e7d1ade024444486e63cf1b81e9626: Bootstrap starting.
I20251023 07:59:30.936358 20274 ts_tablet_manager.cc:1434] T fa36a9cfa4fe43418245de193502470f P 65876a2b197c4ea6918f5cab47ded25c: Time spent starting tablet: real 0.016s user 0.008s sys 0.001s
I20251023 07:59:30.937582 20274 tablet_bootstrap.cc:492] T 0229047af3034761a2bf168928917afb P 65876a2b197c4ea6918f5cab47ded25c: Bootstrap starting.
I20251023 07:59:30.945019 20272 tablet_bootstrap.cc:654] T 7060af9ee4a34ecca18900b2f272e1d1 P 35e7d1ade024444486e63cf1b81e9626: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:30.953518 20274 tablet_bootstrap.cc:654] T 0229047af3034761a2bf168928917afb P 65876a2b197c4ea6918f5cab47ded25c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:30.960461 20347 consensus_queue.cc:1048] T db045d1b86484fe9987f82ce426362e5 P 35e7d1ade024444486e63cf1b81e9626 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:59:30.972172 20274 tablet_bootstrap.cc:492] T 0229047af3034761a2bf168928917afb P 65876a2b197c4ea6918f5cab47ded25c: No bootstrap required, opened a new log
I20251023 07:59:30.972739 20274 ts_tablet_manager.cc:1403] T 0229047af3034761a2bf168928917afb P 65876a2b197c4ea6918f5cab47ded25c: Time spent bootstrapping tablet: real 0.035s user 0.012s sys 0.003s
I20251023 07:59:30.975822 20274 raft_consensus.cc:359] T 0229047af3034761a2bf168928917afb P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:30.981500 20393 consensus_queue.cc:1048] T 7062462192fc4895b5a9f6a34c4a132a P 35e7d1ade024444486e63cf1b81e9626 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:59:30.984812 20274 raft_consensus.cc:385] T 0229047af3034761a2bf168928917afb P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:30.986752 20274 raft_consensus.cc:740] T 0229047af3034761a2bf168928917afb P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65876a2b197c4ea6918f5cab47ded25c, State: Initialized, Role: FOLLOWER
I20251023 07:59:30.987625 20274 consensus_queue.cc:260] T 0229047af3034761a2bf168928917afb P 65876a2b197c4ea6918f5cab47ded25c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
W20251023 07:59:30.990621 20116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.2:42309, user_credentials={real_user=slave}} blocked reactor thread for 47945.4us
I20251023 07:59:30.992506 20274 ts_tablet_manager.cc:1434] T 0229047af3034761a2bf168928917afb P 65876a2b197c4ea6918f5cab47ded25c: Time spent starting tablet: real 0.019s user 0.003s sys 0.006s
I20251023 07:59:30.993511 20274 tablet_bootstrap.cc:492] T 5855488965da49f4a33c7516f6a5596a P 65876a2b197c4ea6918f5cab47ded25c: Bootstrap starting.
I20251023 07:59:30.994982 20399 raft_consensus.cc:493] T aa253535ba594367a12fda3dea3b75d4 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:30.995777 20399 raft_consensus.cc:515] T aa253535ba594367a12fda3dea3b75d4 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:31.003463 20282 consensus_queue.cc:1048] T 7062462192fc4895b5a9f6a34c4a132a P 35e7d1ade024444486e63cf1b81e9626 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:59:31.006299 20274 tablet_bootstrap.cc:654] T 5855488965da49f4a33c7516f6a5596a P 65876a2b197c4ea6918f5cab47ded25c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:31.053676 20350 consensus_queue.cc:1048] T 92fae2a393404d8998ad2747fbd08cc9 P d1379e91aa9c41629cd25262571beb2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:59:31.053931 20400 consensus_queue.cc:1048] T 7d599e4b62364f04b966ca88e16b560a P 0f412334fb994ff0ab492afde64f5855 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:59:31.059059 20414 raft_consensus.cc:493] T 0229047af3034761a2bf168928917afb P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:31.059612 20414 raft_consensus.cc:515] T 0229047af3034761a2bf168928917afb P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:31.075897 20274 tablet_bootstrap.cc:492] T 5855488965da49f4a33c7516f6a5596a P 65876a2b197c4ea6918f5cab47ded25c: No bootstrap required, opened a new log
I20251023 07:59:31.076699 20274 ts_tablet_manager.cc:1403] T 5855488965da49f4a33c7516f6a5596a P 65876a2b197c4ea6918f5cab47ded25c: Time spent bootstrapping tablet: real 0.083s user 0.013s sys 0.001s
I20251023 07:59:31.082346 20002 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aa253535ba594367a12fda3dea3b75d4" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:31.083511 20002 raft_consensus.cc:2468] T aa253535ba594367a12fda3dea3b75d4 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f412334fb994ff0ab492afde64f5855 in term 0.
I20251023 07:59:31.084112 20414 leader_election.cc:290] T 0229047af3034761a2bf168928917afb P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865), 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309)
I20251023 07:59:31.084705 20003 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0229047af3034761a2bf168928917afb" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:31.085595 20118 leader_election.cc:304] T aa253535ba594367a12fda3dea3b75d4 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, d1379e91aa9c41629cd25262571beb2c; no voters:
W20251023 07:59:31.086206 20192 leader_election.cc:343] T 0229047af3034761a2bf168928917afb P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:31.086723 20400 raft_consensus.cc:2804] T aa253535ba594367a12fda3dea3b75d4 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:31.087217 20400 raft_consensus.cc:493] T aa253535ba594367a12fda3dea3b75d4 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:31.087608 20400 raft_consensus.cc:3060] T aa253535ba594367a12fda3dea3b75d4 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:31.088698 19896 catalog_manager.cc:5649] T fa36a9cfa4fe43418245de193502470f P d1379e91aa9c41629cd25262571beb2c reported cstate change: term changed from 0 to 1, leader changed from <none> to d1379e91aa9c41629cd25262571beb2c (127.16.126.1). New cstate: current_term: 1 leader_uuid: "d1379e91aa9c41629cd25262571beb2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: HEALTHY } } }
I20251023 07:59:31.095933 20350 consensus_queue.cc:1048] T 076aca7c8ecb4f34af0d457fcee0e585 P d1379e91aa9c41629cd25262571beb2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:59:31.111626 20273 tablet_bootstrap.cc:492] T 7060af9ee4a34ecca18900b2f272e1d1 P d1379e91aa9c41629cd25262571beb2c: No bootstrap required, opened a new log
I20251023 07:59:31.112224 20273 ts_tablet_manager.cc:1403] T 7060af9ee4a34ecca18900b2f272e1d1 P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.381s user 0.072s sys 0.134s
I20251023 07:59:31.109613 20309 raft_consensus.cc:493] T 791953f9d44946eaa145c5857557a5e4 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:31.118490 20309 raft_consensus.cc:515] T 791953f9d44946eaa145c5857557a5e4 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:31.128484 20309 leader_election.cc:290] T 791953f9d44946eaa145c5857557a5e4 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309), 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955)
I20251023 07:59:31.129791 20076 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aa253535ba594367a12fda3dea3b75d4" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
I20251023 07:59:31.131846 20076 raft_consensus.cc:2468] T aa253535ba594367a12fda3dea3b75d4 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f412334fb994ff0ab492afde64f5855 in term 0.
I20251023 07:59:31.130093 20223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "791953f9d44946eaa145c5857557a5e4" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c" is_pre_election: true
I20251023 07:59:31.134043 20223 raft_consensus.cc:2468] T 791953f9d44946eaa145c5857557a5e4 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f412334fb994ff0ab492afde64f5855 in term 0.
I20251023 07:59:31.130167 20075 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "791953f9d44946eaa145c5857557a5e4" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
I20251023 07:59:31.119565 20360 raft_consensus.cc:493] T 7d599e4b62364f04b966ca88e16b560a P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:31.122424 20399 leader_election.cc:290] T aa253535ba594367a12fda3dea3b75d4 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865), 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309)
I20251023 07:59:31.140129 20117 leader_election.cc:304] T 791953f9d44946eaa145c5857557a5e4 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, 65876a2b197c4ea6918f5cab47ded25c; no voters:
I20251023 07:59:31.146107 20075 raft_consensus.cc:3060] T e2c26d408ee04105bd615b58287c82f9 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:31.145671 20360 raft_consensus.cc:515] T 7d599e4b62364f04b966ca88e16b560a P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:31.146703 20076 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0229047af3034761a2bf168928917afb" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
W20251023 07:59:31.149794 19949 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20251023 07:59:31.150447 20400 raft_consensus.cc:515] T aa253535ba594367a12fda3dea3b75d4 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:31.155510 20392 consensus_queue.cc:1048] T 92fae2a393404d8998ad2747fbd08cc9 P d1379e91aa9c41629cd25262571beb2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:59:31.159844 20274 raft_consensus.cc:359] T 5855488965da49f4a33c7516f6a5596a P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:31.167917 20274 raft_consensus.cc:385] T 5855488965da49f4a33c7516f6a5596a P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:31.162633 20273 raft_consensus.cc:359] T 7060af9ee4a34ecca18900b2f272e1d1 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:31.168710 20273 raft_consensus.cc:385] T 7060af9ee4a34ecca18900b2f272e1d1 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:31.168939 20273 raft_consensus.cc:740] T 7060af9ee4a34ecca18900b2f272e1d1 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
W20251023 07:59:31.164948 20116 leader_election.cc:343] T 791953f9d44946eaa145c5857557a5e4 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:31.171505 20272 tablet_bootstrap.cc:492] T 7060af9ee4a34ecca18900b2f272e1d1 P 35e7d1ade024444486e63cf1b81e9626: No bootstrap required, opened a new log
I20251023 07:59:31.172024 20272 ts_tablet_manager.cc:1403] T 7060af9ee4a34ecca18900b2f272e1d1 P 35e7d1ade024444486e63cf1b81e9626: Time spent bootstrapping tablet: real 0.240s user 0.051s sys 0.099s
I20251023 07:59:31.174548 20272 raft_consensus.cc:359] T 7060af9ee4a34ecca18900b2f272e1d1 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:31.175362 20272 raft_consensus.cc:385] T 7060af9ee4a34ecca18900b2f272e1d1 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:31.175745 20272 raft_consensus.cc:740] T 7060af9ee4a34ecca18900b2f272e1d1 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e7d1ade024444486e63cf1b81e9626, State: Initialized, Role: FOLLOWER
I20251023 07:59:31.176573 20272 consensus_queue.cc:260] T 7060af9ee4a34ecca18900b2f272e1d1 P 35e7d1ade024444486e63cf1b81e9626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:31.168289 20274 raft_consensus.cc:740] T 5855488965da49f4a33c7516f6a5596a P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65876a2b197c4ea6918f5cab47ded25c, State: Initialized, Role: FOLLOWER
I20251023 07:59:31.178349 20274 consensus_queue.cc:260] T 5855488965da49f4a33c7516f6a5596a P 65876a2b197c4ea6918f5cab47ded25c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:31.179306 20273 consensus_queue.cc:260] T 7060af9ee4a34ecca18900b2f272e1d1 P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
W20251023 07:59:31.180379 20190 leader_election.cc:343] T 0229047af3034761a2bf168928917afb P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:31.180861 20190 leader_election.cc:304] T 0229047af3034761a2bf168928917afb P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65876a2b197c4ea6918f5cab47ded25c; no voters: 35e7d1ade024444486e63cf1b81e9626, d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:31.181841 20272 ts_tablet_manager.cc:1434] T 7060af9ee4a34ecca18900b2f272e1d1 P 35e7d1ade024444486e63cf1b81e9626: Time spent starting tablet: real 0.010s user 0.009s sys 0.000s
I20251023 07:59:31.182238 20414 raft_consensus.cc:2749] T 0229047af3034761a2bf168928917afb P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:59:31.182837 20272 tablet_bootstrap.cc:492] T 791953f9d44946eaa145c5857557a5e4 P 35e7d1ade024444486e63cf1b81e9626: Bootstrap starting.
I20251023 07:59:31.191149 20273 ts_tablet_manager.cc:1434] T 7060af9ee4a34ecca18900b2f272e1d1 P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.079s user 0.005s sys 0.001s
I20251023 07:59:31.166020 20309 raft_consensus.cc:2804] T 791953f9d44946eaa145c5857557a5e4 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:31.195688 20274 ts_tablet_manager.cc:1434] T 5855488965da49f4a33c7516f6a5596a P 65876a2b197c4ea6918f5cab47ded25c: Time spent starting tablet: real 0.119s user 0.004s sys 0.003s
I20251023 07:59:31.200367 20360 leader_election.cc:290] T 7d599e4b62364f04b966ca88e16b560a P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309), 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287)
I20251023 07:59:31.201839 20076 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7d599e4b62364f04b966ca88e16b560a" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
I20251023 07:59:31.210714 20345 consensus_queue.cc:1048] T 076aca7c8ecb4f34af0d457fcee0e585 P d1379e91aa9c41629cd25262571beb2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20251023 07:59:31.212164 20433 log.cc:927] Time spent T 076aca7c8ecb4f34af0d457fcee0e585 P 65876a2b197c4ea6918f5cab47ded25c: Append to log took a long time: real 0.101s user 0.001s sys 0.000s
I20251023 07:59:31.196699 20309 raft_consensus.cc:493] T 791953f9d44946eaa145c5857557a5e4 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:31.213874 20309 raft_consensus.cc:3060] T 791953f9d44946eaa145c5857557a5e4 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:31.221166 20271 tablet_bootstrap.cc:492] T 5855488965da49f4a33c7516f6a5596a P 0f412334fb994ff0ab492afde64f5855: No bootstrap required, opened a new log
I20251023 07:59:31.221750 20271 ts_tablet_manager.cc:1403] T 5855488965da49f4a33c7516f6a5596a P 0f412334fb994ff0ab492afde64f5855: Time spent bootstrapping tablet: real 0.391s user 0.030s sys 0.102s
I20251023 07:59:31.224543 20272 tablet_bootstrap.cc:654] T 791953f9d44946eaa145c5857557a5e4 P 35e7d1ade024444486e63cf1b81e9626: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:31.224375 20271 raft_consensus.cc:359] T 5855488965da49f4a33c7516f6a5596a P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:31.225111 20271 raft_consensus.cc:385] T 5855488965da49f4a33c7516f6a5596a P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:31.225392 20271 raft_consensus.cc:740] T 5855488965da49f4a33c7516f6a5596a P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Initialized, Role: FOLLOWER
I20251023 07:59:31.226071 20271 consensus_queue.cc:260] T 5855488965da49f4a33c7516f6a5596a P 0f412334fb994ff0ab492afde64f5855 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:31.227960 20274 tablet_bootstrap.cc:492] T e08e797f71f1483a9c2b5899554a6dec P 65876a2b197c4ea6918f5cab47ded25c: Bootstrap starting.
I20251023 07:59:31.228758 20271 ts_tablet_manager.cc:1434] T 5855488965da49f4a33c7516f6a5596a P 0f412334fb994ff0ab492afde64f5855: Time spent starting tablet: real 0.007s user 0.004s sys 0.000s
I20251023 07:59:31.229954 20271 tablet_bootstrap.cc:492] T e08e797f71f1483a9c2b5899554a6dec P 0f412334fb994ff0ab492afde64f5855: Bootstrap starting.
I20251023 07:59:31.234987 20273 tablet_bootstrap.cc:492] T 0229047af3034761a2bf168928917afb P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:31.239653 20271 tablet_bootstrap.cc:654] T e08e797f71f1483a9c2b5899554a6dec P 0f412334fb994ff0ab492afde64f5855: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:31.239871 20414 consensus_queue.cc:1048] T e2c26d408ee04105bd615b58287c82f9 P 65876a2b197c4ea6918f5cab47ded25c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:59:31.255384 20400 leader_election.cc:290] T aa253535ba594367a12fda3dea3b75d4 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 election: Requested vote from peers d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865), 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309)
I20251023 07:59:31.263998 20438 raft_consensus.cc:493] T 7060af9ee4a34ecca18900b2f272e1d1 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:31.264700 20273 tablet_bootstrap.cc:654] T 0229047af3034761a2bf168928917afb P d1379e91aa9c41629cd25262571beb2c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:31.264528 20438 raft_consensus.cc:515] T 7060af9ee4a34ecca18900b2f272e1d1 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:31.268260 20001 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aa253535ba594367a12fda3dea3b75d4" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c"
I20251023 07:59:31.269129 20001 raft_consensus.cc:3060] T aa253535ba594367a12fda3dea3b75d4 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:31.277313 20274 tablet_bootstrap.cc:654] T e08e797f71f1483a9c2b5899554a6dec P 65876a2b197c4ea6918f5cab47ded25c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:31.277312 20438 leader_election.cc:290] T 7060af9ee4a34ecca18900b2f272e1d1 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865), 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309)
I20251023 07:59:31.278249 20360 consensus_queue.cc:1048] T e2c26d408ee04105bd615b58287c82f9 P 65876a2b197c4ea6918f5cab47ded25c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:59:31.280383 20000 raft_consensus.cc:1275] T d214412da5754dd0a08f25d50b5584f1 P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Refusing update from remote peer 0f412334fb994ff0ab492afde64f5855: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20251023 07:59:31.281796 20003 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7060af9ee4a34ecca18900b2f272e1d1" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:31.258970 20309 raft_consensus.cc:515] T 791953f9d44946eaa145c5857557a5e4 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:31.298323 20439 consensus_queue.cc:1048] T d214412da5754dd0a08f25d50b5584f1 P 0f412334fb994ff0ab492afde64f5855 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:59:31.290781 20003 raft_consensus.cc:2468] T 7060af9ee4a34ecca18900b2f272e1d1 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f412334fb994ff0ab492afde64f5855 in term 0.
I20251023 07:59:31.300863 20345 raft_consensus.cc:493] T 7060af9ee4a34ecca18900b2f272e1d1 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:31.301352 20345 raft_consensus.cc:515] T 7060af9ee4a34ecca18900b2f272e1d1 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:31.302323 20309 leader_election.cc:290] T 791953f9d44946eaa145c5857557a5e4 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 election: Requested vote from peers 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309), 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955)
I20251023 07:59:31.304939 20001 raft_consensus.cc:2468] T aa253535ba594367a12fda3dea3b75d4 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f412334fb994ff0ab492afde64f5855 in term 1.
I20251023 07:59:31.306103 20075 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7060af9ee4a34ecca18900b2f272e1d1" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
I20251023 07:59:31.308034 20075 raft_consensus.cc:2468] T 7060af9ee4a34ecca18900b2f272e1d1 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 0.
I20251023 07:59:31.310343 20118 leader_election.cc:304] T 7060af9ee4a34ecca18900b2f272e1d1 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, d1379e91aa9c41629cd25262571beb2c; no voters:
I20251023 07:59:31.310618 19967 leader_election.cc:304] T 7060af9ee4a34ecca18900b2f272e1d1 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35e7d1ade024444486e63cf1b81e9626, d1379e91aa9c41629cd25262571beb2c; no voters:
W20251023 07:59:31.285853 20116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.2:42309, user_credentials={real_user=slave}} blocked reactor thread for 81259.2us
I20251023 07:59:31.311484 20350 raft_consensus.cc:2804] T 7060af9ee4a34ecca18900b2f272e1d1 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:31.315852 20350 raft_consensus.cc:493] T 7060af9ee4a34ecca18900b2f272e1d1 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:31.316289 20350 raft_consensus.cc:3060] T 7060af9ee4a34ecca18900b2f272e1d1 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:31.319940 20118 leader_election.cc:304] T aa253535ba594367a12fda3dea3b75d4 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, d1379e91aa9c41629cd25262571beb2c; no voters:
I20251023 07:59:31.324345 20438 raft_consensus.cc:2804] T aa253535ba594367a12fda3dea3b75d4 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:59:31.325469 20438 raft_consensus.cc:697] T aa253535ba594367a12fda3dea3b75d4 P 0f412334fb994ff0ab492afde64f5855 [term 1 LEADER]: Becoming Leader. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Running, Role: LEADER
I20251023 07:59:31.323092 20152 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7060af9ee4a34ecca18900b2f272e1d1" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855" is_pre_election: true
I20251023 07:59:31.321076 20345 leader_election.cc:290] T 7060af9ee4a34ecca18900b2f272e1d1 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309), 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287)
I20251023 07:59:31.325945 20224 raft_consensus.cc:3060] T 7d599e4b62364f04b966ca88e16b560a P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:31.328510 20438 consensus_queue.cc:237] T aa253535ba594367a12fda3dea3b75d4 P 0f412334fb994ff0ab492afde64f5855 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:31.335601 20272 tablet_bootstrap.cc:492] T 791953f9d44946eaa145c5857557a5e4 P 35e7d1ade024444486e63cf1b81e9626: No bootstrap required, opened a new log
I20251023 07:59:31.336212 20341 raft_consensus.cc:493] T fa36a9cfa4fe43418245de193502470f P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:31.343662 20435 consensus_queue.cc:1048] T 82812175f15d4d3dae73f31641a1e583 P 35e7d1ade024444486e63cf1b81e9626 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:59:31.311574 20436 raft_consensus.cc:2804] T 7060af9ee4a34ecca18900b2f272e1d1 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:31.345640 20272 ts_tablet_manager.cc:1403] T 791953f9d44946eaa145c5857557a5e4 P 35e7d1ade024444486e63cf1b81e9626: Time spent bootstrapping tablet: real 0.163s user 0.012s sys 0.002s
I20251023 07:59:31.346884 20341 raft_consensus.cc:515] T fa36a9cfa4fe43418245de193502470f P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:31.353884 20150 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7d599e4b62364f04b966ca88e16b560a" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855" is_pre_election: true
I20251023 07:59:31.354967 20075 raft_consensus.cc:1275] T d214412da5754dd0a08f25d50b5584f1 P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Refusing update from remote peer 0f412334fb994ff0ab492afde64f5855: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20251023 07:59:31.351554 20436 raft_consensus.cc:493] T 7060af9ee4a34ecca18900b2f272e1d1 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:31.365942 20436 raft_consensus.cc:3060] T 7060af9ee4a34ecca18900b2f272e1d1 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:31.366881 20271 tablet_bootstrap.cc:492] T e08e797f71f1483a9c2b5899554a6dec P 0f412334fb994ff0ab492afde64f5855: No bootstrap required, opened a new log
I20251023 07:59:31.367800 20271 ts_tablet_manager.cc:1403] T e08e797f71f1483a9c2b5899554a6dec P 0f412334fb994ff0ab492afde64f5855: Time spent bootstrapping tablet: real 0.138s user 0.015s sys 0.002s
I20251023 07:59:31.368649 20341 leader_election.cc:290] T fa36a9cfa4fe43418245de193502470f P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:31.368989 20225 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "791953f9d44946eaa145c5857557a5e4" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c"
I20251023 07:59:31.369626 20225 raft_consensus.cc:3060] T 791953f9d44946eaa145c5857557a5e4 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:31.369736 20003 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fa36a9cfa4fe43418245de193502470f" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:31.370337 20271 raft_consensus.cc:359] T e08e797f71f1483a9c2b5899554a6dec P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:31.371026 20271 raft_consensus.cc:385] T e08e797f71f1483a9c2b5899554a6dec P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:31.371270 20271 raft_consensus.cc:740] T e08e797f71f1483a9c2b5899554a6dec P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Initialized, Role: FOLLOWER
I20251023 07:59:31.371613 20078 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "791953f9d44946eaa145c5857557a5e4" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626"
I20251023 07:59:31.373282 20271 consensus_queue.cc:260] T e08e797f71f1483a9c2b5899554a6dec P 0f412334fb994ff0ab492afde64f5855 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:31.377018 20075 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aa253535ba594367a12fda3dea3b75d4" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626"
I20251023 07:59:31.379132 20400 consensus_queue.cc:1048] T d214412da5754dd0a08f25d50b5584f1 P 0f412334fb994ff0ab492afde64f5855 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:59:31.380177 20075 raft_consensus.cc:3060] T aa253535ba594367a12fda3dea3b75d4 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:31.382264 20271 ts_tablet_manager.cc:1434] T e08e797f71f1483a9c2b5899554a6dec P 0f412334fb994ff0ab492afde64f5855: Time spent starting tablet: real 0.014s user 0.006s sys 0.000s
I20251023 07:59:31.398375 20271 tablet_bootstrap.cc:492] T a468f7a5913245b58705dc4f8560dade P 0f412334fb994ff0ab492afde64f5855: Bootstrap starting.
I20251023 07:59:31.374534 20336 consensus_queue.cc:1048] T 82812175f15d4d3dae73f31641a1e583 P 35e7d1ade024444486e63cf1b81e9626 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20251023 07:59:31.377617 20077 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7060af9ee4a34ecca18900b2f272e1d1" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
I20251023 07:59:31.388243 20272 raft_consensus.cc:359] T 791953f9d44946eaa145c5857557a5e4 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:31.404038 20272 raft_consensus.cc:385] T 791953f9d44946eaa145c5857557a5e4 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:31.404974 20077 raft_consensus.cc:2468] T 7060af9ee4a34ecca18900b2f272e1d1 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f412334fb994ff0ab492afde64f5855 in term 0.
W20251023 07:59:31.390779 20116 leader_election.cc:343] T 791953f9d44946eaa145c5857557a5e4 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:31.378485 20189 leader_election.cc:304] T 7d599e4b62364f04b966ca88e16b560a P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65876a2b197c4ea6918f5cab47ded25c; no voters: 0f412334fb994ff0ab492afde64f5855, 35e7d1ade024444486e63cf1b81e9626
I20251023 07:59:31.407692 20272 raft_consensus.cc:740] T 791953f9d44946eaa145c5857557a5e4 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e7d1ade024444486e63cf1b81e9626, State: Initialized, Role: FOLLOWER
I20251023 07:59:31.409248 20272 consensus_queue.cc:260] T 791953f9d44946eaa145c5857557a5e4 P 35e7d1ade024444486e63cf1b81e9626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:31.412927 20075 raft_consensus.cc:2468] T aa253535ba594367a12fda3dea3b75d4 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f412334fb994ff0ab492afde64f5855 in term 1.
I20251023 07:59:31.412487 20350 raft_consensus.cc:515] T 7060af9ee4a34ecca18900b2f272e1d1 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:31.416734 20350 leader_election.cc:290] T 7060af9ee4a34ecca18900b2f272e1d1 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 election: Requested vote from peers 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309), 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287)
I20251023 07:59:31.418560 20149 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7060af9ee4a34ecca18900b2f272e1d1" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855"
I20251023 07:59:31.420183 20075 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7060af9ee4a34ecca18900b2f272e1d1" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626"
I20251023 07:59:31.420838 20075 raft_consensus.cc:3060] T 7060af9ee4a34ecca18900b2f272e1d1 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:31.422019 20271 tablet_bootstrap.cc:654] T a468f7a5913245b58705dc4f8560dade P 0f412334fb994ff0ab492afde64f5855: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:31.423957 20273 tablet_bootstrap.cc:492] T 0229047af3034761a2bf168928917afb P d1379e91aa9c41629cd25262571beb2c: No bootstrap required, opened a new log
I20251023 07:59:31.425009 20273 ts_tablet_manager.cc:1403] T 0229047af3034761a2bf168928917afb P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.190s user 0.015s sys 0.007s
I20251023 07:59:31.425652 20272 ts_tablet_manager.cc:1434] T 791953f9d44946eaa145c5857557a5e4 P 35e7d1ade024444486e63cf1b81e9626: Time spent starting tablet: real 0.078s user 0.007s sys 0.000s
I20251023 07:59:31.426750 20272 tablet_bootstrap.cc:492] T 0229047af3034761a2bf168928917afb P 35e7d1ade024444486e63cf1b81e9626: Bootstrap starting.
I20251023 07:59:31.432250 20273 raft_consensus.cc:359] T 0229047af3034761a2bf168928917afb P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:31.432974 20273 raft_consensus.cc:385] T 0229047af3034761a2bf168928917afb P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:31.433249 20273 raft_consensus.cc:740] T 0229047af3034761a2bf168928917afb P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:31.434062 20273 consensus_queue.cc:260] T 0229047af3034761a2bf168928917afb P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:31.436461 20273 ts_tablet_manager.cc:1434] T 0229047af3034761a2bf168928917afb P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.011s user 0.005s sys 0.001s
I20251023 07:59:31.437233 20075 raft_consensus.cc:2468] T 7060af9ee4a34ecca18900b2f272e1d1 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 1.
I20251023 07:59:31.437587 20273 tablet_bootstrap.cc:492] T 5855488965da49f4a33c7516f6a5596a P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:31.442265 20272 tablet_bootstrap.cc:654] T 0229047af3034761a2bf168928917afb P 35e7d1ade024444486e63cf1b81e9626: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:31.449510 19967 leader_election.cc:304] T 7060af9ee4a34ecca18900b2f272e1d1 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35e7d1ade024444486e63cf1b81e9626, d1379e91aa9c41629cd25262571beb2c; no voters: 0f412334fb994ff0ab492afde64f5855
I20251023 07:59:31.451602 20448 raft_consensus.cc:2804] T 7060af9ee4a34ecca18900b2f272e1d1 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:59:31.452668 20341 raft_consensus.cc:2749] T 7d599e4b62364f04b966ca88e16b560a P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:59:31.453487 20448 raft_consensus.cc:697] T 7060af9ee4a34ecca18900b2f272e1d1 P d1379e91aa9c41629cd25262571beb2c [term 1 LEADER]: Becoming Leader. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Running, Role: LEADER
I20251023 07:59:31.456463 20448 consensus_queue.cc:237] T 7060af9ee4a34ecca18900b2f272e1d1 P d1379e91aa9c41629cd25262571beb2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:31.460071 20150 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fa36a9cfa4fe43418245de193502470f" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855" is_pre_election: true
I20251023 07:59:31.460964 20150 raft_consensus.cc:2393] T fa36a9cfa4fe43418245de193502470f P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65876a2b197c4ea6918f5cab47ded25c in current term 1: Already voted for candidate d1379e91aa9c41629cd25262571beb2c in this term.
I20251023 07:59:31.441263 20225 raft_consensus.cc:2468] T 791953f9d44946eaa145c5857557a5e4 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f412334fb994ff0ab492afde64f5855 in term 1.
I20251023 07:59:31.468189 20189 leader_election.cc:304] T fa36a9cfa4fe43418245de193502470f P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65876a2b197c4ea6918f5cab47ded25c; no voters: 0f412334fb994ff0ab492afde64f5855, d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:31.469158 20447 raft_consensus.cc:3060] T fa36a9cfa4fe43418245de193502470f P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:31.471937 20436 raft_consensus.cc:515] T 7060af9ee4a34ecca18900b2f272e1d1 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:31.473227 20152 raft_consensus.cc:2393] T 7060af9ee4a34ecca18900b2f272e1d1 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d1379e91aa9c41629cd25262571beb2c in current term 1: Already voted for candidate 0f412334fb994ff0ab492afde64f5855 in this term.
I20251023 07:59:31.472764 20117 leader_election.cc:304] T 791953f9d44946eaa145c5857557a5e4 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, 65876a2b197c4ea6918f5cab47ded25c; no voters: 35e7d1ade024444486e63cf1b81e9626
I20251023 07:59:31.477800 20001 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7060af9ee4a34ecca18900b2f272e1d1" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c"
I20251023 07:59:31.496300 19900 catalog_manager.cc:5649] T aa253535ba594367a12fda3dea3b75d4 P 0f412334fb994ff0ab492afde64f5855 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f412334fb994ff0ab492afde64f5855 (127.16.126.3). New cstate: current_term: 1 leader_uuid: "0f412334fb994ff0ab492afde64f5855" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } health_report { overall_health: HEALTHY } } }
I20251023 07:59:31.479568 20438 consensus_queue.cc:1048] T 7d599e4b62364f04b966ca88e16b560a P 0f412334fb994ff0ab492afde64f5855 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20251023 07:59:31.491127 20399 raft_consensus.cc:493] T 5855488965da49f4a33c7516f6a5596a P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:31.498093 20399 raft_consensus.cc:515] T 5855488965da49f4a33c7516f6a5596a P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:31.490288 20448 consensus_queue.cc:1048] T fa36a9cfa4fe43418245de193502470f P d1379e91aa9c41629cd25262571beb2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20251023 07:59:31.500123 20399 leader_election.cc:290] T 5855488965da49f4a33c7516f6a5596a P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:31.502318 20274 tablet_bootstrap.cc:492] T e08e797f71f1483a9c2b5899554a6dec P 65876a2b197c4ea6918f5cab47ded25c: No bootstrap required, opened a new log
I20251023 07:59:31.502849 20274 ts_tablet_manager.cc:1403] T e08e797f71f1483a9c2b5899554a6dec P 65876a2b197c4ea6918f5cab47ded25c: Time spent bootstrapping tablet: real 0.275s user 0.018s sys 0.013s
I20251023 07:59:31.489552 20400 raft_consensus.cc:2804] T 791953f9d44946eaa145c5857557a5e4 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:59:31.505854 20400 raft_consensus.cc:697] T 791953f9d44946eaa145c5857557a5e4 P 0f412334fb994ff0ab492afde64f5855 [term 1 LEADER]: Becoming Leader. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Running, Role: LEADER
I20251023 07:59:31.508975 20400 consensus_queue.cc:237] T 791953f9d44946eaa145c5857557a5e4 P 0f412334fb994ff0ab492afde64f5855 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:31.505414 20274 raft_consensus.cc:359] T e08e797f71f1483a9c2b5899554a6dec P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:31.512732 20274 raft_consensus.cc:385] T e08e797f71f1483a9c2b5899554a6dec P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:31.513002 20274 raft_consensus.cc:740] T e08e797f71f1483a9c2b5899554a6dec P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65876a2b197c4ea6918f5cab47ded25c, State: Initialized, Role: FOLLOWER
I20251023 07:59:31.506357 20001 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5855488965da49f4a33c7516f6a5596a" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:31.514060 20274 consensus_queue.cc:260] T e08e797f71f1483a9c2b5899554a6dec P 65876a2b197c4ea6918f5cab47ded25c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:31.507696 20077 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7060af9ee4a34ecca18900b2f272e1d1" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626"
I20251023 07:59:31.515606 20077 raft_consensus.cc:2393] T 7060af9ee4a34ecca18900b2f272e1d1 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f412334fb994ff0ab492afde64f5855 in current term 1: Already voted for candidate d1379e91aa9c41629cd25262571beb2c in this term.
I20251023 07:59:31.517834 20274 ts_tablet_manager.cc:1434] T e08e797f71f1483a9c2b5899554a6dec P 65876a2b197c4ea6918f5cab47ded25c: Time spent starting tablet: real 0.015s user 0.008s sys 0.000s
I20251023 07:59:31.518994 20274 tablet_bootstrap.cc:492] T a0ff2fc9a3c04716ab748f95a00dec76 P 65876a2b197c4ea6918f5cab47ded25c: Bootstrap starting.
I20251023 07:59:31.490819 20436 leader_election.cc:290] T 7060af9ee4a34ecca18900b2f272e1d1 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 election: Requested vote from peers d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865), 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309)
W20251023 07:59:31.534653 20451 log.cc:927] Time spent T 82812175f15d4d3dae73f31641a1e583 P 0f412334fb994ff0ab492afde64f5855: Append to log took a long time: real 0.096s user 0.001s sys 0.000s
W20251023 07:59:31.521462 20118 leader_election.cc:343] T 5855488965da49f4a33c7516f6a5596a P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:31.528000 20116 leader_election.cc:304] T 7060af9ee4a34ecca18900b2f272e1d1 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855; no voters: 35e7d1ade024444486e63cf1b81e9626, d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:31.536978 20223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5855488965da49f4a33c7516f6a5596a" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c" is_pre_election: true
I20251023 07:59:31.544076 20223 raft_consensus.cc:2468] T 5855488965da49f4a33c7516f6a5596a P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f412334fb994ff0ab492afde64f5855 in term 0.
I20251023 07:59:31.543597 20436 raft_consensus.cc:2749] T 7060af9ee4a34ecca18900b2f272e1d1 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20251023 07:59:31.555447 20273 tablet_bootstrap.cc:654] T 5855488965da49f4a33c7516f6a5596a P d1379e91aa9c41629cd25262571beb2c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:31.557521 20117 leader_election.cc:304] T 5855488965da49f4a33c7516f6a5596a P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, 65876a2b197c4ea6918f5cab47ded25c; no voters: d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:31.563966 20274 tablet_bootstrap.cc:654] T a0ff2fc9a3c04716ab748f95a00dec76 P 65876a2b197c4ea6918f5cab47ded25c: Neither blocks nor log segments found. Creating new log.
W20251023 07:59:31.564446 20452 log.cc:927] Time spent T e2c26d408ee04105bd615b58287c82f9 P d1379e91aa9c41629cd25262571beb2c: Append to log took a long time: real 0.067s user 0.002s sys 0.001s
I20251023 07:59:31.575966 20271 tablet_bootstrap.cc:492] T a468f7a5913245b58705dc4f8560dade P 0f412334fb994ff0ab492afde64f5855: No bootstrap required, opened a new log
I20251023 07:59:31.576655 20271 ts_tablet_manager.cc:1403] T a468f7a5913245b58705dc4f8560dade P 0f412334fb994ff0ab492afde64f5855: Time spent bootstrapping tablet: real 0.178s user 0.004s sys 0.034s
I20251023 07:59:31.562500 20436 raft_consensus.cc:2804] T 5855488965da49f4a33c7516f6a5596a P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:31.581482 20436 raft_consensus.cc:493] T 5855488965da49f4a33c7516f6a5596a P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:31.581861 20436 raft_consensus.cc:3060] T 5855488965da49f4a33c7516f6a5596a P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:31.585114 20271 raft_consensus.cc:359] T a468f7a5913245b58705dc4f8560dade P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:31.586194 20271 raft_consensus.cc:385] T a468f7a5913245b58705dc4f8560dade P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:31.586885 20271 raft_consensus.cc:740] T a468f7a5913245b58705dc4f8560dade P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Initialized, Role: FOLLOWER
I20251023 07:59:31.588160 20272 tablet_bootstrap.cc:492] T 0229047af3034761a2bf168928917afb P 35e7d1ade024444486e63cf1b81e9626: No bootstrap required, opened a new log
I20251023 07:59:31.587797 20271 consensus_queue.cc:260] T a468f7a5913245b58705dc4f8560dade P 0f412334fb994ff0ab492afde64f5855 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:31.588673 20272 ts_tablet_manager.cc:1403] T 0229047af3034761a2bf168928917afb P 35e7d1ade024444486e63cf1b81e9626: Time spent bootstrapping tablet: real 0.162s user 0.029s sys 0.017s
I20251023 07:59:31.588514 19901 catalog_manager.cc:5649] T 7060af9ee4a34ecca18900b2f272e1d1 P d1379e91aa9c41629cd25262571beb2c reported cstate change: term changed from 0 to 1, leader changed from <none> to d1379e91aa9c41629cd25262571beb2c (127.16.126.1). New cstate: current_term: 1 leader_uuid: "d1379e91aa9c41629cd25262571beb2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:31.590962 20271 ts_tablet_manager.cc:1434] T a468f7a5913245b58705dc4f8560dade P 0f412334fb994ff0ab492afde64f5855: Time spent starting tablet: real 0.014s user 0.005s sys 0.002s
I20251023 07:59:31.591704 20271 tablet_bootstrap.cc:492] T b4b44015a24e47ddae24244c3fb1fff1 P 0f412334fb994ff0ab492afde64f5855: Bootstrap starting.
I20251023 07:59:31.596875 20272 raft_consensus.cc:359] T 0229047af3034761a2bf168928917afb P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:31.598588 20272 raft_consensus.cc:385] T 0229047af3034761a2bf168928917afb P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:31.598784 20272 raft_consensus.cc:740] T 0229047af3034761a2bf168928917afb P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e7d1ade024444486e63cf1b81e9626, State: Initialized, Role: FOLLOWER
I20251023 07:59:31.561396 20447 raft_consensus.cc:2749] T fa36a9cfa4fe43418245de193502470f P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:59:31.599326 20272 consensus_queue.cc:260] T 0229047af3034761a2bf168928917afb P 35e7d1ade024444486e63cf1b81e9626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:31.608229 20272 ts_tablet_manager.cc:1434] T 0229047af3034761a2bf168928917afb P 35e7d1ade024444486e63cf1b81e9626: Time spent starting tablet: real 0.019s user 0.003s sys 0.002s
I20251023 07:59:31.609232 20272 tablet_bootstrap.cc:492] T e08e797f71f1483a9c2b5899554a6dec P 35e7d1ade024444486e63cf1b81e9626: Bootstrap starting.
I20251023 07:59:31.613746 20345 consensus_queue.cc:1048] T fa36a9cfa4fe43418245de193502470f P d1379e91aa9c41629cd25262571beb2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:59:31.616700 20273 tablet_bootstrap.cc:492] T 5855488965da49f4a33c7516f6a5596a P d1379e91aa9c41629cd25262571beb2c: No bootstrap required, opened a new log
I20251023 07:59:31.617219 20273 ts_tablet_manager.cc:1403] T 5855488965da49f4a33c7516f6a5596a P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.180s user 0.017s sys 0.002s
I20251023 07:59:31.619763 20273 raft_consensus.cc:359] T 5855488965da49f4a33c7516f6a5596a P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:31.620417 20273 raft_consensus.cc:385] T 5855488965da49f4a33c7516f6a5596a P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:31.620709 20273 raft_consensus.cc:740] T 5855488965da49f4a33c7516f6a5596a P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:31.623284 20274 tablet_bootstrap.cc:492] T a0ff2fc9a3c04716ab748f95a00dec76 P 65876a2b197c4ea6918f5cab47ded25c: No bootstrap required, opened a new log
I20251023 07:59:31.623880 20274 ts_tablet_manager.cc:1403] T a0ff2fc9a3c04716ab748f95a00dec76 P 65876a2b197c4ea6918f5cab47ded25c: Time spent bootstrapping tablet: real 0.105s user 0.018s sys 0.005s
I20251023 07:59:31.623704 20272 tablet_bootstrap.cc:654] T e08e797f71f1483a9c2b5899554a6dec P 35e7d1ade024444486e63cf1b81e9626: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:31.624248 20273 consensus_queue.cc:260] T 5855488965da49f4a33c7516f6a5596a P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:31.626835 20274 raft_consensus.cc:359] T a0ff2fc9a3c04716ab748f95a00dec76 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:31.627596 20274 raft_consensus.cc:385] T a0ff2fc9a3c04716ab748f95a00dec76 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:31.627878 20274 raft_consensus.cc:740] T a0ff2fc9a3c04716ab748f95a00dec76 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65876a2b197c4ea6918f5cab47ded25c, State: Initialized, Role: FOLLOWER
I20251023 07:59:31.626855 19900 catalog_manager.cc:5649] T 791953f9d44946eaa145c5857557a5e4 P 0f412334fb994ff0ab492afde64f5855 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f412334fb994ff0ab492afde64f5855 (127.16.126.3). New cstate: current_term: 1 leader_uuid: "0f412334fb994ff0ab492afde64f5855" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:31.628516 20274 consensus_queue.cc:260] T a0ff2fc9a3c04716ab748f95a00dec76 P 65876a2b197c4ea6918f5cab47ded25c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:31.630051 20273 ts_tablet_manager.cc:1434] T 5855488965da49f4a33c7516f6a5596a P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.013s user 0.005s sys 0.001s
I20251023 07:59:31.630380 20271 tablet_bootstrap.cc:654] T b4b44015a24e47ddae24244c3fb1fff1 P 0f412334fb994ff0ab492afde64f5855: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:31.630990 20273 tablet_bootstrap.cc:492] T a0ff2fc9a3c04716ab748f95a00dec76 P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:31.633744 20436 raft_consensus.cc:515] T 5855488965da49f4a33c7516f6a5596a P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:31.635740 20436 leader_election.cc:290] T 5855488965da49f4a33c7516f6a5596a P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 election: Requested vote from peers 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:31.636696 20225 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5855488965da49f4a33c7516f6a5596a" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c"
I20251023 07:59:31.637112 20273 tablet_bootstrap.cc:654] T a0ff2fc9a3c04716ab748f95a00dec76 P d1379e91aa9c41629cd25262571beb2c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:31.637527 20274 ts_tablet_manager.cc:1434] T a0ff2fc9a3c04716ab748f95a00dec76 P 65876a2b197c4ea6918f5cab47ded25c: Time spent starting tablet: real 0.013s user 0.009s sys 0.000s
I20251023 07:59:31.637727 20000 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5855488965da49f4a33c7516f6a5596a" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c"
I20251023 07:59:31.638299 20000 raft_consensus.cc:3060] T 5855488965da49f4a33c7516f6a5596a P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:31.638532 20274 tablet_bootstrap.cc:492] T c52243b5fda44e2fba36f6319b4c13e3 P 65876a2b197c4ea6918f5cab47ded25c: Bootstrap starting.
I20251023 07:59:31.641773 20272 tablet_bootstrap.cc:492] T e08e797f71f1483a9c2b5899554a6dec P 35e7d1ade024444486e63cf1b81e9626: No bootstrap required, opened a new log
I20251023 07:59:31.642266 20272 ts_tablet_manager.cc:1403] T e08e797f71f1483a9c2b5899554a6dec P 35e7d1ade024444486e63cf1b81e9626: Time spent bootstrapping tablet: real 0.033s user 0.004s sys 0.007s
I20251023 07:59:31.644531 20274 tablet_bootstrap.cc:654] T c52243b5fda44e2fba36f6319b4c13e3 P 65876a2b197c4ea6918f5cab47ded25c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:31.644747 20272 raft_consensus.cc:359] T e08e797f71f1483a9c2b5899554a6dec P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:31.645464 20272 raft_consensus.cc:385] T e08e797f71f1483a9c2b5899554a6dec P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:31.645754 20272 raft_consensus.cc:740] T e08e797f71f1483a9c2b5899554a6dec P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e7d1ade024444486e63cf1b81e9626, State: Initialized, Role: FOLLOWER
I20251023 07:59:31.645982 20000 raft_consensus.cc:2468] T 5855488965da49f4a33c7516f6a5596a P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f412334fb994ff0ab492afde64f5855 in term 1.
I20251023 07:59:31.647261 20118 leader_election.cc:304] T 5855488965da49f4a33c7516f6a5596a P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, d1379e91aa9c41629cd25262571beb2c; no voters:
I20251023 07:59:31.637279 20225 raft_consensus.cc:3060] T 5855488965da49f4a33c7516f6a5596a P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:31.648270 20436 raft_consensus.cc:2804] T 5855488965da49f4a33c7516f6a5596a P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:59:31.648813 20436 raft_consensus.cc:697] T 5855488965da49f4a33c7516f6a5596a P 0f412334fb994ff0ab492afde64f5855 [term 1 LEADER]: Becoming Leader. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Running, Role: LEADER
I20251023 07:59:31.648828 20272 consensus_queue.cc:260] T e08e797f71f1483a9c2b5899554a6dec P 35e7d1ade024444486e63cf1b81e9626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:31.649803 20436 consensus_queue.cc:237] T 5855488965da49f4a33c7516f6a5596a P 0f412334fb994ff0ab492afde64f5855 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:31.652356 20272 ts_tablet_manager.cc:1434] T e08e797f71f1483a9c2b5899554a6dec P 35e7d1ade024444486e63cf1b81e9626: Time spent starting tablet: real 0.010s user 0.006s sys 0.000s
I20251023 07:59:31.653391 20272 tablet_bootstrap.cc:492] T b4b44015a24e47ddae24244c3fb1fff1 P 35e7d1ade024444486e63cf1b81e9626: Bootstrap starting.
I20251023 07:59:31.657007 20225 raft_consensus.cc:2468] T 5855488965da49f4a33c7516f6a5596a P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f412334fb994ff0ab492afde64f5855 in term 1.
I20251023 07:59:31.658946 20272 tablet_bootstrap.cc:654] T b4b44015a24e47ddae24244c3fb1fff1 P 35e7d1ade024444486e63cf1b81e9626: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:31.664891 20273 tablet_bootstrap.cc:492] T a0ff2fc9a3c04716ab748f95a00dec76 P d1379e91aa9c41629cd25262571beb2c: No bootstrap required, opened a new log
I20251023 07:59:31.665398 20273 ts_tablet_manager.cc:1403] T a0ff2fc9a3c04716ab748f95a00dec76 P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.035s user 0.010s sys 0.000s
I20251023 07:59:31.666366 20271 tablet_bootstrap.cc:492] T b4b44015a24e47ddae24244c3fb1fff1 P 0f412334fb994ff0ab492afde64f5855: No bootstrap required, opened a new log
I20251023 07:59:31.666908 20271 ts_tablet_manager.cc:1403] T b4b44015a24e47ddae24244c3fb1fff1 P 0f412334fb994ff0ab492afde64f5855: Time spent bootstrapping tablet: real 0.075s user 0.008s sys 0.002s
I20251023 07:59:31.668020 20273 raft_consensus.cc:359] T a0ff2fc9a3c04716ab748f95a00dec76 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:31.668749 20273 raft_consensus.cc:385] T a0ff2fc9a3c04716ab748f95a00dec76 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:31.669121 20273 raft_consensus.cc:740] T a0ff2fc9a3c04716ab748f95a00dec76 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:31.669778 20274 tablet_bootstrap.cc:492] T c52243b5fda44e2fba36f6319b4c13e3 P 65876a2b197c4ea6918f5cab47ded25c: No bootstrap required, opened a new log
I20251023 07:59:31.670282 20274 ts_tablet_manager.cc:1403] T c52243b5fda44e2fba36f6319b4c13e3 P 65876a2b197c4ea6918f5cab47ded25c: Time spent bootstrapping tablet: real 0.032s user 0.013s sys 0.003s
I20251023 07:59:31.672955 20274 raft_consensus.cc:359] T c52243b5fda44e2fba36f6319b4c13e3 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:31.673635 20274 raft_consensus.cc:385] T c52243b5fda44e2fba36f6319b4c13e3 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:31.673906 20274 raft_consensus.cc:740] T c52243b5fda44e2fba36f6319b4c13e3 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65876a2b197c4ea6918f5cab47ded25c, State: Initialized, Role: FOLLOWER
I20251023 07:59:31.674623 20274 consensus_queue.cc:260] T c52243b5fda44e2fba36f6319b4c13e3 P 65876a2b197c4ea6918f5cab47ded25c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:31.675901 20273 consensus_queue.cc:260] T a0ff2fc9a3c04716ab748f95a00dec76 P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:31.676013 20271 raft_consensus.cc:359] T b4b44015a24e47ddae24244c3fb1fff1 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:31.676776 20271 raft_consensus.cc:385] T b4b44015a24e47ddae24244c3fb1fff1 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:31.677053 20271 raft_consensus.cc:740] T b4b44015a24e47ddae24244c3fb1fff1 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Initialized, Role: FOLLOWER
I20251023 07:59:31.677058 20274 ts_tablet_manager.cc:1434] T c52243b5fda44e2fba36f6319b4c13e3 P 65876a2b197c4ea6918f5cab47ded25c: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20251023 07:59:31.678767 20435 raft_consensus.cc:493] T 791953f9d44946eaa145c5857557a5e4 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:31.679241 20435 raft_consensus.cc:515] T 791953f9d44946eaa145c5857557a5e4 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:31.677776 20271 consensus_queue.cc:260] T b4b44015a24e47ddae24244c3fb1fff1 P 0f412334fb994ff0ab492afde64f5855 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:31.682250 20151 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "791953f9d44946eaa145c5857557a5e4" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855" is_pre_election: true
I20251023 07:59:31.682794 20435 leader_election.cc:290] T 791953f9d44946eaa145c5857557a5e4 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287), 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955)
I20251023 07:59:31.683966 20274 tablet_bootstrap.cc:492] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P 65876a2b197c4ea6918f5cab47ded25c: Bootstrap starting.
I20251023 07:59:31.685040 20271 ts_tablet_manager.cc:1434] T b4b44015a24e47ddae24244c3fb1fff1 P 0f412334fb994ff0ab492afde64f5855: Time spent starting tablet: real 0.018s user 0.004s sys 0.002s
I20251023 07:59:31.687692 20273 ts_tablet_manager.cc:1434] T a0ff2fc9a3c04716ab748f95a00dec76 P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.022s user 0.005s sys 0.001s
I20251023 07:59:31.688745 20273 tablet_bootstrap.cc:492] T e813343bd62640cc9976d0ae394aa315 P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:31.691215 20271 tablet_bootstrap.cc:492] T a0ff2fc9a3c04716ab748f95a00dec76 P 0f412334fb994ff0ab492afde64f5855: Bootstrap starting.
I20251023 07:59:31.693812 20225 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "791953f9d44946eaa145c5857557a5e4" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c" is_pre_election: true
I20251023 07:59:31.694337 20274 tablet_bootstrap.cc:654] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P 65876a2b197c4ea6918f5cab47ded25c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:31.694893 20225 raft_consensus.cc:2393] T 791953f9d44946eaa145c5857557a5e4 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35e7d1ade024444486e63cf1b81e9626 in current term 1: Already voted for candidate 0f412334fb994ff0ab492afde64f5855 in this term.
I20251023 07:59:31.695132 20273 tablet_bootstrap.cc:654] T e813343bd62640cc9976d0ae394aa315 P d1379e91aa9c41629cd25262571beb2c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:31.696161 20043 leader_election.cc:304] T 791953f9d44946eaa145c5857557a5e4 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35e7d1ade024444486e63cf1b81e9626; no voters: 0f412334fb994ff0ab492afde64f5855, 65876a2b197c4ea6918f5cab47ded25c
I20251023 07:59:31.697759 20435 raft_consensus.cc:3060] T 791953f9d44946eaa145c5857557a5e4 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:31.703387 20272 tablet_bootstrap.cc:492] T b4b44015a24e47ddae24244c3fb1fff1 P 35e7d1ade024444486e63cf1b81e9626: No bootstrap required, opened a new log
I20251023 07:59:31.703907 20272 ts_tablet_manager.cc:1403] T b4b44015a24e47ddae24244c3fb1fff1 P 35e7d1ade024444486e63cf1b81e9626: Time spent bootstrapping tablet: real 0.051s user 0.010s sys 0.003s
I20251023 07:59:31.706311 20274 tablet_bootstrap.cc:492] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P 65876a2b197c4ea6918f5cab47ded25c: No bootstrap required, opened a new log
I20251023 07:59:31.706800 20274 ts_tablet_manager.cc:1403] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P 65876a2b197c4ea6918f5cab47ded25c: Time spent bootstrapping tablet: real 0.023s user 0.012s sys 0.004s
I20251023 07:59:31.706523 20272 raft_consensus.cc:359] T b4b44015a24e47ddae24244c3fb1fff1 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:31.707264 20272 raft_consensus.cc:385] T b4b44015a24e47ddae24244c3fb1fff1 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:31.707566 20272 raft_consensus.cc:740] T b4b44015a24e47ddae24244c3fb1fff1 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e7d1ade024444486e63cf1b81e9626, State: Initialized, Role: FOLLOWER
I20251023 07:59:31.708256 20272 consensus_queue.cc:260] T b4b44015a24e47ddae24244c3fb1fff1 P 35e7d1ade024444486e63cf1b81e9626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:31.709353 20274 raft_consensus.cc:359] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:31.710063 20274 raft_consensus.cc:385] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:31.710326 20274 raft_consensus.cc:740] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65876a2b197c4ea6918f5cab47ded25c, State: Initialized, Role: FOLLOWER
I20251023 07:59:31.710969 20274 consensus_queue.cc:260] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P 65876a2b197c4ea6918f5cab47ded25c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:31.711333 20272 ts_tablet_manager.cc:1434] T b4b44015a24e47ddae24244c3fb1fff1 P 35e7d1ade024444486e63cf1b81e9626: Time spent starting tablet: real 0.007s user 0.005s sys 0.001s
I20251023 07:59:31.712383 20272 tablet_bootstrap.cc:492] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P 35e7d1ade024444486e63cf1b81e9626: Bootstrap starting.
I20251023 07:59:31.713558 20274 ts_tablet_manager.cc:1434] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P 65876a2b197c4ea6918f5cab47ded25c: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20251023 07:59:31.714504 20274 tablet_bootstrap.cc:492] T 58cef989d86d4b0c8401b4d6b2f890c0 P 65876a2b197c4ea6918f5cab47ded25c: Bootstrap starting.
I20251023 07:59:31.718046 20272 tablet_bootstrap.cc:654] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P 35e7d1ade024444486e63cf1b81e9626: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:31.719188 20271 tablet_bootstrap.cc:654] T a0ff2fc9a3c04716ab748f95a00dec76 P 0f412334fb994ff0ab492afde64f5855: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:31.720721 20447 raft_consensus.cc:493] T a0ff2fc9a3c04716ab748f95a00dec76 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:31.721215 20447 raft_consensus.cc:515] T a0ff2fc9a3c04716ab748f95a00dec76 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:31.722224 20435 raft_consensus.cc:2749] T 791953f9d44946eaa145c5857557a5e4 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:59:31.723357 20447 leader_election.cc:290] T a0ff2fc9a3c04716ab748f95a00dec76 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:31.725361 20151 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a0ff2fc9a3c04716ab748f95a00dec76" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855" is_pre_election: true
I20251023 07:59:31.725649 20000 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a0ff2fc9a3c04716ab748f95a00dec76" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:31.726258 20000 raft_consensus.cc:2468] T a0ff2fc9a3c04716ab748f95a00dec76 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65876a2b197c4ea6918f5cab47ded25c in term 0.
W20251023 07:59:31.726768 20189 leader_election.cc:343] T a0ff2fc9a3c04716ab748f95a00dec76 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:31.728670 20192 leader_election.cc:304] T a0ff2fc9a3c04716ab748f95a00dec76 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65876a2b197c4ea6918f5cab47ded25c, d1379e91aa9c41629cd25262571beb2c; no voters: 0f412334fb994ff0ab492afde64f5855
I20251023 07:59:31.729562 20447 raft_consensus.cc:2804] T a0ff2fc9a3c04716ab748f95a00dec76 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:31.730024 20271 tablet_bootstrap.cc:492] T a0ff2fc9a3c04716ab748f95a00dec76 P 0f412334fb994ff0ab492afde64f5855: No bootstrap required, opened a new log
I20251023 07:59:31.729972 20447 raft_consensus.cc:493] T a0ff2fc9a3c04716ab748f95a00dec76 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:31.729562 20435 raft_consensus.cc:493] T e08e797f71f1483a9c2b5899554a6dec P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:31.730448 20447 raft_consensus.cc:3060] T a0ff2fc9a3c04716ab748f95a00dec76 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:31.730728 20435 raft_consensus.cc:515] T e08e797f71f1483a9c2b5899554a6dec P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:31.732801 20435 leader_election.cc:290] T e08e797f71f1483a9c2b5899554a6dec P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287), 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955)
I20251023 07:59:31.733968 20225 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e08e797f71f1483a9c2b5899554a6dec" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c" is_pre_election: true
I20251023 07:59:31.734146 20151 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e08e797f71f1483a9c2b5899554a6dec" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855" is_pre_election: true
I20251023 07:59:31.734638 20225 raft_consensus.cc:2468] T e08e797f71f1483a9c2b5899554a6dec P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35e7d1ade024444486e63cf1b81e9626 in term 0.
I20251023 07:59:31.734989 20151 raft_consensus.cc:2468] T e08e797f71f1483a9c2b5899554a6dec P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35e7d1ade024444486e63cf1b81e9626 in term 0.
I20251023 07:59:31.735562 20274 tablet_bootstrap.cc:654] T 58cef989d86d4b0c8401b4d6b2f890c0 P 65876a2b197c4ea6918f5cab47ded25c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:31.735885 20043 leader_election.cc:304] T e08e797f71f1483a9c2b5899554a6dec P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35e7d1ade024444486e63cf1b81e9626, 65876a2b197c4ea6918f5cab47ded25c; no voters:
I20251023 07:59:31.743008 20336 raft_consensus.cc:2804] T e08e797f71f1483a9c2b5899554a6dec P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:31.743402 20336 raft_consensus.cc:493] T e08e797f71f1483a9c2b5899554a6dec P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:31.743747 20336 raft_consensus.cc:3060] T e08e797f71f1483a9c2b5899554a6dec P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:31.743842 20447 raft_consensus.cc:515] T a0ff2fc9a3c04716ab748f95a00dec76 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:31.750281 20271 ts_tablet_manager.cc:1403] T a0ff2fc9a3c04716ab748f95a00dec76 P 0f412334fb994ff0ab492afde64f5855: Time spent bootstrapping tablet: real 0.059s user 0.011s sys 0.000s
I20251023 07:59:31.753234 20336 raft_consensus.cc:515] T e08e797f71f1483a9c2b5899554a6dec P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:31.760514 20151 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e08e797f71f1483a9c2b5899554a6dec" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855"
I20251023 07:59:31.760732 20225 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e08e797f71f1483a9c2b5899554a6dec" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c"
I20251023 07:59:31.761162 20151 raft_consensus.cc:3060] T e08e797f71f1483a9c2b5899554a6dec P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:31.761631 20336 leader_election.cc:290] T e08e797f71f1483a9c2b5899554a6dec P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 election: Requested vote from peers 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287), 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955)
I20251023 07:59:31.761232 20225 raft_consensus.cc:3060] T e08e797f71f1483a9c2b5899554a6dec P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:31.768416 20271 raft_consensus.cc:359] T a0ff2fc9a3c04716ab748f95a00dec76 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:31.769188 20271 raft_consensus.cc:385] T a0ff2fc9a3c04716ab748f95a00dec76 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:31.769528 20271 raft_consensus.cc:740] T a0ff2fc9a3c04716ab748f95a00dec76 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Initialized, Role: FOLLOWER
I20251023 07:59:31.769287 20436 consensus_queue.cc:1048] T aa253535ba594367a12fda3dea3b75d4 P 0f412334fb994ff0ab492afde64f5855 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:59:31.770304 20271 consensus_queue.cc:260] T a0ff2fc9a3c04716ab748f95a00dec76 P 0f412334fb994ff0ab492afde64f5855 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:31.772858 20152 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a0ff2fc9a3c04716ab748f95a00dec76" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855"
I20251023 07:59:31.758708 19898 catalog_manager.cc:5649] T 5855488965da49f4a33c7516f6a5596a P 0f412334fb994ff0ab492afde64f5855 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f412334fb994ff0ab492afde64f5855 (127.16.126.3). New cstate: current_term: 1 leader_uuid: "0f412334fb994ff0ab492afde64f5855" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:31.775918 20152 raft_consensus.cc:3060] T a0ff2fc9a3c04716ab748f95a00dec76 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:31.781958 20271 ts_tablet_manager.cc:1434] T a0ff2fc9a3c04716ab748f95a00dec76 P 0f412334fb994ff0ab492afde64f5855: Time spent starting tablet: real 0.031s user 0.008s sys 0.000s
I20251023 07:59:31.782680 20341 raft_consensus.cc:493] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:31.785363 20341 raft_consensus.cc:515] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:31.789096 20341 leader_election.cc:290] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865), 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309)
I20251023 07:59:31.789119 20271 tablet_bootstrap.cc:492] T 58cef989d86d4b0c8401b4d6b2f890c0 P 0f412334fb994ff0ab492afde64f5855: Bootstrap starting.
I20251023 07:59:31.791743 20077 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0a62e9fdd3de46bcb61bebafbf9f7a2c" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
W20251023 07:59:31.793255 20190 leader_election.cc:343] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:31.801934 20447 leader_election.cc:290] T a0ff2fc9a3c04716ab748f95a00dec76 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 election: Requested vote from peers 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:31.802546 20000 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0a62e9fdd3de46bcb61bebafbf9f7a2c" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:31.805048 20151 raft_consensus.cc:2468] T e08e797f71f1483a9c2b5899554a6dec P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35e7d1ade024444486e63cf1b81e9626 in term 1.
I20251023 07:59:31.806032 20000 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a0ff2fc9a3c04716ab748f95a00dec76" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c"
I20251023 07:59:31.809900 20000 raft_consensus.cc:3060] T a0ff2fc9a3c04716ab748f95a00dec76 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:31.810551 20152 raft_consensus.cc:2468] T a0ff2fc9a3c04716ab748f95a00dec76 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65876a2b197c4ea6918f5cab47ded25c in term 1.
I20251023 07:59:31.812111 20189 leader_election.cc:304] T a0ff2fc9a3c04716ab748f95a00dec76 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, 65876a2b197c4ea6918f5cab47ded25c; no voters:
W20251023 07:59:31.806355 20192 leader_election.cc:343] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:31.809238 20271 tablet_bootstrap.cc:654] T 58cef989d86d4b0c8401b4d6b2f890c0 P 0f412334fb994ff0ab492afde64f5855: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:31.813886 20192 leader_election.cc:304] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65876a2b197c4ea6918f5cab47ded25c; no voters: 35e7d1ade024444486e63cf1b81e9626, d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:31.815725 20341 raft_consensus.cc:2804] T a0ff2fc9a3c04716ab748f95a00dec76 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:59:31.816336 20341 raft_consensus.cc:697] T a0ff2fc9a3c04716ab748f95a00dec76 P 65876a2b197c4ea6918f5cab47ded25c [term 1 LEADER]: Becoming Leader. State: Replica: 65876a2b197c4ea6918f5cab47ded25c, State: Running, Role: LEADER
I20251023 07:59:31.816442 20360 raft_consensus.cc:2749] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:59:31.817201 20341 consensus_queue.cc:237] T a0ff2fc9a3c04716ab748f95a00dec76 P 65876a2b197c4ea6918f5cab47ded25c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:31.827034 20000 raft_consensus.cc:2468] T a0ff2fc9a3c04716ab748f95a00dec76 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65876a2b197c4ea6918f5cab47ded25c in term 1.
I20251023 07:59:31.809141 20225 raft_consensus.cc:2468] T e08e797f71f1483a9c2b5899554a6dec P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35e7d1ade024444486e63cf1b81e9626 in term 1.
I20251023 07:59:31.829115 20043 leader_election.cc:304] T e08e797f71f1483a9c2b5899554a6dec P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35e7d1ade024444486e63cf1b81e9626, 65876a2b197c4ea6918f5cab47ded25c; no voters:
I20251023 07:59:31.830539 20336 raft_consensus.cc:2804] T e08e797f71f1483a9c2b5899554a6dec P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:59:31.831040 20336 raft_consensus.cc:697] T e08e797f71f1483a9c2b5899554a6dec P 35e7d1ade024444486e63cf1b81e9626 [term 1 LEADER]: Becoming Leader. State: Replica: 35e7d1ade024444486e63cf1b81e9626, State: Running, Role: LEADER
I20251023 07:59:31.831851 20336 consensus_queue.cc:237] T e08e797f71f1483a9c2b5899554a6dec P 35e7d1ade024444486e63cf1b81e9626 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:31.836488 20273 tablet_bootstrap.cc:492] T e813343bd62640cc9976d0ae394aa315 P d1379e91aa9c41629cd25262571beb2c: No bootstrap required, opened a new log
I20251023 07:59:31.837203 20273 ts_tablet_manager.cc:1403] T e813343bd62640cc9976d0ae394aa315 P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.149s user 0.018s sys 0.014s
I20251023 07:59:31.858292 20309 consensus_queue.cc:1048] T aa253535ba594367a12fda3dea3b75d4 P 0f412334fb994ff0ab492afde64f5855 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:59:31.867120 20279 consensus_queue.cc:1048] T 7060af9ee4a34ecca18900b2f272e1d1 P d1379e91aa9c41629cd25262571beb2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:59:31.874606 20399 raft_consensus.cc:493] T b4b44015a24e47ddae24244c3fb1fff1 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:31.881685 20399 raft_consensus.cc:515] T b4b44015a24e47ddae24244c3fb1fff1 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:31.885907 20399 leader_election.cc:290] T b4b44015a24e47ddae24244c3fb1fff1 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309), 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955)
I20251023 07:59:31.887774 20225 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b4b44015a24e47ddae24244c3fb1fff1" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c" is_pre_election: true
W20251023 07:59:31.895956 20117 leader_election.cc:343] T b4b44015a24e47ddae24244c3fb1fff1 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:31.902056 20350 consensus_queue.cc:1048] T 7060af9ee4a34ecca18900b2f272e1d1 P d1379e91aa9c41629cd25262571beb2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:59:31.889218 20309 raft_consensus.cc:493] T a468f7a5913245b58705dc4f8560dade P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:31.907166 20309 raft_consensus.cc:515] T a468f7a5913245b58705dc4f8560dade P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:31.911062 20309 leader_election.cc:290] T a468f7a5913245b58705dc4f8560dade P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865), 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309)
I20251023 07:59:31.916415 20001 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a468f7a5913245b58705dc4f8560dade" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:31.921829 20350 raft_consensus.cc:493] T 0229047af3034761a2bf168928917afb P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:31.923132 20350 raft_consensus.cc:515] T 0229047af3034761a2bf168928917afb P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:31.925936 20075 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b4b44015a24e47ddae24244c3fb1fff1" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
I20251023 07:59:31.927004 20075 raft_consensus.cc:2468] T b4b44015a24e47ddae24244c3fb1fff1 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f412334fb994ff0ab492afde64f5855 in term 0.
I20251023 07:59:31.935899 20116 leader_election.cc:304] T b4b44015a24e47ddae24244c3fb1fff1 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, 35e7d1ade024444486e63cf1b81e9626; no voters: 65876a2b197c4ea6918f5cab47ded25c
I20251023 07:59:31.936837 20399 raft_consensus.cc:2804] T b4b44015a24e47ddae24244c3fb1fff1 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:31.937240 20399 raft_consensus.cc:493] T b4b44015a24e47ddae24244c3fb1fff1 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:31.937614 20399 raft_consensus.cc:3060] T b4b44015a24e47ddae24244c3fb1fff1 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Advancing to term 1
W20251023 07:59:31.954818 20118 leader_election.cc:343] T a468f7a5913245b58705dc4f8560dade P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:31.958318 20077 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a468f7a5913245b58705dc4f8560dade" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
I20251023 07:59:31.959581 20438 consensus_queue.cc:1048] T 791953f9d44946eaa145c5857557a5e4 P 0f412334fb994ff0ab492afde64f5855 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:59:31.958279 20274 tablet_bootstrap.cc:492] T 58cef989d86d4b0c8401b4d6b2f890c0 P 65876a2b197c4ea6918f5cab47ded25c: No bootstrap required, opened a new log
W20251023 07:59:31.960903 20116 leader_election.cc:343] T a468f7a5913245b58705dc4f8560dade P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:31.961668 20274 ts_tablet_manager.cc:1403] T 58cef989d86d4b0c8401b4d6b2f890c0 P 65876a2b197c4ea6918f5cab47ded25c: Time spent bootstrapping tablet: real 0.247s user 0.052s sys 0.075s
I20251023 07:59:31.961582 20116 leader_election.cc:304] T a468f7a5913245b58705dc4f8560dade P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855; no voters: 35e7d1ade024444486e63cf1b81e9626, d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:31.963261 20438 raft_consensus.cc:2749] T a468f7a5913245b58705dc4f8560dade P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:59:31.970299 20273 raft_consensus.cc:359] T e813343bd62640cc9976d0ae394aa315 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:31.971338 20273 raft_consensus.cc:385] T e813343bd62640cc9976d0ae394aa315 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:31.971702 20273 raft_consensus.cc:740] T e813343bd62640cc9976d0ae394aa315 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:31.974471 20274 raft_consensus.cc:359] T 58cef989d86d4b0c8401b4d6b2f890c0 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:31.978402 20274 raft_consensus.cc:385] T 58cef989d86d4b0c8401b4d6b2f890c0 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:31.978832 20274 raft_consensus.cc:740] T 58cef989d86d4b0c8401b4d6b2f890c0 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65876a2b197c4ea6918f5cab47ded25c, State: Initialized, Role: FOLLOWER
I20251023 07:59:31.982859 20274 consensus_queue.cc:260] T 58cef989d86d4b0c8401b4d6b2f890c0 P 65876a2b197c4ea6918f5cab47ded25c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:31.981261 20224 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0229047af3034761a2bf168928917afb" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c" is_pre_election: true
I20251023 07:59:31.985811 20272 tablet_bootstrap.cc:492] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P 35e7d1ade024444486e63cf1b81e9626: No bootstrap required, opened a new log
I20251023 07:59:31.986146 20224 raft_consensus.cc:2468] T 0229047af3034761a2bf168928917afb P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 0.
I20251023 07:59:31.986359 20272 ts_tablet_manager.cc:1403] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P 35e7d1ade024444486e63cf1b81e9626: Time spent bootstrapping tablet: real 0.274s user 0.054s sys 0.109s
I20251023 07:59:31.988466 19968 leader_election.cc:304] T 0229047af3034761a2bf168928917afb P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65876a2b197c4ea6918f5cab47ded25c, d1379e91aa9c41629cd25262571beb2c; no voters:
I20251023 07:59:31.990957 20273 consensus_queue.cc:260] T e813343bd62640cc9976d0ae394aa315 P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:31.993088 20274 ts_tablet_manager.cc:1434] T 58cef989d86d4b0c8401b4d6b2f890c0 P 65876a2b197c4ea6918f5cab47ded25c: Time spent starting tablet: real 0.031s user 0.009s sys 0.004s
I20251023 07:59:31.994472 20274 tablet_bootstrap.cc:492] T b4b44015a24e47ddae24244c3fb1fff1 P 65876a2b197c4ea6918f5cab47ded25c: Bootstrap starting.
I20251023 07:59:31.998757 20272 raft_consensus.cc:359] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:31.999469 20272 raft_consensus.cc:385] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:31.999723 20272 raft_consensus.cc:740] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e7d1ade024444486e63cf1b81e9626, State: Initialized, Role: FOLLOWER
I20251023 07:59:31.993932 20279 raft_consensus.cc:2804] T 0229047af3034761a2bf168928917afb P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:32.000259 20279 raft_consensus.cc:493] T 0229047af3034761a2bf168928917afb P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:32.000810 20274 tablet_bootstrap.cc:654] T b4b44015a24e47ddae24244c3fb1fff1 P 65876a2b197c4ea6918f5cab47ded25c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:32.000628 20279 raft_consensus.cc:3060] T 0229047af3034761a2bf168928917afb P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:32.001896 20273 ts_tablet_manager.cc:1434] T e813343bd62640cc9976d0ae394aa315 P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.126s user 0.010s sys 0.000s
I20251023 07:59:32.001747 19898 catalog_manager.cc:5649] T e08e797f71f1483a9c2b5899554a6dec P 35e7d1ade024444486e63cf1b81e9626 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2). New cstate: current_term: 1 leader_uuid: "35e7d1ade024444486e63cf1b81e9626" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:32.002946 20273 tablet_bootstrap.cc:492] T 58cef989d86d4b0c8401b4d6b2f890c0 P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:32.003938 20077 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0229047af3034761a2bf168928917afb" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
I20251023 07:59:32.004601 20077 raft_consensus.cc:2468] T 0229047af3034761a2bf168928917afb P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 0.
I20251023 07:59:32.006599 20271 tablet_bootstrap.cc:492] T 58cef989d86d4b0c8401b4d6b2f890c0 P 0f412334fb994ff0ab492afde64f5855: No bootstrap required, opened a new log
I20251023 07:59:32.001061 20350 leader_election.cc:290] T 0229047af3034761a2bf168928917afb P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955), 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309)
I20251023 07:59:32.007139 20271 ts_tablet_manager.cc:1403] T 58cef989d86d4b0c8401b4d6b2f890c0 P 0f412334fb994ff0ab492afde64f5855: Time spent bootstrapping tablet: real 0.218s user 0.015s sys 0.004s
I20251023 07:59:32.009749 20271 raft_consensus.cc:359] T 58cef989d86d4b0c8401b4d6b2f890c0 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:32.010404 20271 raft_consensus.cc:385] T 58cef989d86d4b0c8401b4d6b2f890c0 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:32.010689 20271 raft_consensus.cc:740] T 58cef989d86d4b0c8401b4d6b2f890c0 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Initialized, Role: FOLLOWER
I20251023 07:59:32.010931 20341 raft_consensus.cc:493] T 58cef989d86d4b0c8401b4d6b2f890c0 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:32.011384 20271 consensus_queue.cc:260] T 58cef989d86d4b0c8401b4d6b2f890c0 P 0f412334fb994ff0ab492afde64f5855 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:32.011449 20341 raft_consensus.cc:515] T 58cef989d86d4b0c8401b4d6b2f890c0 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:32.013752 20341 leader_election.cc:290] T 58cef989d86d4b0c8401b4d6b2f890c0 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:32.014425 20151 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58cef989d86d4b0c8401b4d6b2f890c0" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855" is_pre_election: true
I20251023 07:59:32.015107 20151 raft_consensus.cc:2468] T 58cef989d86d4b0c8401b4d6b2f890c0 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65876a2b197c4ea6918f5cab47ded25c in term 0.
I20251023 07:59:32.014978 20399 raft_consensus.cc:515] T b4b44015a24e47ddae24244c3fb1fff1 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:32.000597 20272 consensus_queue.cc:260] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P 35e7d1ade024444486e63cf1b81e9626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:32.016563 20438 consensus_queue.cc:1048] T 791953f9d44946eaa145c5857557a5e4 P 0f412334fb994ff0ab492afde64f5855 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:59:32.016957 20000 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58cef989d86d4b0c8401b4d6b2f890c0" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:32.018086 20272 ts_tablet_manager.cc:1434] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P 35e7d1ade024444486e63cf1b81e9626: Time spent starting tablet: real 0.031s user 0.007s sys 0.000s
I20251023 07:59:32.016597 20189 leader_election.cc:304] T 58cef989d86d4b0c8401b4d6b2f890c0 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, 65876a2b197c4ea6918f5cab47ded25c; no voters:
W20251023 07:59:32.020124 20192 leader_election.cc:343] T 58cef989d86d4b0c8401b4d6b2f890c0 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:32.020493 20271 ts_tablet_manager.cc:1434] T 58cef989d86d4b0c8401b4d6b2f890c0 P 0f412334fb994ff0ab492afde64f5855: Time spent starting tablet: real 0.013s user 0.004s sys 0.003s
I20251023 07:59:32.021605 20271 tablet_bootstrap.cc:492] T e813343bd62640cc9976d0ae394aa315 P 0f412334fb994ff0ab492afde64f5855: Bootstrap starting.
I20251023 07:59:32.023737 20399 leader_election.cc:290] T b4b44015a24e47ddae24244c3fb1fff1 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 election: Requested vote from peers 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309), 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955)
I20251023 07:59:32.026716 19901 catalog_manager.cc:5649] T a0ff2fc9a3c04716ab748f95a00dec76 P 65876a2b197c4ea6918f5cab47ded25c reported cstate change: term changed from 0 to 1, leader changed from <none> to 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4). New cstate: current_term: 1 leader_uuid: "65876a2b197c4ea6918f5cab47ded25c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:32.030282 20224 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b4b44015a24e47ddae24244c3fb1fff1" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c"
I20251023 07:59:32.033349 20075 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b4b44015a24e47ddae24244c3fb1fff1" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626"
I20251023 07:59:32.034037 20075 raft_consensus.cc:3060] T b4b44015a24e47ddae24244c3fb1fff1 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:32.033844 20279 raft_consensus.cc:515] T 0229047af3034761a2bf168928917afb P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:32.036074 20341 raft_consensus.cc:2804] T 58cef989d86d4b0c8401b4d6b2f890c0 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:32.037184 20273 tablet_bootstrap.cc:654] T 58cef989d86d4b0c8401b4d6b2f890c0 P d1379e91aa9c41629cd25262571beb2c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:32.037684 20272 tablet_bootstrap.cc:492] T e813343bd62640cc9976d0ae394aa315 P 35e7d1ade024444486e63cf1b81e9626: Bootstrap starting.
I20251023 07:59:32.042815 20224 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0229047af3034761a2bf168928917afb" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c"
I20251023 07:59:32.043449 20224 raft_consensus.cc:3060] T 0229047af3034761a2bf168928917afb P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:32.036511 20341 raft_consensus.cc:493] T 58cef989d86d4b0c8401b4d6b2f890c0 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:32.045456 20271 tablet_bootstrap.cc:654] T e813343bd62640cc9976d0ae394aa315 P 0f412334fb994ff0ab492afde64f5855: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:32.045627 20341 raft_consensus.cc:3060] T 58cef989d86d4b0c8401b4d6b2f890c0 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Advancing to term 1
W20251023 07:59:32.041828 20117 leader_election.cc:343] T b4b44015a24e47ddae24244c3fb1fff1 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:32.054296 20078 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0229047af3034761a2bf168928917afb" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626"
I20251023 07:59:32.054971 20078 raft_consensus.cc:3060] T 0229047af3034761a2bf168928917afb P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:32.057289 20272 tablet_bootstrap.cc:654] T e813343bd62640cc9976d0ae394aa315 P 35e7d1ade024444486e63cf1b81e9626: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:32.059528 20075 raft_consensus.cc:2468] T b4b44015a24e47ddae24244c3fb1fff1 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f412334fb994ff0ab492afde64f5855 in term 1.
I20251023 07:59:32.060743 20116 leader_election.cc:304] T b4b44015a24e47ddae24244c3fb1fff1 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, 35e7d1ade024444486e63cf1b81e9626; no voters: 65876a2b197c4ea6918f5cab47ded25c
I20251023 07:59:32.061914 20399 raft_consensus.cc:2804] T b4b44015a24e47ddae24244c3fb1fff1 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:59:32.062422 20399 raft_consensus.cc:697] T b4b44015a24e47ddae24244c3fb1fff1 P 0f412334fb994ff0ab492afde64f5855 [term 1 LEADER]: Becoming Leader. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Running, Role: LEADER
I20251023 07:59:32.062935 20078 raft_consensus.cc:2468] T 0229047af3034761a2bf168928917afb P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 1.
I20251023 07:59:32.063264 20399 consensus_queue.cc:237] T b4b44015a24e47ddae24244c3fb1fff1 P 0f412334fb994ff0ab492afde64f5855 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:32.064218 19967 leader_election.cc:304] T 0229047af3034761a2bf168928917afb P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35e7d1ade024444486e63cf1b81e9626, d1379e91aa9c41629cd25262571beb2c; no voters:
I20251023 07:59:32.065224 20350 raft_consensus.cc:2804] T 0229047af3034761a2bf168928917afb P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:59:32.065735 20350 raft_consensus.cc:697] T 0229047af3034761a2bf168928917afb P d1379e91aa9c41629cd25262571beb2c [term 1 LEADER]: Becoming Leader. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Running, Role: LEADER
I20251023 07:59:32.067178 20279 leader_election.cc:290] T 0229047af3034761a2bf168928917afb P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 election: Requested vote from peers 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955), 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309)
I20251023 07:59:32.066691 20350 consensus_queue.cc:237] T 0229047af3034761a2bf168928917afb P d1379e91aa9c41629cd25262571beb2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:32.069106 20224 raft_consensus.cc:2468] T 0229047af3034761a2bf168928917afb P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 1.
I20251023 07:59:32.078332 20273 tablet_bootstrap.cc:492] T 58cef989d86d4b0c8401b4d6b2f890c0 P d1379e91aa9c41629cd25262571beb2c: No bootstrap required, opened a new log
I20251023 07:59:32.078809 20271 tablet_bootstrap.cc:492] T e813343bd62640cc9976d0ae394aa315 P 0f412334fb994ff0ab492afde64f5855: No bootstrap required, opened a new log
I20251023 07:59:32.078881 20273 ts_tablet_manager.cc:1403] T 58cef989d86d4b0c8401b4d6b2f890c0 P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.076s user 0.010s sys 0.000s
I20251023 07:59:32.079454 20271 ts_tablet_manager.cc:1403] T e813343bd62640cc9976d0ae394aa315 P 0f412334fb994ff0ab492afde64f5855: Time spent bootstrapping tablet: real 0.058s user 0.011s sys 0.004s
I20251023 07:59:32.084000 20271 raft_consensus.cc:359] T e813343bd62640cc9976d0ae394aa315 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:32.084640 20271 raft_consensus.cc:385] T e813343bd62640cc9976d0ae394aa315 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:32.084941 20271 raft_consensus.cc:740] T e813343bd62640cc9976d0ae394aa315 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Initialized, Role: FOLLOWER
I20251023 07:59:32.085592 20271 consensus_queue.cc:260] T e813343bd62640cc9976d0ae394aa315 P 0f412334fb994ff0ab492afde64f5855 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:32.090927 20273 raft_consensus.cc:359] T 58cef989d86d4b0c8401b4d6b2f890c0 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:32.091485 20273 raft_consensus.cc:385] T 58cef989d86d4b0c8401b4d6b2f890c0 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:32.091699 20273 raft_consensus.cc:740] T 58cef989d86d4b0c8401b4d6b2f890c0 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:32.091569 20274 tablet_bootstrap.cc:492] T b4b44015a24e47ddae24244c3fb1fff1 P 65876a2b197c4ea6918f5cab47ded25c: No bootstrap required, opened a new log
I20251023 07:59:32.092718 20274 ts_tablet_manager.cc:1403] T b4b44015a24e47ddae24244c3fb1fff1 P 65876a2b197c4ea6918f5cab47ded25c: Time spent bootstrapping tablet: real 0.099s user 0.012s sys 0.002s
I20251023 07:59:32.094940 20309 raft_consensus.cc:493] T e813343bd62640cc9976d0ae394aa315 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:32.095464 20309 raft_consensus.cc:515] T e813343bd62640cc9976d0ae394aa315 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:32.097746 20309 leader_election.cc:290] T e813343bd62640cc9976d0ae394aa315 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865), 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309)
I20251023 07:59:32.099370 20000 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e813343bd62640cc9976d0ae394aa315" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:32.100093 20000 raft_consensus.cc:2468] T e813343bd62640cc9976d0ae394aa315 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f412334fb994ff0ab492afde64f5855 in term 0.
I20251023 07:59:32.100502 20077 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e813343bd62640cc9976d0ae394aa315" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
W20251023 07:59:32.102649 20116 leader_election.cc:343] T e813343bd62640cc9976d0ae394aa315 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:32.103497 20118 leader_election.cc:304] T e813343bd62640cc9976d0ae394aa315 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, d1379e91aa9c41629cd25262571beb2c; no voters: 35e7d1ade024444486e63cf1b81e9626
I20251023 07:59:32.104568 20438 consensus_queue.cc:1048] T 5855488965da49f4a33c7516f6a5596a P 0f412334fb994ff0ab492afde64f5855 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:59:32.105942 20438 raft_consensus.cc:2804] T e813343bd62640cc9976d0ae394aa315 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:32.106292 20438 raft_consensus.cc:493] T e813343bd62640cc9976d0ae394aa315 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:32.106643 20438 raft_consensus.cc:3060] T e813343bd62640cc9976d0ae394aa315 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:32.108127 20271 ts_tablet_manager.cc:1434] T e813343bd62640cc9976d0ae394aa315 P 0f412334fb994ff0ab492afde64f5855: Time spent starting tablet: real 0.028s user 0.008s sys 0.000s
I20251023 07:59:32.109195 20271 tablet_bootstrap.cc:492] T 13d572956c644586b0efbe8f63aecae5 P 0f412334fb994ff0ab492afde64f5855: Bootstrap starting.
I20251023 07:59:32.115099 20271 tablet_bootstrap.cc:654] T 13d572956c644586b0efbe8f63aecae5 P 0f412334fb994ff0ab492afde64f5855: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:32.118026 20274 raft_consensus.cc:359] T b4b44015a24e47ddae24244c3fb1fff1 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:32.119014 20274 raft_consensus.cc:385] T b4b44015a24e47ddae24244c3fb1fff1 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:32.119354 20274 raft_consensus.cc:740] T b4b44015a24e47ddae24244c3fb1fff1 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65876a2b197c4ea6918f5cab47ded25c, State: Initialized, Role: FOLLOWER
I20251023 07:59:32.120151 20274 consensus_queue.cc:260] T b4b44015a24e47ddae24244c3fb1fff1 P 65876a2b197c4ea6918f5cab47ded25c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:32.123654 20274 ts_tablet_manager.cc:1434] T b4b44015a24e47ddae24244c3fb1fff1 P 65876a2b197c4ea6918f5cab47ded25c: Time spent starting tablet: real 0.030s user 0.007s sys 0.000s
I20251023 07:59:32.124732 20274 tablet_bootstrap.cc:492] T 13d572956c644586b0efbe8f63aecae5 P 65876a2b197c4ea6918f5cab47ded25c: Bootstrap starting.
I20251023 07:59:32.113332 19897 catalog_manager.cc:5649] T b4b44015a24e47ddae24244c3fb1fff1 P 0f412334fb994ff0ab492afde64f5855 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f412334fb994ff0ab492afde64f5855 (127.16.126.3). New cstate: current_term: 1 leader_uuid: "0f412334fb994ff0ab492afde64f5855" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:32.127537 20438 raft_consensus.cc:515] T e813343bd62640cc9976d0ae394aa315 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:32.126322 20341 raft_consensus.cc:515] T 58cef989d86d4b0c8401b4d6b2f890c0 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:32.106132 19901 catalog_manager.cc:5649] T 0229047af3034761a2bf168928917afb P d1379e91aa9c41629cd25262571beb2c reported cstate change: term changed from 0 to 1, leader changed from <none> to d1379e91aa9c41629cd25262571beb2c (127.16.126.1). New cstate: current_term: 1 leader_uuid: "d1379e91aa9c41629cd25262571beb2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:32.133328 20151 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58cef989d86d4b0c8401b4d6b2f890c0" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855"
I20251023 07:59:32.133963 20151 raft_consensus.cc:3060] T 58cef989d86d4b0c8401b4d6b2f890c0 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:32.134341 20271 tablet_bootstrap.cc:492] T 13d572956c644586b0efbe8f63aecae5 P 0f412334fb994ff0ab492afde64f5855: No bootstrap required, opened a new log
I20251023 07:59:32.134809 20271 ts_tablet_manager.cc:1403] T 13d572956c644586b0efbe8f63aecae5 P 0f412334fb994ff0ab492afde64f5855: Time spent bootstrapping tablet: real 0.026s user 0.009s sys 0.002s
I20251023 07:59:32.137483 20271 raft_consensus.cc:359] T 13d572956c644586b0efbe8f63aecae5 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:32.138141 20271 raft_consensus.cc:385] T 13d572956c644586b0efbe8f63aecae5 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:32.138402 20271 raft_consensus.cc:740] T 13d572956c644586b0efbe8f63aecae5 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Initialized, Role: FOLLOWER
I20251023 07:59:32.138994 20271 consensus_queue.cc:260] T 13d572956c644586b0efbe8f63aecae5 P 0f412334fb994ff0ab492afde64f5855 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:32.141461 20271 ts_tablet_manager.cc:1434] T 13d572956c644586b0efbe8f63aecae5 P 0f412334fb994ff0ab492afde64f5855: Time spent starting tablet: real 0.006s user 0.005s sys 0.001s
I20251023 07:59:32.142517 20271 tablet_bootstrap.cc:492] T 8b6aca6db6ab43e8be0b6ec22dc96700 P 0f412334fb994ff0ab492afde64f5855: Bootstrap starting.
I20251023 07:59:32.144119 20414 raft_consensus.cc:493] T c52243b5fda44e2fba36f6319b4c13e3 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:32.144608 20414 raft_consensus.cc:515] T c52243b5fda44e2fba36f6319b4c13e3 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:32.145772 20274 tablet_bootstrap.cc:654] T 13d572956c644586b0efbe8f63aecae5 P 65876a2b197c4ea6918f5cab47ded25c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:32.146638 20414 leader_election.cc:290] T c52243b5fda44e2fba36f6319b4c13e3 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865), 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309)
I20251023 07:59:32.147861 20000 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58cef989d86d4b0c8401b4d6b2f890c0" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c"
I20251023 07:59:32.147960 20075 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c52243b5fda44e2fba36f6319b4c13e3" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
I20251023 07:59:32.149533 20341 leader_election.cc:290] T 58cef989d86d4b0c8401b4d6b2f890c0 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 election: Requested vote from peers 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:32.141314 20151 raft_consensus.cc:2468] T 58cef989d86d4b0c8401b4d6b2f890c0 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65876a2b197c4ea6918f5cab47ded25c in term 1.
I20251023 07:59:32.150681 19999 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c52243b5fda44e2fba36f6319b4c13e3" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:32.151242 20189 leader_election.cc:304] T 58cef989d86d4b0c8401b4d6b2f890c0 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, 65876a2b197c4ea6918f5cab47ded25c; no voters:
I20251023 07:59:32.152402 20341 raft_consensus.cc:2804] T 58cef989d86d4b0c8401b4d6b2f890c0 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Leader election won for term 1
W20251023 07:59:32.152674 20190 leader_election.cc:343] T c52243b5fda44e2fba36f6319b4c13e3 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:32.153230 20341 raft_consensus.cc:697] T 58cef989d86d4b0c8401b4d6b2f890c0 P 65876a2b197c4ea6918f5cab47ded25c [term 1 LEADER]: Becoming Leader. State: Replica: 65876a2b197c4ea6918f5cab47ded25c, State: Running, Role: LEADER
I20251023 07:59:32.092439 20273 consensus_queue.cc:260] T 58cef989d86d4b0c8401b4d6b2f890c0 P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:32.154882 20000 raft_consensus.cc:3060] T 58cef989d86d4b0c8401b4d6b2f890c0 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:32.154593 20341 consensus_queue.cc:237] T 58cef989d86d4b0c8401b4d6b2f890c0 P 65876a2b197c4ea6918f5cab47ded25c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
W20251023 07:59:32.156044 20192 leader_election.cc:343] T c52243b5fda44e2fba36f6319b4c13e3 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:32.129606 20272 tablet_bootstrap.cc:492] T e813343bd62640cc9976d0ae394aa315 P 35e7d1ade024444486e63cf1b81e9626: No bootstrap required, opened a new log
I20251023 07:59:32.156499 20192 leader_election.cc:304] T c52243b5fda44e2fba36f6319b4c13e3 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65876a2b197c4ea6918f5cab47ded25c; no voters: 35e7d1ade024444486e63cf1b81e9626, d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:32.156908 20272 ts_tablet_manager.cc:1403] T e813343bd62640cc9976d0ae394aa315 P 35e7d1ade024444486e63cf1b81e9626: Time spent bootstrapping tablet: real 0.119s user 0.023s sys 0.032s
I20251023 07:59:32.157246 20414 raft_consensus.cc:2749] T c52243b5fda44e2fba36f6319b4c13e3 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:59:32.157796 20274 tablet_bootstrap.cc:492] T 13d572956c644586b0efbe8f63aecae5 P 65876a2b197c4ea6918f5cab47ded25c: No bootstrap required, opened a new log
I20251023 07:59:32.158255 20274 ts_tablet_manager.cc:1403] T 13d572956c644586b0efbe8f63aecae5 P 65876a2b197c4ea6918f5cab47ded25c: Time spent bootstrapping tablet: real 0.034s user 0.009s sys 0.007s
I20251023 07:59:32.160228 20272 raft_consensus.cc:359] T e813343bd62640cc9976d0ae394aa315 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:32.160936 20272 raft_consensus.cc:385] T e813343bd62640cc9976d0ae394aa315 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:32.160658 20274 raft_consensus.cc:359] T 13d572956c644586b0efbe8f63aecae5 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:32.161193 20272 raft_consensus.cc:740] T e813343bd62640cc9976d0ae394aa315 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e7d1ade024444486e63cf1b81e9626, State: Initialized, Role: FOLLOWER
I20251023 07:59:32.161290 20274 raft_consensus.cc:385] T 13d572956c644586b0efbe8f63aecae5 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:32.161720 20274 raft_consensus.cc:740] T 13d572956c644586b0efbe8f63aecae5 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65876a2b197c4ea6918f5cab47ded25c, State: Initialized, Role: FOLLOWER
I20251023 07:59:32.161836 20271 tablet_bootstrap.cc:654] T 8b6aca6db6ab43e8be0b6ec22dc96700 P 0f412334fb994ff0ab492afde64f5855: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:32.162451 20274 consensus_queue.cc:260] T 13d572956c644586b0efbe8f63aecae5 P 65876a2b197c4ea6918f5cab47ded25c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:32.163810 20272 consensus_queue.cc:260] T e813343bd62640cc9976d0ae394aa315 P 35e7d1ade024444486e63cf1b81e9626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:32.164963 20274 ts_tablet_manager.cc:1434] T 13d572956c644586b0efbe8f63aecae5 P 65876a2b197c4ea6918f5cab47ded25c: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20251023 07:59:32.165905 20274 tablet_bootstrap.cc:492] T ae516c440b7749f388e0e2f89a6a81b7 P 65876a2b197c4ea6918f5cab47ded25c: Bootstrap starting.
I20251023 07:59:32.170286 20272 ts_tablet_manager.cc:1434] T e813343bd62640cc9976d0ae394aa315 P 35e7d1ade024444486e63cf1b81e9626: Time spent starting tablet: real 0.012s user 0.006s sys 0.000s
I20251023 07:59:32.171289 20272 tablet_bootstrap.cc:492] T a468f7a5913245b58705dc4f8560dade P 35e7d1ade024444486e63cf1b81e9626: Bootstrap starting.
I20251023 07:59:32.171586 20274 tablet_bootstrap.cc:654] T ae516c440b7749f388e0e2f89a6a81b7 P 65876a2b197c4ea6918f5cab47ded25c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:32.179719 20000 raft_consensus.cc:2468] T 58cef989d86d4b0c8401b4d6b2f890c0 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65876a2b197c4ea6918f5cab47ded25c in term 1.
I20251023 07:59:32.184932 20272 tablet_bootstrap.cc:654] T a468f7a5913245b58705dc4f8560dade P 35e7d1ade024444486e63cf1b81e9626: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:32.192864 20309 consensus_queue.cc:1048] T 5855488965da49f4a33c7516f6a5596a P 0f412334fb994ff0ab492afde64f5855 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:59:32.261905 19999 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e813343bd62640cc9976d0ae394aa315" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c"
I20251023 07:59:32.262737 19999 raft_consensus.cc:3060] T e813343bd62640cc9976d0ae394aa315 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:32.268180 20075 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e813343bd62640cc9976d0ae394aa315" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626"
I20251023 07:59:32.269134 20075 raft_consensus.cc:3060] T e813343bd62640cc9976d0ae394aa315 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:32.274000 20272 tablet_bootstrap.cc:492] T a468f7a5913245b58705dc4f8560dade P 35e7d1ade024444486e63cf1b81e9626: No bootstrap required, opened a new log
I20251023 07:59:32.274518 20272 ts_tablet_manager.cc:1403] T a468f7a5913245b58705dc4f8560dade P 35e7d1ade024444486e63cf1b81e9626: Time spent bootstrapping tablet: real 0.103s user 0.011s sys 0.008s
I20251023 07:59:32.279403 20272 raft_consensus.cc:359] T a468f7a5913245b58705dc4f8560dade P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:32.280113 20272 raft_consensus.cc:385] T a468f7a5913245b58705dc4f8560dade P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:32.280575 20272 raft_consensus.cc:740] T a468f7a5913245b58705dc4f8560dade P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e7d1ade024444486e63cf1b81e9626, State: Initialized, Role: FOLLOWER
I20251023 07:59:32.281672 20272 consensus_queue.cc:260] T a468f7a5913245b58705dc4f8560dade P 35e7d1ade024444486e63cf1b81e9626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:32.284788 20272 ts_tablet_manager.cc:1434] T a468f7a5913245b58705dc4f8560dade P 35e7d1ade024444486e63cf1b81e9626: Time spent starting tablet: real 0.010s user 0.006s sys 0.000s
I20251023 07:59:32.285743 20272 tablet_bootstrap.cc:492] T c52243b5fda44e2fba36f6319b4c13e3 P 35e7d1ade024444486e63cf1b81e9626: Bootstrap starting.
I20251023 07:59:32.288203 20336 consensus_queue.cc:1048] T e08e797f71f1483a9c2b5899554a6dec P 35e7d1ade024444486e63cf1b81e9626 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:59:32.291464 20272 tablet_bootstrap.cc:654] T c52243b5fda44e2fba36f6319b4c13e3 P 35e7d1ade024444486e63cf1b81e9626: Neither blocks nor log segments found. Creating new log.
W20251023 07:59:32.213150 19949 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20251023 07:59:32.216987 20341 consensus_queue.cc:1048] T a0ff2fc9a3c04716ab748f95a00dec76 P 65876a2b197c4ea6918f5cab47ded25c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:59:32.251539 19900 catalog_manager.cc:5649] T 58cef989d86d4b0c8401b4d6b2f890c0 P 65876a2b197c4ea6918f5cab47ded25c reported cstate change: term changed from 0 to 1, leader changed from <none> to 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4). New cstate: current_term: 1 leader_uuid: "65876a2b197c4ea6918f5cab47ded25c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:32.316324 20438 leader_election.cc:290] T e813343bd62640cc9976d0ae394aa315 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 election: Requested vote from peers d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865), 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309)
I20251023 07:59:32.323634 20336 consensus_queue.cc:1048] T e08e797f71f1483a9c2b5899554a6dec P 35e7d1ade024444486e63cf1b81e9626 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:59:32.338203 20273 ts_tablet_manager.cc:1434] T 58cef989d86d4b0c8401b4d6b2f890c0 P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.259s user 0.010s sys 0.001s
I20251023 07:59:32.339545 20273 tablet_bootstrap.cc:492] T a468f7a5913245b58705dc4f8560dade P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:32.342128 20075 raft_consensus.cc:2468] T e813343bd62640cc9976d0ae394aa315 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f412334fb994ff0ab492afde64f5855 in term 1.
I20251023 07:59:32.342875 20272 tablet_bootstrap.cc:492] T c52243b5fda44e2fba36f6319b4c13e3 P 35e7d1ade024444486e63cf1b81e9626: No bootstrap required, opened a new log
I20251023 07:59:32.343384 20272 ts_tablet_manager.cc:1403] T c52243b5fda44e2fba36f6319b4c13e3 P 35e7d1ade024444486e63cf1b81e9626: Time spent bootstrapping tablet: real 0.058s user 0.013s sys 0.001s
I20251023 07:59:32.345970 20116 leader_election.cc:304] T e813343bd62640cc9976d0ae394aa315 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, 35e7d1ade024444486e63cf1b81e9626; no voters:
I20251023 07:59:32.347569 20400 raft_consensus.cc:2804] T e813343bd62640cc9976d0ae394aa315 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:59:32.348196 20400 raft_consensus.cc:697] T e813343bd62640cc9976d0ae394aa315 P 0f412334fb994ff0ab492afde64f5855 [term 1 LEADER]: Becoming Leader. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Running, Role: LEADER
I20251023 07:59:32.349300 20400 consensus_queue.cc:237] T e813343bd62640cc9976d0ae394aa315 P 0f412334fb994ff0ab492afde64f5855 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:32.360095 20341 consensus_queue.cc:1048] T a0ff2fc9a3c04716ab748f95a00dec76 P 65876a2b197c4ea6918f5cab47ded25c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:59:32.371850 20272 raft_consensus.cc:359] T c52243b5fda44e2fba36f6319b4c13e3 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:32.372665 20272 raft_consensus.cc:385] T c52243b5fda44e2fba36f6319b4c13e3 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:32.372970 20272 raft_consensus.cc:740] T c52243b5fda44e2fba36f6319b4c13e3 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e7d1ade024444486e63cf1b81e9626, State: Initialized, Role: FOLLOWER
I20251023 07:59:32.373685 20272 consensus_queue.cc:260] T c52243b5fda44e2fba36f6319b4c13e3 P 35e7d1ade024444486e63cf1b81e9626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:32.375581 20273 tablet_bootstrap.cc:654] T a468f7a5913245b58705dc4f8560dade P d1379e91aa9c41629cd25262571beb2c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:32.378896 20272 ts_tablet_manager.cc:1434] T c52243b5fda44e2fba36f6319b4c13e3 P 35e7d1ade024444486e63cf1b81e9626: Time spent starting tablet: real 0.035s user 0.012s sys 0.008s
I20251023 07:59:32.380250 19999 raft_consensus.cc:2468] T e813343bd62640cc9976d0ae394aa315 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f412334fb994ff0ab492afde64f5855 in term 1.
I20251023 07:59:32.508658 20272 tablet_bootstrap.cc:492] T f8ceeb2a7d7d45629aee9466b149251b P 35e7d1ade024444486e63cf1b81e9626: Bootstrap starting.
I20251023 07:59:32.515316 20272 tablet_bootstrap.cc:654] T f8ceeb2a7d7d45629aee9466b149251b P 35e7d1ade024444486e63cf1b81e9626: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:32.532356 20350 consensus_queue.cc:1048] T 0229047af3034761a2bf168928917afb P d1379e91aa9c41629cd25262571beb2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:59:32.551775 20414 raft_consensus.cc:493] T 13d572956c644586b0efbe8f63aecae5 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:32.552397 20414 raft_consensus.cc:515] T 13d572956c644586b0efbe8f63aecae5 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:32.581594 20341 raft_consensus.cc:493] T b4b44015a24e47ddae24244c3fb1fff1 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:32.582098 20274 tablet_bootstrap.cc:492] T ae516c440b7749f388e0e2f89a6a81b7 P 65876a2b197c4ea6918f5cab47ded25c: No bootstrap required, opened a new log
I20251023 07:59:32.555310 20152 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "13d572956c644586b0efbe8f63aecae5" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855" is_pre_election: true
I20251023 07:59:32.582778 20274 ts_tablet_manager.cc:1403] T ae516c440b7749f388e0e2f89a6a81b7 P 65876a2b197c4ea6918f5cab47ded25c: Time spent bootstrapping tablet: real 0.417s user 0.071s sys 0.157s
I20251023 07:59:32.583249 20152 raft_consensus.cc:2468] T 13d572956c644586b0efbe8f63aecae5 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65876a2b197c4ea6918f5cab47ded25c in term 0.
I20251023 07:59:32.583854 20271 tablet_bootstrap.cc:492] T 8b6aca6db6ab43e8be0b6ec22dc96700 P 0f412334fb994ff0ab492afde64f5855: No bootstrap required, opened a new log
I20251023 07:59:32.584332 20271 ts_tablet_manager.cc:1403] T 8b6aca6db6ab43e8be0b6ec22dc96700 P 0f412334fb994ff0ab492afde64f5855: Time spent bootstrapping tablet: real 0.442s user 0.088s sys 0.146s
I20251023 07:59:32.584714 20189 leader_election.cc:304] T 13d572956c644586b0efbe8f63aecae5 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, 65876a2b197c4ea6918f5cab47ded25c; no voters:
I20251023 07:59:32.582198 20341 raft_consensus.cc:515] T b4b44015a24e47ddae24244c3fb1fff1 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:32.585498 20274 raft_consensus.cc:359] T ae516c440b7749f388e0e2f89a6a81b7 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:32.586197 20274 raft_consensus.cc:385] T ae516c440b7749f388e0e2f89a6a81b7 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:32.586470 20274 raft_consensus.cc:740] T ae516c440b7749f388e0e2f89a6a81b7 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65876a2b197c4ea6918f5cab47ded25c, State: Initialized, Role: FOLLOWER
I20251023 07:59:32.587255 20274 consensus_queue.cc:260] T ae516c440b7749f388e0e2f89a6a81b7 P 65876a2b197c4ea6918f5cab47ded25c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:32.589653 20274 ts_tablet_manager.cc:1434] T ae516c440b7749f388e0e2f89a6a81b7 P 65876a2b197c4ea6918f5cab47ded25c: Time spent starting tablet: real 0.006s user 0.005s sys 0.001s
I20251023 07:59:32.590272 20504 raft_consensus.cc:2804] T 13d572956c644586b0efbe8f63aecae5 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:32.590536 20274 tablet_bootstrap.cc:492] T f8ceeb2a7d7d45629aee9466b149251b P 65876a2b197c4ea6918f5cab47ded25c: Bootstrap starting.
I20251023 07:59:32.590454 20152 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b4b44015a24e47ddae24244c3fb1fff1" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855" is_pre_election: true
I20251023 07:59:32.590735 20504 raft_consensus.cc:493] T 13d572956c644586b0efbe8f63aecae5 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:32.591149 20504 raft_consensus.cc:3060] T 13d572956c644586b0efbe8f63aecae5 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Advancing to term 1
W20251023 07:59:32.555666 20118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.126.1:37865, user_credentials={real_user=slave}} blocked reactor thread for 112772us
I20251023 07:59:32.546808 20282 raft_consensus.cc:493] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:32.597563 20282 raft_consensus.cc:515] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:32.598323 20400 consensus_queue.cc:1048] T b4b44015a24e47ddae24244c3fb1fff1 P 0f412334fb994ff0ab492afde64f5855 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:59:32.599645 20282 leader_election.cc:290] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:32.603541 20272 tablet_bootstrap.cc:492] T f8ceeb2a7d7d45629aee9466b149251b P 35e7d1ade024444486e63cf1b81e9626: No bootstrap required, opened a new log
I20251023 07:59:32.604130 20272 ts_tablet_manager.cc:1403] T f8ceeb2a7d7d45629aee9466b149251b P 35e7d1ade024444486e63cf1b81e9626: Time spent bootstrapping tablet: real 0.096s user 0.018s sys 0.005s
I20251023 07:59:32.605239 19999 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0a62e9fdd3de46bcb61bebafbf9f7a2c" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
W20251023 07:59:32.606832 20044 leader_election.cc:343] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:32.593333 20271 raft_consensus.cc:359] T 8b6aca6db6ab43e8be0b6ec22dc96700 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:32.606927 20272 raft_consensus.cc:359] T f8ceeb2a7d7d45629aee9466b149251b P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:32.607455 20271 raft_consensus.cc:385] T 8b6aca6db6ab43e8be0b6ec22dc96700 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:32.607617 20272 raft_consensus.cc:385] T f8ceeb2a7d7d45629aee9466b149251b P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:32.607810 20271 raft_consensus.cc:740] T 8b6aca6db6ab43e8be0b6ec22dc96700 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Initialized, Role: FOLLOWER
I20251023 07:59:32.607942 20272 raft_consensus.cc:740] T f8ceeb2a7d7d45629aee9466b149251b P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e7d1ade024444486e63cf1b81e9626, State: Initialized, Role: FOLLOWER
I20251023 07:59:32.608546 20271 consensus_queue.cc:260] T 8b6aca6db6ab43e8be0b6ec22dc96700 P 0f412334fb994ff0ab492afde64f5855 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:32.608671 20272 consensus_queue.cc:260] T f8ceeb2a7d7d45629aee9466b149251b P 35e7d1ade024444486e63cf1b81e9626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:32.609225 20341 leader_election.cc:290] T b4b44015a24e47ddae24244c3fb1fff1 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309), 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287)
I20251023 07:59:32.611234 20272 ts_tablet_manager.cc:1434] T f8ceeb2a7d7d45629aee9466b149251b P 35e7d1ade024444486e63cf1b81e9626: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20251023 07:59:32.612254 20272 tablet_bootstrap.cc:492] T ae516c440b7749f388e0e2f89a6a81b7 P 35e7d1ade024444486e63cf1b81e9626: Bootstrap starting.
I20251023 07:59:32.613265 20271 ts_tablet_manager.cc:1434] T 8b6aca6db6ab43e8be0b6ec22dc96700 P 0f412334fb994ff0ab492afde64f5855: Time spent starting tablet: real 0.029s user 0.006s sys 0.002s
I20251023 07:59:32.614306 20271 tablet_bootstrap.cc:492] T cfbe734be0c84115840c7c45f3398002 P 0f412334fb994ff0ab492afde64f5855: Bootstrap starting.
I20251023 07:59:32.617578 20505 raft_consensus.cc:493] T c52243b5fda44e2fba36f6319b4c13e3 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:32.596781 20274 tablet_bootstrap.cc:654] T f8ceeb2a7d7d45629aee9466b149251b P 65876a2b197c4ea6918f5cab47ded25c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:32.621380 20505 raft_consensus.cc:515] T c52243b5fda44e2fba36f6319b4c13e3 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:32.627206 20504 raft_consensus.cc:515] T 13d572956c644586b0efbe8f63aecae5 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:32.630277 20152 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "13d572956c644586b0efbe8f63aecae5" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855"
I20251023 07:59:32.630879 20152 raft_consensus.cc:3060] T 13d572956c644586b0efbe8f63aecae5 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:32.630935 20505 leader_election.cc:290] T c52243b5fda44e2fba36f6319b4c13e3 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:32.632097 20438 raft_consensus.cc:493] T 8b6aca6db6ab43e8be0b6ec22dc96700 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:32.620247 20273 tablet_bootstrap.cc:492] T a468f7a5913245b58705dc4f8560dade P d1379e91aa9c41629cd25262571beb2c: No bootstrap required, opened a new log
I20251023 07:59:32.633975 20273 ts_tablet_manager.cc:1403] T a468f7a5913245b58705dc4f8560dade P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.295s user 0.012s sys 0.023s
I20251023 07:59:32.627658 20272 tablet_bootstrap.cc:654] T ae516c440b7749f388e0e2f89a6a81b7 P 35e7d1ade024444486e63cf1b81e9626: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:32.615499 20414 leader_election.cc:290] T 13d572956c644586b0efbe8f63aecae5 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:32.632614 20438 raft_consensus.cc:515] T 8b6aca6db6ab43e8be0b6ec22dc96700 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:32.652940 20438 leader_election.cc:290] T 8b6aca6db6ab43e8be0b6ec22dc96700 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309), 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955)
I20251023 07:59:32.655164 20075 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b6aca6db6ab43e8be0b6ec22dc96700" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
I20251023 07:59:32.658802 20271 tablet_bootstrap.cc:654] T cfbe734be0c84115840c7c45f3398002 P 0f412334fb994ff0ab492afde64f5855: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:32.655951 20001 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c52243b5fda44e2fba36f6319b4c13e3" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:32.646763 20341 raft_consensus.cc:493] T ae516c440b7749f388e0e2f89a6a81b7 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20251023 07:59:32.643836 19966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.3:33287, user_credentials={real_user=slave}} blocked reactor thread for 129570us
W20251023 07:59:32.642590 19967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.2:42309, user_credentials={real_user=slave}} blocked reactor thread for 127628us
I20251023 07:59:32.669046 20273 raft_consensus.cc:359] T a468f7a5913245b58705dc4f8560dade P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:32.674415 20273 raft_consensus.cc:385] T a468f7a5913245b58705dc4f8560dade P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:32.675684 20274 tablet_bootstrap.cc:492] T f8ceeb2a7d7d45629aee9466b149251b P 65876a2b197c4ea6918f5cab47ded25c: No bootstrap required, opened a new log
I20251023 07:59:32.676611 20274 ts_tablet_manager.cc:1403] T f8ceeb2a7d7d45629aee9466b149251b P 65876a2b197c4ea6918f5cab47ded25c: Time spent bootstrapping tablet: real 0.086s user 0.013s sys 0.006s
I20251023 07:59:32.674749 20273 raft_consensus.cc:740] T a468f7a5913245b58705dc4f8560dade P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:32.681056 20273 consensus_queue.cc:260] T a468f7a5913245b58705dc4f8560dade P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:32.663007 20504 leader_election.cc:290] T 13d572956c644586b0efbe8f63aecae5 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 election: Requested vote from peers 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
W20251023 07:59:32.673837 20116 leader_election.cc:343] T 8b6aca6db6ab43e8be0b6ec22dc96700 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:32.689499 20273 ts_tablet_manager.cc:1434] T a468f7a5913245b58705dc4f8560dade P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.055s user 0.008s sys 0.000s
I20251023 07:59:32.690497 20273 tablet_bootstrap.cc:492] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:32.691078 20078 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b4b44015a24e47ddae24244c3fb1fff1" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
I20251023 07:59:32.674242 20341 raft_consensus.cc:515] T ae516c440b7749f388e0e2f89a6a81b7 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:32.693811 20341 leader_election.cc:290] T ae516c440b7749f388e0e2f89a6a81b7 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309), 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287)
I20251023 07:59:32.696345 20273 tablet_bootstrap.cc:654] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P d1379e91aa9c41629cd25262571beb2c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:32.696969 20223 raft_consensus.cc:3060] T b4b44015a24e47ddae24244c3fb1fff1 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:32.705892 20226 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b6aca6db6ab43e8be0b6ec22dc96700" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c" is_pre_election: true
W20251023 07:59:32.766075 20044 leader_election.cc:343] T c52243b5fda44e2fba36f6319b4c13e3 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Illegal state: must be running to vote when last-logged opid is not known
W20251023 07:59:32.768278 20117 leader_election.cc:343] T 8b6aca6db6ab43e8be0b6ec22dc96700 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:32.712723 20225 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0a62e9fdd3de46bcb61bebafbf9f7a2c" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c" is_pre_election: true
I20251023 07:59:32.777078 20505 raft_consensus.cc:493] T f8ceeb2a7d7d45629aee9466b149251b P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:32.771293 20225 raft_consensus.cc:2468] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35e7d1ade024444486e63cf1b81e9626 in term 0.
I20251023 07:59:32.778389 20505 raft_consensus.cc:515] T f8ceeb2a7d7d45629aee9466b149251b P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:32.780620 20518 raft_consensus.cc:493] T a468f7a5913245b58705dc4f8560dade P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:32.771291 20150 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ae516c440b7749f388e0e2f89a6a81b7" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855" is_pre_election: true
I20251023 07:59:32.769135 20117 leader_election.cc:304] T 8b6aca6db6ab43e8be0b6ec22dc96700 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855; no voters: 35e7d1ade024444486e63cf1b81e9626, 65876a2b197c4ea6918f5cab47ded25c
I20251023 07:59:32.782765 20518 raft_consensus.cc:515] T a468f7a5913245b58705dc4f8560dade P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:32.790325 19999 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "13d572956c644586b0efbe8f63aecae5" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:32.792579 20003 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "13d572956c644586b0efbe8f63aecae5" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c"
I20251023 07:59:32.800879 20272 tablet_bootstrap.cc:492] T ae516c440b7749f388e0e2f89a6a81b7 P 35e7d1ade024444486e63cf1b81e9626: No bootstrap required, opened a new log
I20251023 07:59:32.806762 20272 ts_tablet_manager.cc:1403] T ae516c440b7749f388e0e2f89a6a81b7 P 35e7d1ade024444486e63cf1b81e9626: Time spent bootstrapping tablet: real 0.195s user 0.015s sys 0.016s
I20251023 07:59:32.811012 20438 raft_consensus.cc:2749] T 8b6aca6db6ab43e8be0b6ec22dc96700 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251023 07:59:32.818814 20189 leader_election.cc:343] T ae516c440b7749f388e0e2f89a6a81b7 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:32.822508 20513 consensus_queue.cc:1048] T 58cef989d86d4b0c8401b4d6b2f890c0 P 65876a2b197c4ea6918f5cab47ded25c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:59:32.823961 20272 raft_consensus.cc:359] T ae516c440b7749f388e0e2f89a6a81b7 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:32.825110 20272 raft_consensus.cc:385] T ae516c440b7749f388e0e2f89a6a81b7 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:32.825541 20272 raft_consensus.cc:740] T ae516c440b7749f388e0e2f89a6a81b7 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e7d1ade024444486e63cf1b81e9626, State: Initialized, Role: FOLLOWER
I20251023 07:59:32.826570 20272 consensus_queue.cc:260] T ae516c440b7749f388e0e2f89a6a81b7 P 35e7d1ade024444486e63cf1b81e9626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:32.837927 20272 ts_tablet_manager.cc:1434] T ae516c440b7749f388e0e2f89a6a81b7 P 35e7d1ade024444486e63cf1b81e9626: Time spent starting tablet: real 0.030s user 0.002s sys 0.010s
I20251023 07:59:32.839344 20505 leader_election.cc:290] T f8ceeb2a7d7d45629aee9466b149251b P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:32.845237 20279 consensus_queue.cc:1048] T 0229047af3034761a2bf168928917afb P d1379e91aa9c41629cd25262571beb2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:59:32.805285 20518 leader_election.cc:290] T a468f7a5913245b58705dc4f8560dade P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865), 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287)
W20251023 07:59:32.853456 20192 leader_election.cc:343] T 13d572956c644586b0efbe8f63aecae5 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:32.860464 20514 consensus_queue.cc:1048] T 58cef989d86d4b0c8401b4d6b2f890c0 P 65876a2b197c4ea6918f5cab47ded25c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20251023 07:59:32.867049 20221 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c52243b5fda44e2fba36f6319b4c13e3" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c" is_pre_election: true
I20251023 07:59:32.867502 20224 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8ceeb2a7d7d45629aee9466b149251b" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c" is_pre_election: true
I20251023 07:59:32.868109 20221 raft_consensus.cc:2468] T c52243b5fda44e2fba36f6319b4c13e3 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35e7d1ade024444486e63cf1b81e9626 in term 0.
I20251023 07:59:32.868054 19900 catalog_manager.cc:5649] T e813343bd62640cc9976d0ae394aa315 P 0f412334fb994ff0ab492afde64f5855 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f412334fb994ff0ab492afde64f5855 (127.16.126.3). New cstate: current_term: 1 leader_uuid: "0f412334fb994ff0ab492afde64f5855" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } health_report { overall_health: HEALTHY } } }
I20251023 07:59:32.838040 20274 raft_consensus.cc:359] T f8ceeb2a7d7d45629aee9466b149251b P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:32.870281 20274 raft_consensus.cc:385] T f8ceeb2a7d7d45629aee9466b149251b P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:32.870692 20274 raft_consensus.cc:740] T f8ceeb2a7d7d45629aee9466b149251b P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65876a2b197c4ea6918f5cab47ded25c, State: Initialized, Role: FOLLOWER
I20251023 07:59:32.871400 20273 tablet_bootstrap.cc:492] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P d1379e91aa9c41629cd25262571beb2c: No bootstrap required, opened a new log
I20251023 07:59:32.872071 20043 leader_election.cc:304] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35e7d1ade024444486e63cf1b81e9626, 65876a2b197c4ea6918f5cab47ded25c; no voters: d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:32.872717 20271 tablet_bootstrap.cc:492] T cfbe734be0c84115840c7c45f3398002 P 0f412334fb994ff0ab492afde64f5855: No bootstrap required, opened a new log
I20251023 07:59:32.873688 20271 ts_tablet_manager.cc:1403] T cfbe734be0c84115840c7c45f3398002 P 0f412334fb994ff0ab492afde64f5855: Time spent bootstrapping tablet: real 0.260s user 0.004s sys 0.029s
W20251023 07:59:32.874432 20192 leader_election.cc:343] T 13d572956c644586b0efbe8f63aecae5 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:32.874851 20077 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ae516c440b7749f388e0e2f89a6a81b7" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
I20251023 07:59:32.875612 20077 raft_consensus.cc:2468] T ae516c440b7749f388e0e2f89a6a81b7 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65876a2b197c4ea6918f5cab47ded25c in term 0.
I20251023 07:59:32.877934 20526 raft_consensus.cc:2804] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:32.878460 20526 raft_consensus.cc:493] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:32.878885 20526 raft_consensus.cc:3060] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:32.886445 20150 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a468f7a5913245b58705dc4f8560dade" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855" is_pre_election: true
I20251023 07:59:32.887543 20150 raft_consensus.cc:2468] T a468f7a5913245b58705dc4f8560dade P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35e7d1ade024444486e63cf1b81e9626 in term 0.
I20251023 07:59:32.888978 20272 tablet_bootstrap.cc:492] T 8b6aca6db6ab43e8be0b6ec22dc96700 P 35e7d1ade024444486e63cf1b81e9626: Bootstrap starting.
I20251023 07:59:32.889572 20273 ts_tablet_manager.cc:1403] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.199s user 0.016s sys 0.015s
I20251023 07:59:32.890039 20003 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a468f7a5913245b58705dc4f8560dade" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:32.890877 20003 raft_consensus.cc:2468] T a468f7a5913245b58705dc4f8560dade P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35e7d1ade024444486e63cf1b81e9626 in term 0.
I20251023 07:59:32.871482 20274 consensus_queue.cc:260] T f8ceeb2a7d7d45629aee9466b149251b P 65876a2b197c4ea6918f5cab47ded25c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:32.897419 20224 raft_consensus.cc:2468] T f8ceeb2a7d7d45629aee9466b149251b P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35e7d1ade024444486e63cf1b81e9626 in term 0.
I20251023 07:59:32.898519 20043 leader_election.cc:304] T c52243b5fda44e2fba36f6319b4c13e3 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35e7d1ade024444486e63cf1b81e9626, 65876a2b197c4ea6918f5cab47ded25c; no voters: d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:32.901850 20505 raft_consensus.cc:2804] T c52243b5fda44e2fba36f6319b4c13e3 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:32.902297 20505 raft_consensus.cc:493] T c52243b5fda44e2fba36f6319b4c13e3 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:32.902637 20505 raft_consensus.cc:3060] T c52243b5fda44e2fba36f6319b4c13e3 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:32.904865 20399 consensus_queue.cc:1048] T e813343bd62640cc9976d0ae394aa315 P 0f412334fb994ff0ab492afde64f5855 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20251023 07:59:32.905539 20400 consensus_queue.cc:1048] T b4b44015a24e47ddae24244c3fb1fff1 P 0f412334fb994ff0ab492afde64f5855 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:59:32.908460 20190 leader_election.cc:304] T b4b44015a24e47ddae24244c3fb1fff1 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65876a2b197c4ea6918f5cab47ded25c; no voters: 0f412334fb994ff0ab492afde64f5855, 35e7d1ade024444486e63cf1b81e9626
I20251023 07:59:32.906080 20271 raft_consensus.cc:359] T cfbe734be0c84115840c7c45f3398002 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:32.914145 20271 raft_consensus.cc:385] T cfbe734be0c84115840c7c45f3398002 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:32.914505 20271 raft_consensus.cc:740] T cfbe734be0c84115840c7c45f3398002 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Initialized, Role: FOLLOWER
I20251023 07:59:32.903364 20273 raft_consensus.cc:359] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:32.917910 20273 raft_consensus.cc:385] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:32.918118 20273 raft_consensus.cc:740] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:32.917191 20341 raft_consensus.cc:2749] T b4b44015a24e47ddae24244c3fb1fff1 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:59:32.919494 20003 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8ceeb2a7d7d45629aee9466b149251b" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:32.921913 20271 consensus_queue.cc:260] T cfbe734be0c84115840c7c45f3398002 P 0f412334fb994ff0ab492afde64f5855 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:32.925863 20273 consensus_queue.cc:260] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:32.931752 20274 ts_tablet_manager.cc:1434] T f8ceeb2a7d7d45629aee9466b149251b P 65876a2b197c4ea6918f5cab47ded25c: Time spent starting tablet: real 0.252s user 0.011s sys 0.000s
I20251023 07:59:32.933377 20274 tablet_bootstrap.cc:492] T f20a7a673ce6433eac41600d3573e314 P 65876a2b197c4ea6918f5cab47ded25c: Bootstrap starting.
I20251023 07:59:32.933519 20152 raft_consensus.cc:2468] T 13d572956c644586b0efbe8f63aecae5 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65876a2b197c4ea6918f5cab47ded25c in term 1.
I20251023 07:59:32.935361 20189 leader_election.cc:304] T 13d572956c644586b0efbe8f63aecae5 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, 65876a2b197c4ea6918f5cab47ded25c; no voters: d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:32.937132 20414 raft_consensus.cc:2804] T 13d572956c644586b0efbe8f63aecae5 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:59:32.937708 20414 raft_consensus.cc:697] T 13d572956c644586b0efbe8f63aecae5 P 65876a2b197c4ea6918f5cab47ded25c [term 1 LEADER]: Becoming Leader. State: Replica: 65876a2b197c4ea6918f5cab47ded25c, State: Running, Role: LEADER
I20251023 07:59:32.938938 20414 consensus_queue.cc:237] T 13d572956c644586b0efbe8f63aecae5 P 65876a2b197c4ea6918f5cab47ded25c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:32.943662 20190 leader_election.cc:304] T ae516c440b7749f388e0e2f89a6a81b7 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35e7d1ade024444486e63cf1b81e9626, 65876a2b197c4ea6918f5cab47ded25c; no voters: 0f412334fb994ff0ab492afde64f5855
I20251023 07:59:32.944939 20512 raft_consensus.cc:2804] T ae516c440b7749f388e0e2f89a6a81b7 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:32.945413 20512 raft_consensus.cc:493] T ae516c440b7749f388e0e2f89a6a81b7 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:32.945809 20512 raft_consensus.cc:3060] T ae516c440b7749f388e0e2f89a6a81b7 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:32.947017 20043 leader_election.cc:304] T f8ceeb2a7d7d45629aee9466b149251b P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35e7d1ade024444486e63cf1b81e9626, 65876a2b197c4ea6918f5cab47ded25c; no voters:
I20251023 07:59:32.948370 20518 raft_consensus.cc:2804] T f8ceeb2a7d7d45629aee9466b149251b P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:32.948769 20518 raft_consensus.cc:493] T f8ceeb2a7d7d45629aee9466b149251b P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:32.949126 20518 raft_consensus.cc:3060] T f8ceeb2a7d7d45629aee9466b149251b P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:32.950649 20273 ts_tablet_manager.cc:1434] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.061s user 0.001s sys 0.005s
I20251023 07:59:32.952164 20273 tablet_bootstrap.cc:492] T c52243b5fda44e2fba36f6319b4c13e3 P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:32.975200 20400 consensus_queue.cc:1048] T e813343bd62640cc9976d0ae394aa315 P 0f412334fb994ff0ab492afde64f5855 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:59:32.913013 20041 leader_election.cc:304] T a468f7a5913245b58705dc4f8560dade P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, 35e7d1ade024444486e63cf1b81e9626; no voters:
W20251023 07:59:32.976475 20041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.126.3:33287, user_credentials={real_user=slave}} blocked reactor thread for 75205.2us
I20251023 07:59:32.977504 20336 raft_consensus.cc:2804] T a468f7a5913245b58705dc4f8560dade P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:32.978010 20336 raft_consensus.cc:493] T a468f7a5913245b58705dc4f8560dade P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:32.978411 20336 raft_consensus.cc:3060] T a468f7a5913245b58705dc4f8560dade P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Advancing to term 1
W20251023 07:59:32.979719 20044 leader_election.cc:343] T f8ceeb2a7d7d45629aee9466b149251b P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:32.982708 20271 ts_tablet_manager.cc:1434] T cfbe734be0c84115840c7c45f3398002 P 0f412334fb994ff0ab492afde64f5855: Time spent starting tablet: real 0.109s user 0.004s sys 0.004s
I20251023 07:59:32.984434 20271 tablet_bootstrap.cc:492] T ae516c440b7749f388e0e2f89a6a81b7 P 0f412334fb994ff0ab492afde64f5855: Bootstrap starting.
I20251023 07:59:32.986197 20526 raft_consensus.cc:515] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:32.994524 20518 raft_consensus.cc:515] T f8ceeb2a7d7d45629aee9466b149251b P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:32.996794 20518 leader_election.cc:290] T f8ceeb2a7d7d45629aee9466b149251b P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 election: Requested vote from peers 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:32.998178 20223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8ceeb2a7d7d45629aee9466b149251b" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c"
I20251023 07:59:32.998836 20223 raft_consensus.cc:3060] T f8ceeb2a7d7d45629aee9466b149251b P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:33.006112 20226 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0a62e9fdd3de46bcb61bebafbf9f7a2c" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c"
I20251023 07:59:33.021756 20226 raft_consensus.cc:3060] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:33.017038 20505 raft_consensus.cc:515] T c52243b5fda44e2fba36f6319b4c13e3 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:33.024941 20526 leader_election.cc:290] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 election: Requested vote from peers 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:33.032191 20272 tablet_bootstrap.cc:654] T 8b6aca6db6ab43e8be0b6ec22dc96700 P 35e7d1ade024444486e63cf1b81e9626: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:33.034631 20001 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8ceeb2a7d7d45629aee9466b149251b" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c"
I20251023 07:59:33.036615 20273 tablet_bootstrap.cc:654] T c52243b5fda44e2fba36f6319b4c13e3 P d1379e91aa9c41629cd25262571beb2c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:33.039237 20221 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c52243b5fda44e2fba36f6319b4c13e3" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c"
I20251023 07:59:33.039947 20221 raft_consensus.cc:3060] T c52243b5fda44e2fba36f6319b4c13e3 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:33.042069 20505 leader_election.cc:290] T c52243b5fda44e2fba36f6319b4c13e3 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 election: Requested vote from peers 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:33.046963 20274 tablet_bootstrap.cc:654] T f20a7a673ce6433eac41600d3573e314 P 65876a2b197c4ea6918f5cab47ded25c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:33.028535 20336 raft_consensus.cc:515] T a468f7a5913245b58705dc4f8560dade P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:33.051318 20512 raft_consensus.cc:515] T ae516c440b7749f388e0e2f89a6a81b7 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:33.065956 20512 leader_election.cc:290] T ae516c440b7749f388e0e2f89a6a81b7 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 election: Requested vote from peers 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309), 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287)
W20251023 07:59:33.061558 20044 leader_election.cc:343] T f8ceeb2a7d7d45629aee9466b149251b P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:33.068835 19999 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c52243b5fda44e2fba36f6319b4c13e3" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c"
I20251023 07:59:33.069178 20001 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0a62e9fdd3de46bcb61bebafbf9f7a2c" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c"
I20251023 07:59:33.070103 20001 raft_consensus.cc:3060] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:33.072767 20078 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ae516c440b7749f388e0e2f89a6a81b7" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626"
I20251023 07:59:33.073463 20078 raft_consensus.cc:3060] T ae516c440b7749f388e0e2f89a6a81b7 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:33.079643 20400 raft_consensus.cc:493] T cfbe734be0c84115840c7c45f3398002 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:33.068325 20150 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ae516c440b7749f388e0e2f89a6a81b7" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855"
I20251023 07:59:33.080407 20400 raft_consensus.cc:515] T cfbe734be0c84115840c7c45f3398002 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
W20251023 07:59:33.084463 20189 leader_election.cc:343] T ae516c440b7749f388e0e2f89a6a81b7 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:33.090008 20223 raft_consensus.cc:2468] T f8ceeb2a7d7d45629aee9466b149251b P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35e7d1ade024444486e63cf1b81e9626 in term 1.
I20251023 07:59:33.093173 20400 leader_election.cc:290] T cfbe734be0c84115840c7c45f3398002 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865), 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309)
I20251023 07:59:33.094594 20002 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cfbe734be0c84115840c7c45f3398002" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
W20251023 07:59:33.097831 20118 leader_election.cc:343] T cfbe734be0c84115840c7c45f3398002 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:33.105209 20271 tablet_bootstrap.cc:654] T ae516c440b7749f388e0e2f89a6a81b7 P 0f412334fb994ff0ab492afde64f5855: Neither blocks nor log segments found. Creating new log.
W20251023 07:59:33.102615 20044 leader_election.cc:343] T c52243b5fda44e2fba36f6319b4c13e3 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:33.091094 20226 raft_consensus.cc:2468] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35e7d1ade024444486e63cf1b81e9626 in term 1.
I20251023 07:59:33.118114 20078 raft_consensus.cc:2468] T ae516c440b7749f388e0e2f89a6a81b7 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65876a2b197c4ea6918f5cab47ded25c in term 1.
I20251023 07:59:33.123339 20274 tablet_bootstrap.cc:492] T f20a7a673ce6433eac41600d3573e314 P 65876a2b197c4ea6918f5cab47ded25c: No bootstrap required, opened a new log
I20251023 07:59:33.123049 20190 leader_election.cc:304] T ae516c440b7749f388e0e2f89a6a81b7 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35e7d1ade024444486e63cf1b81e9626, 65876a2b197c4ea6918f5cab47ded25c; no voters: 0f412334fb994ff0ab492afde64f5855
I20251023 07:59:33.123899 20274 ts_tablet_manager.cc:1403] T f20a7a673ce6433eac41600d3573e314 P 65876a2b197c4ea6918f5cab47ded25c: Time spent bootstrapping tablet: real 0.191s user 0.013s sys 0.012s
I20251023 07:59:33.124804 20414 raft_consensus.cc:2804] T ae516c440b7749f388e0e2f89a6a81b7 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:59:33.125520 20414 raft_consensus.cc:697] T ae516c440b7749f388e0e2f89a6a81b7 P 65876a2b197c4ea6918f5cab47ded25c [term 1 LEADER]: Becoming Leader. State: Replica: 65876a2b197c4ea6918f5cab47ded25c, State: Running, Role: LEADER
I20251023 07:59:33.126250 20336 leader_election.cc:290] T a468f7a5913245b58705dc4f8560dade P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 election: Requested vote from peers d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865), 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287)
I20251023 07:59:33.126902 20043 leader_election.cc:304] T f8ceeb2a7d7d45629aee9466b149251b P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35e7d1ade024444486e63cf1b81e9626, 65876a2b197c4ea6918f5cab47ded25c; no voters: d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:33.126758 20414 consensus_queue.cc:237] T ae516c440b7749f388e0e2f89a6a81b7 P 65876a2b197c4ea6918f5cab47ded25c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:33.128340 20150 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a468f7a5913245b58705dc4f8560dade" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855"
I20251023 07:59:33.128963 20150 raft_consensus.cc:3060] T a468f7a5913245b58705dc4f8560dade P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:33.129297 20221 raft_consensus.cc:2468] T c52243b5fda44e2fba36f6319b4c13e3 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35e7d1ade024444486e63cf1b81e9626 in term 1.
I20251023 07:59:33.132105 20274 raft_consensus.cc:359] T f20a7a673ce6433eac41600d3573e314 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:33.133774 20274 raft_consensus.cc:385] T f20a7a673ce6433eac41600d3573e314 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:33.134009 20274 raft_consensus.cc:740] T f20a7a673ce6433eac41600d3573e314 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65876a2b197c4ea6918f5cab47ded25c, State: Initialized, Role: FOLLOWER
I20251023 07:59:33.135008 20274 consensus_queue.cc:260] T f20a7a673ce6433eac41600d3573e314 P 65876a2b197c4ea6918f5cab47ded25c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:33.136538 20043 leader_election.cc:304] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35e7d1ade024444486e63cf1b81e9626, 65876a2b197c4ea6918f5cab47ded25c; no voters:
I20251023 07:59:33.137302 20000 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a468f7a5913245b58705dc4f8560dade" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c"
I20251023 07:59:33.137614 20043 leader_election.cc:304] T c52243b5fda44e2fba36f6319b4c13e3 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35e7d1ade024444486e63cf1b81e9626, 65876a2b197c4ea6918f5cab47ded25c; no voters: d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:33.137951 20000 raft_consensus.cc:3060] T a468f7a5913245b58705dc4f8560dade P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:33.138195 20518 raft_consensus.cc:2804] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:59:33.138710 20518 raft_consensus.cc:697] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P 35e7d1ade024444486e63cf1b81e9626 [term 1 LEADER]: Becoming Leader. State: Replica: 35e7d1ade024444486e63cf1b81e9626, State: Running, Role: LEADER
I20251023 07:59:33.138988 20505 raft_consensus.cc:2804] T c52243b5fda44e2fba36f6319b4c13e3 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:59:33.139567 20505 raft_consensus.cc:697] T c52243b5fda44e2fba36f6319b4c13e3 P 35e7d1ade024444486e63cf1b81e9626 [term 1 LEADER]: Becoming Leader. State: Replica: 35e7d1ade024444486e63cf1b81e9626, State: Running, Role: LEADER
I20251023 07:59:33.139696 20518 consensus_queue.cc:237] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P 35e7d1ade024444486e63cf1b81e9626 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:33.140604 20505 consensus_queue.cc:237] T c52243b5fda44e2fba36f6319b4c13e3 P 35e7d1ade024444486e63cf1b81e9626 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:33.141243 20078 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cfbe734be0c84115840c7c45f3398002" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
I20251023 07:59:33.145390 20273 tablet_bootstrap.cc:492] T c52243b5fda44e2fba36f6319b4c13e3 P d1379e91aa9c41629cd25262571beb2c: No bootstrap required, opened a new log
I20251023 07:59:33.145938 20273 ts_tablet_manager.cc:1403] T c52243b5fda44e2fba36f6319b4c13e3 P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.194s user 0.004s sys 0.014s
I20251023 07:59:33.146725 20150 raft_consensus.cc:2468] T a468f7a5913245b58705dc4f8560dade P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35e7d1ade024444486e63cf1b81e9626 in term 1.
I20251023 07:59:33.147969 20041 leader_election.cc:304] T a468f7a5913245b58705dc4f8560dade P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, 35e7d1ade024444486e63cf1b81e9626; no voters:
W20251023 07:59:33.148648 20116 leader_election.cc:343] T cfbe734be0c84115840c7c45f3398002 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:33.148983 20282 raft_consensus.cc:2804] T a468f7a5913245b58705dc4f8560dade P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:59:33.148787 20273 raft_consensus.cc:359] T c52243b5fda44e2fba36f6319b4c13e3 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:33.131690 20336 raft_consensus.cc:2804] T f8ceeb2a7d7d45629aee9466b149251b P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:59:33.150147 20273 raft_consensus.cc:385] T c52243b5fda44e2fba36f6319b4c13e3 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:33.150463 20273 raft_consensus.cc:740] T c52243b5fda44e2fba36f6319b4c13e3 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:33.149137 20116 leader_election.cc:304] T cfbe734be0c84115840c7c45f3398002 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855; no voters: 35e7d1ade024444486e63cf1b81e9626, d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:33.149595 20282 raft_consensus.cc:697] T a468f7a5913245b58705dc4f8560dade P 35e7d1ade024444486e63cf1b81e9626 [term 1 LEADER]: Becoming Leader. State: Replica: 35e7d1ade024444486e63cf1b81e9626, State: Running, Role: LEADER
I20251023 07:59:33.153366 20400 raft_consensus.cc:2749] T cfbe734be0c84115840c7c45f3398002 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:59:33.155074 20282 consensus_queue.cc:237] T a468f7a5913245b58705dc4f8560dade P 35e7d1ade024444486e63cf1b81e9626 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:33.152868 20273 consensus_queue.cc:260] T c52243b5fda44e2fba36f6319b4c13e3 P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:33.160468 20272 tablet_bootstrap.cc:492] T 8b6aca6db6ab43e8be0b6ec22dc96700 P 35e7d1ade024444486e63cf1b81e9626: No bootstrap required, opened a new log
I20251023 07:59:33.161031 20001 raft_consensus.cc:2468] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35e7d1ade024444486e63cf1b81e9626 in term 1.
I20251023 07:59:33.161296 20272 ts_tablet_manager.cc:1403] T 8b6aca6db6ab43e8be0b6ec22dc96700 P 35e7d1ade024444486e63cf1b81e9626: Time spent bootstrapping tablet: real 0.273s user 0.016s sys 0.022s
I20251023 07:59:33.161829 20273 ts_tablet_manager.cc:1434] T c52243b5fda44e2fba36f6319b4c13e3 P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.016s user 0.008s sys 0.000s
I20251023 07:59:33.171782 20336 raft_consensus.cc:697] T f8ceeb2a7d7d45629aee9466b149251b P 35e7d1ade024444486e63cf1b81e9626 [term 1 LEADER]: Becoming Leader. State: Replica: 35e7d1ade024444486e63cf1b81e9626, State: Running, Role: LEADER
I20251023 07:59:33.178193 20274 ts_tablet_manager.cc:1434] T f20a7a673ce6433eac41600d3573e314 P 65876a2b197c4ea6918f5cab47ded25c: Time spent starting tablet: real 0.054s user 0.004s sys 0.004s
I20251023 07:59:33.178728 20272 raft_consensus.cc:359] T 8b6aca6db6ab43e8be0b6ec22dc96700 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:33.179395 20274 tablet_bootstrap.cc:492] T dc81e0e89365425793f2851459b7e892 P 65876a2b197c4ea6918f5cab47ded25c: Bootstrap starting.
I20251023 07:59:33.179517 20272 raft_consensus.cc:385] T 8b6aca6db6ab43e8be0b6ec22dc96700 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:33.179850 20272 raft_consensus.cc:740] T 8b6aca6db6ab43e8be0b6ec22dc96700 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e7d1ade024444486e63cf1b81e9626, State: Initialized, Role: FOLLOWER
I20251023 07:59:33.181272 20273 tablet_bootstrap.cc:492] T cfbe734be0c84115840c7c45f3398002 P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:33.180493 20272 consensus_queue.cc:260] T 8b6aca6db6ab43e8be0b6ec22dc96700 P 35e7d1ade024444486e63cf1b81e9626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:33.173362 20336 consensus_queue.cc:237] T f8ceeb2a7d7d45629aee9466b149251b P 35e7d1ade024444486e63cf1b81e9626 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:33.149622 20000 raft_consensus.cc:2468] T a468f7a5913245b58705dc4f8560dade P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35e7d1ade024444486e63cf1b81e9626 in term 1.
I20251023 07:59:33.205500 20272 ts_tablet_manager.cc:1434] T 8b6aca6db6ab43e8be0b6ec22dc96700 P 35e7d1ade024444486e63cf1b81e9626: Time spent starting tablet: real 0.039s user 0.000s sys 0.006s
I20251023 07:59:33.211290 20271 tablet_bootstrap.cc:492] T ae516c440b7749f388e0e2f89a6a81b7 P 0f412334fb994ff0ab492afde64f5855: No bootstrap required, opened a new log
I20251023 07:59:33.212013 20271 ts_tablet_manager.cc:1403] T ae516c440b7749f388e0e2f89a6a81b7 P 0f412334fb994ff0ab492afde64f5855: Time spent bootstrapping tablet: real 0.228s user 0.012s sys 0.004s
I20251023 07:59:33.213811 19897 catalog_manager.cc:5649] T 13d572956c644586b0efbe8f63aecae5 P 65876a2b197c4ea6918f5cab47ded25c reported cstate change: term changed from 0 to 1, leader changed from <none> to 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4). New cstate: current_term: 1 leader_uuid: "65876a2b197c4ea6918f5cab47ded25c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:33.215549 20271 raft_consensus.cc:359] T ae516c440b7749f388e0e2f89a6a81b7 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:33.216500 20271 raft_consensus.cc:385] T ae516c440b7749f388e0e2f89a6a81b7 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:33.216854 20271 raft_consensus.cc:740] T ae516c440b7749f388e0e2f89a6a81b7 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Initialized, Role: FOLLOWER
I20251023 07:59:33.217839 20271 consensus_queue.cc:260] T ae516c440b7749f388e0e2f89a6a81b7 P 0f412334fb994ff0ab492afde64f5855 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:33.227303 20274 tablet_bootstrap.cc:654] T dc81e0e89365425793f2851459b7e892 P 65876a2b197c4ea6918f5cab47ded25c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:33.228850 20272 tablet_bootstrap.cc:492] T cfbe734be0c84115840c7c45f3398002 P 35e7d1ade024444486e63cf1b81e9626: Bootstrap starting.
I20251023 07:59:33.239034 20272 tablet_bootstrap.cc:654] T cfbe734be0c84115840c7c45f3398002 P 35e7d1ade024444486e63cf1b81e9626: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:33.239955 20271 ts_tablet_manager.cc:1434] T ae516c440b7749f388e0e2f89a6a81b7 P 0f412334fb994ff0ab492afde64f5855: Time spent starting tablet: real 0.028s user 0.005s sys 0.005s
I20251023 07:59:33.241860 20271 tablet_bootstrap.cc:492] T 20f681957fa04333b8a04cbad085db57 P 0f412334fb994ff0ab492afde64f5855: Bootstrap starting.
I20251023 07:59:33.248831 20271 tablet_bootstrap.cc:654] T 20f681957fa04333b8a04cbad085db57 P 0f412334fb994ff0ab492afde64f5855: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:33.257331 20273 tablet_bootstrap.cc:654] T cfbe734be0c84115840c7c45f3398002 P d1379e91aa9c41629cd25262571beb2c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:33.267057 20274 tablet_bootstrap.cc:492] T dc81e0e89365425793f2851459b7e892 P 65876a2b197c4ea6918f5cab47ded25c: No bootstrap required, opened a new log
I20251023 07:59:33.267553 20274 ts_tablet_manager.cc:1403] T dc81e0e89365425793f2851459b7e892 P 65876a2b197c4ea6918f5cab47ded25c: Time spent bootstrapping tablet: real 0.088s user 0.012s sys 0.002s
I20251023 07:59:33.269565 20274 raft_consensus.cc:359] T dc81e0e89365425793f2851459b7e892 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:33.270063 20274 raft_consensus.cc:385] T dc81e0e89365425793f2851459b7e892 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:33.270278 20274 raft_consensus.cc:740] T dc81e0e89365425793f2851459b7e892 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65876a2b197c4ea6918f5cab47ded25c, State: Initialized, Role: FOLLOWER
I20251023 07:59:33.270834 20274 consensus_queue.cc:260] T dc81e0e89365425793f2851459b7e892 P 65876a2b197c4ea6918f5cab47ded25c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:33.272600 20274 ts_tablet_manager.cc:1434] T dc81e0e89365425793f2851459b7e892 P 65876a2b197c4ea6918f5cab47ded25c: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20251023 07:59:33.273375 20274 tablet_bootstrap.cc:492] T c3527495b334413f82d0eca2c4d117b1 P 65876a2b197c4ea6918f5cab47ded25c: Bootstrap starting.
I20251023 07:59:33.276070 20272 tablet_bootstrap.cc:492] T cfbe734be0c84115840c7c45f3398002 P 35e7d1ade024444486e63cf1b81e9626: No bootstrap required, opened a new log
I20251023 07:59:33.276585 20272 ts_tablet_manager.cc:1403] T cfbe734be0c84115840c7c45f3398002 P 35e7d1ade024444486e63cf1b81e9626: Time spent bootstrapping tablet: real 0.048s user 0.018s sys 0.015s
I20251023 07:59:33.279353 20274 tablet_bootstrap.cc:654] T c3527495b334413f82d0eca2c4d117b1 P 65876a2b197c4ea6918f5cab47ded25c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:33.279268 20272 raft_consensus.cc:359] T cfbe734be0c84115840c7c45f3398002 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:33.280367 20272 raft_consensus.cc:385] T cfbe734be0c84115840c7c45f3398002 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:33.280673 20272 raft_consensus.cc:740] T cfbe734be0c84115840c7c45f3398002 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e7d1ade024444486e63cf1b81e9626, State: Initialized, Role: FOLLOWER
I20251023 07:59:33.281461 20272 consensus_queue.cc:260] T cfbe734be0c84115840c7c45f3398002 P 35e7d1ade024444486e63cf1b81e9626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:33.284051 20273 tablet_bootstrap.cc:492] T cfbe734be0c84115840c7c45f3398002 P d1379e91aa9c41629cd25262571beb2c: No bootstrap required, opened a new log
I20251023 07:59:33.284572 20273 ts_tablet_manager.cc:1403] T cfbe734be0c84115840c7c45f3398002 P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.104s user 0.011s sys 0.002s
I20251023 07:59:33.287125 20273 raft_consensus.cc:359] T cfbe734be0c84115840c7c45f3398002 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:33.287935 20273 raft_consensus.cc:385] T cfbe734be0c84115840c7c45f3398002 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:33.288218 20273 raft_consensus.cc:740] T cfbe734be0c84115840c7c45f3398002 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:33.288980 20273 consensus_queue.cc:260] T cfbe734be0c84115840c7c45f3398002 P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:33.291565 20273 ts_tablet_manager.cc:1434] T cfbe734be0c84115840c7c45f3398002 P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20251023 07:59:33.293723 20272 ts_tablet_manager.cc:1434] T cfbe734be0c84115840c7c45f3398002 P 35e7d1ade024444486e63cf1b81e9626: Time spent starting tablet: real 0.017s user 0.008s sys 0.000s
I20251023 07:59:33.294939 20272 tablet_bootstrap.cc:492] T dc81e0e89365425793f2851459b7e892 P 35e7d1ade024444486e63cf1b81e9626: Bootstrap starting.
I20251023 07:59:33.300942 20273 tablet_bootstrap.cc:492] T c3527495b334413f82d0eca2c4d117b1 P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:33.303928 19898 catalog_manager.cc:5649] T c52243b5fda44e2fba36f6319b4c13e3 P 35e7d1ade024444486e63cf1b81e9626 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2). New cstate: current_term: 1 leader_uuid: "35e7d1ade024444486e63cf1b81e9626" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } health_report { overall_health: HEALTHY } } }
I20251023 07:59:33.306458 19898 catalog_manager.cc:5649] T f8ceeb2a7d7d45629aee9466b149251b P 35e7d1ade024444486e63cf1b81e9626 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2). New cstate: current_term: 1 leader_uuid: "35e7d1ade024444486e63cf1b81e9626" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } health_report { overall_health: HEALTHY } } }
I20251023 07:59:33.307771 20336 raft_consensus.cc:493] T 8b6aca6db6ab43e8be0b6ec22dc96700 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:33.308286 20336 raft_consensus.cc:515] T 8b6aca6db6ab43e8be0b6ec22dc96700 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:33.310247 20336 leader_election.cc:290] T 8b6aca6db6ab43e8be0b6ec22dc96700 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287), 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955)
I20251023 07:59:33.312287 20221 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b6aca6db6ab43e8be0b6ec22dc96700" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c" is_pre_election: true
I20251023 07:59:33.312559 20150 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b6aca6db6ab43e8be0b6ec22dc96700" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855" is_pre_election: true
I20251023 07:59:33.313166 20150 raft_consensus.cc:2468] T 8b6aca6db6ab43e8be0b6ec22dc96700 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35e7d1ade024444486e63cf1b81e9626 in term 0.
W20251023 07:59:33.313875 20043 leader_election.cc:343] T 8b6aca6db6ab43e8be0b6ec22dc96700 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:33.314460 20041 leader_election.cc:304] T 8b6aca6db6ab43e8be0b6ec22dc96700 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, 35e7d1ade024444486e63cf1b81e9626; no voters: 65876a2b197c4ea6918f5cab47ded25c
I20251023 07:59:33.315636 20272 tablet_bootstrap.cc:654] T dc81e0e89365425793f2851459b7e892 P 35e7d1ade024444486e63cf1b81e9626: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:33.315956 20336 raft_consensus.cc:2804] T 8b6aca6db6ab43e8be0b6ec22dc96700 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:33.316496 20336 raft_consensus.cc:493] T 8b6aca6db6ab43e8be0b6ec22dc96700 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:33.316926 20336 raft_consensus.cc:3060] T 8b6aca6db6ab43e8be0b6ec22dc96700 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:33.319026 20273 tablet_bootstrap.cc:654] T c3527495b334413f82d0eca2c4d117b1 P d1379e91aa9c41629cd25262571beb2c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:33.321622 20414 consensus_queue.cc:1048] T 13d572956c644586b0efbe8f63aecae5 P 65876a2b197c4ea6918f5cab47ded25c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:59:33.331827 20336 raft_consensus.cc:515] T 8b6aca6db6ab43e8be0b6ec22dc96700 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:33.334875 19898 catalog_manager.cc:5649] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P 35e7d1ade024444486e63cf1b81e9626 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2). New cstate: current_term: 1 leader_uuid: "35e7d1ade024444486e63cf1b81e9626" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } health_report { overall_health: HEALTHY } } }
I20251023 07:59:33.339906 20152 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b6aca6db6ab43e8be0b6ec22dc96700" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855"
I20251023 07:59:33.340647 20152 raft_consensus.cc:3060] T 8b6aca6db6ab43e8be0b6ec22dc96700 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:33.346192 20505 raft_consensus.cc:493] T cfbe734be0c84115840c7c45f3398002 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:33.346776 20505 raft_consensus.cc:515] T cfbe734be0c84115840c7c45f3398002 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:33.348785 20505 leader_election.cc:290] T cfbe734be0c84115840c7c45f3398002 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865), 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287)
I20251023 07:59:33.350565 20151 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cfbe734be0c84115840c7c45f3398002" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855" is_pre_election: true
I20251023 07:59:33.351516 20151 raft_consensus.cc:2468] T cfbe734be0c84115840c7c45f3398002 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35e7d1ade024444486e63cf1b81e9626 in term 0.
I20251023 07:59:33.353574 20041 leader_election.cc:304] T cfbe734be0c84115840c7c45f3398002 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, 35e7d1ade024444486e63cf1b81e9626; no voters:
I20251023 07:59:33.356853 20533 raft_consensus.cc:2804] T cfbe734be0c84115840c7c45f3398002 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:33.357020 20000 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cfbe734be0c84115840c7c45f3398002" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:33.357309 20533 raft_consensus.cc:493] T cfbe734be0c84115840c7c45f3398002 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:33.357707 20533 raft_consensus.cc:3060] T cfbe734be0c84115840c7c45f3398002 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:33.357772 20000 raft_consensus.cc:2468] T cfbe734be0c84115840c7c45f3398002 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35e7d1ade024444486e63cf1b81e9626 in term 0.
I20251023 07:59:33.361618 20271 tablet_bootstrap.cc:492] T 20f681957fa04333b8a04cbad085db57 P 0f412334fb994ff0ab492afde64f5855: No bootstrap required, opened a new log
I20251023 07:59:33.365685 20533 raft_consensus.cc:515] T cfbe734be0c84115840c7c45f3398002 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:33.366608 20271 ts_tablet_manager.cc:1403] T 20f681957fa04333b8a04cbad085db57 P 0f412334fb994ff0ab492afde64f5855: Time spent bootstrapping tablet: real 0.125s user 0.006s sys 0.012s
I20251023 07:59:33.369998 20000 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cfbe734be0c84115840c7c45f3398002" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c"
I20251023 07:59:33.372174 20226 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b6aca6db6ab43e8be0b6ec22dc96700" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c"
I20251023 07:59:33.370752 20000 raft_consensus.cc:3060] T cfbe734be0c84115840c7c45f3398002 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Advancing to term 1
W20251023 07:59:33.373589 20043 leader_election.cc:343] T 8b6aca6db6ab43e8be0b6ec22dc96700 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955): Illegal state: must be running to vote when last-logged opid is not known
W20251023 07:59:33.377063 20192 consensus_peers.cc:597] T 13d572956c644586b0efbe8f63aecae5 P 65876a2b197c4ea6918f5cab47ded25c -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:33.377355 20336 leader_election.cc:290] T 8b6aca6db6ab43e8be0b6ec22dc96700 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 election: Requested vote from peers 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287), 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955)
I20251023 07:59:33.379438 20271 raft_consensus.cc:359] T 20f681957fa04333b8a04cbad085db57 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:33.380975 20271 raft_consensus.cc:385] T 20f681957fa04333b8a04cbad085db57 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:33.381307 20271 raft_consensus.cc:740] T 20f681957fa04333b8a04cbad085db57 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Initialized, Role: FOLLOWER
I20251023 07:59:33.382174 20151 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cfbe734be0c84115840c7c45f3398002" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855"
I20251023 07:59:33.382772 20151 raft_consensus.cc:3060] T cfbe734be0c84115840c7c45f3398002 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:33.383493 20271 consensus_queue.cc:260] T 20f681957fa04333b8a04cbad085db57 P 0f412334fb994ff0ab492afde64f5855 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:33.386046 20271 ts_tablet_manager.cc:1434] T 20f681957fa04333b8a04cbad085db57 P 0f412334fb994ff0ab492afde64f5855: Time spent starting tablet: real 0.019s user 0.006s sys 0.000s
I20251023 07:59:33.387230 20271 tablet_bootstrap.cc:492] T d6cbef26ab7c4389b265743ae018e227 P 0f412334fb994ff0ab492afde64f5855: Bootstrap starting.
I20251023 07:59:33.391103 20151 raft_consensus.cc:2468] T cfbe734be0c84115840c7c45f3398002 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35e7d1ade024444486e63cf1b81e9626 in term 1.
I20251023 07:59:33.392370 20041 leader_election.cc:304] T cfbe734be0c84115840c7c45f3398002 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, 35e7d1ade024444486e63cf1b81e9626; no voters:
I20251023 07:59:33.380234 20000 raft_consensus.cc:2468] T cfbe734be0c84115840c7c45f3398002 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35e7d1ade024444486e63cf1b81e9626 in term 1.
I20251023 07:59:33.393162 20336 raft_consensus.cc:2804] T cfbe734be0c84115840c7c45f3398002 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:59:33.393671 20336 raft_consensus.cc:697] T cfbe734be0c84115840c7c45f3398002 P 35e7d1ade024444486e63cf1b81e9626 [term 1 LEADER]: Becoming Leader. State: Replica: 35e7d1ade024444486e63cf1b81e9626, State: Running, Role: LEADER
I20251023 07:59:33.393750 20533 leader_election.cc:290] T cfbe734be0c84115840c7c45f3398002 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 election: Requested vote from peers d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865), 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287)
I20251023 07:59:33.370132 19898 catalog_manager.cc:5649] T a468f7a5913245b58705dc4f8560dade P 35e7d1ade024444486e63cf1b81e9626 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2). New cstate: current_term: 1 leader_uuid: "35e7d1ade024444486e63cf1b81e9626" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:33.365638 20152 raft_consensus.cc:2468] T 8b6aca6db6ab43e8be0b6ec22dc96700 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35e7d1ade024444486e63cf1b81e9626 in term 1.
I20251023 07:59:33.400128 20041 leader_election.cc:304] T 8b6aca6db6ab43e8be0b6ec22dc96700 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, 35e7d1ade024444486e63cf1b81e9626; no voters: 65876a2b197c4ea6918f5cab47ded25c
I20251023 07:59:33.401849 20505 raft_consensus.cc:2804] T 8b6aca6db6ab43e8be0b6ec22dc96700 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:59:33.402474 20505 raft_consensus.cc:697] T 8b6aca6db6ab43e8be0b6ec22dc96700 P 35e7d1ade024444486e63cf1b81e9626 [term 1 LEADER]: Becoming Leader. State: Replica: 35e7d1ade024444486e63cf1b81e9626, State: Running, Role: LEADER
I20251023 07:59:33.403524 20505 consensus_queue.cc:237] T 8b6aca6db6ab43e8be0b6ec22dc96700 P 35e7d1ade024444486e63cf1b81e9626 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:33.405718 20336 consensus_queue.cc:237] T cfbe734be0c84115840c7c45f3398002 P 35e7d1ade024444486e63cf1b81e9626 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:33.457077 20271 tablet_bootstrap.cc:654] T d6cbef26ab7c4389b265743ae018e227 P 0f412334fb994ff0ab492afde64f5855: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:33.464654 20274 tablet_bootstrap.cc:492] T c3527495b334413f82d0eca2c4d117b1 P 65876a2b197c4ea6918f5cab47ded25c: No bootstrap required, opened a new log
I20251023 07:59:33.465158 20274 ts_tablet_manager.cc:1403] T c3527495b334413f82d0eca2c4d117b1 P 65876a2b197c4ea6918f5cab47ded25c: Time spent bootstrapping tablet: real 0.192s user 0.043s sys 0.052s
I20251023 07:59:33.467835 20274 raft_consensus.cc:359] T c3527495b334413f82d0eca2c4d117b1 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:33.468526 20274 raft_consensus.cc:385] T c3527495b334413f82d0eca2c4d117b1 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:33.468791 20274 raft_consensus.cc:740] T c3527495b334413f82d0eca2c4d117b1 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65876a2b197c4ea6918f5cab47ded25c, State: Initialized, Role: FOLLOWER
I20251023 07:59:33.469390 20274 consensus_queue.cc:260] T c3527495b334413f82d0eca2c4d117b1 P 65876a2b197c4ea6918f5cab47ded25c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
W20251023 07:59:33.457595 20044 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.126.1:37865, user_credentials={real_user=slave}} blocked reactor thread for 58584.8us
W20251023 07:59:33.458698 20041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.126.3:33287, user_credentials={real_user=slave}} blocked reactor thread for 58684.8us
I20251023 07:59:33.459391 20272 tablet_bootstrap.cc:492] T dc81e0e89365425793f2851459b7e892 P 35e7d1ade024444486e63cf1b81e9626: No bootstrap required, opened a new log
I20251023 07:59:33.460413 20414 raft_consensus.cc:493] T f20a7a673ce6433eac41600d3573e314 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:33.471660 20274 ts_tablet_manager.cc:1434] T c3527495b334413f82d0eca2c4d117b1 P 65876a2b197c4ea6918f5cab47ded25c: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20251023 07:59:33.471967 20414 raft_consensus.cc:515] T f20a7a673ce6433eac41600d3573e314 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:33.472764 20274 tablet_bootstrap.cc:492] T 8b6aca6db6ab43e8be0b6ec22dc96700 P 65876a2b197c4ea6918f5cab47ded25c: Bootstrap starting.
I20251023 07:59:33.474756 20414 leader_election.cc:290] T f20a7a673ce6433eac41600d3573e314 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:33.461534 20273 tablet_bootstrap.cc:492] T c3527495b334413f82d0eca2c4d117b1 P d1379e91aa9c41629cd25262571beb2c: No bootstrap required, opened a new log
I20251023 07:59:33.475572 20272 ts_tablet_manager.cc:1403] T dc81e0e89365425793f2851459b7e892 P 35e7d1ade024444486e63cf1b81e9626: Time spent bootstrapping tablet: real 0.181s user 0.023s sys 0.035s
I20251023 07:59:33.476281 20000 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f20a7a673ce6433eac41600d3573e314" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
W20251023 07:59:33.478112 20192 leader_election.cc:343] T f20a7a673ce6433eac41600d3573e314 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:33.478996 20152 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f20a7a673ce6433eac41600d3573e314" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855" is_pre_election: true
I20251023 07:59:33.479341 20274 tablet_bootstrap.cc:654] T 8b6aca6db6ab43e8be0b6ec22dc96700 P 65876a2b197c4ea6918f5cab47ded25c: Neither blocks nor log segments found. Creating new log.
W20251023 07:59:33.480320 20189 leader_election.cc:343] T f20a7a673ce6433eac41600d3573e314 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:33.480845 20189 leader_election.cc:304] T f20a7a673ce6433eac41600d3573e314 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65876a2b197c4ea6918f5cab47ded25c; no voters: 0f412334fb994ff0ab492afde64f5855, d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:33.481748 20414 raft_consensus.cc:2749] T f20a7a673ce6433eac41600d3573e314 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:59:33.476341 20273 ts_tablet_manager.cc:1403] T c3527495b334413f82d0eca2c4d117b1 P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.176s user 0.018s sys 0.042s
I20251023 07:59:33.480495 20272 raft_consensus.cc:359] T dc81e0e89365425793f2851459b7e892 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:33.483127 20272 raft_consensus.cc:385] T dc81e0e89365425793f2851459b7e892 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:33.483528 20272 raft_consensus.cc:740] T dc81e0e89365425793f2851459b7e892 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e7d1ade024444486e63cf1b81e9626, State: Initialized, Role: FOLLOWER
I20251023 07:59:33.484376 20272 consensus_queue.cc:260] T dc81e0e89365425793f2851459b7e892 P 35e7d1ade024444486e63cf1b81e9626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:33.488929 20273 raft_consensus.cc:359] T c3527495b334413f82d0eca2c4d117b1 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:33.494565 20273 raft_consensus.cc:385] T c3527495b334413f82d0eca2c4d117b1 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:33.495057 20273 raft_consensus.cc:740] T c3527495b334413f82d0eca2c4d117b1 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:33.502467 20272 ts_tablet_manager.cc:1434] T dc81e0e89365425793f2851459b7e892 P 35e7d1ade024444486e63cf1b81e9626: Time spent starting tablet: real 0.026s user 0.004s sys 0.003s
I20251023 07:59:33.503870 20272 tablet_bootstrap.cc:492] T bd5baee3419c4a7aa0def773845ac48a P 35e7d1ade024444486e63cf1b81e9626: Bootstrap starting.
I20251023 07:59:33.495872 20273 consensus_queue.cc:260] T c3527495b334413f82d0eca2c4d117b1 P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:33.509524 20273 ts_tablet_manager.cc:1434] T c3527495b334413f82d0eca2c4d117b1 P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.027s user 0.008s sys 0.000s
I20251023 07:59:33.513150 20271 tablet_bootstrap.cc:492] T d6cbef26ab7c4389b265743ae018e227 P 0f412334fb994ff0ab492afde64f5855: No bootstrap required, opened a new log
I20251023 07:59:33.524816 20271 ts_tablet_manager.cc:1403] T d6cbef26ab7c4389b265743ae018e227 P 0f412334fb994ff0ab492afde64f5855: Time spent bootstrapping tablet: real 0.138s user 0.014s sys 0.011s
I20251023 07:59:33.513617 20273 tablet_bootstrap.cc:492] T f20a7a673ce6433eac41600d3573e314 P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
W20251023 07:59:33.529963 20557 log.cc:927] Time spent T 8b6aca6db6ab43e8be0b6ec22dc96700 P 35e7d1ade024444486e63cf1b81e9626: Append to log took a long time: real 0.060s user 0.000s sys 0.001s
I20251023 07:59:33.516342 19897 catalog_manager.cc:5649] T ae516c440b7749f388e0e2f89a6a81b7 P 65876a2b197c4ea6918f5cab47ded25c reported cstate change: term changed from 0 to 1, leader changed from <none> to 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4). New cstate: current_term: 1 leader_uuid: "65876a2b197c4ea6918f5cab47ded25c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } health_report { overall_health: HEALTHY } } }
I20251023 07:59:33.535418 20273 tablet_bootstrap.cc:654] T f20a7a673ce6433eac41600d3573e314 P d1379e91aa9c41629cd25262571beb2c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:33.523756 20400 raft_consensus.cc:493] T 20f681957fa04333b8a04cbad085db57 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:33.536427 20400 raft_consensus.cc:515] T 20f681957fa04333b8a04cbad085db57 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:33.536845 20336 consensus_queue.cc:1048] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P 35e7d1ade024444486e63cf1b81e9626 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:59:33.538537 20400 leader_election.cc:290] T 20f681957fa04333b8a04cbad085db57 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:33.539299 20221 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "20f681957fa04333b8a04cbad085db57" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c" is_pre_election: true
I20251023 07:59:33.521355 20274 tablet_bootstrap.cc:492] T 8b6aca6db6ab43e8be0b6ec22dc96700 P 65876a2b197c4ea6918f5cab47ded25c: No bootstrap required, opened a new log
I20251023 07:59:33.540570 20274 ts_tablet_manager.cc:1403] T 8b6aca6db6ab43e8be0b6ec22dc96700 P 65876a2b197c4ea6918f5cab47ded25c: Time spent bootstrapping tablet: real 0.068s user 0.020s sys 0.028s
I20251023 07:59:33.529247 20271 raft_consensus.cc:359] T d6cbef26ab7c4389b265743ae018e227 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:33.535494 20272 tablet_bootstrap.cc:654] T bd5baee3419c4a7aa0def773845ac48a P 35e7d1ade024444486e63cf1b81e9626: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:33.541711 20003 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "20f681957fa04333b8a04cbad085db57" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
W20251023 07:59:33.543493 20118 leader_election.cc:343] T 20f681957fa04333b8a04cbad085db57 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:33.541743 20271 raft_consensus.cc:385] T d6cbef26ab7c4389b265743ae018e227 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:33.544641 20271 raft_consensus.cc:740] T d6cbef26ab7c4389b265743ae018e227 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Initialized, Role: FOLLOWER
W20251023 07:59:33.544659 20117 leader_election.cc:343] T 20f681957fa04333b8a04cbad085db57 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:33.545235 20117 leader_election.cc:304] T 20f681957fa04333b8a04cbad085db57 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855; no voters: 65876a2b197c4ea6918f5cab47ded25c, d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:33.545392 20271 consensus_queue.cc:260] T d6cbef26ab7c4389b265743ae018e227 P 0f412334fb994ff0ab492afde64f5855 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:33.546541 20438 raft_consensus.cc:2749] T 20f681957fa04333b8a04cbad085db57 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:59:33.547907 20271 ts_tablet_manager.cc:1434] T d6cbef26ab7c4389b265743ae018e227 P 0f412334fb994ff0ab492afde64f5855: Time spent starting tablet: real 0.023s user 0.006s sys 0.000s
I20251023 07:59:33.549089 20271 tablet_bootstrap.cc:492] T f20a7a673ce6433eac41600d3573e314 P 0f412334fb994ff0ab492afde64f5855: Bootstrap starting.
I20251023 07:59:33.551407 20274 raft_consensus.cc:359] T 8b6aca6db6ab43e8be0b6ec22dc96700 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:33.552151 20274 raft_consensus.cc:385] T 8b6aca6db6ab43e8be0b6ec22dc96700 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:33.552426 20274 raft_consensus.cc:740] T 8b6aca6db6ab43e8be0b6ec22dc96700 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65876a2b197c4ea6918f5cab47ded25c, State: Initialized, Role: FOLLOWER
I20251023 07:59:33.557219 20512 consensus_queue.cc:1048] T ae516c440b7749f388e0e2f89a6a81b7 P 65876a2b197c4ea6918f5cab47ded25c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20251023 07:59:33.560681 19949 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20251023 07:59:33.563544 20273 tablet_bootstrap.cc:492] T f20a7a673ce6433eac41600d3573e314 P d1379e91aa9c41629cd25262571beb2c: No bootstrap required, opened a new log
I20251023 07:59:33.564088 20273 ts_tablet_manager.cc:1403] T f20a7a673ce6433eac41600d3573e314 P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.051s user 0.011s sys 0.000s
I20251023 07:59:33.570053 20152 raft_consensus.cc:3060] T ae516c440b7749f388e0e2f89a6a81b7 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:33.571410 20273 raft_consensus.cc:359] T f20a7a673ce6433eac41600d3573e314 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:33.572161 20273 raft_consensus.cc:385] T f20a7a673ce6433eac41600d3573e314 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:33.572430 20273 raft_consensus.cc:740] T f20a7a673ce6433eac41600d3573e314 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:33.576738 20273 consensus_queue.cc:260] T f20a7a673ce6433eac41600d3573e314 P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:33.579329 20273 ts_tablet_manager.cc:1434] T f20a7a673ce6433eac41600d3573e314 P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.015s user 0.007s sys 0.000s
I20251023 07:59:33.580389 20273 tablet_bootstrap.cc:492] T d6cbef26ab7c4389b265743ae018e227 P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:33.581326 20274 consensus_queue.cc:260] T 8b6aca6db6ab43e8be0b6ec22dc96700 P 65876a2b197c4ea6918f5cab47ded25c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:33.584213 20274 ts_tablet_manager.cc:1434] T 8b6aca6db6ab43e8be0b6ec22dc96700 P 65876a2b197c4ea6918f5cab47ded25c: Time spent starting tablet: real 0.043s user 0.006s sys 0.000s
I20251023 07:59:33.585253 20274 tablet_bootstrap.cc:492] T c469a3ace4204641be00f1b797fbffe9 P 65876a2b197c4ea6918f5cab47ded25c: Bootstrap starting.
I20251023 07:59:33.589529 20273 tablet_bootstrap.cc:654] T d6cbef26ab7c4389b265743ae018e227 P d1379e91aa9c41629cd25262571beb2c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:33.592813 20282 consensus_queue.cc:1048] T c52243b5fda44e2fba36f6319b4c13e3 P 35e7d1ade024444486e63cf1b81e9626 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:59:33.594465 20272 tablet_bootstrap.cc:492] T bd5baee3419c4a7aa0def773845ac48a P 35e7d1ade024444486e63cf1b81e9626: No bootstrap required, opened a new log
I20251023 07:59:33.595465 20272 ts_tablet_manager.cc:1403] T bd5baee3419c4a7aa0def773845ac48a P 35e7d1ade024444486e63cf1b81e9626: Time spent bootstrapping tablet: real 0.092s user 0.010s sys 0.002s
I20251023 07:59:33.589399 20414 consensus_queue.cc:1048] T ae516c440b7749f388e0e2f89a6a81b7 P 65876a2b197c4ea6918f5cab47ded25c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20251023 07:59:33.579593 19898 catalog_manager.cc:5649] T cfbe734be0c84115840c7c45f3398002 P 35e7d1ade024444486e63cf1b81e9626 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2). New cstate: current_term: 1 leader_uuid: "35e7d1ade024444486e63cf1b81e9626" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:33.604050 19898 catalog_manager.cc:5649] T 8b6aca6db6ab43e8be0b6ec22dc96700 P 35e7d1ade024444486e63cf1b81e9626 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2). New cstate: current_term: 1 leader_uuid: "35e7d1ade024444486e63cf1b81e9626" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:33.606362 20271 tablet_bootstrap.cc:654] T f20a7a673ce6433eac41600d3573e314 P 0f412334fb994ff0ab492afde64f5855: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:33.612174 20000 raft_consensus.cc:3060] T c52243b5fda44e2fba36f6319b4c13e3 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:33.599555 20272 raft_consensus.cc:359] T bd5baee3419c4a7aa0def773845ac48a P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:33.613574 20272 raft_consensus.cc:385] T bd5baee3419c4a7aa0def773845ac48a P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:33.613873 20272 raft_consensus.cc:740] T bd5baee3419c4a7aa0def773845ac48a P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e7d1ade024444486e63cf1b81e9626, State: Initialized, Role: FOLLOWER
I20251023 07:59:33.614660 20272 consensus_queue.cc:260] T bd5baee3419c4a7aa0def773845ac48a P 35e7d1ade024444486e63cf1b81e9626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:33.617199 20272 ts_tablet_manager.cc:1434] T bd5baee3419c4a7aa0def773845ac48a P 35e7d1ade024444486e63cf1b81e9626: Time spent starting tablet: real 0.021s user 0.002s sys 0.004s
I20251023 07:59:33.618322 20272 tablet_bootstrap.cc:492] T c3527495b334413f82d0eca2c4d117b1 P 35e7d1ade024444486e63cf1b81e9626: Bootstrap starting.
I20251023 07:59:33.625643 20274 tablet_bootstrap.cc:654] T c469a3ace4204641be00f1b797fbffe9 P 65876a2b197c4ea6918f5cab47ded25c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:33.629817 20414 raft_consensus.cc:493] T dc81e0e89365425793f2851459b7e892 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:33.634866 20336 consensus_queue.cc:1048] T c52243b5fda44e2fba36f6319b4c13e3 P 35e7d1ade024444486e63cf1b81e9626 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:59:33.635084 20414 raft_consensus.cc:515] T dc81e0e89365425793f2851459b7e892 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:33.636449 20282 consensus_queue.cc:1048] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P 35e7d1ade024444486e63cf1b81e9626 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:59:33.637328 20414 leader_election.cc:290] T dc81e0e89365425793f2851459b7e892 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309), 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287)
I20251023 07:59:33.638664 20279 raft_consensus.cc:493] T c52243b5fda44e2fba36f6319b4c13e3 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:33.639201 20279 raft_consensus.cc:515] T c52243b5fda44e2fba36f6319b4c13e3 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:33.640779 20075 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dc81e0e89365425793f2851459b7e892" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
I20251023 07:59:33.641407 20075 raft_consensus.cc:2468] T dc81e0e89365425793f2851459b7e892 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65876a2b197c4ea6918f5cab47ded25c in term 0.
I20251023 07:59:33.641284 20279 leader_election.cc:290] T c52243b5fda44e2fba36f6319b4c13e3 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955), 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309)
I20251023 07:59:33.643463 20226 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c52243b5fda44e2fba36f6319b4c13e3" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c" is_pre_election: true
I20251023 07:59:33.643777 20272 tablet_bootstrap.cc:654] T c3527495b334413f82d0eca2c4d117b1 P 35e7d1ade024444486e63cf1b81e9626: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:33.644968 20190 leader_election.cc:304] T dc81e0e89365425793f2851459b7e892 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35e7d1ade024444486e63cf1b81e9626, 65876a2b197c4ea6918f5cab47ded25c; no voters:
I20251023 07:59:33.644963 20075 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c52243b5fda44e2fba36f6319b4c13e3" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
I20251023 07:59:33.645936 20514 raft_consensus.cc:2804] T dc81e0e89365425793f2851459b7e892 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:33.646309 20514 raft_consensus.cc:493] T dc81e0e89365425793f2851459b7e892 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:33.646661 20514 raft_consensus.cc:3060] T dc81e0e89365425793f2851459b7e892 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:33.648386 19967 leader_election.cc:304] T c52243b5fda44e2fba36f6319b4c13e3 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d1379e91aa9c41629cd25262571beb2c; no voters: 35e7d1ade024444486e63cf1b81e9626, 65876a2b197c4ea6918f5cab47ded25c
I20251023 07:59:33.650208 20152 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dc81e0e89365425793f2851459b7e892" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855" is_pre_election: true
W20251023 07:59:33.651714 20189 leader_election.cc:343] T dc81e0e89365425793f2851459b7e892 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:33.668031 20282 consensus_queue.cc:1048] T f8ceeb2a7d7d45629aee9466b149251b P 35e7d1ade024444486e63cf1b81e9626 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:59:33.691080 20271 tablet_bootstrap.cc:492] T f20a7a673ce6433eac41600d3573e314 P 0f412334fb994ff0ab492afde64f5855: No bootstrap required, opened a new log
I20251023 07:59:33.699373 20341 raft_consensus.cc:493] T c3527495b334413f82d0eca2c4d117b1 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:33.668840 20514 raft_consensus.cc:515] T dc81e0e89365425793f2851459b7e892 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:33.699900 20341 raft_consensus.cc:515] T c3527495b334413f82d0eca2c4d117b1 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:33.701932 20341 leader_election.cc:290] T c3527495b334413f82d0eca2c4d117b1 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865), 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309)
I20251023 07:59:33.702579 20075 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dc81e0e89365425793f2851459b7e892" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626"
I20251023 07:59:33.703138 20510 raft_consensus.cc:493] T c3527495b334413f82d0eca2c4d117b1 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:33.703194 20075 raft_consensus.cc:3060] T dc81e0e89365425793f2851459b7e892 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:33.703428 20514 leader_election.cc:290] T dc81e0e89365425793f2851459b7e892 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 election: Requested vote from peers 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309), 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287)
I20251023 07:59:33.703708 20510 raft_consensus.cc:515] T c3527495b334413f82d0eca2c4d117b1 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:33.705821 20078 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c3527495b334413f82d0eca2c4d117b1" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
I20251023 07:59:33.701480 20271 ts_tablet_manager.cc:1403] T f20a7a673ce6433eac41600d3573e314 P 0f412334fb994ff0ab492afde64f5855: Time spent bootstrapping tablet: real 0.150s user 0.012s sys 0.004s
W20251023 07:59:33.708775 20190 leader_election.cc:343] T c3527495b334413f82d0eca2c4d117b1 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:33.706703 20282 consensus_queue.cc:1048] T a468f7a5913245b58705dc4f8560dade P 35e7d1ade024444486e63cf1b81e9626 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20251023 07:59:33.711035 20510 leader_election.cc:290] T c3527495b334413f82d0eca2c4d117b1 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955), 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309)
I20251023 07:59:33.712385 20152 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dc81e0e89365425793f2851459b7e892" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855"
I20251023 07:59:33.712421 20077 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c3527495b334413f82d0eca2c4d117b1" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
I20251023 07:59:33.712385 20000 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c3527495b334413f82d0eca2c4d117b1" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:33.714062 20000 raft_consensus.cc:2468] T c3527495b334413f82d0eca2c4d117b1 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65876a2b197c4ea6918f5cab47ded25c in term 0.
W20251023 07:59:33.714951 19967 leader_election.cc:343] T c3527495b334413f82d0eca2c4d117b1 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:33.715292 20226 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c3527495b334413f82d0eca2c4d117b1" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c" is_pre_election: true
W20251023 07:59:33.715714 20189 leader_election.cc:343] T dc81e0e89365425793f2851459b7e892 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:33.715839 20192 leader_election.cc:304] T c3527495b334413f82d0eca2c4d117b1 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65876a2b197c4ea6918f5cab47ded25c, d1379e91aa9c41629cd25262571beb2c; no voters: 35e7d1ade024444486e63cf1b81e9626
I20251023 07:59:33.715909 20226 raft_consensus.cc:2468] T c3527495b334413f82d0eca2c4d117b1 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 0.
I20251023 07:59:33.717339 20414 raft_consensus.cc:2804] T c3527495b334413f82d0eca2c4d117b1 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:33.717813 20414 raft_consensus.cc:493] T c3527495b334413f82d0eca2c4d117b1 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:33.718237 20414 raft_consensus.cc:3060] T c3527495b334413f82d0eca2c4d117b1 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:33.718211 19968 leader_election.cc:304] T c3527495b334413f82d0eca2c4d117b1 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65876a2b197c4ea6918f5cab47ded25c, d1379e91aa9c41629cd25262571beb2c; no voters: 35e7d1ade024444486e63cf1b81e9626
I20251023 07:59:33.723721 20336 consensus_queue.cc:1048] T a468f7a5913245b58705dc4f8560dade P 35e7d1ade024444486e63cf1b81e9626 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20251023 07:59:33.725808 20510 raft_consensus.cc:2804] T c3527495b334413f82d0eca2c4d117b1 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:33.732772 20273 tablet_bootstrap.cc:492] T d6cbef26ab7c4389b265743ae018e227 P d1379e91aa9c41629cd25262571beb2c: No bootstrap required, opened a new log
I20251023 07:59:33.733312 20273 ts_tablet_manager.cc:1403] T d6cbef26ab7c4389b265743ae018e227 P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.153s user 0.024s sys 0.002s
I20251023 07:59:33.731005 20510 raft_consensus.cc:493] T c3527495b334413f82d0eca2c4d117b1 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:33.737005 20279 raft_consensus.cc:2749] T c52243b5fda44e2fba36f6319b4c13e3 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251023 07:59:33.738535 20510 raft_consensus.cc:3060] T c3527495b334413f82d0eca2c4d117b1 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:33.740581 20274 tablet_bootstrap.cc:492] T c469a3ace4204641be00f1b797fbffe9 P 65876a2b197c4ea6918f5cab47ded25c: No bootstrap required, opened a new log
I20251023 07:59:33.741082 20274 ts_tablet_manager.cc:1403] T c469a3ace4204641be00f1b797fbffe9 P 65876a2b197c4ea6918f5cab47ded25c: Time spent bootstrapping tablet: real 0.156s user 0.009s sys 0.005s
I20251023 07:59:33.753087 20274 raft_consensus.cc:359] T c469a3ace4204641be00f1b797fbffe9 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:33.753846 20274 raft_consensus.cc:385] T c469a3ace4204641be00f1b797fbffe9 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:33.754122 20274 raft_consensus.cc:740] T c469a3ace4204641be00f1b797fbffe9 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65876a2b197c4ea6918f5cab47ded25c, State: Initialized, Role: FOLLOWER
I20251023 07:59:33.755738 20274 consensus_queue.cc:260] T c469a3ace4204641be00f1b797fbffe9 P 65876a2b197c4ea6918f5cab47ded25c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:33.758136 20274 ts_tablet_manager.cc:1434] T c469a3ace4204641be00f1b797fbffe9 P 65876a2b197c4ea6918f5cab47ded25c: Time spent starting tablet: real 0.017s user 0.008s sys 0.000s
I20251023 07:59:33.759179 20274 tablet_bootstrap.cc:492] T a1c85032f5ef4634a35c20eec56ae62f P 65876a2b197c4ea6918f5cab47ded25c: Bootstrap starting.
I20251023 07:59:33.760587 20400 raft_consensus.cc:493] T d6cbef26ab7c4389b265743ae018e227 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:33.761123 20400 raft_consensus.cc:515] T d6cbef26ab7c4389b265743ae018e227 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:33.767551 20273 raft_consensus.cc:359] T d6cbef26ab7c4389b265743ae018e227 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:33.770644 20002 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d6cbef26ab7c4389b265743ae018e227" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:33.778815 20273 raft_consensus.cc:385] T d6cbef26ab7c4389b265743ae018e227 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:33.779152 20273 raft_consensus.cc:740] T d6cbef26ab7c4389b265743ae018e227 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:33.779784 20273 consensus_queue.cc:260] T d6cbef26ab7c4389b265743ae018e227 P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:33.774396 20400 leader_election.cc:290] T d6cbef26ab7c4389b265743ae018e227 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865), 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309)
I20251023 07:59:33.781013 20002 raft_consensus.cc:2468] T d6cbef26ab7c4389b265743ae018e227 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f412334fb994ff0ab492afde64f5855 in term 0.
I20251023 07:59:33.783488 20273 ts_tablet_manager.cc:1434] T d6cbef26ab7c4389b265743ae018e227 P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.049s user 0.007s sys 0.000s
I20251023 07:59:33.778369 20272 tablet_bootstrap.cc:492] T c3527495b334413f82d0eca2c4d117b1 P 35e7d1ade024444486e63cf1b81e9626: No bootstrap required, opened a new log
I20251023 07:59:33.784644 20272 ts_tablet_manager.cc:1403] T c3527495b334413f82d0eca2c4d117b1 P 35e7d1ade024444486e63cf1b81e9626: Time spent bootstrapping tablet: real 0.167s user 0.010s sys 0.008s
I20251023 07:59:33.789239 20077 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d6cbef26ab7c4389b265743ae018e227" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
I20251023 07:59:33.765645 20271 raft_consensus.cc:359] T f20a7a673ce6433eac41600d3573e314 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:33.792491 20271 raft_consensus.cc:385] T f20a7a673ce6433eac41600d3573e314 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:33.792763 20271 raft_consensus.cc:740] T f20a7a673ce6433eac41600d3573e314 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Initialized, Role: FOLLOWER
W20251023 07:59:33.797758 20116 leader_election.cc:343] T d6cbef26ab7c4389b265743ae018e227 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:33.807155 20273 tablet_bootstrap.cc:492] T fb985a87f45d43d68b172b937404e770 P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:33.807791 20510 raft_consensus.cc:515] T c3527495b334413f82d0eca2c4d117b1 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:33.809818 20271 consensus_queue.cc:260] T f20a7a673ce6433eac41600d3573e314 P 0f412334fb994ff0ab492afde64f5855 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
W20251023 07:59:33.816311 19968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.4:34955, user_credentials={real_user=slave}} blocked reactor thread for 43578.2us
I20251023 07:59:33.822208 20272 raft_consensus.cc:359] T c3527495b334413f82d0eca2c4d117b1 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:33.823071 20272 raft_consensus.cc:385] T c3527495b334413f82d0eca2c4d117b1 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:33.823351 20272 raft_consensus.cc:740] T c3527495b334413f82d0eca2c4d117b1 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e7d1ade024444486e63cf1b81e9626, State: Initialized, Role: FOLLOWER
I20251023 07:59:33.825470 20510 leader_election.cc:290] T c3527495b334413f82d0eca2c4d117b1 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 election: Requested vote from peers 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955), 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309)
I20251023 07:59:33.822832 20118 leader_election.cc:304] T d6cbef26ab7c4389b265743ae018e227 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, d1379e91aa9c41629cd25262571beb2c; no voters: 35e7d1ade024444486e63cf1b81e9626
I20251023 07:59:33.830602 20272 consensus_queue.cc:260] T c3527495b334413f82d0eca2c4d117b1 P 35e7d1ade024444486e63cf1b81e9626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
W20251023 07:59:33.831710 20044 consensus_peers.cc:597] T f8ceeb2a7d7d45629aee9466b149251b P 35e7d1ade024444486e63cf1b81e9626 -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:33.828760 20078 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c3527495b334413f82d0eca2c4d117b1" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626"
I20251023 07:59:33.835180 20078 raft_consensus.cc:3060] T c3527495b334413f82d0eca2c4d117b1 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:33.832324 20438 raft_consensus.cc:2804] T d6cbef26ab7c4389b265743ae018e227 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:33.833706 20221 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c3527495b334413f82d0eca2c4d117b1" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c"
I20251023 07:59:33.827483 20075 raft_consensus.cc:2468] T dc81e0e89365425793f2851459b7e892 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65876a2b197c4ea6918f5cab47ded25c in term 1.
I20251023 07:59:33.838919 20272 ts_tablet_manager.cc:1434] T c3527495b334413f82d0eca2c4d117b1 P 35e7d1ade024444486e63cf1b81e9626: Time spent starting tablet: real 0.054s user 0.007s sys 0.000s
I20251023 07:59:33.840163 20438 raft_consensus.cc:493] T d6cbef26ab7c4389b265743ae018e227 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:33.841176 20438 raft_consensus.cc:3060] T d6cbef26ab7c4389b265743ae018e227 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:33.841519 20271 ts_tablet_manager.cc:1434] T f20a7a673ce6433eac41600d3573e314 P 0f412334fb994ff0ab492afde64f5855: Time spent starting tablet: real 0.134s user 0.005s sys 0.003s
I20251023 07:59:33.842607 20271 tablet_bootstrap.cc:492] T fb985a87f45d43d68b172b937404e770 P 0f412334fb994ff0ab492afde64f5855: Bootstrap starting.
I20251023 07:59:33.844379 20190 leader_election.cc:304] T dc81e0e89365425793f2851459b7e892 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35e7d1ade024444486e63cf1b81e9626, 65876a2b197c4ea6918f5cab47ded25c; no voters: 0f412334fb994ff0ab492afde64f5855
I20251023 07:59:33.845592 20514 raft_consensus.cc:2804] T dc81e0e89365425793f2851459b7e892 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:59:33.846082 20514 raft_consensus.cc:697] T dc81e0e89365425793f2851459b7e892 P 65876a2b197c4ea6918f5cab47ded25c [term 1 LEADER]: Becoming Leader. State: Replica: 65876a2b197c4ea6918f5cab47ded25c, State: Running, Role: LEADER
I20251023 07:59:33.846908 20514 consensus_queue.cc:237] T dc81e0e89365425793f2851459b7e892 P 65876a2b197c4ea6918f5cab47ded25c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:33.849689 20274 tablet_bootstrap.cc:654] T a1c85032f5ef4634a35c20eec56ae62f P 65876a2b197c4ea6918f5cab47ded25c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:33.850543 20078 raft_consensus.cc:2468] T c3527495b334413f82d0eca2c4d117b1 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 1.
I20251023 07:59:33.851130 20438 raft_consensus.cc:515] T d6cbef26ab7c4389b265743ae018e227 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:33.854971 20414 raft_consensus.cc:515] T c3527495b334413f82d0eca2c4d117b1 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:33.856353 19967 leader_election.cc:304] T c3527495b334413f82d0eca2c4d117b1 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35e7d1ade024444486e63cf1b81e9626, d1379e91aa9c41629cd25262571beb2c; no voters:
I20251023 07:59:33.858793 20003 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d6cbef26ab7c4389b265743ae018e227" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c"
I20251023 07:59:33.859207 20533 consensus_queue.cc:1048] T 8b6aca6db6ab43e8be0b6ec22dc96700 P 35e7d1ade024444486e63cf1b81e9626 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:59:33.863456 20438 leader_election.cc:290] T d6cbef26ab7c4389b265743ae018e227 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 election: Requested vote from peers d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865), 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309)
I20251023 07:59:33.863580 20510 raft_consensus.cc:2804] T c3527495b334413f82d0eca2c4d117b1 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:59:33.865097 20273 tablet_bootstrap.cc:654] T fb985a87f45d43d68b172b937404e770 P d1379e91aa9c41629cd25262571beb2c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:33.865201 20510 raft_consensus.cc:697] T c3527495b334413f82d0eca2c4d117b1 P d1379e91aa9c41629cd25262571beb2c [term 1 LEADER]: Becoming Leader. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Running, Role: LEADER
I20251023 07:59:33.866348 20510 consensus_queue.cc:237] T c3527495b334413f82d0eca2c4d117b1 P d1379e91aa9c41629cd25262571beb2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:33.872808 20272 tablet_bootstrap.cc:492] T d6cbef26ab7c4389b265743ae018e227 P 35e7d1ade024444486e63cf1b81e9626: Bootstrap starting.
I20251023 07:59:33.875500 20271 tablet_bootstrap.cc:654] T fb985a87f45d43d68b172b937404e770 P 0f412334fb994ff0ab492afde64f5855: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:33.864531 20003 raft_consensus.cc:3060] T d6cbef26ab7c4389b265743ae018e227 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:33.894677 20221 raft_consensus.cc:2393] T c3527495b334413f82d0eca2c4d117b1 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d1379e91aa9c41629cd25262571beb2c in current term 1: Already voted for candidate 65876a2b197c4ea6918f5cab47ded25c in this term.
I20251023 07:59:33.897104 20002 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c3527495b334413f82d0eca2c4d117b1" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c"
I20251023 07:59:33.897270 20075 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c3527495b334413f82d0eca2c4d117b1" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626"
I20251023 07:59:33.897508 20078 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d6cbef26ab7c4389b265743ae018e227" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626"
I20251023 07:59:33.898164 20075 raft_consensus.cc:2393] T c3527495b334413f82d0eca2c4d117b1 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 65876a2b197c4ea6918f5cab47ded25c in current term 1: Already voted for candidate d1379e91aa9c41629cd25262571beb2c in this term.
W20251023 07:59:33.899403 20116 leader_election.cc:343] T d6cbef26ab7c4389b265743ae018e227 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:33.902001 20190 leader_election.cc:304] T c3527495b334413f82d0eca2c4d117b1 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65876a2b197c4ea6918f5cab47ded25c; no voters: 35e7d1ade024444486e63cf1b81e9626, d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:33.903681 20514 raft_consensus.cc:2749] T c3527495b334413f82d0eca2c4d117b1 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20251023 07:59:33.909138 20221 raft_consensus.cc:3060] T 8b6aca6db6ab43e8be0b6ec22dc96700 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:33.909220 20510 raft_consensus.cc:493] T f20a7a673ce6433eac41600d3573e314 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:33.910543 20272 tablet_bootstrap.cc:654] T d6cbef26ab7c4389b265743ae018e227 P 35e7d1ade024444486e63cf1b81e9626: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:33.911281 20274 tablet_bootstrap.cc:492] T a1c85032f5ef4634a35c20eec56ae62f P 65876a2b197c4ea6918f5cab47ded25c: No bootstrap required, opened a new log
I20251023 07:59:33.911804 20274 ts_tablet_manager.cc:1403] T a1c85032f5ef4634a35c20eec56ae62f P 65876a2b197c4ea6918f5cab47ded25c: Time spent bootstrapping tablet: real 0.153s user 0.013s sys 0.006s
I20251023 07:59:33.914355 20274 raft_consensus.cc:359] T a1c85032f5ef4634a35c20eec56ae62f P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:33.915033 20274 raft_consensus.cc:385] T a1c85032f5ef4634a35c20eec56ae62f P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:33.915305 20274 raft_consensus.cc:740] T a1c85032f5ef4634a35c20eec56ae62f P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65876a2b197c4ea6918f5cab47ded25c, State: Initialized, Role: FOLLOWER
I20251023 07:59:33.915942 20274 consensus_queue.cc:260] T a1c85032f5ef4634a35c20eec56ae62f P 65876a2b197c4ea6918f5cab47ded25c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:33.916926 19898 catalog_manager.cc:5649] T dc81e0e89365425793f2851459b7e892 P 65876a2b197c4ea6918f5cab47ded25c reported cstate change: term changed from 0 to 1, leader changed from <none> to 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4). New cstate: current_term: 1 leader_uuid: "65876a2b197c4ea6918f5cab47ded25c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } health_report { overall_health: HEALTHY } } }
I20251023 07:59:33.917613 20510 raft_consensus.cc:515] T f20a7a673ce6433eac41600d3573e314 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:33.919687 20003 raft_consensus.cc:2468] T d6cbef26ab7c4389b265743ae018e227 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f412334fb994ff0ab492afde64f5855 in term 1.
I20251023 07:59:33.920924 20533 consensus_queue.cc:1048] T cfbe734be0c84115840c7c45f3398002 P 35e7d1ade024444486e63cf1b81e9626 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:59:33.897076 20414 leader_election.cc:290] T c3527495b334413f82d0eca2c4d117b1 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 election: Requested vote from peers d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865), 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309)
I20251023 07:59:33.922511 20152 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f20a7a673ce6433eac41600d3573e314" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855" is_pre_election: true
I20251023 07:59:33.923204 20152 raft_consensus.cc:2468] T f20a7a673ce6433eac41600d3573e314 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 0.
I20251023 07:59:33.923740 20273 tablet_bootstrap.cc:492] T fb985a87f45d43d68b172b937404e770 P d1379e91aa9c41629cd25262571beb2c: No bootstrap required, opened a new log
I20251023 07:59:33.924221 20273 ts_tablet_manager.cc:1403] T fb985a87f45d43d68b172b937404e770 P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.117s user 0.020s sys 0.006s
I20251023 07:59:33.924501 19966 leader_election.cc:304] T f20a7a673ce6433eac41600d3573e314 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, d1379e91aa9c41629cd25262571beb2c; no voters:
I20251023 07:59:33.925338 20576 raft_consensus.cc:2804] T f20a7a673ce6433eac41600d3573e314 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:33.925711 20576 raft_consensus.cc:493] T f20a7a673ce6433eac41600d3573e314 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:33.926055 20576 raft_consensus.cc:3060] T f20a7a673ce6433eac41600d3573e314 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:33.927055 20223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f20a7a673ce6433eac41600d3573e314" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c" is_pre_election: true
I20251023 07:59:33.927726 20223 raft_consensus.cc:2468] T f20a7a673ce6433eac41600d3573e314 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 0.
I20251023 07:59:33.935216 20576 raft_consensus.cc:515] T f20a7a673ce6433eac41600d3573e314 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:33.920940 20118 leader_election.cc:304] T d6cbef26ab7c4389b265743ae018e227 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, d1379e91aa9c41629cd25262571beb2c; no voters: 35e7d1ade024444486e63cf1b81e9626
I20251023 07:59:33.939194 20226 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f20a7a673ce6433eac41600d3573e314" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c"
I20251023 07:59:33.939863 20226 raft_consensus.cc:3060] T f20a7a673ce6433eac41600d3573e314 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:33.941171 20438 raft_consensus.cc:2804] T d6cbef26ab7c4389b265743ae018e227 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:59:33.941907 20438 raft_consensus.cc:697] T d6cbef26ab7c4389b265743ae018e227 P 0f412334fb994ff0ab492afde64f5855 [term 1 LEADER]: Becoming Leader. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Running, Role: LEADER
I20251023 07:59:33.943033 20438 consensus_queue.cc:237] T d6cbef26ab7c4389b265743ae018e227 P 0f412334fb994ff0ab492afde64f5855 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:33.946800 20152 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f20a7a673ce6433eac41600d3573e314" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855"
I20251023 07:59:33.947400 20152 raft_consensus.cc:3060] T f20a7a673ce6433eac41600d3573e314 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:33.959151 20505 consensus_queue.cc:1048] T cfbe734be0c84115840c7c45f3398002 P 35e7d1ade024444486e63cf1b81e9626 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:59:33.965950 20273 raft_consensus.cc:359] T fb985a87f45d43d68b172b937404e770 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:33.967137 20226 raft_consensus.cc:2468] T f20a7a673ce6433eac41600d3573e314 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 1.
I20251023 07:59:33.937359 20576 leader_election.cc:290] T f20a7a673ce6433eac41600d3573e314 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 election: Requested vote from peers 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287), 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955)
I20251023 07:59:33.971030 20273 raft_consensus.cc:385] T fb985a87f45d43d68b172b937404e770 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:33.967423 20510 leader_election.cc:290] T f20a7a673ce6433eac41600d3573e314 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287), 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955)
I20251023 07:59:33.918435 19901 catalog_manager.cc:5649] T c3527495b334413f82d0eca2c4d117b1 P d1379e91aa9c41629cd25262571beb2c reported cstate change: term changed from 0 to 1, leader changed from <none> to d1379e91aa9c41629cd25262571beb2c (127.16.126.1). New cstate: current_term: 1 leader_uuid: "d1379e91aa9c41629cd25262571beb2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:33.918994 20274 ts_tablet_manager.cc:1434] T a1c85032f5ef4634a35c20eec56ae62f P 65876a2b197c4ea6918f5cab47ded25c: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20251023 07:59:33.980893 20274 tablet_bootstrap.cc:492] T 2ff74dfb94334c20b99ea84b985a27a5 P 65876a2b197c4ea6918f5cab47ded25c: Bootstrap starting.
I20251023 07:59:33.983186 19968 leader_election.cc:304] T f20a7a673ce6433eac41600d3573e314 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65876a2b197c4ea6918f5cab47ded25c, d1379e91aa9c41629cd25262571beb2c; no voters:
I20251023 07:59:33.981365 20152 raft_consensus.cc:2468] T f20a7a673ce6433eac41600d3573e314 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 1.
I20251023 07:59:33.969873 20271 tablet_bootstrap.cc:492] T fb985a87f45d43d68b172b937404e770 P 0f412334fb994ff0ab492afde64f5855: No bootstrap required, opened a new log
I20251023 07:59:33.987907 20271 ts_tablet_manager.cc:1403] T fb985a87f45d43d68b172b937404e770 P 0f412334fb994ff0ab492afde64f5855: Time spent bootstrapping tablet: real 0.146s user 0.012s sys 0.010s
I20251023 07:59:33.991655 20271 raft_consensus.cc:359] T fb985a87f45d43d68b172b937404e770 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:33.992509 20271 raft_consensus.cc:385] T fb985a87f45d43d68b172b937404e770 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:33.993523 20271 raft_consensus.cc:740] T fb985a87f45d43d68b172b937404e770 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Initialized, Role: FOLLOWER
I20251023 07:59:33.994676 20512 raft_consensus.cc:493] T c469a3ace4204641be00f1b797fbffe9 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:33.996333 20512 raft_consensus.cc:515] T c469a3ace4204641be00f1b797fbffe9 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:33.998324 20512 leader_election.cc:290] T c469a3ace4204641be00f1b797fbffe9 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309), 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287)
I20251023 07:59:34.000401 20078 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c469a3ace4204641be00f1b797fbffe9" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
W20251023 07:59:34.002530 20190 leader_election.cc:343] T c469a3ace4204641be00f1b797fbffe9 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:33.971374 20273 raft_consensus.cc:740] T fb985a87f45d43d68b172b937404e770 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:34.003911 20148 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c469a3ace4204641be00f1b797fbffe9" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855" is_pre_election: true
I20251023 07:59:34.003543 20271 consensus_queue.cc:260] T fb985a87f45d43d68b172b937404e770 P 0f412334fb994ff0ab492afde64f5855 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:34.004581 20273 consensus_queue.cc:260] T fb985a87f45d43d68b172b937404e770 P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
W20251023 07:59:34.005781 20189 leader_election.cc:343] T c469a3ace4204641be00f1b797fbffe9 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:34.009050 20189 leader_election.cc:304] T c469a3ace4204641be00f1b797fbffe9 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65876a2b197c4ea6918f5cab47ded25c; no voters: 0f412334fb994ff0ab492afde64f5855, 35e7d1ade024444486e63cf1b81e9626
I20251023 07:59:34.010922 20273 ts_tablet_manager.cc:1434] T fb985a87f45d43d68b172b937404e770 P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.086s user 0.005s sys 0.003s
I20251023 07:59:34.010109 20512 raft_consensus.cc:2749] T c469a3ace4204641be00f1b797fbffe9 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:59:34.003980 20576 raft_consensus.cc:2804] T f20a7a673ce6433eac41600d3573e314 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:59:34.014567 20271 ts_tablet_manager.cc:1434] T fb985a87f45d43d68b172b937404e770 P 0f412334fb994ff0ab492afde64f5855: Time spent starting tablet: real 0.026s user 0.007s sys 0.000s
I20251023 07:59:34.014854 20576 raft_consensus.cc:697] T f20a7a673ce6433eac41600d3573e314 P d1379e91aa9c41629cd25262571beb2c [term 1 LEADER]: Becoming Leader. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Running, Role: LEADER
I20251023 07:59:34.015973 20271 tablet_bootstrap.cc:492] T dc81e0e89365425793f2851459b7e892 P 0f412334fb994ff0ab492afde64f5855: Bootstrap starting.
I20251023 07:59:34.016793 20273 tablet_bootstrap.cc:492] T 13d572956c644586b0efbe8f63aecae5 P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:34.016302 20576 consensus_queue.cc:237] T f20a7a673ce6433eac41600d3573e314 P d1379e91aa9c41629cd25262571beb2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:34.021085 20274 tablet_bootstrap.cc:654] T 2ff74dfb94334c20b99ea84b985a27a5 P 65876a2b197c4ea6918f5cab47ded25c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:34.025817 20273 tablet_bootstrap.cc:654] T 13d572956c644586b0efbe8f63aecae5 P d1379e91aa9c41629cd25262571beb2c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:34.031716 20341 raft_consensus.cc:493] T 8b6aca6db6ab43e8be0b6ec22dc96700 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:34.032323 20341 raft_consensus.cc:515] T 8b6aca6db6ab43e8be0b6ec22dc96700 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:34.033910 20271 tablet_bootstrap.cc:654] T dc81e0e89365425793f2851459b7e892 P 0f412334fb994ff0ab492afde64f5855: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:34.037014 20341 leader_election.cc:290] T 8b6aca6db6ab43e8be0b6ec22dc96700 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309), 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287)
I20251023 07:59:34.038977 20078 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b6aca6db6ab43e8be0b6ec22dc96700" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
I20251023 07:59:34.039680 20505 consensus_queue.cc:1048] T 8b6aca6db6ab43e8be0b6ec22dc96700 P 35e7d1ade024444486e63cf1b81e9626 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:59:34.042153 20148 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b6aca6db6ab43e8be0b6ec22dc96700" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855" is_pre_election: true
I20251023 07:59:34.047900 20189 leader_election.cc:304] T 8b6aca6db6ab43e8be0b6ec22dc96700 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65876a2b197c4ea6918f5cab47ded25c; no voters: 0f412334fb994ff0ab492afde64f5855, 35e7d1ade024444486e63cf1b81e9626
I20251023 07:59:34.066547 20272 tablet_bootstrap.cc:492] T d6cbef26ab7c4389b265743ae018e227 P 35e7d1ade024444486e63cf1b81e9626: No bootstrap required, opened a new log
I20251023 07:59:34.067137 20272 ts_tablet_manager.cc:1403] T d6cbef26ab7c4389b265743ae018e227 P 35e7d1ade024444486e63cf1b81e9626: Time spent bootstrapping tablet: real 0.198s user 0.050s sys 0.051s
I20251023 07:59:34.071817 20512 raft_consensus.cc:2749] T 8b6aca6db6ab43e8be0b6ec22dc96700 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251023 07:59:34.078481 20272 raft_consensus.cc:359] T d6cbef26ab7c4389b265743ae018e227 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:34.079257 20272 raft_consensus.cc:385] T d6cbef26ab7c4389b265743ae018e227 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:34.079521 20272 raft_consensus.cc:740] T d6cbef26ab7c4389b265743ae018e227 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e7d1ade024444486e63cf1b81e9626, State: Initialized, Role: FOLLOWER
I20251023 07:59:34.079993 20282 raft_consensus.cc:493] T bd5baee3419c4a7aa0def773845ac48a P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:34.080252 20272 consensus_queue.cc:260] T d6cbef26ab7c4389b265743ae018e227 P 35e7d1ade024444486e63cf1b81e9626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:34.080534 20282 raft_consensus.cc:515] T bd5baee3419c4a7aa0def773845ac48a P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:34.082350 20272 ts_tablet_manager.cc:1434] T d6cbef26ab7c4389b265743ae018e227 P 35e7d1ade024444486e63cf1b81e9626: Time spent starting tablet: real 0.015s user 0.007s sys 0.000s
I20251023 07:59:34.083149 20274 tablet_bootstrap.cc:492] T 2ff74dfb94334c20b99ea84b985a27a5 P 65876a2b197c4ea6918f5cab47ded25c: No bootstrap required, opened a new log
I20251023 07:59:34.083338 20272 tablet_bootstrap.cc:492] T c469a3ace4204641be00f1b797fbffe9 P 35e7d1ade024444486e63cf1b81e9626: Bootstrap starting.
I20251023 07:59:34.083673 20274 ts_tablet_manager.cc:1403] T 2ff74dfb94334c20b99ea84b985a27a5 P 65876a2b197c4ea6918f5cab47ded25c: Time spent bootstrapping tablet: real 0.103s user 0.021s sys 0.000s
I20251023 07:59:34.085049 20282 leader_election.cc:290] T bd5baee3419c4a7aa0def773845ac48a P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865), 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287)
I20251023 07:59:34.087093 20003 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bd5baee3419c4a7aa0def773845ac48a" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:34.088277 20148 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bd5baee3419c4a7aa0def773845ac48a" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855" is_pre_election: true
W20251023 07:59:34.089661 20044 leader_election.cc:343] T bd5baee3419c4a7aa0def773845ac48a P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Illegal state: must be running to vote when last-logged opid is not known
W20251023 07:59:34.090145 20041 leader_election.cc:343] T bd5baee3419c4a7aa0def773845ac48a P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:34.090566 20041 leader_election.cc:304] T bd5baee3419c4a7aa0def773845ac48a P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35e7d1ade024444486e63cf1b81e9626; no voters: 0f412334fb994ff0ab492afde64f5855, d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:34.091784 20272 tablet_bootstrap.cc:654] T c469a3ace4204641be00f1b797fbffe9 P 35e7d1ade024444486e63cf1b81e9626: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:34.092610 20336 raft_consensus.cc:2749] T bd5baee3419c4a7aa0def773845ac48a P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:59:34.086681 20274 raft_consensus.cc:359] T 2ff74dfb94334c20b99ea84b985a27a5 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:34.094030 20274 raft_consensus.cc:385] T 2ff74dfb94334c20b99ea84b985a27a5 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:34.094368 20274 raft_consensus.cc:740] T 2ff74dfb94334c20b99ea84b985a27a5 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65876a2b197c4ea6918f5cab47ded25c, State: Initialized, Role: FOLLOWER
I20251023 07:59:34.095085 20274 consensus_queue.cc:260] T 2ff74dfb94334c20b99ea84b985a27a5 P 65876a2b197c4ea6918f5cab47ded25c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:34.101853 20274 ts_tablet_manager.cc:1434] T 2ff74dfb94334c20b99ea84b985a27a5 P 65876a2b197c4ea6918f5cab47ded25c: Time spent starting tablet: real 0.018s user 0.007s sys 0.000s
I20251023 07:59:34.102922 20272 tablet_bootstrap.cc:492] T c469a3ace4204641be00f1b797fbffe9 P 35e7d1ade024444486e63cf1b81e9626: No bootstrap required, opened a new log
I20251023 07:59:34.103022 20274 tablet_bootstrap.cc:492] T 382a939856194537b68f791851ceaa65 P 65876a2b197c4ea6918f5cab47ded25c: Bootstrap starting.
I20251023 07:59:34.103487 20272 ts_tablet_manager.cc:1403] T c469a3ace4204641be00f1b797fbffe9 P 35e7d1ade024444486e63cf1b81e9626: Time spent bootstrapping tablet: real 0.020s user 0.010s sys 0.000s
I20251023 07:59:34.104753 20273 tablet_bootstrap.cc:492] T 13d572956c644586b0efbe8f63aecae5 P d1379e91aa9c41629cd25262571beb2c: No bootstrap required, opened a new log
I20251023 07:59:34.105265 20273 ts_tablet_manager.cc:1403] T 13d572956c644586b0efbe8f63aecae5 P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.093s user 0.011s sys 0.006s
I20251023 07:59:34.107534 20271 tablet_bootstrap.cc:492] T dc81e0e89365425793f2851459b7e892 P 0f412334fb994ff0ab492afde64f5855: No bootstrap required, opened a new log
I20251023 07:59:34.108033 20271 ts_tablet_manager.cc:1403] T dc81e0e89365425793f2851459b7e892 P 0f412334fb994ff0ab492afde64f5855: Time spent bootstrapping tablet: real 0.093s user 0.017s sys 0.018s
I20251023 07:59:34.110672 20274 tablet_bootstrap.cc:654] T 382a939856194537b68f791851ceaa65 P 65876a2b197c4ea6918f5cab47ded25c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:34.110811 20272 raft_consensus.cc:359] T c469a3ace4204641be00f1b797fbffe9 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:34.110949 20273 raft_consensus.cc:359] T 13d572956c644586b0efbe8f63aecae5 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:34.111598 20272 raft_consensus.cc:385] T c469a3ace4204641be00f1b797fbffe9 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:34.111689 20273 raft_consensus.cc:385] T 13d572956c644586b0efbe8f63aecae5 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:34.111922 20272 raft_consensus.cc:740] T c469a3ace4204641be00f1b797fbffe9 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e7d1ade024444486e63cf1b81e9626, State: Initialized, Role: FOLLOWER
I20251023 07:59:34.112107 20273 raft_consensus.cc:740] T 13d572956c644586b0efbe8f63aecae5 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:34.112841 20273 consensus_queue.cc:260] T 13d572956c644586b0efbe8f63aecae5 P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:34.113025 20271 raft_consensus.cc:359] T dc81e0e89365425793f2851459b7e892 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:34.113734 20271 raft_consensus.cc:385] T dc81e0e89365425793f2851459b7e892 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:34.114027 20271 raft_consensus.cc:740] T dc81e0e89365425793f2851459b7e892 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Initialized, Role: FOLLOWER
I20251023 07:59:34.114666 20271 consensus_queue.cc:260] T dc81e0e89365425793f2851459b7e892 P 0f412334fb994ff0ab492afde64f5855 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:34.117137 20271 ts_tablet_manager.cc:1434] T dc81e0e89365425793f2851459b7e892 P 0f412334fb994ff0ab492afde64f5855: Time spent starting tablet: real 0.009s user 0.007s sys 0.000s
I20251023 07:59:34.118847 20271 tablet_bootstrap.cc:492] T bd5baee3419c4a7aa0def773845ac48a P 0f412334fb994ff0ab492afde64f5855: Bootstrap starting.
I20251023 07:59:34.121701 20272 consensus_queue.cc:260] T c469a3ace4204641be00f1b797fbffe9 P 35e7d1ade024444486e63cf1b81e9626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:34.122865 20274 tablet_bootstrap.cc:492] T 382a939856194537b68f791851ceaa65 P 65876a2b197c4ea6918f5cab47ded25c: No bootstrap required, opened a new log
I20251023 07:59:34.123404 20274 ts_tablet_manager.cc:1403] T 382a939856194537b68f791851ceaa65 P 65876a2b197c4ea6918f5cab47ded25c: Time spent bootstrapping tablet: real 0.021s user 0.017s sys 0.001s
I20251023 07:59:34.124143 20272 ts_tablet_manager.cc:1434] T c469a3ace4204641be00f1b797fbffe9 P 35e7d1ade024444486e63cf1b81e9626: Time spent starting tablet: real 0.020s user 0.006s sys 0.000s
I20251023 07:59:34.115824 20273 ts_tablet_manager.cc:1434] T 13d572956c644586b0efbe8f63aecae5 P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.010s user 0.003s sys 0.005s
I20251023 07:59:34.125296 20272 tablet_bootstrap.cc:492] T 382a939856194537b68f791851ceaa65 P 35e7d1ade024444486e63cf1b81e9626: Bootstrap starting.
I20251023 07:59:34.125335 20273 tablet_bootstrap.cc:492] T f8ceeb2a7d7d45629aee9466b149251b P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:34.126303 20274 raft_consensus.cc:359] T 382a939856194537b68f791851ceaa65 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:34.127137 20274 raft_consensus.cc:385] T 382a939856194537b68f791851ceaa65 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:34.127457 20274 raft_consensus.cc:740] T 382a939856194537b68f791851ceaa65 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65876a2b197c4ea6918f5cab47ded25c, State: Initialized, Role: FOLLOWER
I20251023 07:59:34.128158 20274 consensus_queue.cc:260] T 382a939856194537b68f791851ceaa65 P 65876a2b197c4ea6918f5cab47ded25c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:34.130549 20274 ts_tablet_manager.cc:1434] T 382a939856194537b68f791851ceaa65 P 65876a2b197c4ea6918f5cab47ded25c: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20251023 07:59:34.131570 20273 tablet_bootstrap.cc:654] T f8ceeb2a7d7d45629aee9466b149251b P d1379e91aa9c41629cd25262571beb2c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:34.131848 20274 tablet_bootstrap.cc:492] T 090551fa29ba48dd8d41263e14b8ec3c P 65876a2b197c4ea6918f5cab47ded25c: Bootstrap starting.
I20251023 07:59:34.131104 19896 catalog_manager.cc:5649] T d6cbef26ab7c4389b265743ae018e227 P 0f412334fb994ff0ab492afde64f5855 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f412334fb994ff0ab492afde64f5855 (127.16.126.3). New cstate: current_term: 1 leader_uuid: "0f412334fb994ff0ab492afde64f5855" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } health_report { overall_health: HEALTHY } } }
I20251023 07:59:34.134665 20271 tablet_bootstrap.cc:654] T bd5baee3419c4a7aa0def773845ac48a P 0f412334fb994ff0ab492afde64f5855: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:34.139194 20272 tablet_bootstrap.cc:654] T 382a939856194537b68f791851ceaa65 P 35e7d1ade024444486e63cf1b81e9626: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:34.139549 20274 tablet_bootstrap.cc:654] T 090551fa29ba48dd8d41263e14b8ec3c P 65876a2b197c4ea6918f5cab47ded25c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:34.147269 20271 tablet_bootstrap.cc:492] T bd5baee3419c4a7aa0def773845ac48a P 0f412334fb994ff0ab492afde64f5855: No bootstrap required, opened a new log
I20251023 07:59:34.147570 20274 tablet_bootstrap.cc:492] T 090551fa29ba48dd8d41263e14b8ec3c P 65876a2b197c4ea6918f5cab47ded25c: No bootstrap required, opened a new log
I20251023 07:59:34.147775 20271 ts_tablet_manager.cc:1403] T bd5baee3419c4a7aa0def773845ac48a P 0f412334fb994ff0ab492afde64f5855: Time spent bootstrapping tablet: real 0.029s user 0.008s sys 0.000s
I20251023 07:59:34.148104 20274 ts_tablet_manager.cc:1403] T 090551fa29ba48dd8d41263e14b8ec3c P 65876a2b197c4ea6918f5cab47ded25c: Time spent bootstrapping tablet: real 0.017s user 0.012s sys 0.000s
I20251023 07:59:34.149197 20273 tablet_bootstrap.cc:492] T f8ceeb2a7d7d45629aee9466b149251b P d1379e91aa9c41629cd25262571beb2c: No bootstrap required, opened a new log
I20251023 07:59:34.149703 20273 ts_tablet_manager.cc:1403] T f8ceeb2a7d7d45629aee9466b149251b P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.025s user 0.009s sys 0.007s
I20251023 07:59:34.150524 20271 raft_consensus.cc:359] T bd5baee3419c4a7aa0def773845ac48a P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:34.150797 20274 raft_consensus.cc:359] T 090551fa29ba48dd8d41263e14b8ec3c P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:34.151504 20274 raft_consensus.cc:385] T 090551fa29ba48dd8d41263e14b8ec3c P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:34.151221 20271 raft_consensus.cc:385] T bd5baee3419c4a7aa0def773845ac48a P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:34.151791 20274 raft_consensus.cc:740] T 090551fa29ba48dd8d41263e14b8ec3c P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65876a2b197c4ea6918f5cab47ded25c, State: Initialized, Role: FOLLOWER
I20251023 07:59:34.151971 20271 raft_consensus.cc:740] T bd5baee3419c4a7aa0def773845ac48a P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Initialized, Role: FOLLOWER
I20251023 07:59:34.152222 20273 raft_consensus.cc:359] T f8ceeb2a7d7d45629aee9466b149251b P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:34.152954 20273 raft_consensus.cc:385] T f8ceeb2a7d7d45629aee9466b149251b P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:34.152700 20271 consensus_queue.cc:260] T bd5baee3419c4a7aa0def773845ac48a P 0f412334fb994ff0ab492afde64f5855 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:34.153242 20273 raft_consensus.cc:740] T f8ceeb2a7d7d45629aee9466b149251b P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:34.153942 20273 consensus_queue.cc:260] T f8ceeb2a7d7d45629aee9466b149251b P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:34.154280 20274 consensus_queue.cc:260] T 090551fa29ba48dd8d41263e14b8ec3c P 65876a2b197c4ea6918f5cab47ded25c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:34.155025 20271 ts_tablet_manager.cc:1434] T bd5baee3419c4a7aa0def773845ac48a P 0f412334fb994ff0ab492afde64f5855: Time spent starting tablet: real 0.007s user 0.005s sys 0.002s
I20251023 07:59:34.155988 20271 tablet_bootstrap.cc:492] T c469a3ace4204641be00f1b797fbffe9 P 0f412334fb994ff0ab492afde64f5855: Bootstrap starting.
I20251023 07:59:34.156095 20273 ts_tablet_manager.cc:1434] T f8ceeb2a7d7d45629aee9466b149251b P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20251023 07:59:34.156389 20274 ts_tablet_manager.cc:1434] T 090551fa29ba48dd8d41263e14b8ec3c P 65876a2b197c4ea6918f5cab47ded25c: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20251023 07:59:34.157142 20273 tablet_bootstrap.cc:492] T bd5baee3419c4a7aa0def773845ac48a P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:34.157367 20274 tablet_bootstrap.cc:492] T 0973ba22912840bd9bded8b0376fa1e7 P 65876a2b197c4ea6918f5cab47ded25c: Bootstrap starting.
I20251023 07:59:34.163787 20274 tablet_bootstrap.cc:654] T 0973ba22912840bd9bded8b0376fa1e7 P 65876a2b197c4ea6918f5cab47ded25c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:34.163787 20273 tablet_bootstrap.cc:654] T bd5baee3419c4a7aa0def773845ac48a P d1379e91aa9c41629cd25262571beb2c: Neither blocks nor log segments found. Creating new log.
W20251023 07:59:34.167765 20585 log.cc:927] Time spent T cfbe734be0c84115840c7c45f3398002 P d1379e91aa9c41629cd25262571beb2c: Append to log took a long time: real 0.096s user 0.000s sys 0.000s
I20251023 07:59:34.171481 20271 tablet_bootstrap.cc:654] T c469a3ace4204641be00f1b797fbffe9 P 0f412334fb994ff0ab492afde64f5855: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:34.175403 20274 tablet_bootstrap.cc:492] T 0973ba22912840bd9bded8b0376fa1e7 P 65876a2b197c4ea6918f5cab47ded25c: No bootstrap required, opened a new log
I20251023 07:59:34.176115 20274 ts_tablet_manager.cc:1403] T 0973ba22912840bd9bded8b0376fa1e7 P 65876a2b197c4ea6918f5cab47ded25c: Time spent bootstrapping tablet: real 0.019s user 0.013s sys 0.003s
I20251023 07:59:34.179863 20274 raft_consensus.cc:359] T 0973ba22912840bd9bded8b0376fa1e7 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:34.181015 20274 raft_consensus.cc:385] T 0973ba22912840bd9bded8b0376fa1e7 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:34.181270 20274 raft_consensus.cc:740] T 0973ba22912840bd9bded8b0376fa1e7 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65876a2b197c4ea6918f5cab47ded25c, State: Initialized, Role: FOLLOWER
I20251023 07:59:34.181911 20274 consensus_queue.cc:260] T 0973ba22912840bd9bded8b0376fa1e7 P 65876a2b197c4ea6918f5cab47ded25c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:34.184276 20274 ts_tablet_manager.cc:1434] T 0973ba22912840bd9bded8b0376fa1e7 P 65876a2b197c4ea6918f5cab47ded25c: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s
I20251023 07:59:34.185289 20274 tablet_bootstrap.cc:492] T 20f681957fa04333b8a04cbad085db57 P 65876a2b197c4ea6918f5cab47ded25c: Bootstrap starting.
I20251023 07:59:34.187150 20271 tablet_bootstrap.cc:492] T c469a3ace4204641be00f1b797fbffe9 P 0f412334fb994ff0ab492afde64f5855: No bootstrap required, opened a new log
I20251023 07:59:34.189179 20271 ts_tablet_manager.cc:1403] T c469a3ace4204641be00f1b797fbffe9 P 0f412334fb994ff0ab492afde64f5855: Time spent bootstrapping tablet: real 0.033s user 0.010s sys 0.002s
I20251023 07:59:34.190428 20273 tablet_bootstrap.cc:492] T bd5baee3419c4a7aa0def773845ac48a P d1379e91aa9c41629cd25262571beb2c: No bootstrap required, opened a new log
I20251023 07:59:34.190912 20273 ts_tablet_manager.cc:1403] T bd5baee3419c4a7aa0def773845ac48a P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.034s user 0.015s sys 0.002s
I20251023 07:59:34.191748 20271 raft_consensus.cc:359] T c469a3ace4204641be00f1b797fbffe9 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:34.192442 20271 raft_consensus.cc:385] T c469a3ace4204641be00f1b797fbffe9 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:34.192683 20271 raft_consensus.cc:740] T c469a3ace4204641be00f1b797fbffe9 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Initialized, Role: FOLLOWER
I20251023 07:59:34.193208 20273 raft_consensus.cc:359] T bd5baee3419c4a7aa0def773845ac48a P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:34.194139 20273 raft_consensus.cc:385] T bd5baee3419c4a7aa0def773845ac48a P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:34.194381 20273 raft_consensus.cc:740] T bd5baee3419c4a7aa0def773845ac48a P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:34.195082 20273 consensus_queue.cc:260] T bd5baee3419c4a7aa0def773845ac48a P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:34.195850 20510 raft_consensus.cc:493] T fb985a87f45d43d68b172b937404e770 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:34.196483 20510 raft_consensus.cc:515] T fb985a87f45d43d68b172b937404e770 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:34.197695 20273 ts_tablet_manager.cc:1434] T bd5baee3419c4a7aa0def773845ac48a P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20251023 07:59:34.198110 20271 consensus_queue.cc:260] T c469a3ace4204641be00f1b797fbffe9 P 0f412334fb994ff0ab492afde64f5855 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:34.198791 20273 tablet_bootstrap.cc:492] T 20f681957fa04333b8a04cbad085db57 P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:34.201797 20271 ts_tablet_manager.cc:1434] T c469a3ace4204641be00f1b797fbffe9 P 0f412334fb994ff0ab492afde64f5855: Time spent starting tablet: real 0.012s user 0.005s sys 0.001s
I20251023 07:59:34.203115 20078 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fb985a87f45d43d68b172b937404e770" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
I20251023 07:59:34.205219 20273 tablet_bootstrap.cc:654] T 20f681957fa04333b8a04cbad085db57 P d1379e91aa9c41629cd25262571beb2c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:34.207544 20274 tablet_bootstrap.cc:654] T 20f681957fa04333b8a04cbad085db57 P 65876a2b197c4ea6918f5cab47ded25c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:34.216151 20002 raft_consensus.cc:3060] T f8ceeb2a7d7d45629aee9466b149251b P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:34.217552 20273 tablet_bootstrap.cc:492] T 20f681957fa04333b8a04cbad085db57 P d1379e91aa9c41629cd25262571beb2c: No bootstrap required, opened a new log
I20251023 07:59:34.218238 20273 ts_tablet_manager.cc:1403] T 20f681957fa04333b8a04cbad085db57 P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.020s user 0.017s sys 0.000s
I20251023 07:59:34.221799 20273 raft_consensus.cc:359] T 20f681957fa04333b8a04cbad085db57 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:34.223129 20273 raft_consensus.cc:385] T 20f681957fa04333b8a04cbad085db57 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:34.223486 20273 raft_consensus.cc:740] T 20f681957fa04333b8a04cbad085db57 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:34.224506 20273 consensus_queue.cc:260] T 20f681957fa04333b8a04cbad085db57 P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:34.227828 20273 ts_tablet_manager.cc:1434] T 20f681957fa04333b8a04cbad085db57 P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.009s user 0.008s sys 0.000s
I20251023 07:59:34.229378 20273 tablet_bootstrap.cc:492] T 2ff74dfb94334c20b99ea84b985a27a5 P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:34.238479 20273 tablet_bootstrap.cc:654] T 2ff74dfb94334c20b99ea84b985a27a5 P d1379e91aa9c41629cd25262571beb2c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:34.251674 20273 tablet_bootstrap.cc:492] T 2ff74dfb94334c20b99ea84b985a27a5 P d1379e91aa9c41629cd25262571beb2c: No bootstrap required, opened a new log
I20251023 07:59:34.252350 20273 ts_tablet_manager.cc:1403] T 2ff74dfb94334c20b99ea84b985a27a5 P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.023s user 0.015s sys 0.003s
W20251023 07:59:34.205159 19967 leader_election.cc:343] T fb985a87f45d43d68b172b937404e770 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309): Illegal state: must be running to vote when last-logged opid is not known
W20251023 07:59:34.253226 19967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.126.2:42309, user_credentials={real_user=slave}} blocked reactor thread for 48125.9us
I20251023 07:59:34.255689 20273 raft_consensus.cc:359] T 2ff74dfb94334c20b99ea84b985a27a5 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:34.256716 20273 raft_consensus.cc:385] T 2ff74dfb94334c20b99ea84b985a27a5 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:34.257092 20273 raft_consensus.cc:740] T 2ff74dfb94334c20b99ea84b985a27a5 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:34.258018 20273 consensus_queue.cc:260] T 2ff74dfb94334c20b99ea84b985a27a5 P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:34.259219 20510 leader_election.cc:290] T fb985a87f45d43d68b172b937404e770 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309), 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287)
I20251023 07:59:34.260268 20148 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fb985a87f45d43d68b172b937404e770" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855" is_pre_election: true
I20251023 07:59:34.270509 20148 raft_consensus.cc:2468] T fb985a87f45d43d68b172b937404e770 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 0.
I20251023 07:59:34.272190 19966 leader_election.cc:304] T fb985a87f45d43d68b172b937404e770 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, d1379e91aa9c41629cd25262571beb2c; no voters: 35e7d1ade024444486e63cf1b81e9626
I20251023 07:59:34.274459 20510 raft_consensus.cc:2804] T fb985a87f45d43d68b172b937404e770 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:34.275075 20510 raft_consensus.cc:493] T fb985a87f45d43d68b172b937404e770 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:34.275601 20510 raft_consensus.cc:3060] T fb985a87f45d43d68b172b937404e770 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:34.278643 20414 consensus_queue.cc:1048] T dc81e0e89365425793f2851459b7e892 P 65876a2b197c4ea6918f5cab47ded25c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:59:34.261449 20273 ts_tablet_manager.cc:1434] T 2ff74dfb94334c20b99ea84b985a27a5 P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.009s user 0.009s sys 0.001s
I20251023 07:59:34.262490 20341 raft_consensus.cc:493] T 382a939856194537b68f791851ceaa65 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:34.293709 20341 raft_consensus.cc:515] T 382a939856194537b68f791851ceaa65 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:34.294111 20414 raft_consensus.cc:493] T a1c85032f5ef4634a35c20eec56ae62f P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:34.294848 20414 raft_consensus.cc:515] T a1c85032f5ef4634a35c20eec56ae62f P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:34.299816 20309 raft_consensus.cc:493] T c469a3ace4204641be00f1b797fbffe9 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:34.300608 20309 raft_consensus.cc:515] T c469a3ace4204641be00f1b797fbffe9 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:34.303179 20309 leader_election.cc:290] T c469a3ace4204641be00f1b797fbffe9 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309), 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955)
I20251023 07:59:34.304801 20341 leader_election.cc:290] T 382a939856194537b68f791851ceaa65 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865), 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309)
I20251023 07:59:34.304653 20077 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c469a3ace4204641be00f1b797fbffe9" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
I20251023 07:59:34.309151 20148 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a1c85032f5ef4634a35c20eec56ae62f" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855" is_pre_election: true
I20251023 07:59:34.309284 20077 raft_consensus.cc:2468] T c469a3ace4204641be00f1b797fbffe9 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f412334fb994ff0ab492afde64f5855 in term 0.
W20251023 07:59:34.311023 20189 leader_election.cc:343] T a1c85032f5ef4634a35c20eec56ae62f P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:34.311307 20226 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c469a3ace4204641be00f1b797fbffe9" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c" is_pre_election: true
I20251023 07:59:34.312426 20226 raft_consensus.cc:2468] T c469a3ace4204641be00f1b797fbffe9 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f412334fb994ff0ab492afde64f5855 in term 0.
I20251023 07:59:34.312882 20271 tablet_bootstrap.cc:492] T 090551fa29ba48dd8d41263e14b8ec3c P 0f412334fb994ff0ab492afde64f5855: Bootstrap starting.
I20251023 07:59:34.313315 20273 tablet_bootstrap.cc:492] T 0973ba22912840bd9bded8b0376fa1e7 P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:34.314394 20117 leader_election.cc:304] T c469a3ace4204641be00f1b797fbffe9 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, 65876a2b197c4ea6918f5cab47ded25c; no voters:
I20251023 07:59:34.316205 20438 raft_consensus.cc:2804] T c469a3ace4204641be00f1b797fbffe9 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:34.316666 20438 raft_consensus.cc:493] T c469a3ace4204641be00f1b797fbffe9 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:34.317101 20438 raft_consensus.cc:3060] T c469a3ace4204641be00f1b797fbffe9 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:34.319319 20271 tablet_bootstrap.cc:654] T 090551fa29ba48dd8d41263e14b8ec3c P 0f412334fb994ff0ab492afde64f5855: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:34.321911 19897 catalog_manager.cc:5649] T f20a7a673ce6433eac41600d3573e314 P d1379e91aa9c41629cd25262571beb2c reported cstate change: term changed from 0 to 1, leader changed from <none> to d1379e91aa9c41629cd25262571beb2c (127.16.126.1). New cstate: current_term: 1 leader_uuid: "d1379e91aa9c41629cd25262571beb2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: HEALTHY } } }
I20251023 07:59:34.307367 20003 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a1c85032f5ef4634a35c20eec56ae62f" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:34.308264 20414 leader_election.cc:290] T a1c85032f5ef4634a35c20eec56ae62f P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:34.329843 20414 raft_consensus.cc:493] T 090551fa29ba48dd8d41263e14b8ec3c P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:34.330149 20078 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "382a939856194537b68f791851ceaa65" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
I20251023 07:59:34.330439 20414 raft_consensus.cc:515] T 090551fa29ba48dd8d41263e14b8ec3c P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
W20251023 07:59:34.331770 20190 leader_election.cc:343] T 382a939856194537b68f791851ceaa65 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:34.332803 20000 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "382a939856194537b68f791851ceaa65" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
W20251023 07:59:34.333500 20192 leader_election.cc:343] T a1c85032f5ef4634a35c20eec56ae62f P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:34.333974 20192 leader_election.cc:304] T a1c85032f5ef4634a35c20eec56ae62f P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65876a2b197c4ea6918f5cab47ded25c; no voters: 0f412334fb994ff0ab492afde64f5855, d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:34.334719 20512 raft_consensus.cc:2749] T a1c85032f5ef4634a35c20eec56ae62f P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:59:34.334887 20271 tablet_bootstrap.cc:492] T 090551fa29ba48dd8d41263e14b8ec3c P 0f412334fb994ff0ab492afde64f5855: No bootstrap required, opened a new log
W20251023 07:59:34.335825 20192 leader_election.cc:343] T 382a939856194537b68f791851ceaa65 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:34.336321 20192 leader_election.cc:304] T 382a939856194537b68f791851ceaa65 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65876a2b197c4ea6918f5cab47ded25c; no voters: 35e7d1ade024444486e63cf1b81e9626, d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:34.337302 20512 raft_consensus.cc:2749] T 382a939856194537b68f791851ceaa65 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:59:34.341562 20152 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "090551fa29ba48dd8d41263e14b8ec3c" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855" is_pre_election: true
I20251023 07:59:34.342377 20150 raft_consensus.cc:3060] T dc81e0e89365425793f2851459b7e892 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:34.345856 20078 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "090551fa29ba48dd8d41263e14b8ec3c" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
W20251023 07:59:34.347360 20190 leader_election.cc:343] T 090551fa29ba48dd8d41263e14b8ec3c P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309): Illegal state: must be running to vote when last-logged opid is not known
W20251023 07:59:34.350812 20189 leader_election.cc:343] T 090551fa29ba48dd8d41263e14b8ec3c P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:34.351439 20189 leader_election.cc:304] T 090551fa29ba48dd8d41263e14b8ec3c P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65876a2b197c4ea6918f5cab47ded25c; no voters: 0f412334fb994ff0ab492afde64f5855, 35e7d1ade024444486e63cf1b81e9626
I20251023 07:59:34.355110 20341 raft_consensus.cc:2749] T 090551fa29ba48dd8d41263e14b8ec3c P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:59:34.361564 20414 leader_election.cc:290] T 090551fa29ba48dd8d41263e14b8ec3c P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309), 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287)
I20251023 07:59:34.366190 20000 raft_consensus.cc:3060] T 13d572956c644586b0efbe8f63aecae5 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:34.359568 20438 raft_consensus.cc:515] T c469a3ace4204641be00f1b797fbffe9 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:34.336344 20271 ts_tablet_manager.cc:1403] T 090551fa29ba48dd8d41263e14b8ec3c P 0f412334fb994ff0ab492afde64f5855: Time spent bootstrapping tablet: real 0.024s user 0.013s sys 0.003s
I20251023 07:59:34.389950 20279 raft_consensus.cc:493] T bd5baee3419c4a7aa0def773845ac48a P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:34.390522 20279 raft_consensus.cc:515] T bd5baee3419c4a7aa0def773845ac48a P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:34.392750 20279 leader_election.cc:290] T bd5baee3419c4a7aa0def773845ac48a P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309), 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287)
I20251023 07:59:34.392784 20399 consensus_queue.cc:1048] T d6cbef26ab7c4389b265743ae018e227 P 0f412334fb994ff0ab492afde64f5855 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:59:34.394045 20274 tablet_bootstrap.cc:492] T 20f681957fa04333b8a04cbad085db57 P 65876a2b197c4ea6918f5cab47ded25c: No bootstrap required, opened a new log
I20251023 07:59:34.394718 20274 ts_tablet_manager.cc:1403] T 20f681957fa04333b8a04cbad085db57 P 65876a2b197c4ea6918f5cab47ded25c: Time spent bootstrapping tablet: real 0.210s user 0.059s sys 0.065s
I20251023 07:59:34.395694 20078 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c469a3ace4204641be00f1b797fbffe9" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626"
I20251023 07:59:34.396340 20078 raft_consensus.cc:3060] T c469a3ace4204641be00f1b797fbffe9 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:34.398080 20274 raft_consensus.cc:359] T 20f681957fa04333b8a04cbad085db57 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:34.399029 20274 raft_consensus.cc:385] T 20f681957fa04333b8a04cbad085db57 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:34.399343 20274 raft_consensus.cc:740] T 20f681957fa04333b8a04cbad085db57 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65876a2b197c4ea6918f5cab47ded25c, State: Initialized, Role: FOLLOWER
I20251023 07:59:34.400764 20274 consensus_queue.cc:260] T 20f681957fa04333b8a04cbad085db57 P 65876a2b197c4ea6918f5cab47ded25c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:34.403064 20274 ts_tablet_manager.cc:1434] T 20f681957fa04333b8a04cbad085db57 P 65876a2b197c4ea6918f5cab47ded25c: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20251023 07:59:34.411402 20077 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bd5baee3419c4a7aa0def773845ac48a" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
I20251023 07:59:34.412173 20077 raft_consensus.cc:2468] T bd5baee3419c4a7aa0def773845ac48a P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 0.
I20251023 07:59:34.414924 19967 leader_election.cc:304] T bd5baee3419c4a7aa0def773845ac48a P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35e7d1ade024444486e63cf1b81e9626, d1379e91aa9c41629cd25262571beb2c; no voters:
I20251023 07:59:34.415935 20279 raft_consensus.cc:2804] T bd5baee3419c4a7aa0def773845ac48a P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:34.415971 20341 consensus_queue.cc:1048] T dc81e0e89365425793f2851459b7e892 P 65876a2b197c4ea6918f5cab47ded25c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:59:34.416409 20279 raft_consensus.cc:493] T bd5baee3419c4a7aa0def773845ac48a P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:34.416777 20279 raft_consensus.cc:3060] T bd5baee3419c4a7aa0def773845ac48a P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:34.414772 20148 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bd5baee3419c4a7aa0def773845ac48a" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855" is_pre_election: true
I20251023 07:59:34.420315 20336 raft_consensus.cc:493] T d6cbef26ab7c4389b265743ae018e227 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:34.418779 20274 tablet_bootstrap.cc:492] T 6db769d91ae244679bcea825f9763446 P 65876a2b197c4ea6918f5cab47ded25c: Bootstrap starting.
I20251023 07:59:34.420827 20336 raft_consensus.cc:515] T d6cbef26ab7c4389b265743ae018e227 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:34.424876 20148 raft_consensus.cc:2468] T bd5baee3419c4a7aa0def773845ac48a P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 0.
I20251023 07:59:34.420796 20438 leader_election.cc:290] T c469a3ace4204641be00f1b797fbffe9 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 election: Requested vote from peers 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309), 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955)
I20251023 07:59:34.428675 20001 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d6cbef26ab7c4389b265743ae018e227" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:34.429055 20448 consensus_queue.cc:1048] T c3527495b334413f82d0eca2c4d117b1 P d1379e91aa9c41629cd25262571beb2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:59:34.429643 20001 raft_consensus.cc:2393] T d6cbef26ab7c4389b265743ae018e227 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35e7d1ade024444486e63cf1b81e9626 in current term 1: Already voted for candidate 0f412334fb994ff0ab492afde64f5855 in this term.
I20251023 07:59:34.422387 20512 raft_consensus.cc:493] T 20f681957fa04333b8a04cbad085db57 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:34.434036 20341 raft_consensus.cc:493] T 2ff74dfb94334c20b99ea84b985a27a5 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:34.434011 20512 raft_consensus.cc:515] T 20f681957fa04333b8a04cbad085db57 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:34.434860 20341 raft_consensus.cc:515] T 2ff74dfb94334c20b99ea84b985a27a5 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:34.436916 20512 leader_election.cc:290] T 20f681957fa04333b8a04cbad085db57 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:34.437616 20152 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "20f681957fa04333b8a04cbad085db57" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855" is_pre_election: true
I20251023 07:59:34.438308 20152 raft_consensus.cc:2468] T 20f681957fa04333b8a04cbad085db57 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65876a2b197c4ea6918f5cab47ded25c in term 0.
I20251023 07:59:34.438374 20077 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2ff74dfb94334c20b99ea84b985a27a5" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
I20251023 07:59:34.439555 20221 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c469a3ace4204641be00f1b797fbffe9" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c"
I20251023 07:59:34.440011 20001 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "20f681957fa04333b8a04cbad085db57" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:34.440158 20221 raft_consensus.cc:3060] T c469a3ace4204641be00f1b797fbffe9 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:34.437678 20336 leader_election.cc:290] T d6cbef26ab7c4389b265743ae018e227 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865), 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287)
I20251023 07:59:34.441380 20273 tablet_bootstrap.cc:654] T 0973ba22912840bd9bded8b0376fa1e7 P d1379e91aa9c41629cd25262571beb2c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:34.440716 20001 raft_consensus.cc:2468] T 20f681957fa04333b8a04cbad085db57 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65876a2b197c4ea6918f5cab47ded25c in term 0.
W20251023 07:59:34.442514 20190 leader_election.cc:343] T 2ff74dfb94334c20b99ea84b985a27a5 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:34.441788 20341 leader_election.cc:290] T 2ff74dfb94334c20b99ea84b985a27a5 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865), 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309)
I20251023 07:59:34.442895 19999 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2ff74dfb94334c20b99ea84b985a27a5" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:34.443601 19999 raft_consensus.cc:2468] T 2ff74dfb94334c20b99ea84b985a27a5 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65876a2b197c4ea6918f5cab47ded25c in term 0.
I20251023 07:59:34.443924 20078 raft_consensus.cc:2468] T c469a3ace4204641be00f1b797fbffe9 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f412334fb994ff0ab492afde64f5855 in term 1.
I20251023 07:59:34.444963 20189 leader_election.cc:304] T 20f681957fa04333b8a04cbad085db57 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, 65876a2b197c4ea6918f5cab47ded25c; no voters:
I20251023 07:59:34.445112 20116 leader_election.cc:304] T c469a3ace4204641be00f1b797fbffe9 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, 35e7d1ade024444486e63cf1b81e9626; no voters:
I20251023 07:59:34.445755 20514 raft_consensus.cc:2804] T 20f681957fa04333b8a04cbad085db57 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:34.448140 20274 tablet_bootstrap.cc:654] T 6db769d91ae244679bcea825f9763446 P 65876a2b197c4ea6918f5cab47ded25c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:34.405551 20510 raft_consensus.cc:515] T fb985a87f45d43d68b172b937404e770 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:34.446179 20514 raft_consensus.cc:493] T 20f681957fa04333b8a04cbad085db57 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:34.463034 20514 raft_consensus.cc:3060] T 20f681957fa04333b8a04cbad085db57 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:34.456329 20192 leader_election.cc:304] T 2ff74dfb94334c20b99ea84b985a27a5 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65876a2b197c4ea6918f5cab47ded25c, d1379e91aa9c41629cd25262571beb2c; no voters: 35e7d1ade024444486e63cf1b81e9626
I20251023 07:59:34.449143 20438 raft_consensus.cc:2804] T c469a3ace4204641be00f1b797fbffe9 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:59:34.477749 20341 raft_consensus.cc:2804] T 2ff74dfb94334c20b99ea84b985a27a5 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:34.489421 20272 tablet_bootstrap.cc:492] T 382a939856194537b68f791851ceaa65 P 35e7d1ade024444486e63cf1b81e9626: No bootstrap required, opened a new log
I20251023 07:59:34.490386 20272 ts_tablet_manager.cc:1403] T 382a939856194537b68f791851ceaa65 P 35e7d1ade024444486e63cf1b81e9626: Time spent bootstrapping tablet: real 0.365s user 0.100s sys 0.118s
I20251023 07:59:34.488111 20341 raft_consensus.cc:493] T 2ff74dfb94334c20b99ea84b985a27a5 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:34.492429 20341 raft_consensus.cc:3060] T 2ff74dfb94334c20b99ea84b985a27a5 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:34.517841 20279 raft_consensus.cc:515] T bd5baee3419c4a7aa0def773845ac48a P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:34.520848 20272 raft_consensus.cc:359] T 382a939856194537b68f791851ceaa65 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:34.530949 20272 raft_consensus.cc:385] T 382a939856194537b68f791851ceaa65 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:34.531368 20272 raft_consensus.cc:740] T 382a939856194537b68f791851ceaa65 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e7d1ade024444486e63cf1b81e9626, State: Initialized, Role: FOLLOWER
I20251023 07:59:34.532302 20272 consensus_queue.cc:260] T 382a939856194537b68f791851ceaa65 P 35e7d1ade024444486e63cf1b81e9626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:34.541746 20273 tablet_bootstrap.cc:492] T 0973ba22912840bd9bded8b0376fa1e7 P d1379e91aa9c41629cd25262571beb2c: No bootstrap required, opened a new log
I20251023 07:59:34.542534 20273 ts_tablet_manager.cc:1403] T 0973ba22912840bd9bded8b0376fa1e7 P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.229s user 0.015s sys 0.004s
I20251023 07:59:34.548429 20279 leader_election.cc:290] T bd5baee3419c4a7aa0def773845ac48a P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 election: Requested vote from peers 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309), 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287)
I20251023 07:59:34.548179 20271 raft_consensus.cc:359] T 090551fa29ba48dd8d41263e14b8ec3c P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:34.549094 20271 raft_consensus.cc:385] T 090551fa29ba48dd8d41263e14b8ec3c P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:34.549327 20271 raft_consensus.cc:740] T 090551fa29ba48dd8d41263e14b8ec3c P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Initialized, Role: FOLLOWER
I20251023 07:59:34.549985 20271 consensus_queue.cc:260] T 090551fa29ba48dd8d41263e14b8ec3c P 0f412334fb994ff0ab492afde64f5855 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:34.553349 20271 ts_tablet_manager.cc:1434] T 090551fa29ba48dd8d41263e14b8ec3c P 0f412334fb994ff0ab492afde64f5855: Time spent starting tablet: real 0.182s user 0.006s sys 0.001s
I20251023 07:59:34.553277 20150 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d6cbef26ab7c4389b265743ae018e227" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855" is_pre_election: true
I20251023 07:59:34.558171 20271 tablet_bootstrap.cc:492] T 09f7b5cd377e45be8bbd85052c93dcb3 P 0f412334fb994ff0ab492afde64f5855: Bootstrap starting.
I20251023 07:59:34.561721 20438 raft_consensus.cc:697] T c469a3ace4204641be00f1b797fbffe9 P 0f412334fb994ff0ab492afde64f5855 [term 1 LEADER]: Becoming Leader. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Running, Role: LEADER
I20251023 07:59:34.562836 20438 consensus_queue.cc:237] T c469a3ace4204641be00f1b797fbffe9 P 0f412334fb994ff0ab492afde64f5855 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:34.564788 20609 raft_consensus.cc:493] T 0973ba22912840bd9bded8b0376fa1e7 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:34.565315 20609 raft_consensus.cc:515] T 0973ba22912840bd9bded8b0376fa1e7 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:34.546278 20510 leader_election.cc:290] T fb985a87f45d43d68b172b937404e770 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 election: Requested vote from peers 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309), 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287)
I20251023 07:59:34.568199 20272 ts_tablet_manager.cc:1434] T 382a939856194537b68f791851ceaa65 P 35e7d1ade024444486e63cf1b81e9626: Time spent starting tablet: real 0.078s user 0.008s sys 0.001s
I20251023 07:59:34.570044 20609 leader_election.cc:290] T 0973ba22912840bd9bded8b0376fa1e7 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865), 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309)
I20251023 07:59:34.571923 20273 raft_consensus.cc:359] T 0973ba22912840bd9bded8b0376fa1e7 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:34.572149 20075 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0973ba22912840bd9bded8b0376fa1e7" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
I20251023 07:59:34.558276 20576 raft_consensus.cc:493] T 13d572956c644586b0efbe8f63aecae5 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65876a2b197c4ea6918f5cab47ded25c)
I20251023 07:59:34.587443 20273 raft_consensus.cc:385] T 0973ba22912840bd9bded8b0376fa1e7 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:34.591564 20273 raft_consensus.cc:740] T 0973ba22912840bd9bded8b0376fa1e7 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:34.592499 20273 consensus_queue.cc:260] T 0973ba22912840bd9bded8b0376fa1e7 P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:34.594687 20514 raft_consensus.cc:515] T 20f681957fa04333b8a04cbad085db57 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:34.596745 20514 leader_election.cc:290] T 20f681957fa04333b8a04cbad085db57 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 election: Requested vote from peers 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:34.598225 20576 raft_consensus.cc:515] T 13d572956c644586b0efbe8f63aecae5 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:34.600908 20576 leader_election.cc:290] T 13d572956c644586b0efbe8f63aecae5 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287), 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955)
I20251023 07:59:34.559778 20221 raft_consensus.cc:2468] T c469a3ace4204641be00f1b797fbffe9 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f412334fb994ff0ab492afde64f5855 in term 1.
I20251023 07:59:34.609953 20152 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "20f681957fa04333b8a04cbad085db57" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855"
I20251023 07:59:34.610734 20152 raft_consensus.cc:3060] T 20f681957fa04333b8a04cbad085db57 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:34.611021 20272 tablet_bootstrap.cc:492] T fb985a87f45d43d68b172b937404e770 P 35e7d1ade024444486e63cf1b81e9626: Bootstrap starting.
W20251023 07:59:34.614125 20190 leader_election.cc:343] T 0973ba22912840bd9bded8b0376fa1e7 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:34.615371 20041 leader_election.cc:304] T d6cbef26ab7c4389b265743ae018e227 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35e7d1ade024444486e63cf1b81e9626; no voters: 0f412334fb994ff0ab492afde64f5855, d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:34.616750 20282 raft_consensus.cc:3060] T d6cbef26ab7c4389b265743ae018e227 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:34.617581 20272 tablet_bootstrap.cc:654] T fb985a87f45d43d68b172b937404e770 P 35e7d1ade024444486e63cf1b81e9626: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:34.580722 20341 raft_consensus.cc:515] T 2ff74dfb94334c20b99ea84b985a27a5 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:34.619868 20341 leader_election.cc:290] T 2ff74dfb94334c20b99ea84b985a27a5 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 election: Requested vote from peers d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865), 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309)
W20251023 07:59:34.547021 19967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.2:42309, user_credentials={real_user=slave}} blocked reactor thread for 55712.8us
I20251023 07:59:34.630074 20274 tablet_bootstrap.cc:492] T 6db769d91ae244679bcea825f9763446 P 65876a2b197c4ea6918f5cab47ded25c: No bootstrap required, opened a new log
I20251023 07:59:34.630637 20274 ts_tablet_manager.cc:1403] T 6db769d91ae244679bcea825f9763446 P 65876a2b197c4ea6918f5cab47ded25c: Time spent bootstrapping tablet: real 0.227s user 0.014s sys 0.007s
I20251023 07:59:34.645903 20273 ts_tablet_manager.cc:1434] T 0973ba22912840bd9bded8b0376fa1e7 P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.103s user 0.006s sys 0.003s
I20251023 07:59:34.646884 20273 tablet_bootstrap.cc:492] T 382a939856194537b68f791851ceaa65 P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:34.674386 20152 raft_consensus.cc:2468] T 20f681957fa04333b8a04cbad085db57 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65876a2b197c4ea6918f5cab47ded25c in term 1.
I20251023 07:59:34.666666 20150 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fb985a87f45d43d68b172b937404e770" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855"
I20251023 07:59:34.682422 20274 raft_consensus.cc:359] T 6db769d91ae244679bcea825f9763446 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:34.683266 20274 raft_consensus.cc:385] T 6db769d91ae244679bcea825f9763446 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:34.683585 20274 raft_consensus.cc:740] T 6db769d91ae244679bcea825f9763446 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65876a2b197c4ea6918f5cab47ded25c, State: Initialized, Role: FOLLOWER
I20251023 07:59:34.684458 20274 consensus_queue.cc:260] T 6db769d91ae244679bcea825f9763446 P 65876a2b197c4ea6918f5cab47ded25c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:34.686445 20150 raft_consensus.cc:3060] T fb985a87f45d43d68b172b937404e770 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:34.686471 20077 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fb985a87f45d43d68b172b937404e770" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626"
I20251023 07:59:34.676450 20000 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0973ba22912840bd9bded8b0376fa1e7" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:34.690280 20000 raft_consensus.cc:2468] T 0973ba22912840bd9bded8b0376fa1e7 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65876a2b197c4ea6918f5cab47ded25c in term 0.
I20251023 07:59:34.691190 20078 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2ff74dfb94334c20b99ea84b985a27a5" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626"
I20251023 07:59:34.707646 20075 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bd5baee3419c4a7aa0def773845ac48a" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626"
I20251023 07:59:34.718838 20149 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bd5baee3419c4a7aa0def773845ac48a" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855"
I20251023 07:59:34.719664 20149 raft_consensus.cc:3060] T bd5baee3419c4a7aa0def773845ac48a P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:34.721307 20271 tablet_bootstrap.cc:654] T 09f7b5cd377e45be8bbd85052c93dcb3 P 0f412334fb994ff0ab492afde64f5855: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:34.723017 20576 consensus_queue.cc:1048] T c3527495b334413f82d0eca2c4d117b1 P d1379e91aa9c41629cd25262571beb2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:59:34.709841 20226 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "13d572956c644586b0efbe8f63aecae5" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c" is_pre_election: true
W20251023 07:59:34.706414 20190 leader_election.cc:343] T 2ff74dfb94334c20b99ea84b985a27a5 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:34.724975 20075 raft_consensus.cc:3060] T bd5baee3419c4a7aa0def773845ac48a P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Advancing to term 1
W20251023 07:59:34.750854 19967 leader_election.cc:343] T fb985a87f45d43d68b172b937404e770 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:34.770174 20000 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2ff74dfb94334c20b99ea84b985a27a5" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c"
I20251023 07:59:34.770725 20274 ts_tablet_manager.cc:1434] T 6db769d91ae244679bcea825f9763446 P 65876a2b197c4ea6918f5cab47ded25c: Time spent starting tablet: real 0.140s user 0.015s sys 0.011s
I20251023 07:59:34.767585 20282 raft_consensus.cc:2749] T d6cbef26ab7c4389b265743ae018e227 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:59:34.770753 20000 raft_consensus.cc:3060] T 2ff74dfb94334c20b99ea84b985a27a5 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:34.780591 20274 tablet_bootstrap.cc:492] T f1da9b379f264014adfbf37b2660285b P 65876a2b197c4ea6918f5cab47ded25c: Bootstrap starting.
I20251023 07:59:34.784780 20273 tablet_bootstrap.cc:654] T 382a939856194537b68f791851ceaa65 P d1379e91aa9c41629cd25262571beb2c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:34.776279 20189 leader_election.cc:304] T 20f681957fa04333b8a04cbad085db57 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, 65876a2b197c4ea6918f5cab47ded25c; no voters:
I20251023 07:59:34.778007 20145 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "13d572956c644586b0efbe8f63aecae5" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855" is_pre_election: true
I20251023 07:59:34.792807 20192 leader_election.cc:304] T 0973ba22912840bd9bded8b0376fa1e7 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65876a2b197c4ea6918f5cab47ded25c, d1379e91aa9c41629cd25262571beb2c; no voters: 35e7d1ade024444486e63cf1b81e9626
I20251023 07:59:34.794313 20438 consensus_queue.cc:1048] T d6cbef26ab7c4389b265743ae018e227 P 0f412334fb994ff0ab492afde64f5855 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:59:34.791880 19999 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "20f681957fa04333b8a04cbad085db57" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c"
I20251023 07:59:34.798616 20150 raft_consensus.cc:2468] T fb985a87f45d43d68b172b937404e770 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 1.
I20251023 07:59:34.801522 20617 consensus_queue.cc:1048] T f20a7a673ce6433eac41600d3573e314 P d1379e91aa9c41629cd25262571beb2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:59:34.806988 19968 leader_election.cc:304] T 13d572956c644586b0efbe8f63aecae5 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d1379e91aa9c41629cd25262571beb2c; no voters: 0f412334fb994ff0ab492afde64f5855, 65876a2b197c4ea6918f5cab47ded25c
I20251023 07:59:34.814260 19966 leader_election.cc:304] T fb985a87f45d43d68b172b937404e770 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, d1379e91aa9c41629cd25262571beb2c; no voters: 35e7d1ade024444486e63cf1b81e9626
W20251023 07:59:34.817451 20189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.126.3:33287, user_credentials={real_user=slave}} blocked reactor thread for 43631.5us
I20251023 07:59:34.817688 20514 raft_consensus.cc:2804] T 20f681957fa04333b8a04cbad085db57 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:59:34.839612 20514 raft_consensus.cc:697] T 20f681957fa04333b8a04cbad085db57 P 65876a2b197c4ea6918f5cab47ded25c [term 1 LEADER]: Becoming Leader. State: Replica: 65876a2b197c4ea6918f5cab47ded25c, State: Running, Role: LEADER
I20251023 07:59:34.840344 20274 tablet_bootstrap.cc:654] T f1da9b379f264014adfbf37b2660285b P 65876a2b197c4ea6918f5cab47ded25c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:34.819453 20075 raft_consensus.cc:2468] T bd5baee3419c4a7aa0def773845ac48a P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 1.
I20251023 07:59:34.821169 20623 raft_consensus.cc:2804] T 0973ba22912840bd9bded8b0376fa1e7 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:34.821516 19999 raft_consensus.cc:3060] T 20f681957fa04333b8a04cbad085db57 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:34.821871 20617 raft_consensus.cc:2749] T 13d572956c644586b0efbe8f63aecae5 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251023 07:59:34.831092 20271 tablet_bootstrap.cc:492] T 09f7b5cd377e45be8bbd85052c93dcb3 P 0f412334fb994ff0ab492afde64f5855: No bootstrap required, opened a new log
I20251023 07:59:34.852010 20271 ts_tablet_manager.cc:1403] T 09f7b5cd377e45be8bbd85052c93dcb3 P 0f412334fb994ff0ab492afde64f5855: Time spent bootstrapping tablet: real 0.294s user 0.011s sys 0.018s
I20251023 07:59:34.821307 20272 tablet_bootstrap.cc:492] T fb985a87f45d43d68b172b937404e770 P 35e7d1ade024444486e63cf1b81e9626: No bootstrap required, opened a new log
I20251023 07:59:34.852792 20272 ts_tablet_manager.cc:1403] T fb985a87f45d43d68b172b937404e770 P 35e7d1ade024444486e63cf1b81e9626: Time spent bootstrapping tablet: real 0.242s user 0.044s sys 0.026s
I20251023 07:59:34.834792 20149 raft_consensus.cc:2468] T bd5baee3419c4a7aa0def773845ac48a P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 1.
I20251023 07:59:34.837056 20000 raft_consensus.cc:2468] T 2ff74dfb94334c20b99ea84b985a27a5 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65876a2b197c4ea6918f5cab47ded25c in term 1.
I20251023 07:59:34.853919 19898 catalog_manager.cc:5649] T c469a3ace4204641be00f1b797fbffe9 P 0f412334fb994ff0ab492afde64f5855 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f412334fb994ff0ab492afde64f5855 (127.16.126.3). New cstate: current_term: 1 leader_uuid: "0f412334fb994ff0ab492afde64f5855" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:34.855387 20623 raft_consensus.cc:493] T 0973ba22912840bd9bded8b0376fa1e7 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:34.840534 20514 consensus_queue.cc:237] T 20f681957fa04333b8a04cbad085db57 P 65876a2b197c4ea6918f5cab47ded25c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:34.861105 20617 raft_consensus.cc:2804] T fb985a87f45d43d68b172b937404e770 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:59:34.879176 20617 raft_consensus.cc:697] T fb985a87f45d43d68b172b937404e770 P d1379e91aa9c41629cd25262571beb2c [term 1 LEADER]: Becoming Leader. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Running, Role: LEADER
I20251023 07:59:34.880052 20617 consensus_queue.cc:237] T fb985a87f45d43d68b172b937404e770 P d1379e91aa9c41629cd25262571beb2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:34.876264 20623 raft_consensus.cc:3060] T 0973ba22912840bd9bded8b0376fa1e7 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:34.877295 19967 leader_election.cc:304] T bd5baee3419c4a7aa0def773845ac48a P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35e7d1ade024444486e63cf1b81e9626, d1379e91aa9c41629cd25262571beb2c; no voters:
I20251023 07:59:34.896678 20611 raft_consensus.cc:2804] T bd5baee3419c4a7aa0def773845ac48a P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:59:34.897209 20611 raft_consensus.cc:697] T bd5baee3419c4a7aa0def773845ac48a P d1379e91aa9c41629cd25262571beb2c [term 1 LEADER]: Becoming Leader. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Running, Role: LEADER
I20251023 07:59:34.898051 20611 consensus_queue.cc:237] T bd5baee3419c4a7aa0def773845ac48a P d1379e91aa9c41629cd25262571beb2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
W20251023 07:59:34.875391 19966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.126.3:33287, user_credentials={real_user=slave}} blocked reactor thread for 61276.2us
I20251023 07:59:34.901165 20606 raft_consensus.cc:493] T 090551fa29ba48dd8d41263e14b8ec3c P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:34.901722 20606 raft_consensus.cc:515] T 090551fa29ba48dd8d41263e14b8ec3c P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:34.902474 20271 raft_consensus.cc:359] T 09f7b5cd377e45be8bbd85052c93dcb3 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:34.903203 20271 raft_consensus.cc:385] T 09f7b5cd377e45be8bbd85052c93dcb3 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:34.903465 20271 raft_consensus.cc:740] T 09f7b5cd377e45be8bbd85052c93dcb3 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Initialized, Role: FOLLOWER
I20251023 07:59:34.903730 20606 leader_election.cc:290] T 090551fa29ba48dd8d41263e14b8ec3c P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309), 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955)
I20251023 07:59:34.904115 20271 consensus_queue.cc:260] T 09f7b5cd377e45be8bbd85052c93dcb3 P 0f412334fb994ff0ab492afde64f5855 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:34.908751 20623 raft_consensus.cc:515] T 0973ba22912840bd9bded8b0376fa1e7 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:34.906810 20271 ts_tablet_manager.cc:1434] T 09f7b5cd377e45be8bbd85052c93dcb3 P 0f412334fb994ff0ab492afde64f5855: Time spent starting tablet: real 0.054s user 0.003s sys 0.002s
I20251023 07:59:34.914001 20272 raft_consensus.cc:359] T fb985a87f45d43d68b172b937404e770 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:34.914847 20272 raft_consensus.cc:385] T fb985a87f45d43d68b172b937404e770 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:34.915143 20272 raft_consensus.cc:740] T fb985a87f45d43d68b172b937404e770 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e7d1ade024444486e63cf1b81e9626, State: Initialized, Role: FOLLOWER
I20251023 07:59:34.919365 20272 consensus_queue.cc:260] T fb985a87f45d43d68b172b937404e770 P 35e7d1ade024444486e63cf1b81e9626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:34.924194 20272 ts_tablet_manager.cc:1434] T fb985a87f45d43d68b172b937404e770 P 35e7d1ade024444486e63cf1b81e9626: Time spent starting tablet: real 0.071s user 0.007s sys 0.000s
I20251023 07:59:34.925279 20272 tablet_bootstrap.cc:492] T 2ff74dfb94334c20b99ea84b985a27a5 P 35e7d1ade024444486e63cf1b81e9626: Bootstrap starting.
W20251023 07:59:34.927127 19949 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20251023 07:59:34.929373 20271 tablet_bootstrap.cc:492] T 6db769d91ae244679bcea825f9763446 P 0f412334fb994ff0ab492afde64f5855: Bootstrap starting.
I20251023 07:59:34.930708 20623 leader_election.cc:290] T 0973ba22912840bd9bded8b0376fa1e7 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 election: Requested vote from peers d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865), 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309)
I20251023 07:59:34.933382 20192 leader_election.cc:304] T 2ff74dfb94334c20b99ea84b985a27a5 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65876a2b197c4ea6918f5cab47ded25c, d1379e91aa9c41629cd25262571beb2c; no voters: 35e7d1ade024444486e63cf1b81e9626
I20251023 07:59:34.935336 20226 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "090551fa29ba48dd8d41263e14b8ec3c" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c" is_pre_election: true
I20251023 07:59:34.936064 20226 raft_consensus.cc:2468] T 090551fa29ba48dd8d41263e14b8ec3c P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f412334fb994ff0ab492afde64f5855 in term 0.
I20251023 07:59:34.938508 20117 leader_election.cc:304] T 090551fa29ba48dd8d41263e14b8ec3c P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, 65876a2b197c4ea6918f5cab47ded25c; no voters:
I20251023 07:59:34.940203 20399 raft_consensus.cc:2804] T 090551fa29ba48dd8d41263e14b8ec3c P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:34.940596 20399 raft_consensus.cc:493] T 090551fa29ba48dd8d41263e14b8ec3c P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:34.947777 20512 raft_consensus.cc:2804] T 2ff74dfb94334c20b99ea84b985a27a5 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:59:34.961450 20399 raft_consensus.cc:3060] T 090551fa29ba48dd8d41263e14b8ec3c P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:34.986104 20274 tablet_bootstrap.cc:492] T f1da9b379f264014adfbf37b2660285b P 65876a2b197c4ea6918f5cab47ded25c: No bootstrap required, opened a new log
I20251023 07:59:34.986882 20274 ts_tablet_manager.cc:1403] T f1da9b379f264014adfbf37b2660285b P 65876a2b197c4ea6918f5cab47ded25c: Time spent bootstrapping tablet: real 0.209s user 0.019s sys 0.007s
I20251023 07:59:34.974655 20512 raft_consensus.cc:697] T 2ff74dfb94334c20b99ea84b985a27a5 P 65876a2b197c4ea6918f5cab47ded25c [term 1 LEADER]: Becoming Leader. State: Replica: 65876a2b197c4ea6918f5cab47ded25c, State: Running, Role: LEADER
I20251023 07:59:34.979768 20505 raft_consensus.cc:493] T 382a939856194537b68f791851ceaa65 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:34.976200 19999 raft_consensus.cc:2468] T 20f681957fa04333b8a04cbad085db57 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65876a2b197c4ea6918f5cab47ded25c in term 1.
I20251023 07:59:34.991499 20075 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "090551fa29ba48dd8d41263e14b8ec3c" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
I20251023 07:59:35.007751 20274 raft_consensus.cc:359] T f1da9b379f264014adfbf37b2660285b P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:35.008538 20274 raft_consensus.cc:385] T f1da9b379f264014adfbf37b2660285b P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:35.008805 20274 raft_consensus.cc:740] T f1da9b379f264014adfbf37b2660285b P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65876a2b197c4ea6918f5cab47ded25c, State: Initialized, Role: FOLLOWER
I20251023 07:59:35.010234 20074 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0973ba22912840bd9bded8b0376fa1e7" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626"
I20251023 07:59:35.010758 20617 consensus_queue.cc:1048] T f20a7a673ce6433eac41600d3573e314 P d1379e91aa9c41629cd25262571beb2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:59:35.012326 20272 tablet_bootstrap.cc:654] T 2ff74dfb94334c20b99ea84b985a27a5 P 35e7d1ade024444486e63cf1b81e9626: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:35.013828 20512 consensus_queue.cc:237] T 2ff74dfb94334c20b99ea84b985a27a5 P 65876a2b197c4ea6918f5cab47ded25c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:35.015057 19901 catalog_manager.cc:5649] T 20f681957fa04333b8a04cbad085db57 P 65876a2b197c4ea6918f5cab47ded25c reported cstate change: term changed from 0 to 1, leader changed from <none> to 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4). New cstate: current_term: 1 leader_uuid: "65876a2b197c4ea6918f5cab47ded25c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:34.999588 20505 raft_consensus.cc:515] T 382a939856194537b68f791851ceaa65 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:35.021013 20505 leader_election.cc:290] T 382a939856194537b68f791851ceaa65 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:35.022276 20273 tablet_bootstrap.cc:492] T 382a939856194537b68f791851ceaa65 P d1379e91aa9c41629cd25262571beb2c: No bootstrap required, opened a new log
I20251023 07:59:35.022488 19999 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0973ba22912840bd9bded8b0376fa1e7" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c"
I20251023 07:59:35.022799 20273 ts_tablet_manager.cc:1403] T 382a939856194537b68f791851ceaa65 P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.376s user 0.017s sys 0.004s
I20251023 07:59:35.023089 19999 raft_consensus.cc:3060] T 0973ba22912840bd9bded8b0376fa1e7 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:35.022816 20223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "382a939856194537b68f791851ceaa65" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c" is_pre_election: true
I20251023 07:59:35.032181 20273 raft_consensus.cc:359] T 382a939856194537b68f791851ceaa65 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:35.036723 20273 raft_consensus.cc:385] T 382a939856194537b68f791851ceaa65 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:35.026471 20223 raft_consensus.cc:2468] T 382a939856194537b68f791851ceaa65 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35e7d1ade024444486e63cf1b81e9626 in term 0.
I20251023 07:59:35.033623 20274 consensus_queue.cc:260] T f1da9b379f264014adfbf37b2660285b P 65876a2b197c4ea6918f5cab47ded25c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:35.038901 20273 raft_consensus.cc:740] T 382a939856194537b68f791851ceaa65 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:35.046693 20273 consensus_queue.cc:260] T 382a939856194537b68f791851ceaa65 P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
W20251023 07:59:35.050617 20190 leader_election.cc:343] T 0973ba22912840bd9bded8b0376fa1e7 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:35.053339 20399 raft_consensus.cc:515] T 090551fa29ba48dd8d41263e14b8ec3c P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:35.057089 20043 leader_election.cc:304] T 382a939856194537b68f791851ceaa65 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35e7d1ade024444486e63cf1b81e9626, 65876a2b197c4ea6918f5cab47ded25c; no voters:
I20251023 07:59:35.058089 20505 raft_consensus.cc:2804] T 382a939856194537b68f791851ceaa65 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:35.058465 20505 raft_consensus.cc:493] T 382a939856194537b68f791851ceaa65 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:35.058802 20505 raft_consensus.cc:3060] T 382a939856194537b68f791851ceaa65 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:35.062126 20271 tablet_bootstrap.cc:654] T 6db769d91ae244679bcea825f9763446 P 0f412334fb994ff0ab492afde64f5855: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:35.064013 20002 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "382a939856194537b68f791851ceaa65" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:35.064690 20002 raft_consensus.cc:2468] T 382a939856194537b68f791851ceaa65 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35e7d1ade024444486e63cf1b81e9626 in term 0.
I20251023 07:59:35.067713 20078 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "090551fa29ba48dd8d41263e14b8ec3c" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626"
W20251023 07:59:35.070005 20116 leader_election.cc:343] T 090551fa29ba48dd8d41263e14b8ec3c P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:35.074615 20220 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "090551fa29ba48dd8d41263e14b8ec3c" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c"
I20251023 07:59:35.075536 20220 raft_consensus.cc:3060] T 090551fa29ba48dd8d41263e14b8ec3c P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Advancing to term 1
W20251023 07:59:35.082408 20116 leader_election.cc:343] T 090551fa29ba48dd8d41263e14b8ec3c P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:35.083480 20606 raft_consensus.cc:493] T 09f7b5cd377e45be8bbd85052c93dcb3 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:35.083938 20606 raft_consensus.cc:515] T 09f7b5cd377e45be8bbd85052c93dcb3 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:35.085882 20606 leader_election.cc:290] T 09f7b5cd377e45be8bbd85052c93dcb3 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865), 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309)
I20251023 07:59:35.094360 20505 raft_consensus.cc:515] T 382a939856194537b68f791851ceaa65 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:35.099429 19999 raft_consensus.cc:2468] T 0973ba22912840bd9bded8b0376fa1e7 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65876a2b197c4ea6918f5cab47ded25c in term 1.
I20251023 07:59:35.100522 20505 leader_election.cc:290] T 382a939856194537b68f791851ceaa65 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 election: Requested vote from peers 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:35.097728 20274 ts_tablet_manager.cc:1434] T f1da9b379f264014adfbf37b2660285b P 65876a2b197c4ea6918f5cab47ded25c: Time spent starting tablet: real 0.110s user 0.007s sys 0.001s
I20251023 07:59:35.100814 20192 leader_election.cc:304] T 0973ba22912840bd9bded8b0376fa1e7 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65876a2b197c4ea6918f5cab47ded25c, d1379e91aa9c41629cd25262571beb2c; no voters: 35e7d1ade024444486e63cf1b81e9626
I20251023 07:59:35.104343 20614 consensus_queue.cc:1048] T c469a3ace4204641be00f1b797fbffe9 P 0f412334fb994ff0ab492afde64f5855 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:59:35.105984 20622 raft_consensus.cc:2804] T 0973ba22912840bd9bded8b0376fa1e7 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:59:35.106396 20076 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "09f7b5cd377e45be8bbd85052c93dcb3" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
I20251023 07:59:35.106580 20622 raft_consensus.cc:697] T 0973ba22912840bd9bded8b0376fa1e7 P 65876a2b197c4ea6918f5cab47ded25c [term 1 LEADER]: Becoming Leader. State: Replica: 65876a2b197c4ea6918f5cab47ded25c, State: Running, Role: LEADER
I20251023 07:59:35.107760 20223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "382a939856194537b68f791851ceaa65" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c"
I20251023 07:59:35.109722 20223 raft_consensus.cc:3060] T 382a939856194537b68f791851ceaa65 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:35.113528 20399 leader_election.cc:290] T 090551fa29ba48dd8d41263e14b8ec3c P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 election: Requested vote from peers 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309), 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955)
I20251023 07:59:35.109234 20274 tablet_bootstrap.cc:492] T f524e775b99147de99cfb27d3785965d P 65876a2b197c4ea6918f5cab47ded25c: Bootstrap starting.
I20251023 07:59:35.115309 20273 ts_tablet_manager.cc:1434] T 382a939856194537b68f791851ceaa65 P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.092s user 0.006s sys 0.001s
I20251023 07:59:35.107781 20622 consensus_queue.cc:237] T 0973ba22912840bd9bded8b0376fa1e7 P 65876a2b197c4ea6918f5cab47ded25c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:35.116612 20273 tablet_bootstrap.cc:492] T 09f7b5cd377e45be8bbd85052c93dcb3 P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:35.120782 20220 raft_consensus.cc:2468] T 090551fa29ba48dd8d41263e14b8ec3c P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f412334fb994ff0ab492afde64f5855 in term 1.
W20251023 07:59:35.121598 20118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.1:37865, user_credentials={real_user=slave}} blocked reactor thread for 131528us
W20251023 07:59:35.130472 20116 leader_election.cc:343] T 09f7b5cd377e45be8bbd85052c93dcb3 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:35.130757 19999 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "382a939856194537b68f791851ceaa65" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c"
I20251023 07:59:35.131533 19999 raft_consensus.cc:3060] T 382a939856194537b68f791851ceaa65 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:35.137077 20001 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "09f7b5cd377e45be8bbd85052c93dcb3" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:35.137959 20341 raft_consensus.cc:493] T 6db769d91ae244679bcea825f9763446 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:35.138640 20341 raft_consensus.cc:515] T 6db769d91ae244679bcea825f9763446 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:35.140933 20341 leader_election.cc:290] T 6db769d91ae244679bcea825f9763446 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309), 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287)
I20251023 07:59:35.143589 20117 leader_election.cc:304] T 090551fa29ba48dd8d41263e14b8ec3c P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, 65876a2b197c4ea6918f5cab47ded25c; no voters: 35e7d1ade024444486e63cf1b81e9626
I20251023 07:59:35.145362 20272 tablet_bootstrap.cc:492] T 2ff74dfb94334c20b99ea84b985a27a5 P 35e7d1ade024444486e63cf1b81e9626: No bootstrap required, opened a new log
I20251023 07:59:35.145901 20272 ts_tablet_manager.cc:1403] T 2ff74dfb94334c20b99ea84b985a27a5 P 35e7d1ade024444486e63cf1b81e9626: Time spent bootstrapping tablet: real 0.221s user 0.004s sys 0.014s
I20251023 07:59:35.145731 20149 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6db769d91ae244679bcea825f9763446" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855" is_pre_election: true
I20251023 07:59:35.147570 20078 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6db769d91ae244679bcea825f9763446" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
I20251023 07:59:35.148703 20274 tablet_bootstrap.cc:654] T f524e775b99147de99cfb27d3785965d P 65876a2b197c4ea6918f5cab47ded25c: Neither blocks nor log segments found. Creating new log.
W20251023 07:59:35.148905 20190 leader_election.cc:343] T 6db769d91ae244679bcea825f9763446 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:35.152885 20271 tablet_bootstrap.cc:492] T 6db769d91ae244679bcea825f9763446 P 0f412334fb994ff0ab492afde64f5855: No bootstrap required, opened a new log
I20251023 07:59:35.153379 20271 ts_tablet_manager.cc:1403] T 6db769d91ae244679bcea825f9763446 P 0f412334fb994ff0ab492afde64f5855: Time spent bootstrapping tablet: real 0.224s user 0.010s sys 0.006s
I20251023 07:59:35.155614 20223 raft_consensus.cc:2468] T 382a939856194537b68f791851ceaa65 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35e7d1ade024444486e63cf1b81e9626 in term 1.
I20251023 07:59:35.156641 20043 leader_election.cc:304] T 382a939856194537b68f791851ceaa65 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35e7d1ade024444486e63cf1b81e9626, 65876a2b197c4ea6918f5cab47ded25c; no voters:
I20251023 07:59:35.157624 20533 raft_consensus.cc:2804] T 382a939856194537b68f791851ceaa65 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:59:35.158129 20533 raft_consensus.cc:697] T 382a939856194537b68f791851ceaa65 P 35e7d1ade024444486e63cf1b81e9626 [term 1 LEADER]: Becoming Leader. State: Replica: 35e7d1ade024444486e63cf1b81e9626, State: Running, Role: LEADER
I20251023 07:59:35.158950 20533 consensus_queue.cc:237] T 382a939856194537b68f791851ceaa65 P 35e7d1ade024444486e63cf1b81e9626 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
W20251023 07:59:35.161484 20118 leader_election.cc:343] T 09f7b5cd377e45be8bbd85052c93dcb3 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Illegal state: must be running to vote when last-logged opid is not known
W20251023 07:59:35.159315 20189 leader_election.cc:343] T 6db769d91ae244679bcea825f9763446 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:35.162027 20118 leader_election.cc:304] T 09f7b5cd377e45be8bbd85052c93dcb3 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855; no voters: 35e7d1ade024444486e63cf1b81e9626, d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:35.162420 20189 leader_election.cc:304] T 6db769d91ae244679bcea825f9763446 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65876a2b197c4ea6918f5cab47ded25c; no voters: 0f412334fb994ff0ab492afde64f5855, 35e7d1ade024444486e63cf1b81e9626
I20251023 07:59:35.164089 20635 raft_consensus.cc:2749] T 09f7b5cd377e45be8bbd85052c93dcb3 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:59:35.166178 20341 raft_consensus.cc:2749] T 6db769d91ae244679bcea825f9763446 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:59:35.161603 20438 raft_consensus.cc:2804] T 090551fa29ba48dd8d41263e14b8ec3c P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:59:35.167202 20438 raft_consensus.cc:697] T 090551fa29ba48dd8d41263e14b8ec3c P 0f412334fb994ff0ab492afde64f5855 [term 1 LEADER]: Becoming Leader. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Running, Role: LEADER
I20251023 07:59:35.168270 20438 consensus_queue.cc:237] T 090551fa29ba48dd8d41263e14b8ec3c P 0f412334fb994ff0ab492afde64f5855 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:35.170814 20271 raft_consensus.cc:359] T 6db769d91ae244679bcea825f9763446 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:35.172523 20271 raft_consensus.cc:385] T 6db769d91ae244679bcea825f9763446 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:35.172807 20271 raft_consensus.cc:740] T 6db769d91ae244679bcea825f9763446 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Initialized, Role: FOLLOWER
I20251023 07:59:35.175735 20273 tablet_bootstrap.cc:654] T 09f7b5cd377e45be8bbd85052c93dcb3 P d1379e91aa9c41629cd25262571beb2c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:35.175361 20271 consensus_queue.cc:260] T 6db769d91ae244679bcea825f9763446 P 0f412334fb994ff0ab492afde64f5855 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:35.177611 20606 consensus_queue.cc:1048] T c469a3ace4204641be00f1b797fbffe9 P 0f412334fb994ff0ab492afde64f5855 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:59:35.181504 20271 ts_tablet_manager.cc:1434] T 6db769d91ae244679bcea825f9763446 P 0f412334fb994ff0ab492afde64f5855: Time spent starting tablet: real 0.028s user 0.004s sys 0.002s
I20251023 07:59:35.182510 20272 raft_consensus.cc:359] T 2ff74dfb94334c20b99ea84b985a27a5 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:35.183559 20272 raft_consensus.cc:385] T 2ff74dfb94334c20b99ea84b985a27a5 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:35.183928 20272 raft_consensus.cc:740] T 2ff74dfb94334c20b99ea84b985a27a5 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e7d1ade024444486e63cf1b81e9626, State: Initialized, Role: FOLLOWER
I20251023 07:59:35.184840 20272 consensus_queue.cc:260] T 2ff74dfb94334c20b99ea84b985a27a5 P 35e7d1ade024444486e63cf1b81e9626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:35.198393 20271 tablet_bootstrap.cc:492] T a1c85032f5ef4634a35c20eec56ae62f P 0f412334fb994ff0ab492afde64f5855: Bootstrap starting.
I20251023 07:59:35.201593 20505 raft_consensus.cc:493] T fb985a87f45d43d68b172b937404e770 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:35.202142 20505 raft_consensus.cc:515] T fb985a87f45d43d68b172b937404e770 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:35.211721 20272 ts_tablet_manager.cc:1434] T 2ff74dfb94334c20b99ea84b985a27a5 P 35e7d1ade024444486e63cf1b81e9626: Time spent starting tablet: real 0.066s user 0.004s sys 0.004s
I20251023 07:59:35.216065 20505 leader_election.cc:290] T fb985a87f45d43d68b172b937404e770 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865), 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287)
I20251023 07:59:35.214185 19896 catalog_manager.cc:5649] T fb985a87f45d43d68b172b937404e770 P d1379e91aa9c41629cd25262571beb2c reported cstate change: term changed from 0 to 1, leader changed from <none> to d1379e91aa9c41629cd25262571beb2c (127.16.126.1). New cstate: current_term: 1 leader_uuid: "d1379e91aa9c41629cd25262571beb2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:35.223881 20149 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fb985a87f45d43d68b172b937404e770" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855" is_pre_election: true
I20251023 07:59:35.224869 20149 raft_consensus.cc:2393] T fb985a87f45d43d68b172b937404e770 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35e7d1ade024444486e63cf1b81e9626 in current term 1: Already voted for candidate d1379e91aa9c41629cd25262571beb2c in this term.
I20251023 07:59:35.226497 19998 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fb985a87f45d43d68b172b937404e770" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:35.231244 20272 tablet_bootstrap.cc:492] T 090551fa29ba48dd8d41263e14b8ec3c P 35e7d1ade024444486e63cf1b81e9626: Bootstrap starting.
I20251023 07:59:35.231412 20044 leader_election.cc:304] T fb985a87f45d43d68b172b937404e770 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35e7d1ade024444486e63cf1b81e9626; no voters: 0f412334fb994ff0ab492afde64f5855, d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:35.229012 19999 raft_consensus.cc:2468] T 382a939856194537b68f791851ceaa65 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35e7d1ade024444486e63cf1b81e9626 in term 1.
I20251023 07:59:35.234234 20533 raft_consensus.cc:3060] T fb985a87f45d43d68b172b937404e770 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:35.237965 20271 tablet_bootstrap.cc:654] T a1c85032f5ef4634a35c20eec56ae62f P 0f412334fb994ff0ab492afde64f5855: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:35.244128 20533 raft_consensus.cc:2749] T fb985a87f45d43d68b172b937404e770 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:59:35.240094 20274 tablet_bootstrap.cc:492] T f524e775b99147de99cfb27d3785965d P 65876a2b197c4ea6918f5cab47ded25c: No bootstrap required, opened a new log
I20251023 07:59:35.242726 20272 tablet_bootstrap.cc:654] T 090551fa29ba48dd8d41263e14b8ec3c P 35e7d1ade024444486e63cf1b81e9626: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:35.245616 20274 ts_tablet_manager.cc:1403] T f524e775b99147de99cfb27d3785965d P 65876a2b197c4ea6918f5cab47ded25c: Time spent bootstrapping tablet: real 0.137s user 0.015s sys 0.001s
I20251023 07:59:35.251515 20399 raft_consensus.cc:493] T 6db769d91ae244679bcea825f9763446 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:35.252065 20399 raft_consensus.cc:515] T 6db769d91ae244679bcea825f9763446 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:35.252295 20274 raft_consensus.cc:359] T f524e775b99147de99cfb27d3785965d P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:35.252889 20274 raft_consensus.cc:385] T f524e775b99147de99cfb27d3785965d P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:35.253077 20274 raft_consensus.cc:740] T f524e775b99147de99cfb27d3785965d P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65876a2b197c4ea6918f5cab47ded25c, State: Initialized, Role: FOLLOWER
I20251023 07:59:35.253616 20274 consensus_queue.cc:260] T f524e775b99147de99cfb27d3785965d P 65876a2b197c4ea6918f5cab47ded25c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:35.254077 20399 leader_election.cc:290] T 6db769d91ae244679bcea825f9763446 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309), 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955)
I20251023 07:59:35.258291 20222 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6db769d91ae244679bcea825f9763446" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c" is_pre_election: true
I20251023 07:59:35.257138 20076 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6db769d91ae244679bcea825f9763446" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
I20251023 07:59:35.266450 20512 raft_consensus.cc:493] T f1da9b379f264014adfbf37b2660285b P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20251023 07:59:35.267026 20116 leader_election.cc:343] T 6db769d91ae244679bcea825f9763446 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:35.266966 20512 raft_consensus.cc:515] T f1da9b379f264014adfbf37b2660285b P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:35.267242 20273 tablet_bootstrap.cc:492] T 09f7b5cd377e45be8bbd85052c93dcb3 P d1379e91aa9c41629cd25262571beb2c: No bootstrap required, opened a new log
I20251023 07:59:35.265107 20274 ts_tablet_manager.cc:1434] T f524e775b99147de99cfb27d3785965d P 65876a2b197c4ea6918f5cab47ded25c: Time spent starting tablet: real 0.019s user 0.005s sys 0.000s
I20251023 07:59:35.267910 20273 ts_tablet_manager.cc:1403] T 09f7b5cd377e45be8bbd85052c93dcb3 P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.152s user 0.010s sys 0.002s
I20251023 07:59:35.268759 20274 tablet_bootstrap.cc:492] T 01844334149649bb83991b613a695fe2 P 65876a2b197c4ea6918f5cab47ded25c: Bootstrap starting.
I20251023 07:59:35.270682 20222 raft_consensus.cc:2468] T 6db769d91ae244679bcea825f9763446 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f412334fb994ff0ab492afde64f5855 in term 0.
I20251023 07:59:35.270215 20149 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f1da9b379f264014adfbf37b2660285b" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855" is_pre_election: true
I20251023 07:59:35.271675 20273 raft_consensus.cc:359] T 09f7b5cd377e45be8bbd85052c93dcb3 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:35.272348 20273 raft_consensus.cc:385] T 09f7b5cd377e45be8bbd85052c93dcb3 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:35.272603 20273 raft_consensus.cc:740] T 09f7b5cd377e45be8bbd85052c93dcb3 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:35.272845 20117 leader_election.cc:304] T 6db769d91ae244679bcea825f9763446 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, 65876a2b197c4ea6918f5cab47ded25c; no voters: 35e7d1ade024444486e63cf1b81e9626
I20251023 07:59:35.273316 20273 consensus_queue.cc:260] T 09f7b5cd377e45be8bbd85052c93dcb3 P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
W20251023 07:59:35.274241 20189 leader_election.cc:343] T f1da9b379f264014adfbf37b2660285b P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:35.274923 19898 catalog_manager.cc:5649] T 090551fa29ba48dd8d41263e14b8ec3c P 0f412334fb994ff0ab492afde64f5855 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f412334fb994ff0ab492afde64f5855 (127.16.126.3). New cstate: current_term: 1 leader_uuid: "0f412334fb994ff0ab492afde64f5855" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:35.276051 20273 ts_tablet_manager.cc:1434] T 09f7b5cd377e45be8bbd85052c93dcb3 P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20251023 07:59:35.277093 20512 leader_election.cc:290] T f1da9b379f264014adfbf37b2660285b P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:35.277935 20274 tablet_bootstrap.cc:654] T 01844334149649bb83991b613a695fe2 P 65876a2b197c4ea6918f5cab47ded25c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:35.274287 20614 raft_consensus.cc:2804] T 6db769d91ae244679bcea825f9763446 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:35.279585 20614 raft_consensus.cc:493] T 6db769d91ae244679bcea825f9763446 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:35.280050 20614 raft_consensus.cc:3060] T 6db769d91ae244679bcea825f9763446 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:35.286190 20273 tablet_bootstrap.cc:492] T f1da9b379f264014adfbf37b2660285b P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:35.291391 20272 tablet_bootstrap.cc:492] T 090551fa29ba48dd8d41263e14b8ec3c P 35e7d1ade024444486e63cf1b81e9626: No bootstrap required, opened a new log
I20251023 07:59:35.292038 20272 ts_tablet_manager.cc:1403] T 090551fa29ba48dd8d41263e14b8ec3c P 35e7d1ade024444486e63cf1b81e9626: Time spent bootstrapping tablet: real 0.063s user 0.013s sys 0.004s
I20251023 07:59:35.295377 20272 raft_consensus.cc:359] T 090551fa29ba48dd8d41263e14b8ec3c P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:35.296294 20272 raft_consensus.cc:385] T 090551fa29ba48dd8d41263e14b8ec3c P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:35.296631 20272 raft_consensus.cc:740] T 090551fa29ba48dd8d41263e14b8ec3c P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e7d1ade024444486e63cf1b81e9626, State: Initialized, Role: FOLLOWER
I20251023 07:59:35.301744 20273 tablet_bootstrap.cc:654] T f1da9b379f264014adfbf37b2660285b P d1379e91aa9c41629cd25262571beb2c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:35.304145 20272 consensus_queue.cc:260] T 090551fa29ba48dd8d41263e14b8ec3c P 35e7d1ade024444486e63cf1b81e9626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:35.307693 20272 ts_tablet_manager.cc:1434] T 090551fa29ba48dd8d41263e14b8ec3c P 35e7d1ade024444486e63cf1b81e9626: Time spent starting tablet: real 0.015s user 0.008s sys 0.000s
I20251023 07:59:35.311369 20272 tablet_bootstrap.cc:492] T 6db769d91ae244679bcea825f9763446 P 35e7d1ade024444486e63cf1b81e9626: Bootstrap starting.
I20251023 07:59:35.335749 20274 tablet_bootstrap.cc:492] T 01844334149649bb83991b613a695fe2 P 65876a2b197c4ea6918f5cab47ded25c: No bootstrap required, opened a new log
I20251023 07:59:35.336606 20274 ts_tablet_manager.cc:1403] T 01844334149649bb83991b613a695fe2 P 65876a2b197c4ea6918f5cab47ded25c: Time spent bootstrapping tablet: real 0.068s user 0.019s sys 0.025s
I20251023 07:59:35.342021 20614 raft_consensus.cc:515] T 6db769d91ae244679bcea825f9763446 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:35.342866 20512 consensus_queue.cc:1048] T 20f681957fa04333b8a04cbad085db57 P 65876a2b197c4ea6918f5cab47ded25c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:59:35.344075 20614 leader_election.cc:290] T 6db769d91ae244679bcea825f9763446 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 election: Requested vote from peers 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309), 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955)
I20251023 07:59:35.339004 19999 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f1da9b379f264014adfbf37b2660285b" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:35.345852 20222 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6db769d91ae244679bcea825f9763446" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c"
I20251023 07:59:35.346455 20222 raft_consensus.cc:3060] T 6db769d91ae244679bcea825f9763446 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:35.347047 20272 tablet_bootstrap.cc:654] T 6db769d91ae244679bcea825f9763446 P 35e7d1ade024444486e63cf1b81e9626: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:35.347259 20611 consensus_queue.cc:1048] T bd5baee3419c4a7aa0def773845ac48a P d1379e91aa9c41629cd25262571beb2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:59:35.350807 19901 catalog_manager.cc:5649] T 382a939856194537b68f791851ceaa65 P 35e7d1ade024444486e63cf1b81e9626 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2). New cstate: current_term: 1 leader_uuid: "35e7d1ade024444486e63cf1b81e9626" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } health_report { overall_health: HEALTHY } } }
I20251023 07:59:35.359354 20274 raft_consensus.cc:359] T 01844334149649bb83991b613a695fe2 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:35.360111 20274 raft_consensus.cc:385] T 01844334149649bb83991b613a695fe2 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:35.360388 20274 raft_consensus.cc:740] T 01844334149649bb83991b613a695fe2 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65876a2b197c4ea6918f5cab47ded25c, State: Initialized, Role: FOLLOWER
I20251023 07:59:35.361064 20274 consensus_queue.cc:260] T 01844334149649bb83991b613a695fe2 P 65876a2b197c4ea6918f5cab47ded25c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
W20251023 07:59:35.379227 20192 leader_election.cc:343] T f1da9b379f264014adfbf37b2660285b P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:35.386250 20192 leader_election.cc:304] T f1da9b379f264014adfbf37b2660285b P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65876a2b197c4ea6918f5cab47ded25c; no voters: 0f412334fb994ff0ab492afde64f5855, d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:35.387442 20272 tablet_bootstrap.cc:492] T 6db769d91ae244679bcea825f9763446 P 35e7d1ade024444486e63cf1b81e9626: No bootstrap required, opened a new log
I20251023 07:59:35.388000 20272 ts_tablet_manager.cc:1403] T 6db769d91ae244679bcea825f9763446 P 35e7d1ade024444486e63cf1b81e9626: Time spent bootstrapping tablet: real 0.077s user 0.011s sys 0.015s
I20251023 07:59:35.388423 20512 raft_consensus.cc:2749] T f1da9b379f264014adfbf37b2660285b P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:59:35.391158 20272 raft_consensus.cc:359] T 6db769d91ae244679bcea825f9763446 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:35.392259 20271 tablet_bootstrap.cc:492] T a1c85032f5ef4634a35c20eec56ae62f P 0f412334fb994ff0ab492afde64f5855: No bootstrap required, opened a new log
I20251023 07:59:35.392285 20272 raft_consensus.cc:385] T 6db769d91ae244679bcea825f9763446 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:35.393002 20271 ts_tablet_manager.cc:1403] T a1c85032f5ef4634a35c20eec56ae62f P 0f412334fb994ff0ab492afde64f5855: Time spent bootstrapping tablet: real 0.204s user 0.057s sys 0.021s
I20251023 07:59:35.393108 20272 raft_consensus.cc:740] T 6db769d91ae244679bcea825f9763446 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e7d1ade024444486e63cf1b81e9626, State: Initialized, Role: FOLLOWER
I20251023 07:59:35.394069 20272 consensus_queue.cc:260] T 6db769d91ae244679bcea825f9763446 P 35e7d1ade024444486e63cf1b81e9626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:35.396449 20272 ts_tablet_manager.cc:1434] T 6db769d91ae244679bcea825f9763446 P 35e7d1ade024444486e63cf1b81e9626: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20251023 07:59:35.397399 20272 tablet_bootstrap.cc:492] T 09f7b5cd377e45be8bbd85052c93dcb3 P 35e7d1ade024444486e63cf1b81e9626: Bootstrap starting.
I20251023 07:59:35.399402 20271 raft_consensus.cc:359] T a1c85032f5ef4634a35c20eec56ae62f P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:35.400236 20271 raft_consensus.cc:385] T a1c85032f5ef4634a35c20eec56ae62f P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:35.400583 20271 raft_consensus.cc:740] T a1c85032f5ef4634a35c20eec56ae62f P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Initialized, Role: FOLLOWER
I20251023 07:59:35.401473 20271 consensus_queue.cc:260] T a1c85032f5ef4634a35c20eec56ae62f P 0f412334fb994ff0ab492afde64f5855 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:35.405373 20613 consensus_queue.cc:1048] T fb985a87f45d43d68b172b937404e770 P d1379e91aa9c41629cd25262571beb2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:59:35.383888 20076 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6db769d91ae244679bcea825f9763446" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626"
I20251023 07:59:35.408810 20076 raft_consensus.cc:3060] T 6db769d91ae244679bcea825f9763446 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:35.409646 19900 catalog_manager.cc:5649] T bd5baee3419c4a7aa0def773845ac48a P d1379e91aa9c41629cd25262571beb2c reported cstate change: term changed from 0 to 1, leader changed from <none> to d1379e91aa9c41629cd25262571beb2c (127.16.126.1). New cstate: current_term: 1 leader_uuid: "d1379e91aa9c41629cd25262571beb2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:35.412128 20614 raft_consensus.cc:493] T a1c85032f5ef4634a35c20eec56ae62f P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:35.412647 20614 raft_consensus.cc:515] T a1c85032f5ef4634a35c20eec56ae62f P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:35.414582 20614 leader_election.cc:290] T a1c85032f5ef4634a35c20eec56ae62f P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:35.415413 20274 ts_tablet_manager.cc:1434] T 01844334149649bb83991b613a695fe2 P 65876a2b197c4ea6918f5cab47ded25c: Time spent starting tablet: real 0.078s user 0.007s sys 0.000s
I20251023 07:59:35.412177 20078 raft_consensus.cc:3060] T 2ff74dfb94334c20b99ea84b985a27a5 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:35.418548 20273 tablet_bootstrap.cc:492] T f1da9b379f264014adfbf37b2660285b P d1379e91aa9c41629cd25262571beb2c: No bootstrap required, opened a new log
I20251023 07:59:35.419353 20273 ts_tablet_manager.cc:1403] T f1da9b379f264014adfbf37b2660285b P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.134s user 0.033s sys 0.020s
I20251023 07:59:35.420619 20271 ts_tablet_manager.cc:1434] T a1c85032f5ef4634a35c20eec56ae62f P 0f412334fb994ff0ab492afde64f5855: Time spent starting tablet: real 0.027s user 0.007s sys 0.000s
I20251023 07:59:35.419647 19999 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a1c85032f5ef4634a35c20eec56ae62f" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:35.421283 20272 tablet_bootstrap.cc:654] T 09f7b5cd377e45be8bbd85052c93dcb3 P 35e7d1ade024444486e63cf1b81e9626: Neither blocks nor log segments found. Creating new log.
W20251023 07:59:35.422191 20118 leader_election.cc:343] T a1c85032f5ef4634a35c20eec56ae62f P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:35.424542 20617 consensus_queue.cc:1048] T fb985a87f45d43d68b172b937404e770 P d1379e91aa9c41629cd25262571beb2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:59:35.440548 20274 tablet_bootstrap.cc:492] T 35c1ea979bda45aead7d1b8539f37637 P 65876a2b197c4ea6918f5cab47ded25c: Bootstrap starting.
I20251023 07:59:35.446761 20414 consensus_queue.cc:1048] T 2ff74dfb94334c20b99ea84b985a27a5 P 65876a2b197c4ea6918f5cab47ded25c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:59:35.447772 20273 raft_consensus.cc:359] T f1da9b379f264014adfbf37b2660285b P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:35.448561 20273 raft_consensus.cc:385] T f1da9b379f264014adfbf37b2660285b P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:35.448791 20273 raft_consensus.cc:740] T f1da9b379f264014adfbf37b2660285b P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:35.449404 20273 consensus_queue.cc:260] T f1da9b379f264014adfbf37b2660285b P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:35.453230 20273 ts_tablet_manager.cc:1434] T f1da9b379f264014adfbf37b2660285b P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.034s user 0.000s sys 0.006s
I20251023 07:59:35.460110 20223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a1c85032f5ef4634a35c20eec56ae62f" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c" is_pre_election: true
I20251023 07:59:35.460842 20223 raft_consensus.cc:2468] T a1c85032f5ef4634a35c20eec56ae62f P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f412334fb994ff0ab492afde64f5855 in term 0.
I20251023 07:59:35.462440 20512 consensus_queue.cc:1048] T 20f681957fa04333b8a04cbad085db57 P 65876a2b197c4ea6918f5cab47ded25c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:59:35.462831 20076 raft_consensus.cc:2468] T 6db769d91ae244679bcea825f9763446 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f412334fb994ff0ab492afde64f5855 in term 1.
I20251023 07:59:35.466852 20222 raft_consensus.cc:2468] T 6db769d91ae244679bcea825f9763446 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f412334fb994ff0ab492afde64f5855 in term 1.
I20251023 07:59:35.472011 20116 leader_election.cc:304] T 6db769d91ae244679bcea825f9763446 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, 35e7d1ade024444486e63cf1b81e9626; no voters:
I20251023 07:59:35.472851 20274 tablet_bootstrap.cc:654] T 35c1ea979bda45aead7d1b8539f37637 P 65876a2b197c4ea6918f5cab47ded25c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:35.472915 20614 raft_consensus.cc:2804] T 6db769d91ae244679bcea825f9763446 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:59:35.473675 20614 raft_consensus.cc:697] T 6db769d91ae244679bcea825f9763446 P 0f412334fb994ff0ab492afde64f5855 [term 1 LEADER]: Becoming Leader. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Running, Role: LEADER
I20251023 07:59:35.474494 20614 consensus_queue.cc:237] T 6db769d91ae244679bcea825f9763446 P 0f412334fb994ff0ab492afde64f5855 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:35.478121 19897 catalog_manager.cc:5649] T 2ff74dfb94334c20b99ea84b985a27a5 P 65876a2b197c4ea6918f5cab47ded25c reported cstate change: term changed from 0 to 1, leader changed from <none> to 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4). New cstate: current_term: 1 leader_uuid: "65876a2b197c4ea6918f5cab47ded25c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:35.479540 19897 catalog_manager.cc:5649] T 0973ba22912840bd9bded8b0376fa1e7 P 65876a2b197c4ea6918f5cab47ded25c reported cstate change: term changed from 0 to 1, leader changed from <none> to 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4). New cstate: current_term: 1 leader_uuid: "65876a2b197c4ea6918f5cab47ded25c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:35.482133 20273 tablet_bootstrap.cc:492] T a1c85032f5ef4634a35c20eec56ae62f P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:35.486927 20271 tablet_bootstrap.cc:492] T f1da9b379f264014adfbf37b2660285b P 0f412334fb994ff0ab492afde64f5855: Bootstrap starting.
I20251023 07:59:35.490666 20272 tablet_bootstrap.cc:492] T 09f7b5cd377e45be8bbd85052c93dcb3 P 35e7d1ade024444486e63cf1b81e9626: No bootstrap required, opened a new log
I20251023 07:59:35.491300 20272 ts_tablet_manager.cc:1403] T 09f7b5cd377e45be8bbd85052c93dcb3 P 35e7d1ade024444486e63cf1b81e9626: Time spent bootstrapping tablet: real 0.094s user 0.012s sys 0.011s
I20251023 07:59:35.502107 20272 raft_consensus.cc:359] T 09f7b5cd377e45be8bbd85052c93dcb3 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:35.502926 20272 raft_consensus.cc:385] T 09f7b5cd377e45be8bbd85052c93dcb3 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:35.503185 20272 raft_consensus.cc:740] T 09f7b5cd377e45be8bbd85052c93dcb3 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e7d1ade024444486e63cf1b81e9626, State: Initialized, Role: FOLLOWER
I20251023 07:59:35.503837 20272 consensus_queue.cc:260] T 09f7b5cd377e45be8bbd85052c93dcb3 P 35e7d1ade024444486e63cf1b81e9626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:35.504052 20632 raft_consensus.cc:493] T 090551fa29ba48dd8d41263e14b8ec3c P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:35.504772 20632 raft_consensus.cc:515] T 090551fa29ba48dd8d41263e14b8ec3c P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:35.510214 20632 leader_election.cc:290] T 090551fa29ba48dd8d41263e14b8ec3c P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287), 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955)
I20251023 07:59:35.511654 20117 leader_election.cc:304] T a1c85032f5ef4634a35c20eec56ae62f P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, 65876a2b197c4ea6918f5cab47ded25c; no voters: d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:35.513409 20149 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "090551fa29ba48dd8d41263e14b8ec3c" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855" is_pre_election: true
I20251023 07:59:35.497134 20613 raft_consensus.cc:493] T f1da9b379f264014adfbf37b2660285b P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20251023 07:59:35.514297 20190 consensus_peers.cc:597] T 0973ba22912840bd9bded8b0376fa1e7 P 65876a2b197c4ea6918f5cab47ded25c -> Peer 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309): Couldn't send request to peer 35e7d1ade024444486e63cf1b81e9626. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:35.514842 20613 raft_consensus.cc:515] T f1da9b379f264014adfbf37b2660285b P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:35.521219 20272 ts_tablet_manager.cc:1434] T 09f7b5cd377e45be8bbd85052c93dcb3 P 35e7d1ade024444486e63cf1b81e9626: Time spent starting tablet: real 0.030s user 0.008s sys 0.001s
I20251023 07:59:35.513196 20223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "090551fa29ba48dd8d41263e14b8ec3c" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c" is_pre_election: true
I20251023 07:59:35.526898 20223 raft_consensus.cc:2393] T 090551fa29ba48dd8d41263e14b8ec3c P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35e7d1ade024444486e63cf1b81e9626 in current term 1: Already voted for candidate 0f412334fb994ff0ab492afde64f5855 in this term.
I20251023 07:59:35.528162 20043 leader_election.cc:304] T 090551fa29ba48dd8d41263e14b8ec3c P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35e7d1ade024444486e63cf1b81e9626; no voters: 0f412334fb994ff0ab492afde64f5855, 65876a2b197c4ea6918f5cab47ded25c
I20251023 07:59:35.528843 20533 raft_consensus.cc:3060] T 090551fa29ba48dd8d41263e14b8ec3c P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:35.519488 20606 raft_consensus.cc:2804] T a1c85032f5ef4634a35c20eec56ae62f P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:35.531793 20606 raft_consensus.cc:493] T a1c85032f5ef4634a35c20eec56ae62f P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:35.537737 20606 raft_consensus.cc:3060] T a1c85032f5ef4634a35c20eec56ae62f P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:35.540719 20336 raft_consensus.cc:493] T 09f7b5cd377e45be8bbd85052c93dcb3 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:35.541201 20336 raft_consensus.cc:515] T 09f7b5cd377e45be8bbd85052c93dcb3 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:35.543015 20613 leader_election.cc:290] T f1da9b379f264014adfbf37b2660285b P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287), 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955)
I20251023 07:59:35.543051 20336 leader_election.cc:290] T 09f7b5cd377e45be8bbd85052c93dcb3 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865), 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287)
I20251023 07:59:35.546634 20222 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f1da9b379f264014adfbf37b2660285b" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c" is_pre_election: true
I20251023 07:59:35.547329 20222 raft_consensus.cc:2468] T f1da9b379f264014adfbf37b2660285b P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 0.
I20251023 07:59:35.548663 19968 leader_election.cc:304] T f1da9b379f264014adfbf37b2660285b P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65876a2b197c4ea6918f5cab47ded25c, d1379e91aa9c41629cd25262571beb2c; no voters:
I20251023 07:59:35.551599 20272 tablet_bootstrap.cc:492] T 0973ba22912840bd9bded8b0376fa1e7 P 35e7d1ade024444486e63cf1b81e9626: Bootstrap starting.
I20251023 07:59:35.551468 19998 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "09f7b5cd377e45be8bbd85052c93dcb3" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:35.553671 19998 raft_consensus.cc:2468] T 09f7b5cd377e45be8bbd85052c93dcb3 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35e7d1ade024444486e63cf1b81e9626 in term 0.
I20251023 07:59:35.554517 20611 raft_consensus.cc:2804] T f1da9b379f264014adfbf37b2660285b P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:35.555080 20611 raft_consensus.cc:493] T f1da9b379f264014adfbf37b2660285b P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:35.555452 20611 raft_consensus.cc:3060] T f1da9b379f264014adfbf37b2660285b P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:35.556447 20151 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "09f7b5cd377e45be8bbd85052c93dcb3" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855" is_pre_election: true
I20251023 07:59:35.557626 20044 leader_election.cc:304] T 09f7b5cd377e45be8bbd85052c93dcb3 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35e7d1ade024444486e63cf1b81e9626, d1379e91aa9c41629cd25262571beb2c; no voters:
I20251023 07:59:35.558631 20336 raft_consensus.cc:2804] T 09f7b5cd377e45be8bbd85052c93dcb3 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:35.559090 20336 raft_consensus.cc:493] T 09f7b5cd377e45be8bbd85052c93dcb3 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:35.559464 20336 raft_consensus.cc:3060] T 09f7b5cd377e45be8bbd85052c93dcb3 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:35.560173 20151 raft_consensus.cc:2468] T 09f7b5cd377e45be8bbd85052c93dcb3 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35e7d1ade024444486e63cf1b81e9626 in term 0.
I20251023 07:59:35.560014 20617 consensus_queue.cc:1048] T bd5baee3419c4a7aa0def773845ac48a P d1379e91aa9c41629cd25262571beb2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:59:35.568778 20533 raft_consensus.cc:2749] T 090551fa29ba48dd8d41263e14b8ec3c P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:59:35.581907 20336 raft_consensus.cc:515] T 09f7b5cd377e45be8bbd85052c93dcb3 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:35.583915 20414 raft_consensus.cc:493] T 01844334149649bb83991b613a695fe2 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:35.584710 20273 tablet_bootstrap.cc:654] T a1c85032f5ef4634a35c20eec56ae62f P d1379e91aa9c41629cd25262571beb2c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:35.584440 20414 raft_consensus.cc:515] T 01844334149649bb83991b613a695fe2 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:35.586493 20414 leader_election.cc:290] T 01844334149649bb83991b613a695fe2 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309), 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287)
I20251023 07:59:35.587656 20274 tablet_bootstrap.cc:492] T 35c1ea979bda45aead7d1b8539f37637 P 65876a2b197c4ea6918f5cab47ded25c: No bootstrap required, opened a new log
I20251023 07:59:35.588264 20274 ts_tablet_manager.cc:1403] T 35c1ea979bda45aead7d1b8539f37637 P 65876a2b197c4ea6918f5cab47ded25c: Time spent bootstrapping tablet: real 0.154s user 0.029s sys 0.021s
I20251023 07:59:35.590837 20078 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01844334149649bb83991b613a695fe2" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
I20251023 07:59:35.591764 20151 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01844334149649bb83991b613a695fe2" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855" is_pre_election: true
W20251023 07:59:35.592540 20190 leader_election.cc:343] T 01844334149649bb83991b613a695fe2 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309): Illegal state: must be running to vote when last-logged opid is not known
W20251023 07:59:35.595521 20189 leader_election.cc:343] T 01844334149649bb83991b613a695fe2 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:35.595994 20189 leader_election.cc:304] T 01844334149649bb83991b613a695fe2 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65876a2b197c4ea6918f5cab47ded25c; no voters: 0f412334fb994ff0ab492afde64f5855, 35e7d1ade024444486e63cf1b81e9626
I20251023 07:59:35.597338 20414 raft_consensus.cc:2749] T 01844334149649bb83991b613a695fe2 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:59:35.592941 20271 tablet_bootstrap.cc:654] T f1da9b379f264014adfbf37b2660285b P 0f412334fb994ff0ab492afde64f5855: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:35.596863 20274 raft_consensus.cc:359] T 35c1ea979bda45aead7d1b8539f37637 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:35.614840 20274 raft_consensus.cc:385] T 35c1ea979bda45aead7d1b8539f37637 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:35.615130 20274 raft_consensus.cc:740] T 35c1ea979bda45aead7d1b8539f37637 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65876a2b197c4ea6918f5cab47ded25c, State: Initialized, Role: FOLLOWER
I20251023 07:59:35.616566 20274 consensus_queue.cc:260] T 35c1ea979bda45aead7d1b8539f37637 P 65876a2b197c4ea6918f5cab47ded25c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
W20251023 07:59:35.628602 19967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.2:42309, user_credentials={real_user=slave}} blocked reactor thread for 100813us
I20251023 07:59:35.630477 20274 ts_tablet_manager.cc:1434] T 35c1ea979bda45aead7d1b8539f37637 P 65876a2b197c4ea6918f5cab47ded25c: Time spent starting tablet: real 0.042s user 0.003s sys 0.005s
I20251023 07:59:35.631546 20274 tablet_bootstrap.cc:492] T cb866838666745f0a4462f124ac22f72 P 65876a2b197c4ea6918f5cab47ded25c: Bootstrap starting.
I20251023 07:59:35.639386 20336 leader_election.cc:290] T 09f7b5cd377e45be8bbd85052c93dcb3 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 election: Requested vote from peers d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865), 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287)
W20251023 07:59:35.636171 19966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.3:33287, user_credentials={real_user=slave}} blocked reactor thread for 101766us
I20251023 07:59:35.648617 20274 tablet_bootstrap.cc:654] T cb866838666745f0a4462f124ac22f72 P 65876a2b197c4ea6918f5cab47ded25c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:35.648923 19999 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "09f7b5cd377e45be8bbd85052c93dcb3" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c"
I20251023 07:59:35.657087 19999 raft_consensus.cc:3060] T 09f7b5cd377e45be8bbd85052c93dcb3 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:35.657508 20505 consensus_queue.cc:1048] T 382a939856194537b68f791851ceaa65 P 35e7d1ade024444486e63cf1b81e9626 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:59:35.663417 20512 raft_consensus.cc:493] T f524e775b99147de99cfb27d3785965d P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:35.663941 20512 raft_consensus.cc:515] T f524e775b99147de99cfb27d3785965d P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:35.655053 20606 raft_consensus.cc:515] T a1c85032f5ef4634a35c20eec56ae62f P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:35.668305 20512 leader_election.cc:290] T f524e775b99147de99cfb27d3785965d P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:35.674575 20272 tablet_bootstrap.cc:654] T 0973ba22912840bd9bded8b0376fa1e7 P 35e7d1ade024444486e63cf1b81e9626: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:35.677184 20151 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f524e775b99147de99cfb27d3785965d" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855" is_pre_election: true
I20251023 07:59:35.677206 20146 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f1da9b379f264014adfbf37b2660285b" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855" is_pre_election: true
I20251023 07:59:35.682531 19898 catalog_manager.cc:5649] T 6db769d91ae244679bcea825f9763446 P 0f412334fb994ff0ab492afde64f5855 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f412334fb994ff0ab492afde64f5855 (127.16.126.3). New cstate: current_term: 1 leader_uuid: "0f412334fb994ff0ab492afde64f5855" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:35.683348 20221 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a1c85032f5ef4634a35c20eec56ae62f" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c"
I20251023 07:59:35.683972 20221 raft_consensus.cc:3060] T a1c85032f5ef4634a35c20eec56ae62f P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:35.685518 20611 raft_consensus.cc:515] T f1da9b379f264014adfbf37b2660285b P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
W20251023 07:59:35.687552 20189 leader_election.cc:343] T f524e775b99147de99cfb27d3785965d P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:35.688895 20611 leader_election.cc:290] T f1da9b379f264014adfbf37b2660285b P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 election: Requested vote from peers 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287), 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955)
I20251023 07:59:35.690392 20220 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f1da9b379f264014adfbf37b2660285b" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c"
I20251023 07:59:35.691069 20220 raft_consensus.cc:3060] T f1da9b379f264014adfbf37b2660285b P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Advancing to term 1
W20251023 07:59:35.693704 20044 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.1:37865, user_credentials={real_user=slave}} blocked reactor thread for 55854.2us
I20251023 07:59:35.723856 20000 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a1c85032f5ef4634a35c20eec56ae62f" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c"
W20251023 07:59:35.724548 20664 log.cc:927] Time spent T 6db769d91ae244679bcea825f9763446 P 0f412334fb994ff0ab492afde64f5855: Append to log took a long time: real 0.095s user 0.000s sys 0.001s
W20251023 07:59:35.726666 20118 leader_election.cc:343] T a1c85032f5ef4634a35c20eec56ae62f P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:35.736456 20414 raft_consensus.cc:493] T 35c1ea979bda45aead7d1b8539f37637 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20251023 07:59:35.737064 19966 leader_election.cc:343] T f1da9b379f264014adfbf37b2660285b P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:35.737005 20414 raft_consensus.cc:515] T 35c1ea979bda45aead7d1b8539f37637 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:35.739048 20414 leader_election.cc:290] T 35c1ea979bda45aead7d1b8539f37637 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865), 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309)
I20251023 07:59:35.743006 20145 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f1da9b379f264014adfbf37b2660285b" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855"
I20251023 07:59:35.751581 20512 consensus_queue.cc:1048] T 0973ba22912840bd9bded8b0376fa1e7 P 65876a2b197c4ea6918f5cab47ded25c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:59:35.739850 19997 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f524e775b99147de99cfb27d3785965d" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:35.752771 20221 raft_consensus.cc:2468] T a1c85032f5ef4634a35c20eec56ae62f P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f412334fb994ff0ab492afde64f5855 in term 1.
I20251023 07:59:35.755190 20273 tablet_bootstrap.cc:492] T a1c85032f5ef4634a35c20eec56ae62f P d1379e91aa9c41629cd25262571beb2c: No bootstrap required, opened a new log
I20251023 07:59:35.755749 20273 ts_tablet_manager.cc:1403] T a1c85032f5ef4634a35c20eec56ae62f P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.274s user 0.021s sys 0.027s
I20251023 07:59:35.722723 20606 leader_election.cc:290] T a1c85032f5ef4634a35c20eec56ae62f P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 election: Requested vote from peers 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:35.762707 20220 raft_consensus.cc:2468] T f1da9b379f264014adfbf37b2660285b P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 1.
I20251023 07:59:35.763918 19968 leader_election.cc:304] T f1da9b379f264014adfbf37b2660285b P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65876a2b197c4ea6918f5cab47ded25c, d1379e91aa9c41629cd25262571beb2c; no voters:
I20251023 07:59:35.764729 20448 raft_consensus.cc:2804] T f1da9b379f264014adfbf37b2660285b P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:59:35.765197 20448 raft_consensus.cc:697] T f1da9b379f264014adfbf37b2660285b P d1379e91aa9c41629cd25262571beb2c [term 1 LEADER]: Becoming Leader. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Running, Role: LEADER
I20251023 07:59:35.766111 20448 consensus_queue.cc:237] T f1da9b379f264014adfbf37b2660285b P d1379e91aa9c41629cd25262571beb2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:35.777697 19999 raft_consensus.cc:2468] T 09f7b5cd377e45be8bbd85052c93dcb3 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35e7d1ade024444486e63cf1b81e9626 in term 1.
I20251023 07:59:35.788321 20273 raft_consensus.cc:359] T a1c85032f5ef4634a35c20eec56ae62f P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:35.790377 20273 raft_consensus.cc:385] T a1c85032f5ef4634a35c20eec56ae62f P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:35.790726 20273 raft_consensus.cc:740] T a1c85032f5ef4634a35c20eec56ae62f P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:35.791498 20273 consensus_queue.cc:260] T a1c85032f5ef4634a35c20eec56ae62f P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:35.795794 20044 leader_election.cc:304] T 09f7b5cd377e45be8bbd85052c93dcb3 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35e7d1ade024444486e63cf1b81e9626, d1379e91aa9c41629cd25262571beb2c; no voters:
W20251023 07:59:35.786367 20116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.2:42309, user_credentials={real_user=slave}} blocked reactor thread for 63163.5us
I20251023 07:59:35.800397 20671 raft_consensus.cc:2804] T 09f7b5cd377e45be8bbd85052c93dcb3 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:59:35.806878 20671 raft_consensus.cc:697] T 09f7b5cd377e45be8bbd85052c93dcb3 P 35e7d1ade024444486e63cf1b81e9626 [term 1 LEADER]: Becoming Leader. State: Replica: 35e7d1ade024444486e63cf1b81e9626, State: Running, Role: LEADER
I20251023 07:59:35.807929 20671 consensus_queue.cc:237] T 09f7b5cd377e45be8bbd85052c93dcb3 P 35e7d1ade024444486e63cf1b81e9626 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:35.812882 20145 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "09f7b5cd377e45be8bbd85052c93dcb3" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855"
I20251023 07:59:35.813588 20145 raft_consensus.cc:3060] T 09f7b5cd377e45be8bbd85052c93dcb3 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:35.813372 20675 consensus_queue.cc:1048] T 090551fa29ba48dd8d41263e14b8ec3c P 0f412334fb994ff0ab492afde64f5855 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20251023 07:59:35.822458 20192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.1:37865, user_credentials={real_user=slave}} blocked reactor thread for 71723.8us
I20251023 07:59:35.825567 20117 leader_election.cc:304] T a1c85032f5ef4634a35c20eec56ae62f P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, 65876a2b197c4ea6918f5cab47ded25c; no voters: d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:35.827674 20606 raft_consensus.cc:2804] T a1c85032f5ef4634a35c20eec56ae62f P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:59:35.828781 20606 raft_consensus.cc:697] T a1c85032f5ef4634a35c20eec56ae62f P 0f412334fb994ff0ab492afde64f5855 [term 1 LEADER]: Becoming Leader. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Running, Role: LEADER
I20251023 07:59:35.829624 20606 consensus_queue.cc:237] T a1c85032f5ef4634a35c20eec56ae62f P 0f412334fb994ff0ab492afde64f5855 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:35.852475 20614 consensus_queue.cc:1048] T 090551fa29ba48dd8d41263e14b8ec3c P 0f412334fb994ff0ab492afde64f5855 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:59:35.867524 20533 consensus_queue.cc:1048] T 382a939856194537b68f791851ceaa65 P 35e7d1ade024444486e63cf1b81e9626 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:59:35.871719 20274 tablet_bootstrap.cc:492] T cb866838666745f0a4462f124ac22f72 P 65876a2b197c4ea6918f5cab47ded25c: No bootstrap required, opened a new log
I20251023 07:59:35.872305 20274 ts_tablet_manager.cc:1403] T cb866838666745f0a4462f124ac22f72 P 65876a2b197c4ea6918f5cab47ded25c: Time spent bootstrapping tablet: real 0.241s user 0.023s sys 0.039s
I20251023 07:59:35.878870 20273 ts_tablet_manager.cc:1434] T a1c85032f5ef4634a35c20eec56ae62f P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.123s user 0.007s sys 0.002s
I20251023 07:59:35.882506 20622 consensus_queue.cc:1048] T 2ff74dfb94334c20b99ea84b985a27a5 P 65876a2b197c4ea6918f5cab47ded25c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:59:35.885871 20073 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "35c1ea979bda45aead7d1b8539f37637" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
W20251023 07:59:35.884477 20192 leader_election.cc:343] T f524e775b99147de99cfb27d3785965d P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:35.893811 20192 leader_election.cc:304] T f524e775b99147de99cfb27d3785965d P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65876a2b197c4ea6918f5cab47ded25c; no voters: 0f412334fb994ff0ab492afde64f5855, d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:35.904146 20273 tablet_bootstrap.cc:492] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:35.865239 20145 raft_consensus.cc:2468] T 09f7b5cd377e45be8bbd85052c93dcb3 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35e7d1ade024444486e63cf1b81e9626 in term 1.
W20251023 07:59:35.923475 20190 leader_election.cc:343] T 35c1ea979bda45aead7d1b8539f37637 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:35.947701 20272 tablet_bootstrap.cc:492] T 0973ba22912840bd9bded8b0376fa1e7 P 35e7d1ade024444486e63cf1b81e9626: No bootstrap required, opened a new log
I20251023 07:59:35.948190 20272 ts_tablet_manager.cc:1403] T 0973ba22912840bd9bded8b0376fa1e7 P 35e7d1ade024444486e63cf1b81e9626: Time spent bootstrapping tablet: real 0.397s user 0.015s sys 0.032s
I20251023 07:59:35.950002 20677 raft_consensus.cc:2749] T f524e775b99147de99cfb27d3785965d P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251023 07:59:35.951517 19966 leader_election.cc:343] T f1da9b379f264014adfbf37b2660285b P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:35.953958 19997 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "35c1ea979bda45aead7d1b8539f37637" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:35.953243 20274 raft_consensus.cc:359] T cb866838666745f0a4462f124ac22f72 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:35.958460 20274 raft_consensus.cc:385] T cb866838666745f0a4462f124ac22f72 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:35.969863 19897 catalog_manager.cc:5649] T 09f7b5cd377e45be8bbd85052c93dcb3 P 35e7d1ade024444486e63cf1b81e9626 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2). New cstate: current_term: 1 leader_uuid: "35e7d1ade024444486e63cf1b81e9626" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:35.982707 20272 raft_consensus.cc:359] T 0973ba22912840bd9bded8b0376fa1e7 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:35.998096 20272 raft_consensus.cc:385] T 0973ba22912840bd9bded8b0376fa1e7 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:35.998520 20272 raft_consensus.cc:740] T 0973ba22912840bd9bded8b0376fa1e7 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e7d1ade024444486e63cf1b81e9626, State: Initialized, Role: FOLLOWER
I20251023 07:59:35.999732 20273 tablet_bootstrap.cc:654] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P d1379e91aa9c41629cd25262571beb2c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:35.999385 20272 consensus_queue.cc:260] T 0973ba22912840bd9bded8b0376fa1e7 P 35e7d1ade024444486e63cf1b81e9626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:35.961592 19898 catalog_manager.cc:5649] T f1da9b379f264014adfbf37b2660285b P d1379e91aa9c41629cd25262571beb2c reported cstate change: term changed from 0 to 1, leader changed from <none> to d1379e91aa9c41629cd25262571beb2c (127.16.126.1). New cstate: current_term: 1 leader_uuid: "d1379e91aa9c41629cd25262571beb2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: HEALTHY } } }
W20251023 07:59:36.005550 19966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.3:33287, user_credentials={real_user=slave}} blocked reactor thread for 53031.2us
W20251023 07:59:36.007368 19968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.4:34955, user_credentials={real_user=slave}} blocked reactor thread for 48918.3us
W20251023 07:59:36.007863 20192 leader_election.cc:343] T 35c1ea979bda45aead7d1b8539f37637 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:36.008338 20192 leader_election.cc:304] T 35c1ea979bda45aead7d1b8539f37637 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65876a2b197c4ea6918f5cab47ded25c; no voters: 35e7d1ade024444486e63cf1b81e9626, d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:35.986241 20271 tablet_bootstrap.cc:492] T f1da9b379f264014adfbf37b2660285b P 0f412334fb994ff0ab492afde64f5855: No bootstrap required, opened a new log
I20251023 07:59:36.010566 20271 ts_tablet_manager.cc:1403] T f1da9b379f264014adfbf37b2660285b P 0f412334fb994ff0ab492afde64f5855: Time spent bootstrapping tablet: real 0.524s user 0.011s sys 0.040s
I20251023 07:59:35.958817 20274 raft_consensus.cc:740] T cb866838666745f0a4462f124ac22f72 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65876a2b197c4ea6918f5cab47ded25c, State: Initialized, Role: FOLLOWER
W20251023 07:59:36.009761 19967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.2:42309, user_credentials={real_user=slave}} blocked reactor thread for 56328.5us
I20251023 07:59:36.023178 20677 raft_consensus.cc:2749] T 35c1ea979bda45aead7d1b8539f37637 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:59:36.023449 20271 raft_consensus.cc:359] T f1da9b379f264014adfbf37b2660285b P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:36.024224 20271 raft_consensus.cc:385] T f1da9b379f264014adfbf37b2660285b P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:36.024562 20271 raft_consensus.cc:740] T f1da9b379f264014adfbf37b2660285b P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Initialized, Role: FOLLOWER
I20251023 07:59:36.025693 20274 consensus_queue.cc:260] T cb866838666745f0a4462f124ac22f72 P 65876a2b197c4ea6918f5cab47ded25c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:36.025418 20271 consensus_queue.cc:260] T f1da9b379f264014adfbf37b2660285b P 0f412334fb994ff0ab492afde64f5855 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:36.047844 20274 ts_tablet_manager.cc:1434] T cb866838666745f0a4462f124ac22f72 P 65876a2b197c4ea6918f5cab47ded25c: Time spent starting tablet: real 0.175s user 0.007s sys 0.001s
I20251023 07:59:36.049402 20272 ts_tablet_manager.cc:1434] T 0973ba22912840bd9bded8b0376fa1e7 P 35e7d1ade024444486e63cf1b81e9626: Time spent starting tablet: real 0.101s user 0.006s sys 0.002s
I20251023 07:59:36.050506 20272 tablet_bootstrap.cc:492] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P 35e7d1ade024444486e63cf1b81e9626: Bootstrap starting.
I20251023 07:59:36.053325 20271 ts_tablet_manager.cc:1434] T f1da9b379f264014adfbf37b2660285b P 0f412334fb994ff0ab492afde64f5855: Time spent starting tablet: real 0.042s user 0.007s sys 0.000s
I20251023 07:59:36.054755 20271 tablet_bootstrap.cc:492] T 01844334149649bb83991b613a695fe2 P 0f412334fb994ff0ab492afde64f5855: Bootstrap starting.
I20251023 07:59:36.041687 20438 consensus_queue.cc:1048] T 6db769d91ae244679bcea825f9763446 P 0f412334fb994ff0ab492afde64f5855 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20251023 07:59:36.066601 20669 raft_consensus.cc:493] T 0973ba22912840bd9bded8b0376fa1e7 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:36.067427 20669 raft_consensus.cc:515] T 0973ba22912840bd9bded8b0376fa1e7 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
W20251023 07:59:36.069725 19949 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20251023 07:59:36.071870 20220 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0973ba22912840bd9bded8b0376fa1e7" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c" is_pre_election: true
I20251023 07:59:36.074093 20669 leader_election.cc:290] T 0973ba22912840bd9bded8b0376fa1e7 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:36.080557 20003 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0973ba22912840bd9bded8b0376fa1e7" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:36.083587 20438 raft_consensus.cc:493] T f1da9b379f264014adfbf37b2660285b P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:36.104519 20043 leader_election.cc:304] T 0973ba22912840bd9bded8b0376fa1e7 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35e7d1ade024444486e63cf1b81e9626; no voters: 65876a2b197c4ea6918f5cab47ded25c, d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:36.089676 20309 consensus_queue.cc:1048] T 6db769d91ae244679bcea825f9763446 P 0f412334fb994ff0ab492afde64f5855 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20251023 07:59:36.107893 20336 raft_consensus.cc:2749] T 0973ba22912840bd9bded8b0376fa1e7 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:59:36.089655 20438 raft_consensus.cc:515] T f1da9b379f264014adfbf37b2660285b P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:36.110970 19901 catalog_manager.cc:5649] T a1c85032f5ef4634a35c20eec56ae62f P 0f412334fb994ff0ab492afde64f5855 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f412334fb994ff0ab492afde64f5855 (127.16.126.3). New cstate: current_term: 1 leader_uuid: "0f412334fb994ff0ab492afde64f5855" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:36.138746 20613 raft_consensus.cc:493] T a1c85032f5ef4634a35c20eec56ae62f P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:36.139541 20613 raft_consensus.cc:515] T a1c85032f5ef4634a35c20eec56ae62f P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:36.143961 20613 leader_election.cc:290] T a1c85032f5ef4634a35c20eec56ae62f P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287), 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955)
I20251023 07:59:36.145269 20223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a1c85032f5ef4634a35c20eec56ae62f" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c" is_pre_election: true
I20251023 07:59:36.146157 20223 raft_consensus.cc:2393] T a1c85032f5ef4634a35c20eec56ae62f P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d1379e91aa9c41629cd25262571beb2c in current term 1: Already voted for candidate 0f412334fb994ff0ab492afde64f5855 in this term.
I20251023 07:59:36.153203 20271 tablet_bootstrap.cc:654] T 01844334149649bb83991b613a695fe2 P 0f412334fb994ff0ab492afde64f5855: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:36.155129 20274 tablet_bootstrap.cc:492] T b7dcf1850ca541d6ab42bd11de70d8f4 P 65876a2b197c4ea6918f5cab47ded25c: Bootstrap starting.
I20251023 07:59:36.156328 20438 leader_election.cc:290] T f1da9b379f264014adfbf37b2660285b P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:36.171906 20220 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f1da9b379f264014adfbf37b2660285b" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c" is_pre_election: true
I20251023 07:59:36.184829 20220 raft_consensus.cc:2393] T f1da9b379f264014adfbf37b2660285b P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f412334fb994ff0ab492afde64f5855 in current term 1: Already voted for candidate d1379e91aa9c41629cd25262571beb2c in this term.
I20251023 07:59:36.189574 20273 tablet_bootstrap.cc:492] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P d1379e91aa9c41629cd25262571beb2c: No bootstrap required, opened a new log
I20251023 07:59:36.193490 20145 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a1c85032f5ef4634a35c20eec56ae62f" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855" is_pre_election: true
I20251023 07:59:36.193974 20151 raft_consensus.cc:3060] T f1da9b379f264014adfbf37b2660285b P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:36.190115 20273 ts_tablet_manager.cc:1403] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.293s user 0.010s sys 0.027s
I20251023 07:59:36.195550 20003 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f1da9b379f264014adfbf37b2660285b" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:36.198693 20273 raft_consensus.cc:359] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:36.199334 20273 raft_consensus.cc:385] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:36.199575 20273 raft_consensus.cc:740] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:36.202055 20273 consensus_queue.cc:260] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:36.245553 20273 ts_tablet_manager.cc:1434] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.049s user 0.005s sys 0.002s
I20251023 07:59:36.244007 20117 leader_election.cc:304] T f1da9b379f264014adfbf37b2660285b P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855; no voters: 65876a2b197c4ea6918f5cab47ded25c, d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:36.231222 19966 leader_election.cc:304] T a1c85032f5ef4634a35c20eec56ae62f P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d1379e91aa9c41629cd25262571beb2c; no voters: 0f412334fb994ff0ab492afde64f5855, 65876a2b197c4ea6918f5cab47ded25c
I20251023 07:59:36.250028 20274 tablet_bootstrap.cc:654] T b7dcf1850ca541d6ab42bd11de70d8f4 P 65876a2b197c4ea6918f5cab47ded25c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:36.257179 20611 raft_consensus.cc:3060] T a1c85032f5ef4634a35c20eec56ae62f P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:36.260807 20667 consensus_queue.cc:1048] T f1da9b379f264014adfbf37b2660285b P d1379e91aa9c41629cd25262571beb2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:59:36.253355 20606 raft_consensus.cc:2749] T f1da9b379f264014adfbf37b2660285b P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:59:36.273600 20272 tablet_bootstrap.cc:654] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P 35e7d1ade024444486e63cf1b81e9626: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:36.276315 20273 tablet_bootstrap.cc:492] T cb866838666745f0a4462f124ac22f72 P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:36.278544 20667 consensus_queue.cc:1048] T f1da9b379f264014adfbf37b2660285b P d1379e91aa9c41629cd25262571beb2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20251023 07:59:36.276963 20611 raft_consensus.cc:2749] T a1c85032f5ef4634a35c20eec56ae62f P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:59:36.316941 20505 consensus_queue.cc:1048] T 09f7b5cd377e45be8bbd85052c93dcb3 P 35e7d1ade024444486e63cf1b81e9626 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:59:36.319061 20271 tablet_bootstrap.cc:492] T 01844334149649bb83991b613a695fe2 P 0f412334fb994ff0ab492afde64f5855: No bootstrap required, opened a new log
I20251023 07:59:36.319650 20271 ts_tablet_manager.cc:1403] T 01844334149649bb83991b613a695fe2 P 0f412334fb994ff0ab492afde64f5855: Time spent bootstrapping tablet: real 0.265s user 0.018s sys 0.000s
I20251023 07:59:36.336046 20273 tablet_bootstrap.cc:654] T cb866838666745f0a4462f124ac22f72 P d1379e91aa9c41629cd25262571beb2c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:36.338336 20271 raft_consensus.cc:359] T 01844334149649bb83991b613a695fe2 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:36.339188 20271 raft_consensus.cc:385] T 01844334149649bb83991b613a695fe2 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:36.339494 20271 raft_consensus.cc:740] T 01844334149649bb83991b613a695fe2 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Initialized, Role: FOLLOWER
I20251023 07:59:36.340134 20271 consensus_queue.cc:260] T 01844334149649bb83991b613a695fe2 P 0f412334fb994ff0ab492afde64f5855 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:36.345829 20665 raft_consensus.cc:493] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:36.346499 20271 ts_tablet_manager.cc:1434] T 01844334149649bb83991b613a695fe2 P 0f412334fb994ff0ab492afde64f5855: Time spent starting tablet: real 0.027s user 0.007s sys 0.002s
I20251023 07:59:36.346392 20665 raft_consensus.cc:515] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:36.347769 20271 tablet_bootstrap.cc:492] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P 0f412334fb994ff0ab492afde64f5855: Bootstrap starting.
I20251023 07:59:36.348415 20665 leader_election.cc:290] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309), 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287)
I20251023 07:59:36.351608 20274 tablet_bootstrap.cc:492] T b7dcf1850ca541d6ab42bd11de70d8f4 P 65876a2b197c4ea6918f5cab47ded25c: No bootstrap required, opened a new log
I20251023 07:59:36.352130 20274 ts_tablet_manager.cc:1403] T b7dcf1850ca541d6ab42bd11de70d8f4 P 65876a2b197c4ea6918f5cab47ded25c: Time spent bootstrapping tablet: real 0.228s user 0.021s sys 0.005s
I20251023 07:59:36.351356 20073 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0fead0c9b2cd4e6cabadb0fe1cd8324b" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
W20251023 07:59:36.360138 19967 leader_election.cc:343] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:36.359977 20274 raft_consensus.cc:359] T b7dcf1850ca541d6ab42bd11de70d8f4 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:36.361184 20274 raft_consensus.cc:385] T b7dcf1850ca541d6ab42bd11de70d8f4 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:36.361511 20274 raft_consensus.cc:740] T b7dcf1850ca541d6ab42bd11de70d8f4 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65876a2b197c4ea6918f5cab47ded25c, State: Initialized, Role: FOLLOWER
I20251023 07:59:36.361850 20336 consensus_queue.cc:1048] T 09f7b5cd377e45be8bbd85052c93dcb3 P 35e7d1ade024444486e63cf1b81e9626 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:59:36.362390 20274 consensus_queue.cc:260] T b7dcf1850ca541d6ab42bd11de70d8f4 P 65876a2b197c4ea6918f5cab47ded25c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:36.368376 20146 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0fead0c9b2cd4e6cabadb0fe1cd8324b" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855" is_pre_election: true
W20251023 07:59:36.372285 19966 leader_election.cc:343] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:36.372748 19966 leader_election.cc:304] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d1379e91aa9c41629cd25262571beb2c; no voters: 0f412334fb994ff0ab492afde64f5855, 35e7d1ade024444486e63cf1b81e9626
I20251023 07:59:36.373819 20665 raft_consensus.cc:2749] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:59:36.374504 20274 ts_tablet_manager.cc:1434] T b7dcf1850ca541d6ab42bd11de70d8f4 P 65876a2b197c4ea6918f5cab47ded25c: Time spent starting tablet: real 0.022s user 0.006s sys 0.002s
I20251023 07:59:36.377184 20272 tablet_bootstrap.cc:492] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P 35e7d1ade024444486e63cf1b81e9626: No bootstrap required, opened a new log
I20251023 07:59:36.380551 20272 ts_tablet_manager.cc:1403] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P 35e7d1ade024444486e63cf1b81e9626: Time spent bootstrapping tablet: real 0.330s user 0.010s sys 0.008s
I20251023 07:59:36.384829 20514 raft_consensus.cc:493] T cb866838666745f0a4462f124ac22f72 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:36.385370 20514 raft_consensus.cc:515] T cb866838666745f0a4462f124ac22f72 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:36.387331 20514 leader_election.cc:290] T cb866838666745f0a4462f124ac22f72 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865), 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309)
I20251023 07:59:36.385227 20272 raft_consensus.cc:359] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:36.388127 20272 raft_consensus.cc:385] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:36.388413 20272 raft_consensus.cc:740] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e7d1ade024444486e63cf1b81e9626, State: Initialized, Role: FOLLOWER
I20251023 07:59:36.389421 20077 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cb866838666745f0a4462f124ac22f72" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
W20251023 07:59:36.390998 20190 leader_election.cc:343] T cb866838666745f0a4462f124ac22f72 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:36.394461 20438 consensus_queue.cc:1048] T a1c85032f5ef4634a35c20eec56ae62f P 0f412334fb994ff0ab492afde64f5855 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:59:36.389053 20272 consensus_queue.cc:260] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P 35e7d1ade024444486e63cf1b81e9626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:36.397238 20272 ts_tablet_manager.cc:1434] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P 35e7d1ade024444486e63cf1b81e9626: Time spent starting tablet: real 0.016s user 0.004s sys 0.000s
I20251023 07:59:36.398669 20272 tablet_bootstrap.cc:492] T 01844334149649bb83991b613a695fe2 P 35e7d1ade024444486e63cf1b81e9626: Bootstrap starting.
I20251023 07:59:36.404561 19998 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cb866838666745f0a4462f124ac22f72" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:36.412588 20514 raft_consensus.cc:493] T b7dcf1850ca541d6ab42bd11de70d8f4 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:36.413125 20514 raft_consensus.cc:515] T b7dcf1850ca541d6ab42bd11de70d8f4 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:36.413926 20272 tablet_bootstrap.cc:654] T 01844334149649bb83991b613a695fe2 P 35e7d1ade024444486e63cf1b81e9626: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:36.415169 20514 leader_election.cc:290] T b7dcf1850ca541d6ab42bd11de70d8f4 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:36.416123 20145 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7dcf1850ca541d6ab42bd11de70d8f4" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855" is_pre_election: true
W20251023 07:59:36.417637 20189 leader_election.cc:343] T b7dcf1850ca541d6ab42bd11de70d8f4 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287): Illegal state: must be running to vote when last-logged opid is not known
W20251023 07:59:36.418001 20192 leader_election.cc:343] T cb866838666745f0a4462f124ac22f72 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:36.418411 20192 leader_election.cc:304] T cb866838666745f0a4462f124ac22f72 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65876a2b197c4ea6918f5cab47ded25c; no voters: 35e7d1ade024444486e63cf1b81e9626, d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:36.419515 20514 raft_consensus.cc:2749] T cb866838666745f0a4462f124ac22f72 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:59:36.421801 19998 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7dcf1850ca541d6ab42bd11de70d8f4" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
W20251023 07:59:36.425699 20192 leader_election.cc:343] T b7dcf1850ca541d6ab42bd11de70d8f4 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:36.407512 20271 tablet_bootstrap.cc:654] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P 0f412334fb994ff0ab492afde64f5855: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:36.426187 20192 leader_election.cc:304] T b7dcf1850ca541d6ab42bd11de70d8f4 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65876a2b197c4ea6918f5cab47ded25c; no voters: 0f412334fb994ff0ab492afde64f5855, d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:36.431936 20514 raft_consensus.cc:2749] T b7dcf1850ca541d6ab42bd11de70d8f4 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:59:36.437444 20273 tablet_bootstrap.cc:492] T cb866838666745f0a4462f124ac22f72 P d1379e91aa9c41629cd25262571beb2c: No bootstrap required, opened a new log
I20251023 07:59:36.438015 20273 ts_tablet_manager.cc:1403] T cb866838666745f0a4462f124ac22f72 P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.184s user 0.022s sys 0.007s
I20251023 07:59:36.440240 20606 consensus_queue.cc:1048] T a1c85032f5ef4634a35c20eec56ae62f P 0f412334fb994ff0ab492afde64f5855 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:59:36.445676 20077 raft_consensus.cc:3060] T 0973ba22912840bd9bded8b0376fa1e7 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:36.446249 20272 tablet_bootstrap.cc:492] T 01844334149649bb83991b613a695fe2 P 35e7d1ade024444486e63cf1b81e9626: No bootstrap required, opened a new log
I20251023 07:59:36.446898 20272 ts_tablet_manager.cc:1403] T 01844334149649bb83991b613a695fe2 P 35e7d1ade024444486e63cf1b81e9626: Time spent bootstrapping tablet: real 0.049s user 0.013s sys 0.000s
I20251023 07:59:36.449947 20273 raft_consensus.cc:359] T cb866838666745f0a4462f124ac22f72 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:36.450651 20273 raft_consensus.cc:385] T cb866838666745f0a4462f124ac22f72 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:36.450906 20273 raft_consensus.cc:740] T cb866838666745f0a4462f124ac22f72 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:36.452702 20272 raft_consensus.cc:359] T 01844334149649bb83991b613a695fe2 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:36.453398 20273 consensus_queue.cc:260] T cb866838666745f0a4462f124ac22f72 P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:36.453449 20272 raft_consensus.cc:385] T 01844334149649bb83991b613a695fe2 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:36.455168 20272 raft_consensus.cc:740] T 01844334149649bb83991b613a695fe2 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e7d1ade024444486e63cf1b81e9626, State: Initialized, Role: FOLLOWER
I20251023 07:59:36.458107 20273 ts_tablet_manager.cc:1434] T cb866838666745f0a4462f124ac22f72 P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.019s user 0.006s sys 0.000s
I20251023 07:59:36.459146 20273 tablet_bootstrap.cc:492] T d51f1c713224480980c425d473226a02 P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:36.461854 20272 consensus_queue.cc:260] T 01844334149649bb83991b613a695fe2 P 35e7d1ade024444486e63cf1b81e9626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:36.465421 20272 ts_tablet_manager.cc:1434] T 01844334149649bb83991b613a695fe2 P 35e7d1ade024444486e63cf1b81e9626: Time spent starting tablet: real 0.018s user 0.006s sys 0.001s
I20251023 07:59:36.466416 20272 tablet_bootstrap.cc:492] T cb866838666745f0a4462f124ac22f72 P 35e7d1ade024444486e63cf1b81e9626: Bootstrap starting.
I20251023 07:59:36.468535 20606 raft_consensus.cc:493] T 01844334149649bb83991b613a695fe2 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:36.469043 20606 raft_consensus.cc:515] T 01844334149649bb83991b613a695fe2 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:36.486899 20073 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01844334149649bb83991b613a695fe2" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
I20251023 07:59:36.493857 20073 raft_consensus.cc:2468] T 01844334149649bb83991b613a695fe2 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f412334fb994ff0ab492afde64f5855 in term 0.
I20251023 07:59:36.495128 20116 leader_election.cc:304] T 01844334149649bb83991b613a695fe2 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, 35e7d1ade024444486e63cf1b81e9626; no voters:
I20251023 07:59:36.495950 20272 tablet_bootstrap.cc:654] T cb866838666745f0a4462f124ac22f72 P 35e7d1ade024444486e63cf1b81e9626: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:36.495997 20675 raft_consensus.cc:2804] T 01844334149649bb83991b613a695fe2 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:36.496995 20675 raft_consensus.cc:493] T 01844334149649bb83991b613a695fe2 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:36.497327 20675 raft_consensus.cc:3060] T 01844334149649bb83991b613a695fe2 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:36.503352 20606 leader_election.cc:290] T 01844334149649bb83991b613a695fe2 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309), 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955)
I20251023 07:59:36.508229 20223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01844334149649bb83991b613a695fe2" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c" is_pre_election: true
I20251023 07:59:36.510515 20271 tablet_bootstrap.cc:492] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P 0f412334fb994ff0ab492afde64f5855: No bootstrap required, opened a new log
I20251023 07:59:36.510720 20223 raft_consensus.cc:2468] T 01844334149649bb83991b613a695fe2 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f412334fb994ff0ab492afde64f5855 in term 0.
I20251023 07:59:36.505967 20675 raft_consensus.cc:515] T 01844334149649bb83991b613a695fe2 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:36.511061 20271 ts_tablet_manager.cc:1403] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P 0f412334fb994ff0ab492afde64f5855: Time spent bootstrapping tablet: real 0.164s user 0.024s sys 0.006s
I20251023 07:59:36.513231 20073 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01844334149649bb83991b613a695fe2" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626"
I20251023 07:59:36.513819 20073 raft_consensus.cc:3060] T 01844334149649bb83991b613a695fe2 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:36.513895 20675 leader_election.cc:290] T 01844334149649bb83991b613a695fe2 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 election: Requested vote from peers 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309), 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955)
I20251023 07:59:36.516408 20273 tablet_bootstrap.cc:654] T d51f1c713224480980c425d473226a02 P d1379e91aa9c41629cd25262571beb2c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:36.521239 20223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01844334149649bb83991b613a695fe2" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c"
I20251023 07:59:36.521992 20223 raft_consensus.cc:3060] T 01844334149649bb83991b613a695fe2 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:36.526731 20073 raft_consensus.cc:2468] T 01844334149649bb83991b613a695fe2 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f412334fb994ff0ab492afde64f5855 in term 1.
I20251023 07:59:36.529178 20116 leader_election.cc:304] T 01844334149649bb83991b613a695fe2 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, 35e7d1ade024444486e63cf1b81e9626; no voters:
I20251023 07:59:36.529767 20271 raft_consensus.cc:359] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:36.530496 20614 raft_consensus.cc:2804] T 01844334149649bb83991b613a695fe2 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:59:36.531042 20614 raft_consensus.cc:697] T 01844334149649bb83991b613a695fe2 P 0f412334fb994ff0ab492afde64f5855 [term 1 LEADER]: Becoming Leader. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Running, Role: LEADER
I20251023 07:59:36.531921 20614 consensus_queue.cc:237] T 01844334149649bb83991b613a695fe2 P 0f412334fb994ff0ab492afde64f5855 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:36.530469 20271 raft_consensus.cc:385] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:36.533912 20271 raft_consensus.cc:740] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Initialized, Role: FOLLOWER
I20251023 07:59:36.534193 20273 tablet_bootstrap.cc:492] T d51f1c713224480980c425d473226a02 P d1379e91aa9c41629cd25262571beb2c: No bootstrap required, opened a new log
I20251023 07:59:36.534719 20273 ts_tablet_manager.cc:1403] T d51f1c713224480980c425d473226a02 P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.076s user 0.011s sys 0.001s
I20251023 07:59:36.535121 20271 consensus_queue.cc:260] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P 0f412334fb994ff0ab492afde64f5855 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:36.537114 20273 raft_consensus.cc:359] T d51f1c713224480980c425d473226a02 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:36.537806 20273 raft_consensus.cc:385] T d51f1c713224480980c425d473226a02 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:36.538058 20273 raft_consensus.cc:740] T d51f1c713224480980c425d473226a02 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:36.538658 20271 ts_tablet_manager.cc:1434] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P 0f412334fb994ff0ab492afde64f5855: Time spent starting tablet: real 0.027s user 0.002s sys 0.004s
I20251023 07:59:36.538743 20273 consensus_queue.cc:260] T d51f1c713224480980c425d473226a02 P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:36.539798 20271 tablet_bootstrap.cc:492] T f524e775b99147de99cfb27d3785965d P 0f412334fb994ff0ab492afde64f5855: Bootstrap starting.
I20251023 07:59:36.540548 20675 raft_consensus.cc:493] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:36.541326 20675 raft_consensus.cc:515] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:36.546905 20273 ts_tablet_manager.cc:1434] T d51f1c713224480980c425d473226a02 P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.012s user 0.006s sys 0.000s
I20251023 07:59:36.552769 20273 tablet_bootstrap.cc:492] T f524e775b99147de99cfb27d3785965d P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:36.554387 19999 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0fead0c9b2cd4e6cabadb0fe1cd8324b" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:36.555115 19999 raft_consensus.cc:2468] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f412334fb994ff0ab492afde64f5855 in term 0.
I20251023 07:59:36.556401 20118 leader_election.cc:304] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, d1379e91aa9c41629cd25262571beb2c; no voters:
I20251023 07:59:36.557281 20606 raft_consensus.cc:2804] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:36.557730 20606 raft_consensus.cc:493] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:36.557904 20272 tablet_bootstrap.cc:492] T cb866838666745f0a4462f124ac22f72 P 35e7d1ade024444486e63cf1b81e9626: No bootstrap required, opened a new log
I20251023 07:59:36.558164 20606 raft_consensus.cc:3060] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:36.558516 20273 tablet_bootstrap.cc:654] T f524e775b99147de99cfb27d3785965d P d1379e91aa9c41629cd25262571beb2c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:36.558789 20272 ts_tablet_manager.cc:1403] T cb866838666745f0a4462f124ac22f72 P 35e7d1ade024444486e63cf1b81e9626: Time spent bootstrapping tablet: real 0.093s user 0.007s sys 0.009s
I20251023 07:59:36.575608 19901 catalog_manager.cc:5649] T 01844334149649bb83991b613a695fe2 P 0f412334fb994ff0ab492afde64f5855 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f412334fb994ff0ab492afde64f5855 (127.16.126.3). New cstate: current_term: 1 leader_uuid: "0f412334fb994ff0ab492afde64f5855" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:36.578348 20273 tablet_bootstrap.cc:492] T f524e775b99147de99cfb27d3785965d P d1379e91aa9c41629cd25262571beb2c: No bootstrap required, opened a new log
I20251023 07:59:36.578922 20273 ts_tablet_manager.cc:1403] T f524e775b99147de99cfb27d3785965d P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.026s user 0.013s sys 0.010s
I20251023 07:59:36.565610 20077 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0fead0c9b2cd4e6cabadb0fe1cd8324b" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
I20251023 07:59:36.579631 20077 raft_consensus.cc:2468] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f412334fb994ff0ab492afde64f5855 in term 0.
I20251023 07:59:36.560649 20223 raft_consensus.cc:2468] T 01844334149649bb83991b613a695fe2 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f412334fb994ff0ab492afde64f5855 in term 1.
I20251023 07:59:36.565681 20675 leader_election.cc:290] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865), 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309)
I20251023 07:59:36.564127 20606 raft_consensus.cc:515] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:36.584682 19999 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0fead0c9b2cd4e6cabadb0fe1cd8324b" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c"
I20251023 07:59:36.585326 19999 raft_consensus.cc:3060] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:36.587327 20272 raft_consensus.cc:359] T cb866838666745f0a4462f124ac22f72 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:36.588045 20272 raft_consensus.cc:385] T cb866838666745f0a4462f124ac22f72 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:36.588299 20272 raft_consensus.cc:740] T cb866838666745f0a4462f124ac22f72 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e7d1ade024444486e63cf1b81e9626, State: Initialized, Role: FOLLOWER
I20251023 07:59:36.592221 20272 consensus_queue.cc:260] T cb866838666745f0a4462f124ac22f72 P 35e7d1ade024444486e63cf1b81e9626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:36.559247 20271 tablet_bootstrap.cc:654] T f524e775b99147de99cfb27d3785965d P 0f412334fb994ff0ab492afde64f5855: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:36.593519 20273 raft_consensus.cc:359] T f524e775b99147de99cfb27d3785965d P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:36.594216 20273 raft_consensus.cc:385] T f524e775b99147de99cfb27d3785965d P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:36.594471 20273 raft_consensus.cc:740] T f524e775b99147de99cfb27d3785965d P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:36.596642 20272 ts_tablet_manager.cc:1434] T cb866838666745f0a4462f124ac22f72 P 35e7d1ade024444486e63cf1b81e9626: Time spent starting tablet: real 0.028s user 0.005s sys 0.000s
I20251023 07:59:36.597206 20273 consensus_queue.cc:260] T f524e775b99147de99cfb27d3785965d P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:36.599911 20272 tablet_bootstrap.cc:492] T d51f1c713224480980c425d473226a02 P 35e7d1ade024444486e63cf1b81e9626: Bootstrap starting.
I20251023 07:59:36.600785 19999 raft_consensus.cc:2468] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f412334fb994ff0ab492afde64f5855 in term 1.
I20251023 07:59:36.600883 20077 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0fead0c9b2cd4e6cabadb0fe1cd8324b" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626"
I20251023 07:59:36.601588 20077 raft_consensus.cc:3060] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:36.601943 20118 leader_election.cc:304] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, d1379e91aa9c41629cd25262571beb2c; no voters:
I20251023 07:59:36.603652 20614 raft_consensus.cc:2804] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:59:36.604136 20614 raft_consensus.cc:697] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P 0f412334fb994ff0ab492afde64f5855 [term 1 LEADER]: Becoming Leader. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Running, Role: LEADER
I20251023 07:59:36.606276 20272 tablet_bootstrap.cc:654] T d51f1c713224480980c425d473226a02 P 35e7d1ade024444486e63cf1b81e9626: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:36.605012 20614 consensus_queue.cc:237] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P 0f412334fb994ff0ab492afde64f5855 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:36.598903 20273 ts_tablet_manager.cc:1434] T f524e775b99147de99cfb27d3785965d P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.020s user 0.006s sys 0.000s
I20251023 07:59:36.609217 20273 tablet_bootstrap.cc:492] T 35c1ea979bda45aead7d1b8539f37637 P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:36.610318 20271 tablet_bootstrap.cc:492] T f524e775b99147de99cfb27d3785965d P 0f412334fb994ff0ab492afde64f5855: No bootstrap required, opened a new log
I20251023 07:59:36.610857 20271 ts_tablet_manager.cc:1403] T f524e775b99147de99cfb27d3785965d P 0f412334fb994ff0ab492afde64f5855: Time spent bootstrapping tablet: real 0.071s user 0.011s sys 0.002s
I20251023 07:59:36.613396 20271 raft_consensus.cc:359] T f524e775b99147de99cfb27d3785965d P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:36.614210 20271 raft_consensus.cc:385] T f524e775b99147de99cfb27d3785965d P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:36.614513 20271 raft_consensus.cc:740] T f524e775b99147de99cfb27d3785965d P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Initialized, Role: FOLLOWER
I20251023 07:59:36.615191 20271 consensus_queue.cc:260] T f524e775b99147de99cfb27d3785965d P 0f412334fb994ff0ab492afde64f5855 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:36.617730 20606 leader_election.cc:290] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 election: Requested vote from peers d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865), 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309)
I20251023 07:59:36.622648 20613 raft_consensus.cc:493] T d51f1c713224480980c425d473226a02 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:36.624208 20613 raft_consensus.cc:515] T d51f1c713224480980c425d473226a02 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:36.625360 19901 catalog_manager.cc:5649] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P 0f412334fb994ff0ab492afde64f5855 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f412334fb994ff0ab492afde64f5855 (127.16.126.3). New cstate: current_term: 1 leader_uuid: "0f412334fb994ff0ab492afde64f5855" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } health_report { overall_health: HEALTHY } } }
I20251023 07:59:36.627170 20073 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d51f1c713224480980c425d473226a02" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
W20251023 07:59:36.628480 19967 leader_election.cc:343] T d51f1c713224480980c425d473226a02 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:36.632155 20613 leader_election.cc:290] T d51f1c713224480980c425d473226a02 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309), 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287)
I20251023 07:59:36.634191 20151 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d51f1c713224480980c425d473226a02" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855" is_pre_election: true
W20251023 07:59:36.635588 19966 leader_election.cc:343] T d51f1c713224480980c425d473226a02 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:36.636034 19966 leader_election.cc:304] T d51f1c713224480980c425d473226a02 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d1379e91aa9c41629cd25262571beb2c; no voters: 0f412334fb994ff0ab492afde64f5855, 35e7d1ade024444486e63cf1b81e9626
I20251023 07:59:36.638306 20667 raft_consensus.cc:2749] T d51f1c713224480980c425d473226a02 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:59:36.638151 20273 tablet_bootstrap.cc:654] T 35c1ea979bda45aead7d1b8539f37637 P d1379e91aa9c41629cd25262571beb2c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:36.638360 20271 ts_tablet_manager.cc:1434] T f524e775b99147de99cfb27d3785965d P 0f412334fb994ff0ab492afde64f5855: Time spent starting tablet: real 0.027s user 0.001s sys 0.005s
I20251023 07:59:36.651876 20272 tablet_bootstrap.cc:492] T d51f1c713224480980c425d473226a02 P 35e7d1ade024444486e63cf1b81e9626: No bootstrap required, opened a new log
I20251023 07:59:36.652499 20272 ts_tablet_manager.cc:1403] T d51f1c713224480980c425d473226a02 P 35e7d1ade024444486e63cf1b81e9626: Time spent bootstrapping tablet: real 0.053s user 0.010s sys 0.001s
I20251023 07:59:36.652410 20614 raft_consensus.cc:493] T f524e775b99147de99cfb27d3785965d P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:36.622110 20077 raft_consensus.cc:2468] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f412334fb994ff0ab492afde64f5855 in term 1.
I20251023 07:59:36.654163 20614 raft_consensus.cc:515] T f524e775b99147de99cfb27d3785965d P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:36.658726 20223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f524e775b99147de99cfb27d3785965d" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c" is_pre_election: true
I20251023 07:59:36.659348 20223 raft_consensus.cc:2468] T f524e775b99147de99cfb27d3785965d P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f412334fb994ff0ab492afde64f5855 in term 0.
I20251023 07:59:36.660504 20117 leader_election.cc:304] T f524e775b99147de99cfb27d3785965d P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, 65876a2b197c4ea6918f5cab47ded25c; no voters:
I20251023 07:59:36.661803 20675 raft_consensus.cc:2804] T f524e775b99147de99cfb27d3785965d P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:36.662169 20675 raft_consensus.cc:493] T f524e775b99147de99cfb27d3785965d P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:36.662504 20675 raft_consensus.cc:3060] T f524e775b99147de99cfb27d3785965d P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:36.665853 20272 raft_consensus.cc:359] T d51f1c713224480980c425d473226a02 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:36.665949 20614 leader_election.cc:290] T f524e775b99147de99cfb27d3785965d P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:36.666891 19999 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f524e775b99147de99cfb27d3785965d" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:36.666864 20272 raft_consensus.cc:385] T d51f1c713224480980c425d473226a02 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:36.667727 19999 raft_consensus.cc:2468] T f524e775b99147de99cfb27d3785965d P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f412334fb994ff0ab492afde64f5855 in term 0.
I20251023 07:59:36.669394 20273 tablet_bootstrap.cc:492] T 35c1ea979bda45aead7d1b8539f37637 P d1379e91aa9c41629cd25262571beb2c: No bootstrap required, opened a new log
I20251023 07:59:36.667979 20272 raft_consensus.cc:740] T d51f1c713224480980c425d473226a02 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e7d1ade024444486e63cf1b81e9626, State: Initialized, Role: FOLLOWER
I20251023 07:59:36.655493 20271 tablet_bootstrap.cc:492] T d51f1c713224480980c425d473226a02 P 0f412334fb994ff0ab492afde64f5855: Bootstrap starting.
I20251023 07:59:36.670094 20273 ts_tablet_manager.cc:1403] T 35c1ea979bda45aead7d1b8539f37637 P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.061s user 0.025s sys 0.008s
I20251023 07:59:36.670264 20272 consensus_queue.cc:260] T d51f1c713224480980c425d473226a02 P 35e7d1ade024444486e63cf1b81e9626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:36.671263 20675 raft_consensus.cc:515] T f524e775b99147de99cfb27d3785965d P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:36.678376 20272 ts_tablet_manager.cc:1434] T d51f1c713224480980c425d473226a02 P 35e7d1ade024444486e63cf1b81e9626: Time spent starting tablet: real 0.025s user 0.007s sys 0.006s
I20251023 07:59:36.679471 20272 tablet_bootstrap.cc:492] T 35c1ea979bda45aead7d1b8539f37637 P 35e7d1ade024444486e63cf1b81e9626: Bootstrap starting.
I20251023 07:59:36.680586 20273 raft_consensus.cc:359] T 35c1ea979bda45aead7d1b8539f37637 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:36.682157 20273 raft_consensus.cc:385] T 35c1ea979bda45aead7d1b8539f37637 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:36.682499 20273 raft_consensus.cc:740] T 35c1ea979bda45aead7d1b8539f37637 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:36.683421 20273 consensus_queue.cc:260] T 35c1ea979bda45aead7d1b8539f37637 P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:36.685890 20273 ts_tablet_manager.cc:1434] T 35c1ea979bda45aead7d1b8539f37637 P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.015s user 0.005s sys 0.001s
I20251023 07:59:36.687026 20272 tablet_bootstrap.cc:654] T 35c1ea979bda45aead7d1b8539f37637 P 35e7d1ade024444486e63cf1b81e9626: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:36.688656 20223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f524e775b99147de99cfb27d3785965d" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c"
I20251023 07:59:36.689316 20223 raft_consensus.cc:3060] T f524e775b99147de99cfb27d3785965d P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:36.691877 20273 tablet_bootstrap.cc:492] T b7dcf1850ca541d6ab42bd11de70d8f4 P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:36.698768 20273 tablet_bootstrap.cc:654] T b7dcf1850ca541d6ab42bd11de70d8f4 P d1379e91aa9c41629cd25262571beb2c: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:36.693177 20271 tablet_bootstrap.cc:654] T d51f1c713224480980c425d473226a02 P 0f412334fb994ff0ab492afde64f5855: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:36.700980 20272 tablet_bootstrap.cc:492] T 35c1ea979bda45aead7d1b8539f37637 P 35e7d1ade024444486e63cf1b81e9626: No bootstrap required, opened a new log
I20251023 07:59:36.701517 20272 ts_tablet_manager.cc:1403] T 35c1ea979bda45aead7d1b8539f37637 P 35e7d1ade024444486e63cf1b81e9626: Time spent bootstrapping tablet: real 0.022s user 0.014s sys 0.004s
I20251023 07:59:36.704064 20272 raft_consensus.cc:359] T 35c1ea979bda45aead7d1b8539f37637 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:36.704855 20272 raft_consensus.cc:385] T 35c1ea979bda45aead7d1b8539f37637 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:36.705157 20272 raft_consensus.cc:740] T 35c1ea979bda45aead7d1b8539f37637 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e7d1ade024444486e63cf1b81e9626, State: Initialized, Role: FOLLOWER
I20251023 07:59:36.705935 20272 consensus_queue.cc:260] T 35c1ea979bda45aead7d1b8539f37637 P 35e7d1ade024444486e63cf1b81e9626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:36.708364 20272 ts_tablet_manager.cc:1434] T 35c1ea979bda45aead7d1b8539f37637 P 35e7d1ade024444486e63cf1b81e9626: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20251023 07:59:36.713899 20667 raft_consensus.cc:493] T 35c1ea979bda45aead7d1b8539f37637 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:36.714397 20667 raft_consensus.cc:515] T 35c1ea979bda45aead7d1b8539f37637 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:36.715777 20223 raft_consensus.cc:2468] T f524e775b99147de99cfb27d3785965d P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f412334fb994ff0ab492afde64f5855 in term 1.
I20251023 07:59:36.716933 20117 leader_election.cc:304] T f524e775b99147de99cfb27d3785965d P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, 65876a2b197c4ea6918f5cab47ded25c; no voters:
I20251023 07:59:36.717778 20614 raft_consensus.cc:2804] T f524e775b99147de99cfb27d3785965d P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:59:36.718245 20614 raft_consensus.cc:697] T f524e775b99147de99cfb27d3785965d P 0f412334fb994ff0ab492afde64f5855 [term 1 LEADER]: Becoming Leader. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Running, Role: LEADER
I20251023 07:59:36.718649 20077 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "35c1ea979bda45aead7d1b8539f37637" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
I20251023 07:59:36.719353 20077 raft_consensus.cc:2468] T 35c1ea979bda45aead7d1b8539f37637 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 0.
I20251023 07:59:36.719086 20614 consensus_queue.cc:237] T f524e775b99147de99cfb27d3785965d P 0f412334fb994ff0ab492afde64f5855 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:36.721931 20220 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "35c1ea979bda45aead7d1b8539f37637" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c" is_pre_election: true
I20251023 07:59:36.722590 20220 raft_consensus.cc:2468] T 35c1ea979bda45aead7d1b8539f37637 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 0.
I20251023 07:59:36.723717 20675 leader_election.cc:290] T f524e775b99147de99cfb27d3785965d P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 election: Requested vote from peers 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:36.728219 19967 leader_election.cc:304] T 35c1ea979bda45aead7d1b8539f37637 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35e7d1ade024444486e63cf1b81e9626, d1379e91aa9c41629cd25262571beb2c; no voters:
I20251023 07:59:36.729182 20613 raft_consensus.cc:2804] T 35c1ea979bda45aead7d1b8539f37637 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:36.729589 20613 raft_consensus.cc:493] T 35c1ea979bda45aead7d1b8539f37637 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:36.729893 20613 raft_consensus.cc:3060] T 35c1ea979bda45aead7d1b8539f37637 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:36.731439 20273 tablet_bootstrap.cc:492] T b7dcf1850ca541d6ab42bd11de70d8f4 P d1379e91aa9c41629cd25262571beb2c: No bootstrap required, opened a new log
I20251023 07:59:36.731923 20273 ts_tablet_manager.cc:1403] T b7dcf1850ca541d6ab42bd11de70d8f4 P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.042s user 0.011s sys 0.009s
I20251023 07:59:36.736341 20667 leader_election.cc:290] T 35c1ea979bda45aead7d1b8539f37637 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955), 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309)
I20251023 07:59:36.742141 19900 catalog_manager.cc:5649] T f524e775b99147de99cfb27d3785965d P 0f412334fb994ff0ab492afde64f5855 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f412334fb994ff0ab492afde64f5855 (127.16.126.3). New cstate: current_term: 1 leader_uuid: "0f412334fb994ff0ab492afde64f5855" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:36.746261 20448 raft_consensus.cc:493] T cb866838666745f0a4462f124ac22f72 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:36.746852 20448 raft_consensus.cc:515] T cb866838666745f0a4462f124ac22f72 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:36.748955 20448 leader_election.cc:290] T cb866838666745f0a4462f124ac22f72 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955), 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309)
I20251023 07:59:36.749091 19999 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f524e775b99147de99cfb27d3785965d" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c"
I20251023 07:59:36.749795 19999 raft_consensus.cc:3060] T f524e775b99147de99cfb27d3785965d P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:36.751010 20077 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cb866838666745f0a4462f124ac22f72" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
I20251023 07:59:36.751519 20273 raft_consensus.cc:359] T b7dcf1850ca541d6ab42bd11de70d8f4 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:36.751739 20077 raft_consensus.cc:2468] T cb866838666745f0a4462f124ac22f72 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 0.
I20251023 07:59:36.752213 20273 raft_consensus.cc:385] T b7dcf1850ca541d6ab42bd11de70d8f4 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:36.752544 20273 raft_consensus.cc:740] T b7dcf1850ca541d6ab42bd11de70d8f4 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:36.753203 20273 consensus_queue.cc:260] T b7dcf1850ca541d6ab42bd11de70d8f4 P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:36.755337 19967 leader_election.cc:304] T cb866838666745f0a4462f124ac22f72 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35e7d1ade024444486e63cf1b81e9626, d1379e91aa9c41629cd25262571beb2c; no voters:
I20251023 07:59:36.757318 20273 ts_tablet_manager.cc:1434] T b7dcf1850ca541d6ab42bd11de70d8f4 P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.025s user 0.006s sys 0.001s
I20251023 07:59:36.757647 20667 raft_consensus.cc:2804] T cb866838666745f0a4462f124ac22f72 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:36.757953 19999 raft_consensus.cc:2468] T f524e775b99147de99cfb27d3785965d P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f412334fb994ff0ab492afde64f5855 in term 1.
I20251023 07:59:36.758104 20667 raft_consensus.cc:493] T cb866838666745f0a4462f124ac22f72 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:36.758694 20223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cb866838666745f0a4462f124ac22f72" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c" is_pre_election: true
I20251023 07:59:36.759186 20667 raft_consensus.cc:3060] T cb866838666745f0a4462f124ac22f72 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:36.759434 20223 raft_consensus.cc:2468] T cb866838666745f0a4462f124ac22f72 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 0.
I20251023 07:59:36.764828 20613 raft_consensus.cc:515] T 35c1ea979bda45aead7d1b8539f37637 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:36.767663 20271 tablet_bootstrap.cc:492] T d51f1c713224480980c425d473226a02 P 0f412334fb994ff0ab492afde64f5855: No bootstrap required, opened a new log
I20251023 07:59:36.768203 20271 ts_tablet_manager.cc:1403] T d51f1c713224480980c425d473226a02 P 0f412334fb994ff0ab492afde64f5855: Time spent bootstrapping tablet: real 0.113s user 0.014s sys 0.012s
I20251023 07:59:36.770284 20077 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "35c1ea979bda45aead7d1b8539f37637" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626"
I20251023 07:59:36.770972 20077 raft_consensus.cc:3060] T 35c1ea979bda45aead7d1b8539f37637 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:36.770896 20271 raft_consensus.cc:359] T d51f1c713224480980c425d473226a02 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:36.771632 20271 raft_consensus.cc:385] T d51f1c713224480980c425d473226a02 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:36.771925 20271 raft_consensus.cc:740] T d51f1c713224480980c425d473226a02 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Initialized, Role: FOLLOWER
I20251023 07:59:36.772562 20271 consensus_queue.cc:260] T d51f1c713224480980c425d473226a02 P 0f412334fb994ff0ab492afde64f5855 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:36.774782 20271 ts_tablet_manager.cc:1434] T d51f1c713224480980c425d473226a02 P 0f412334fb994ff0ab492afde64f5855: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20251023 07:59:36.774842 20223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "35c1ea979bda45aead7d1b8539f37637" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c"
I20251023 07:59:36.775682 20223 raft_consensus.cc:3060] T 35c1ea979bda45aead7d1b8539f37637 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:36.776098 20613 leader_election.cc:290] T 35c1ea979bda45aead7d1b8539f37637 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 election: Requested vote from peers 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955), 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309)
I20251023 07:59:36.775753 20271 tablet_bootstrap.cc:492] T b7dcf1850ca541d6ab42bd11de70d8f4 P 0f412334fb994ff0ab492afde64f5855: Bootstrap starting.
I20251023 07:59:36.782527 20271 tablet_bootstrap.cc:654] T b7dcf1850ca541d6ab42bd11de70d8f4 P 0f412334fb994ff0ab492afde64f5855: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:36.783951 20077 raft_consensus.cc:2468] T 35c1ea979bda45aead7d1b8539f37637 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 1.
I20251023 07:59:36.785228 19967 leader_election.cc:304] T 35c1ea979bda45aead7d1b8539f37637 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35e7d1ade024444486e63cf1b81e9626, d1379e91aa9c41629cd25262571beb2c; no voters:
I20251023 07:59:36.786645 20613 raft_consensus.cc:2804] T 35c1ea979bda45aead7d1b8539f37637 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:59:36.787269 20613 raft_consensus.cc:697] T 35c1ea979bda45aead7d1b8539f37637 P d1379e91aa9c41629cd25262571beb2c [term 1 LEADER]: Becoming Leader. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Running, Role: LEADER
I20251023 07:59:36.788376 20613 consensus_queue.cc:237] T 35c1ea979bda45aead7d1b8539f37637 P d1379e91aa9c41629cd25262571beb2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:36.798249 20606 raft_consensus.cc:493] T d51f1c713224480980c425d473226a02 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:36.799027 20606 raft_consensus.cc:515] T d51f1c713224480980c425d473226a02 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:36.802925 19997 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d51f1c713224480980c425d473226a02" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:36.803644 19997 raft_consensus.cc:2468] T d51f1c713224480980c425d473226a02 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f412334fb994ff0ab492afde64f5855 in term 0.
I20251023 07:59:36.802338 20606 leader_election.cc:290] T d51f1c713224480980c425d473226a02 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865), 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309)
I20251023 07:59:36.804767 20118 leader_election.cc:304] T d51f1c713224480980c425d473226a02 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, d1379e91aa9c41629cd25262571beb2c; no voters:
I20251023 07:59:36.804965 20075 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d51f1c713224480980c425d473226a02" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
I20251023 07:59:36.805662 20606 raft_consensus.cc:2804] T d51f1c713224480980c425d473226a02 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:36.805794 20075 raft_consensus.cc:2468] T d51f1c713224480980c425d473226a02 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f412334fb994ff0ab492afde64f5855 in term 0.
I20251023 07:59:36.806074 20606 raft_consensus.cc:493] T d51f1c713224480980c425d473226a02 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:36.806447 20606 raft_consensus.cc:3060] T d51f1c713224480980c425d473226a02 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:36.814296 20606 raft_consensus.cc:515] T d51f1c713224480980c425d473226a02 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:36.817273 20223 raft_consensus.cc:2468] T 35c1ea979bda45aead7d1b8539f37637 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 1.
I20251023 07:59:36.817585 20271 tablet_bootstrap.cc:492] T b7dcf1850ca541d6ab42bd11de70d8f4 P 0f412334fb994ff0ab492afde64f5855: No bootstrap required, opened a new log
I20251023 07:59:36.818079 20271 ts_tablet_manager.cc:1403] T b7dcf1850ca541d6ab42bd11de70d8f4 P 0f412334fb994ff0ab492afde64f5855: Time spent bootstrapping tablet: real 0.043s user 0.021s sys 0.019s
I20251023 07:59:36.819185 20667 raft_consensus.cc:515] T cb866838666745f0a4462f124ac22f72 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:36.820767 20271 raft_consensus.cc:359] T b7dcf1850ca541d6ab42bd11de70d8f4 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:36.821703 19999 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d51f1c713224480980c425d473226a02" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c"
I20251023 07:59:36.823880 19999 raft_consensus.cc:3060] T d51f1c713224480980c425d473226a02 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:36.825497 20075 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cb866838666745f0a4462f124ac22f72" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626"
I20251023 07:59:36.825858 20223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cb866838666745f0a4462f124ac22f72" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c"
I20251023 07:59:36.826164 20075 raft_consensus.cc:3060] T cb866838666745f0a4462f124ac22f72 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:36.826483 20223 raft_consensus.cc:3060] T cb866838666745f0a4462f124ac22f72 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:36.828121 20667 leader_election.cc:290] T cb866838666745f0a4462f124ac22f72 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 election: Requested vote from peers 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955), 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309)
I20251023 07:59:36.831364 19999 raft_consensus.cc:2468] T d51f1c713224480980c425d473226a02 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f412334fb994ff0ab492afde64f5855 in term 1.
I20251023 07:59:36.832177 20271 raft_consensus.cc:385] T b7dcf1850ca541d6ab42bd11de70d8f4 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:36.832494 20271 raft_consensus.cc:740] T b7dcf1850ca541d6ab42bd11de70d8f4 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Initialized, Role: FOLLOWER
I20251023 07:59:36.822471 20077 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d51f1c713224480980c425d473226a02" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626"
I20251023 07:59:36.833510 20077 raft_consensus.cc:3060] T d51f1c713224480980c425d473226a02 P 35e7d1ade024444486e63cf1b81e9626 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:36.833184 20271 consensus_queue.cc:260] T b7dcf1850ca541d6ab42bd11de70d8f4 P 0f412334fb994ff0ab492afde64f5855 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:36.835454 20271 ts_tablet_manager.cc:1434] T b7dcf1850ca541d6ab42bd11de70d8f4 P 0f412334fb994ff0ab492afde64f5855: Time spent starting tablet: real 0.017s user 0.005s sys 0.000s
I20251023 07:59:36.822263 20606 leader_election.cc:290] T d51f1c713224480980c425d473226a02 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 election: Requested vote from peers d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865), 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309)
I20251023 07:59:36.832365 20118 leader_election.cc:304] T d51f1c713224480980c425d473226a02 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, d1379e91aa9c41629cd25262571beb2c; no voters:
I20251023 07:59:36.835704 20223 raft_consensus.cc:2468] T cb866838666745f0a4462f124ac22f72 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 1.
I20251023 07:59:36.836855 20675 raft_consensus.cc:2804] T d51f1c713224480980c425d473226a02 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:59:36.836803 19968 leader_election.cc:304] T cb866838666745f0a4462f124ac22f72 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65876a2b197c4ea6918f5cab47ded25c, d1379e91aa9c41629cd25262571beb2c; no voters:
I20251023 07:59:36.837585 20675 raft_consensus.cc:697] T d51f1c713224480980c425d473226a02 P 0f412334fb994ff0ab492afde64f5855 [term 1 LEADER]: Becoming Leader. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Running, Role: LEADER
I20251023 07:59:36.840893 20675 consensus_queue.cc:237] T d51f1c713224480980c425d473226a02 P 0f412334fb994ff0ab492afde64f5855 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:36.841414 20077 raft_consensus.cc:2468] T d51f1c713224480980c425d473226a02 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f412334fb994ff0ab492afde64f5855 in term 1.
I20251023 07:59:36.837690 20667 raft_consensus.cc:2804] T cb866838666745f0a4462f124ac22f72 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:59:36.845882 20667 raft_consensus.cc:697] T cb866838666745f0a4462f124ac22f72 P d1379e91aa9c41629cd25262571beb2c [term 1 LEADER]: Becoming Leader. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Running, Role: LEADER
I20251023 07:59:36.845793 19900 catalog_manager.cc:5649] T 35c1ea979bda45aead7d1b8539f37637 P d1379e91aa9c41629cd25262571beb2c reported cstate change: term changed from 0 to 1, leader changed from <none> to d1379e91aa9c41629cd25262571beb2c (127.16.126.1). New cstate: current_term: 1 leader_uuid: "d1379e91aa9c41629cd25262571beb2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:36.847146 20667 consensus_queue.cc:237] T cb866838666745f0a4462f124ac22f72 P d1379e91aa9c41629cd25262571beb2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:36.882383 20075 raft_consensus.cc:2468] T cb866838666745f0a4462f124ac22f72 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 1.
I20251023 07:59:36.890259 19901 catalog_manager.cc:5649] T cb866838666745f0a4462f124ac22f72 P d1379e91aa9c41629cd25262571beb2c reported cstate change: term changed from 0 to 1, leader changed from <none> to d1379e91aa9c41629cd25262571beb2c (127.16.126.1). New cstate: current_term: 1 leader_uuid: "d1379e91aa9c41629cd25262571beb2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:36.890550 19900 catalog_manager.cc:5649] T d51f1c713224480980c425d473226a02 P 0f412334fb994ff0ab492afde64f5855 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f412334fb994ff0ab492afde64f5855 (127.16.126.3). New cstate: current_term: 1 leader_uuid: "0f412334fb994ff0ab492afde64f5855" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } health_report { overall_health: HEALTHY } } }
I20251023 07:59:37.084786 20614 consensus_queue.cc:1048] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P 0f412334fb994ff0ab492afde64f5855 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:59:37.091496 20613 raft_consensus.cc:493] T b7dcf1850ca541d6ab42bd11de70d8f4 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:37.092314 20613 raft_consensus.cc:515] T b7dcf1850ca541d6ab42bd11de70d8f4 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:37.096665 20613 leader_election.cc:290] T b7dcf1850ca541d6ab42bd11de70d8f4 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287), 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955)
I20251023 07:59:37.098467 20151 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7dcf1850ca541d6ab42bd11de70d8f4" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855" is_pre_election: true
I20251023 07:59:37.099748 20223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7dcf1850ca541d6ab42bd11de70d8f4" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c" is_pre_election: true
I20251023 07:59:37.100754 20223 raft_consensus.cc:2468] T b7dcf1850ca541d6ab42bd11de70d8f4 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 0.
I20251023 07:59:37.102100 19968 leader_election.cc:304] T b7dcf1850ca541d6ab42bd11de70d8f4 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65876a2b197c4ea6918f5cab47ded25c, d1379e91aa9c41629cd25262571beb2c; no voters:
I20251023 07:59:37.103303 20667 raft_consensus.cc:2804] T b7dcf1850ca541d6ab42bd11de70d8f4 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:37.103689 20667 raft_consensus.cc:493] T b7dcf1850ca541d6ab42bd11de70d8f4 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:37.104068 20667 raft_consensus.cc:3060] T b7dcf1850ca541d6ab42bd11de70d8f4 P d1379e91aa9c41629cd25262571beb2c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:37.103760 20151 raft_consensus.cc:2468] T b7dcf1850ca541d6ab42bd11de70d8f4 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 0.
I20251023 07:59:37.110239 20614 consensus_queue.cc:1048] T 01844334149649bb83991b613a695fe2 P 0f412334fb994ff0ab492afde64f5855 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:59:37.112402 20667 raft_consensus.cc:515] T b7dcf1850ca541d6ab42bd11de70d8f4 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:37.116505 20223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7dcf1850ca541d6ab42bd11de70d8f4" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c"
I20251023 07:59:37.117266 20151 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7dcf1850ca541d6ab42bd11de70d8f4" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855"
I20251023 07:59:37.117962 20151 raft_consensus.cc:3060] T b7dcf1850ca541d6ab42bd11de70d8f4 P 0f412334fb994ff0ab492afde64f5855 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:37.121779 20223 raft_consensus.cc:3060] T b7dcf1850ca541d6ab42bd11de70d8f4 P 65876a2b197c4ea6918f5cab47ded25c [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:37.122933 20675 consensus_queue.cc:1048] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P 0f412334fb994ff0ab492afde64f5855 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:59:37.125756 20151 raft_consensus.cc:2468] T b7dcf1850ca541d6ab42bd11de70d8f4 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 1.
I20251023 07:59:37.127475 19966 leader_election.cc:304] T b7dcf1850ca541d6ab42bd11de70d8f4 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, d1379e91aa9c41629cd25262571beb2c; no voters:
I20251023 07:59:37.128695 20613 raft_consensus.cc:2804] T b7dcf1850ca541d6ab42bd11de70d8f4 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:59:37.130395 20613 raft_consensus.cc:697] T b7dcf1850ca541d6ab42bd11de70d8f4 P d1379e91aa9c41629cd25262571beb2c [term 1 LEADER]: Becoming Leader. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Running, Role: LEADER
I20251023 07:59:37.131923 20613 consensus_queue.cc:237] T b7dcf1850ca541d6ab42bd11de70d8f4 P d1379e91aa9c41629cd25262571beb2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:37.141554 20667 leader_election.cc:290] T b7dcf1850ca541d6ab42bd11de70d8f4 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 1 election: Requested vote from peers 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287), 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955)
I20251023 07:59:37.156462 20606 consensus_queue.cc:1048] T 01844334149649bb83991b613a695fe2 P 0f412334fb994ff0ab492afde64f5855 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:59:37.181358 20223 raft_consensus.cc:2468] T b7dcf1850ca541d6ab42bd11de70d8f4 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 1.
I20251023 07:59:37.182196 20675 consensus_queue.cc:1048] T f524e775b99147de99cfb27d3785965d P 0f412334fb994ff0ab492afde64f5855 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20251023 07:59:37.239753 19900 catalog_manager.cc:5649] T b7dcf1850ca541d6ab42bd11de70d8f4 P d1379e91aa9c41629cd25262571beb2c reported cstate change: term changed from 0 to 1, leader changed from <none> to d1379e91aa9c41629cd25262571beb2c (127.16.126.1). New cstate: current_term: 1 leader_uuid: "d1379e91aa9c41629cd25262571beb2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: HEALTHY } } }
W20251023 07:59:37.240731 20118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.1:37865, user_credentials={real_user=slave}} blocked reactor thread for 61958.7us
W20251023 07:59:37.242746 20116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.2:42309, user_credentials={real_user=slave}} blocked reactor thread for 66882.7us
I20251023 07:59:37.258430 20667 consensus_queue.cc:1048] T 35c1ea979bda45aead7d1b8539f37637 P d1379e91aa9c41629cd25262571beb2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:59:37.292918 20309 consensus_queue.cc:1048] T f524e775b99147de99cfb27d3785965d P 0f412334fb994ff0ab492afde64f5855 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:59:37.317039 20448 consensus_queue.cc:1048] T 35c1ea979bda45aead7d1b8539f37637 P d1379e91aa9c41629cd25262571beb2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:59:37.339344 20731 consensus_queue.cc:1048] T d51f1c713224480980c425d473226a02 P 0f412334fb994ff0ab492afde64f5855 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:59:37.364868 20731 consensus_queue.cc:1048] T d51f1c713224480980c425d473226a02 P 0f412334fb994ff0ab492afde64f5855 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:59:37.411685 20613 consensus_queue.cc:1048] T cb866838666745f0a4462f124ac22f72 P d1379e91aa9c41629cd25262571beb2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:59:37.422269 20448 consensus_queue.cc:1048] T cb866838666745f0a4462f124ac22f72 P d1379e91aa9c41629cd25262571beb2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:59:37.623096 20448 consensus_queue.cc:1048] T b7dcf1850ca541d6ab42bd11de70d8f4 P d1379e91aa9c41629cd25262571beb2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:59:37.643957 20667 consensus_queue.cc:1048] T b7dcf1850ca541d6ab42bd11de70d8f4 P d1379e91aa9c41629cd25262571beb2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:59:37.915449 16888 tablet_server.cc:178] TabletServer@127.16.126.1:0 shutting down...
W20251023 07:59:37.941617 20044 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 173 similar messages]
W20251023 07:59:37.956375 20044 consensus_peers.cc:597] T cfbe734be0c84115840c7c45f3398002 P 35e7d1ade024444486e63cf1b81e9626 -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:37.968824 16888 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251023 07:59:37.970999 16888 tablet_replica.cc:333] T b7dcf1850ca541d6ab42bd11de70d8f4 P d1379e91aa9c41629cd25262571beb2c: stopping tablet replica
I20251023 07:59:37.971805 16888 raft_consensus.cc:2243] T b7dcf1850ca541d6ab42bd11de70d8f4 P d1379e91aa9c41629cd25262571beb2c [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:37.972714 16888 raft_consensus.cc:2272] T b7dcf1850ca541d6ab42bd11de70d8f4 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:37.975423 16888 tablet_replica.cc:333] T d51f1c713224480980c425d473226a02 P d1379e91aa9c41629cd25262571beb2c: stopping tablet replica
I20251023 07:59:37.976032 16888 raft_consensus.cc:2243] T d51f1c713224480980c425d473226a02 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:37.976457 16888 raft_consensus.cc:2272] T d51f1c713224480980c425d473226a02 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:37.978545 16888 tablet_replica.cc:333] T cb866838666745f0a4462f124ac22f72 P d1379e91aa9c41629cd25262571beb2c: stopping tablet replica
I20251023 07:59:37.979173 16888 raft_consensus.cc:2243] T cb866838666745f0a4462f124ac22f72 P d1379e91aa9c41629cd25262571beb2c [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:37.979895 16888 raft_consensus.cc:2272] T cb866838666745f0a4462f124ac22f72 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:37.981966 16888 tablet_replica.cc:333] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P d1379e91aa9c41629cd25262571beb2c: stopping tablet replica
I20251023 07:59:37.982646 16888 raft_consensus.cc:2243] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:37.983047 16888 raft_consensus.cc:2272] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:37.985103 16888 tablet_replica.cc:333] T f1da9b379f264014adfbf37b2660285b P d1379e91aa9c41629cd25262571beb2c: stopping tablet replica
I20251023 07:59:37.985841 16888 raft_consensus.cc:2243] T f1da9b379f264014adfbf37b2660285b P d1379e91aa9c41629cd25262571beb2c [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:37.986732 16888 raft_consensus.cc:2272] T f1da9b379f264014adfbf37b2660285b P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus is shut down!
W20251023 07:59:37.988200 20044 consensus_peers.cc:597] T f8ceeb2a7d7d45629aee9466b149251b P 35e7d1ade024444486e63cf1b81e9626 -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:37.988961 16888 tablet_replica.cc:333] T 382a939856194537b68f791851ceaa65 P d1379e91aa9c41629cd25262571beb2c: stopping tablet replica
I20251023 07:59:37.989661 16888 raft_consensus.cc:2243] T 382a939856194537b68f791851ceaa65 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:37.990123 16888 raft_consensus.cc:2272] T 382a939856194537b68f791851ceaa65 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:37.991827 16888 tablet_replica.cc:333] T 2ff74dfb94334c20b99ea84b985a27a5 P d1379e91aa9c41629cd25262571beb2c: stopping tablet replica
I20251023 07:59:37.992457 16888 raft_consensus.cc:2243] T 2ff74dfb94334c20b99ea84b985a27a5 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:37.992882 16888 raft_consensus.cc:2272] T 2ff74dfb94334c20b99ea84b985a27a5 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:37.994575 16888 tablet_replica.cc:333] T 20f681957fa04333b8a04cbad085db57 P d1379e91aa9c41629cd25262571beb2c: stopping tablet replica
I20251023 07:59:37.995134 16888 raft_consensus.cc:2243] T 20f681957fa04333b8a04cbad085db57 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:37.995509 16888 raft_consensus.cc:2272] T 20f681957fa04333b8a04cbad085db57 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:37.997134 16888 tablet_replica.cc:333] T f8ceeb2a7d7d45629aee9466b149251b P d1379e91aa9c41629cd25262571beb2c: stopping tablet replica
I20251023 07:59:37.997792 16888 raft_consensus.cc:2243] T f8ceeb2a7d7d45629aee9466b149251b P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:37.998227 16888 raft_consensus.cc:2272] T f8ceeb2a7d7d45629aee9466b149251b P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:38.000073 16888 tablet_replica.cc:333] T 35c1ea979bda45aead7d1b8539f37637 P d1379e91aa9c41629cd25262571beb2c: stopping tablet replica
I20251023 07:59:38.000945 16888 raft_consensus.cc:2243] T 35c1ea979bda45aead7d1b8539f37637 P d1379e91aa9c41629cd25262571beb2c [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:38.001869 16888 raft_consensus.cc:2272] T 35c1ea979bda45aead7d1b8539f37637 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus is shut down!
W20251023 07:59:38.002457 20192 consensus_peers.cc:597] T 20f681957fa04333b8a04cbad085db57 P 65876a2b197c4ea6918f5cab47ded25c -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:38.004041 16888 tablet_replica.cc:333] T fb985a87f45d43d68b172b937404e770 P d1379e91aa9c41629cd25262571beb2c: stopping tablet replica
I20251023 07:59:38.004673 16888 raft_consensus.cc:2243] T fb985a87f45d43d68b172b937404e770 P d1379e91aa9c41629cd25262571beb2c [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:38.005376 16888 raft_consensus.cc:2272] T fb985a87f45d43d68b172b937404e770 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:38.007071 16888 tablet_replica.cc:333] T d6cbef26ab7c4389b265743ae018e227 P d1379e91aa9c41629cd25262571beb2c: stopping tablet replica
I20251023 07:59:38.007623 16888 raft_consensus.cc:2243] T d6cbef26ab7c4389b265743ae018e227 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:38.008015 16888 raft_consensus.cc:2272] T d6cbef26ab7c4389b265743ae018e227 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:38.009912 16888 tablet_replica.cc:333] T f20a7a673ce6433eac41600d3573e314 P d1379e91aa9c41629cd25262571beb2c: stopping tablet replica
I20251023 07:59:38.010704 16888 raft_consensus.cc:2243] T f20a7a673ce6433eac41600d3573e314 P d1379e91aa9c41629cd25262571beb2c [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:38.011608 16888 raft_consensus.cc:2272] T f20a7a673ce6433eac41600d3573e314 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:38.013262 16888 tablet_replica.cc:333] T 0973ba22912840bd9bded8b0376fa1e7 P d1379e91aa9c41629cd25262571beb2c: stopping tablet replica
I20251023 07:59:38.013855 16888 raft_consensus.cc:2243] T 0973ba22912840bd9bded8b0376fa1e7 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:38.014243 16888 raft_consensus.cc:2272] T 0973ba22912840bd9bded8b0376fa1e7 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:38.015868 16888 tablet_replica.cc:333] T cfbe734be0c84115840c7c45f3398002 P d1379e91aa9c41629cd25262571beb2c: stopping tablet replica
I20251023 07:59:38.016443 16888 raft_consensus.cc:2243] T cfbe734be0c84115840c7c45f3398002 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:38.016832 16888 raft_consensus.cc:2272] T cfbe734be0c84115840c7c45f3398002 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:38.018731 16888 tablet_replica.cc:333] T f524e775b99147de99cfb27d3785965d P d1379e91aa9c41629cd25262571beb2c: stopping tablet replica
I20251023 07:59:38.019315 16888 raft_consensus.cc:2243] T f524e775b99147de99cfb27d3785965d P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:38.019718 16888 raft_consensus.cc:2272] T f524e775b99147de99cfb27d3785965d P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:38.022181 16888 tablet_replica.cc:333] T c52243b5fda44e2fba36f6319b4c13e3 P d1379e91aa9c41629cd25262571beb2c: stopping tablet replica
I20251023 07:59:38.022913 16888 raft_consensus.cc:2243] T c52243b5fda44e2fba36f6319b4c13e3 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:38.023288 16888 raft_consensus.cc:2272] T c52243b5fda44e2fba36f6319b4c13e3 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:38.025137 16888 tablet_replica.cc:333] T 09f7b5cd377e45be8bbd85052c93dcb3 P d1379e91aa9c41629cd25262571beb2c: stopping tablet replica
I20251023 07:59:38.025739 16888 raft_consensus.cc:2243] T 09f7b5cd377e45be8bbd85052c93dcb3 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:38.026136 16888 raft_consensus.cc:2272] T 09f7b5cd377e45be8bbd85052c93dcb3 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:38.027747 16888 tablet_replica.cc:333] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P d1379e91aa9c41629cd25262571beb2c: stopping tablet replica
I20251023 07:59:38.028312 16888 raft_consensus.cc:2243] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:38.028677 16888 raft_consensus.cc:2272] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:38.030565 16888 tablet_replica.cc:333] T 58cef989d86d4b0c8401b4d6b2f890c0 P d1379e91aa9c41629cd25262571beb2c: stopping tablet replica
I20251023 07:59:38.031082 16888 raft_consensus.cc:2243] T 58cef989d86d4b0c8401b4d6b2f890c0 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:38.031467 16888 raft_consensus.cc:2272] T 58cef989d86d4b0c8401b4d6b2f890c0 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:38.033124 16888 tablet_replica.cc:333] T bd5baee3419c4a7aa0def773845ac48a P d1379e91aa9c41629cd25262571beb2c: stopping tablet replica
I20251023 07:59:38.033707 16888 raft_consensus.cc:2243] T bd5baee3419c4a7aa0def773845ac48a P d1379e91aa9c41629cd25262571beb2c [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:38.034430 16888 raft_consensus.cc:2272] T bd5baee3419c4a7aa0def773845ac48a P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:38.036049 16888 tablet_replica.cc:333] T 82812175f15d4d3dae73f31641a1e583 P d1379e91aa9c41629cd25262571beb2c: stopping tablet replica
I20251023 07:59:38.036567 16888 raft_consensus.cc:2243] T 82812175f15d4d3dae73f31641a1e583 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:38.036978 16888 raft_consensus.cc:2272] T 82812175f15d4d3dae73f31641a1e583 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:38.038772 16888 tablet_replica.cc:333] T e813343bd62640cc9976d0ae394aa315 P d1379e91aa9c41629cd25262571beb2c: stopping tablet replica
I20251023 07:59:38.039300 16888 raft_consensus.cc:2243] T e813343bd62640cc9976d0ae394aa315 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:38.039675 16888 raft_consensus.cc:2272] T e813343bd62640cc9976d0ae394aa315 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:38.041651 16888 tablet_replica.cc:333] T a0ff2fc9a3c04716ab748f95a00dec76 P d1379e91aa9c41629cd25262571beb2c: stopping tablet replica
I20251023 07:59:38.042236 16888 raft_consensus.cc:2243] T a0ff2fc9a3c04716ab748f95a00dec76 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:38.042596 16888 raft_consensus.cc:2272] T a0ff2fc9a3c04716ab748f95a00dec76 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:38.044186 16888 tablet_replica.cc:333] T aa253535ba594367a12fda3dea3b75d4 P d1379e91aa9c41629cd25262571beb2c: stopping tablet replica
I20251023 07:59:38.044715 16888 raft_consensus.cc:2243] T aa253535ba594367a12fda3dea3b75d4 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:38.045097 16888 raft_consensus.cc:2272] T aa253535ba594367a12fda3dea3b75d4 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:38.046929 16888 tablet_replica.cc:333] T a1c85032f5ef4634a35c20eec56ae62f P d1379e91aa9c41629cd25262571beb2c: stopping tablet replica
I20251023 07:59:38.047456 16888 raft_consensus.cc:2243] T a1c85032f5ef4634a35c20eec56ae62f P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:38.047827 16888 raft_consensus.cc:2272] T a1c85032f5ef4634a35c20eec56ae62f P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:38.049360 16888 tablet_replica.cc:333] T db045d1b86484fe9987f82ce426362e5 P d1379e91aa9c41629cd25262571beb2c: stopping tablet replica
I20251023 07:59:38.050010 16888 raft_consensus.cc:2243] T db045d1b86484fe9987f82ce426362e5 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:38.050390 16888 raft_consensus.cc:2272] T db045d1b86484fe9987f82ce426362e5 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:38.052179 16888 tablet_replica.cc:333] T d214412da5754dd0a08f25d50b5584f1 P d1379e91aa9c41629cd25262571beb2c: stopping tablet replica
I20251023 07:59:38.052690 16888 raft_consensus.cc:2243] T d214412da5754dd0a08f25d50b5584f1 P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Raft consensus shutting down.
W20251023 07:59:38.052903 20192 consensus_peers.cc:597] T e2c26d408ee04105bd615b58287c82f9 P 65876a2b197c4ea6918f5cab47ded25c -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:38.053192 16888 raft_consensus.cc:2272] T d214412da5754dd0a08f25d50b5584f1 P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:38.056056 16888 tablet_replica.cc:333] T c6fd96e3f93945f7828a9a8593490daa P d1379e91aa9c41629cd25262571beb2c: stopping tablet replica
I20251023 07:59:38.056692 16888 raft_consensus.cc:2243] T c6fd96e3f93945f7828a9a8593490daa P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:38.057101 16888 raft_consensus.cc:2272] T c6fd96e3f93945f7828a9a8593490daa P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:38.058844 16888 tablet_replica.cc:333] T 12b8704d81fe4e3cb14bfa975c73df29 P d1379e91aa9c41629cd25262571beb2c: stopping tablet replica
I20251023 07:59:38.059377 16888 raft_consensus.cc:2243] T 12b8704d81fe4e3cb14bfa975c73df29 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:38.059756 16888 raft_consensus.cc:2272] T 12b8704d81fe4e3cb14bfa975c73df29 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:38.061936 16888 tablet_replica.cc:333] T 5bc7d7ca172742d1b528af8659661c2a P d1379e91aa9c41629cd25262571beb2c: stopping tablet replica
I20251023 07:59:38.062665 16888 raft_consensus.cc:2243] T 5bc7d7ca172742d1b528af8659661c2a P d1379e91aa9c41629cd25262571beb2c [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:38.063632 16888 raft_consensus.cc:2272] T 5bc7d7ca172742d1b528af8659661c2a P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:38.065871 16888 tablet_replica.cc:333] T 5855488965da49f4a33c7516f6a5596a P d1379e91aa9c41629cd25262571beb2c: stopping tablet replica
I20251023 07:59:38.066473 16888 raft_consensus.cc:2243] T 5855488965da49f4a33c7516f6a5596a P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:38.066967 16888 raft_consensus.cc:2272] T 5855488965da49f4a33c7516f6a5596a P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:38.069401 16888 tablet_replica.cc:333] T a468f7a5913245b58705dc4f8560dade P d1379e91aa9c41629cd25262571beb2c: stopping tablet replica
W20251023 07:59:38.069476 20192 consensus_peers.cc:597] T 58cef989d86d4b0c8401b4d6b2f890c0 P 65876a2b197c4ea6918f5cab47ded25c -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:38.070199 16888 raft_consensus.cc:2243] T a468f7a5913245b58705dc4f8560dade P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:38.070670 16888 raft_consensus.cc:2272] T a468f7a5913245b58705dc4f8560dade P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus is shut down!
W20251023 07:59:38.072252 20192 consensus_peers.cc:597] T ccba7896b7e1413293428358ffd0f8a0 P 65876a2b197c4ea6918f5cab47ded25c -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:38.072404 16888 tablet_replica.cc:333] T a9f4a5a96a444c099e7cefb12fe4c288 P d1379e91aa9c41629cd25262571beb2c: stopping tablet replica
I20251023 07:59:38.073048 16888 raft_consensus.cc:2243] T a9f4a5a96a444c099e7cefb12fe4c288 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:38.073455 16888 raft_consensus.cc:2272] T a9f4a5a96a444c099e7cefb12fe4c288 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:38.075322 16888 tablet_replica.cc:333] T ccba7896b7e1413293428358ffd0f8a0 P d1379e91aa9c41629cd25262571beb2c: stopping tablet replica
I20251023 07:59:38.076005 16888 raft_consensus.cc:2243] T ccba7896b7e1413293428358ffd0f8a0 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:38.076475 16888 raft_consensus.cc:2272] T ccba7896b7e1413293428358ffd0f8a0 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:38.078750 16888 tablet_replica.cc:333] T 62e73cfc2bbc459aba34186c3231ed87 P d1379e91aa9c41629cd25262571beb2c: stopping tablet replica
I20251023 07:59:38.079298 16888 raft_consensus.cc:2243] T 62e73cfc2bbc459aba34186c3231ed87 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:38.079667 16888 raft_consensus.cc:2272] T 62e73cfc2bbc459aba34186c3231ed87 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:38.081478 16888 tablet_replica.cc:333] T 92fae2a393404d8998ad2747fbd08cc9 P d1379e91aa9c41629cd25262571beb2c: stopping tablet replica
I20251023 07:59:38.082015 16888 raft_consensus.cc:2243] T 92fae2a393404d8998ad2747fbd08cc9 P d1379e91aa9c41629cd25262571beb2c [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:38.082751 16888 raft_consensus.cc:2272] T 92fae2a393404d8998ad2747fbd08cc9 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:38.084692 16888 tablet_replica.cc:333] T 7060af9ee4a34ecca18900b2f272e1d1 P d1379e91aa9c41629cd25262571beb2c: stopping tablet replica
I20251023 07:59:38.085152 16888 raft_consensus.cc:2243] T 7060af9ee4a34ecca18900b2f272e1d1 P d1379e91aa9c41629cd25262571beb2c [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:38.086030 16888 raft_consensus.cc:2272] T 7060af9ee4a34ecca18900b2f272e1d1 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:38.088341 16888 tablet_replica.cc:333] T 13d572956c644586b0efbe8f63aecae5 P d1379e91aa9c41629cd25262571beb2c: stopping tablet replica
I20251023 07:59:38.089088 16888 raft_consensus.cc:2243] T 13d572956c644586b0efbe8f63aecae5 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:38.089584 16888 raft_consensus.cc:2272] T 13d572956c644586b0efbe8f63aecae5 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:38.091739 16888 tablet_replica.cc:333] T 076aca7c8ecb4f34af0d457fcee0e585 P d1379e91aa9c41629cd25262571beb2c: stopping tablet replica
I20251023 07:59:38.092440 16888 raft_consensus.cc:2243] T 076aca7c8ecb4f34af0d457fcee0e585 P d1379e91aa9c41629cd25262571beb2c [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:38.093461 16888 raft_consensus.cc:2272] T 076aca7c8ecb4f34af0d457fcee0e585 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:38.095933 16888 tablet_replica.cc:333] T 0229047af3034761a2bf168928917afb P d1379e91aa9c41629cd25262571beb2c: stopping tablet replica
I20251023 07:59:38.096643 16888 raft_consensus.cc:2243] T 0229047af3034761a2bf168928917afb P d1379e91aa9c41629cd25262571beb2c [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:38.097528 16888 raft_consensus.cc:2272] T 0229047af3034761a2bf168928917afb P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus is shut down!
W20251023 07:59:38.097574 20044 consensus_peers.cc:597] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P 35e7d1ade024444486e63cf1b81e9626 -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251023 07:59:38.099696 20192 consensus_peers.cc:597] T 2ff74dfb94334c20b99ea84b985a27a5 P 65876a2b197c4ea6918f5cab47ded25c -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:38.099923 16888 tablet_replica.cc:333] T c3527495b334413f82d0eca2c4d117b1 P d1379e91aa9c41629cd25262571beb2c: stopping tablet replica
I20251023 07:59:38.100750 16888 raft_consensus.cc:2243] T c3527495b334413f82d0eca2c4d117b1 P d1379e91aa9c41629cd25262571beb2c [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:38.101713 16888 raft_consensus.cc:2272] T c3527495b334413f82d0eca2c4d117b1 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus is shut down!
W20251023 07:59:38.102600 20118 consensus_peers.cc:597] T e813343bd62640cc9976d0ae394aa315 P 0f412334fb994ff0ab492afde64f5855 -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:38.103832 16888 tablet_replica.cc:333] T fa36a9cfa4fe43418245de193502470f P d1379e91aa9c41629cd25262571beb2c: stopping tablet replica
I20251023 07:59:38.104523 16888 raft_consensus.cc:2243] T fa36a9cfa4fe43418245de193502470f P d1379e91aa9c41629cd25262571beb2c [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:38.105345 16888 raft_consensus.cc:2272] T fa36a9cfa4fe43418245de193502470f P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:38.107352 16888 tablet_replica.cc:333] T e2c26d408ee04105bd615b58287c82f9 P d1379e91aa9c41629cd25262571beb2c: stopping tablet replica
I20251023 07:59:38.107990 16888 raft_consensus.cc:2243] T e2c26d408ee04105bd615b58287c82f9 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:38.108445 16888 raft_consensus.cc:2272] T e2c26d408ee04105bd615b58287c82f9 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:38.110265 16888 tablet_replica.cc:333] T a9d3294d54be4be29569a460be5c8887 P d1379e91aa9c41629cd25262571beb2c: stopping tablet replica
I20251023 07:59:38.110718 16888 raft_consensus.cc:2243] T a9d3294d54be4be29569a460be5c8887 P d1379e91aa9c41629cd25262571beb2c [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:38.111496 16888 raft_consensus.cc:2272] T a9d3294d54be4be29569a460be5c8887 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus is shut down!
W20251023 07:59:38.113080 20044 consensus_peers.cc:597] T c52243b5fda44e2fba36f6319b4c13e3 P 35e7d1ade024444486e63cf1b81e9626 -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251023 07:59:38.142912 20192 consensus_peers.cc:597] T a0ff2fc9a3c04716ab748f95a00dec76 P 65876a2b197c4ea6918f5cab47ded25c -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251023 07:59:38.147003 20192 consensus_peers.cc:597] T 13d572956c644586b0efbe8f63aecae5 P 65876a2b197c4ea6918f5cab47ded25c -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251023 07:59:38.163267 20044 consensus_peers.cc:597] T 82812175f15d4d3dae73f31641a1e583 P 35e7d1ade024444486e63cf1b81e9626 -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Status: Network error: recv got EOF from unknown peer (error 108). This is attempt 1: this message will repeat every 5th retry.
W20251023 07:59:38.170097 20044 consensus_peers.cc:597] T db045d1b86484fe9987f82ce426362e5 P 35e7d1ade024444486e63cf1b81e9626 -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Status: Network error: Client connection negotiation failed: client connection to 127.16.126.1:37865: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:38.178031 16888 tablet_server.cc:195] TabletServer@127.16.126.1:0 shutdown complete.
W20251023 07:59:38.194588 20044 consensus_peers.cc:597] T 382a939856194537b68f791851ceaa65 P 35e7d1ade024444486e63cf1b81e9626 -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Status: Network error: Client connection negotiation failed: client connection to 127.16.126.1:37865: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251023 07:59:38.204898 20044 consensus_peers.cc:597] T 12b8704d81fe4e3cb14bfa975c73df29 P 35e7d1ade024444486e63cf1b81e9626 -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Status: Network error: Client connection negotiation failed: client connection to 127.16.126.1:37865: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251023 07:59:38.227958 20118 consensus_peers.cc:597] T 5855488965da49f4a33c7516f6a5596a P 0f412334fb994ff0ab492afde64f5855 -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Status: Network error: Client connection negotiation failed: client connection to 127.16.126.1:37865: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251023 07:59:38.242569 20044 consensus_peers.cc:597] T a468f7a5913245b58705dc4f8560dade P 35e7d1ade024444486e63cf1b81e9626 -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Status: Network error: Client connection negotiation failed: client connection to 127.16.126.1:37865: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:38.249140 16888 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251023 07:59:38.256696 20752 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251023 07:59:38.258744 20751 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251023 07:59:38.259348 20118 consensus_peers.cc:597] T f524e775b99147de99cfb27d3785965d P 0f412334fb994ff0ab492afde64f5855 -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Status: Network error: Client connection negotiation failed: client connection to 127.16.126.1:37865: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251023 07:59:38.259588 20044 consensus_peers.cc:597] T a9f4a5a96a444c099e7cefb12fe4c288 P 35e7d1ade024444486e63cf1b81e9626 -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Status: Network error: Client connection negotiation failed: client connection to 127.16.126.1:37865: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251023 07:59:38.262236 20755 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251023 07:59:38.262136 16888 server_base.cc:1047] running on GCE node
I20251023 07:59:38.268543 16888 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251023 07:59:38.268949 16888 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251023 07:59:38.269268 16888 hybrid_clock.cc:648] HybridClock initialized: now 1761206378269247 us; error 0 us; skew 500 ppm
I20251023 07:59:38.269979 16888 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20251023 07:59:38.272816 16888 webserver.cc:492] Webserver started at http://127.16.126.1:39943/ using document root <none> and password file <none>
I20251023 07:59:38.273303 16888 fs_manager.cc:362] Metadata directory not provided
I20251023 07:59:38.273511 16888 fs_manager.cc:365] Using existing metadata directory in first data directory
I20251023 07:59:38.277076 16888 fs_manager.cc:714] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
W20251023 07:59:38.283731 20044 consensus_peers.cc:597] T 09f7b5cd377e45be8bbd85052c93dcb3 P 35e7d1ade024444486e63cf1b81e9626 -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Status: Network error: Client connection negotiation failed: client connection to 127.16.126.1:37865: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:38.286223 20759 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251023 07:59:38.289224 16888 fs_manager.cc:730] Time spent opening block manager: real 0.005s user 0.003s sys 0.001s
I20251023 07:59:38.289705 16888 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1761206251627710-16888-0/minicluster-data/ts-0-root
uuid: "d1379e91aa9c41629cd25262571beb2c"
format_stamp: "Formatted at 2025-10-23 07:59:27 on dist-test-slave-m488"
I20251023 07:59:38.290642 16888 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1761206251627710-16888-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1761206251627710-16888-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1761206251627710-16888-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20251023 07:59:38.292622 20044 consensus_peers.cc:597] T 62e73cfc2bbc459aba34186c3231ed87 P 35e7d1ade024444486e63cf1b81e9626 -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Status: Network error: Client connection negotiation failed: client connection to 127.16.126.1:37865: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:38.307399 16888 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251023 07:59:38.308769 16888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251023 07:59:38.310343 16888 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251023 07:59:38.315241 20766 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20251023 07:59:38.319566 20118 consensus_peers.cc:597] T d51f1c713224480980c425d473226a02 P 0f412334fb994ff0ab492afde64f5855 -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Status: Network error: Client connection negotiation failed: client connection to 127.16.126.1:37865: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251023 07:59:38.342798 20118 consensus_peers.cc:597] T d214412da5754dd0a08f25d50b5584f1 P 0f412334fb994ff0ab492afde64f5855 -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Status: Network error: Client connection negotiation failed: client connection to 127.16.126.1:37865: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251023 07:59:38.345486 20118 consensus_peers.cc:597] T c6fd96e3f93945f7828a9a8593490daa P 0f412334fb994ff0ab492afde64f5855 -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Status: Network error: Client connection negotiation failed: client connection to 127.16.126.1:37865: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251023 07:59:38.347215 20118 consensus_peers.cc:597] T aa253535ba594367a12fda3dea3b75d4 P 0f412334fb994ff0ab492afde64f5855 -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Status: Network error: Client connection negotiation failed: client connection to 127.16.126.1:37865: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251023 07:59:38.388151 20118 consensus_peers.cc:597] T a1c85032f5ef4634a35c20eec56ae62f P 0f412334fb994ff0ab492afde64f5855 -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Status: Network error: Client connection negotiation failed: client connection to 127.16.126.1:37865: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251023 07:59:38.414211 20118 consensus_peers.cc:597] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P 0f412334fb994ff0ab492afde64f5855 -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Status: Network error: Client connection negotiation failed: client connection to 127.16.126.1:37865: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251023 07:59:38.469774 20118 consensus_peers.cc:597] T d6cbef26ab7c4389b265743ae018e227 P 0f412334fb994ff0ab492afde64f5855 -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Status: Network error: Client connection negotiation failed: client connection to 127.16.126.1:37865: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251023 07:59:38.496425 20192 consensus_peers.cc:597] T 0973ba22912840bd9bded8b0376fa1e7 P 65876a2b197c4ea6918f5cab47ded25c -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Status: Network error: Client connection negotiation failed: client connection to 127.16.126.1:37865: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:38.603976 16888 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20251023 07:59:38.604405 16888 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.290s user 0.008s sys 0.000s
I20251023 07:59:38.604748 16888 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20251023 07:59:38.610687 20766 tablet_bootstrap.cc:492] T d6cbef26ab7c4389b265743ae018e227 P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:38.627084 20766 tablet_bootstrap.cc:492] T d6cbef26ab7c4389b265743ae018e227 P d1379e91aa9c41629cd25262571beb2c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:59:38.627885 20766 tablet_bootstrap.cc:492] T d6cbef26ab7c4389b265743ae018e227 P d1379e91aa9c41629cd25262571beb2c: Bootstrap complete.
I20251023 07:59:38.628378 20766 ts_tablet_manager.cc:1403] T d6cbef26ab7c4389b265743ae018e227 P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.018s user 0.005s sys 0.008s
I20251023 07:59:38.630229 20766 raft_consensus.cc:359] T d6cbef26ab7c4389b265743ae018e227 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:38.630923 20766 raft_consensus.cc:740] T d6cbef26ab7c4389b265743ae018e227 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:38.631697 20766 consensus_queue.cc:260] T d6cbef26ab7c4389b265743ae018e227 P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:38.637033 20766 ts_tablet_manager.cc:1434] T d6cbef26ab7c4389b265743ae018e227 P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.008s user 0.010s sys 0.000s
I20251023 07:59:38.637888 20766 tablet_bootstrap.cc:492] T a9d3294d54be4be29569a460be5c8887 P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:38.654886 20766 tablet_bootstrap.cc:492] T a9d3294d54be4be29569a460be5c8887 P d1379e91aa9c41629cd25262571beb2c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:59:38.655635 20766 tablet_bootstrap.cc:492] T a9d3294d54be4be29569a460be5c8887 P d1379e91aa9c41629cd25262571beb2c: Bootstrap complete.
I20251023 07:59:38.656219 20766 ts_tablet_manager.cc:1403] T a9d3294d54be4be29569a460be5c8887 P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.019s user 0.010s sys 0.004s
I20251023 07:59:38.658565 20766 raft_consensus.cc:359] T a9d3294d54be4be29569a460be5c8887 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:38.659241 20766 raft_consensus.cc:740] T a9d3294d54be4be29569a460be5c8887 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:38.659857 20766 consensus_queue.cc:260] T a9d3294d54be4be29569a460be5c8887 P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:38.661665 20766 ts_tablet_manager.cc:1434] T a9d3294d54be4be29569a460be5c8887 P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.005s user 0.008s sys 0.000s
I20251023 07:59:38.662269 20766 tablet_bootstrap.cc:492] T 13d572956c644586b0efbe8f63aecae5 P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:38.690099 20766 tablet_bootstrap.cc:492] T 13d572956c644586b0efbe8f63aecae5 P d1379e91aa9c41629cd25262571beb2c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:59:38.691046 20766 tablet_bootstrap.cc:492] T 13d572956c644586b0efbe8f63aecae5 P d1379e91aa9c41629cd25262571beb2c: Bootstrap complete.
I20251023 07:59:38.691713 20766 ts_tablet_manager.cc:1403] T 13d572956c644586b0efbe8f63aecae5 P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.030s user 0.023s sys 0.004s
I20251023 07:59:38.694196 20766 raft_consensus.cc:359] T 13d572956c644586b0efbe8f63aecae5 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:38.694841 20766 raft_consensus.cc:740] T 13d572956c644586b0efbe8f63aecae5 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:38.695425 20766 consensus_queue.cc:260] T 13d572956c644586b0efbe8f63aecae5 P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:38.697021 20766 ts_tablet_manager.cc:1434] T 13d572956c644586b0efbe8f63aecae5 P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20251023 07:59:38.697736 20766 tablet_bootstrap.cc:492] T f524e775b99147de99cfb27d3785965d P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:38.719568 20766 tablet_bootstrap.cc:492] T f524e775b99147de99cfb27d3785965d P d1379e91aa9c41629cd25262571beb2c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:59:38.720732 20766 tablet_bootstrap.cc:492] T f524e775b99147de99cfb27d3785965d P d1379e91aa9c41629cd25262571beb2c: Bootstrap complete.
I20251023 07:59:38.721397 20766 ts_tablet_manager.cc:1403] T f524e775b99147de99cfb27d3785965d P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.024s user 0.015s sys 0.004s
I20251023 07:59:38.723776 20766 raft_consensus.cc:359] T f524e775b99147de99cfb27d3785965d P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:38.724462 20766 raft_consensus.cc:740] T f524e775b99147de99cfb27d3785965d P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:38.725126 20766 consensus_queue.cc:260] T f524e775b99147de99cfb27d3785965d P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:38.727134 20766 ts_tablet_manager.cc:1434] T f524e775b99147de99cfb27d3785965d P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20251023 07:59:38.727926 20766 tablet_bootstrap.cc:492] T a468f7a5913245b58705dc4f8560dade P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:38.760845 20766 tablet_bootstrap.cc:492] T a468f7a5913245b58705dc4f8560dade P d1379e91aa9c41629cd25262571beb2c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:59:38.761611 20766 tablet_bootstrap.cc:492] T a468f7a5913245b58705dc4f8560dade P d1379e91aa9c41629cd25262571beb2c: Bootstrap complete.
I20251023 07:59:38.762112 20766 ts_tablet_manager.cc:1403] T a468f7a5913245b58705dc4f8560dade P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.034s user 0.018s sys 0.012s
I20251023 07:59:38.763813 20766 raft_consensus.cc:359] T a468f7a5913245b58705dc4f8560dade P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:38.764295 20766 raft_consensus.cc:740] T a468f7a5913245b58705dc4f8560dade P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:38.764827 20766 consensus_queue.cc:260] T a468f7a5913245b58705dc4f8560dade P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:38.766337 20766 ts_tablet_manager.cc:1434] T a468f7a5913245b58705dc4f8560dade P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20251023 07:59:38.766925 20766 tablet_bootstrap.cc:492] T f20a7a673ce6433eac41600d3573e314 P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:38.778779 20766 tablet_bootstrap.cc:492] T f20a7a673ce6433eac41600d3573e314 P d1379e91aa9c41629cd25262571beb2c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:59:38.779652 20766 tablet_bootstrap.cc:492] T f20a7a673ce6433eac41600d3573e314 P d1379e91aa9c41629cd25262571beb2c: Bootstrap complete.
I20251023 07:59:38.780234 20766 ts_tablet_manager.cc:1403] T f20a7a673ce6433eac41600d3573e314 P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.004s
I20251023 07:59:38.782541 20766 raft_consensus.cc:359] T f20a7a673ce6433eac41600d3573e314 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:38.783185 20766 raft_consensus.cc:740] T f20a7a673ce6433eac41600d3573e314 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:38.783766 20766 consensus_queue.cc:260] T f20a7a673ce6433eac41600d3573e314 P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:38.785739 20766 ts_tablet_manager.cc:1434] T f20a7a673ce6433eac41600d3573e314 P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.005s user 0.008s sys 0.000s
I20251023 07:59:38.786531 20766 tablet_bootstrap.cc:492] T c6fd96e3f93945f7828a9a8593490daa P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:38.800089 20766 tablet_bootstrap.cc:492] T c6fd96e3f93945f7828a9a8593490daa P d1379e91aa9c41629cd25262571beb2c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:59:38.800995 20766 tablet_bootstrap.cc:492] T c6fd96e3f93945f7828a9a8593490daa P d1379e91aa9c41629cd25262571beb2c: Bootstrap complete.
I20251023 07:59:38.801681 20766 ts_tablet_manager.cc:1403] T c6fd96e3f93945f7828a9a8593490daa P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.015s user 0.011s sys 0.004s
I20251023 07:59:38.803918 20766 raft_consensus.cc:359] T c6fd96e3f93945f7828a9a8593490daa P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:38.804441 20766 raft_consensus.cc:740] T c6fd96e3f93945f7828a9a8593490daa P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:38.805140 20766 consensus_queue.cc:260] T c6fd96e3f93945f7828a9a8593490daa P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:38.807241 20766 ts_tablet_manager.cc:1434] T c6fd96e3f93945f7828a9a8593490daa P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20251023 07:59:38.807991 20766 tablet_bootstrap.cc:492] T c52243b5fda44e2fba36f6319b4c13e3 P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:38.818852 20766 tablet_bootstrap.cc:492] T c52243b5fda44e2fba36f6319b4c13e3 P d1379e91aa9c41629cd25262571beb2c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:59:38.819558 20766 tablet_bootstrap.cc:492] T c52243b5fda44e2fba36f6319b4c13e3 P d1379e91aa9c41629cd25262571beb2c: Bootstrap complete.
I20251023 07:59:38.820042 20766 ts_tablet_manager.cc:1403] T c52243b5fda44e2fba36f6319b4c13e3 P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.012s user 0.009s sys 0.000s
I20251023 07:59:38.821846 20766 raft_consensus.cc:359] T c52243b5fda44e2fba36f6319b4c13e3 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:38.822330 20766 raft_consensus.cc:740] T c52243b5fda44e2fba36f6319b4c13e3 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:38.822881 20766 consensus_queue.cc:260] T c52243b5fda44e2fba36f6319b4c13e3 P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:38.824456 20766 ts_tablet_manager.cc:1434] T c52243b5fda44e2fba36f6319b4c13e3 P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20251023 07:59:38.825223 20766 tablet_bootstrap.cc:492] T e813343bd62640cc9976d0ae394aa315 P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:38.837100 20766 tablet_bootstrap.cc:492] T e813343bd62640cc9976d0ae394aa315 P d1379e91aa9c41629cd25262571beb2c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:59:38.837860 20766 tablet_bootstrap.cc:492] T e813343bd62640cc9976d0ae394aa315 P d1379e91aa9c41629cd25262571beb2c: Bootstrap complete.
I20251023 07:59:38.838491 20766 ts_tablet_manager.cc:1403] T e813343bd62640cc9976d0ae394aa315 P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.013s user 0.009s sys 0.003s
I20251023 07:59:38.840544 20766 raft_consensus.cc:359] T e813343bd62640cc9976d0ae394aa315 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:38.841182 20766 raft_consensus.cc:740] T e813343bd62640cc9976d0ae394aa315 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:38.841830 20766 consensus_queue.cc:260] T e813343bd62640cc9976d0ae394aa315 P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:38.843784 20766 ts_tablet_manager.cc:1434] T e813343bd62640cc9976d0ae394aa315 P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.005s user 0.003s sys 0.001s
I20251023 07:59:38.844537 20766 tablet_bootstrap.cc:492] T a0ff2fc9a3c04716ab748f95a00dec76 P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:38.870101 16888 ts_tablet_manager.cc:616] Registered 45 tablets
I20251023 07:59:38.870482 16888 ts_tablet_manager.cc:595] Time spent register tablets: real 0.266s user 0.235s sys 0.002s
I20251023 07:59:38.885260 20766 tablet_bootstrap.cc:492] T a0ff2fc9a3c04716ab748f95a00dec76 P d1379e91aa9c41629cd25262571beb2c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:59:38.886961 20766 tablet_bootstrap.cc:492] T a0ff2fc9a3c04716ab748f95a00dec76 P d1379e91aa9c41629cd25262571beb2c: Bootstrap complete.
I20251023 07:59:38.888094 20766 ts_tablet_manager.cc:1403] T a0ff2fc9a3c04716ab748f95a00dec76 P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.044s user 0.022s sys 0.012s
I20251023 07:59:38.891705 20766 raft_consensus.cc:359] T a0ff2fc9a3c04716ab748f95a00dec76 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:38.892737 20766 raft_consensus.cc:740] T a0ff2fc9a3c04716ab748f95a00dec76 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:38.893764 20766 consensus_queue.cc:260] T a0ff2fc9a3c04716ab748f95a00dec76 P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:38.896799 20766 ts_tablet_manager.cc:1434] T a0ff2fc9a3c04716ab748f95a00dec76 P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20251023 07:59:38.899256 20766 tablet_bootstrap.cc:492] T f1da9b379f264014adfbf37b2660285b P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:38.918665 20766 tablet_bootstrap.cc:492] T f1da9b379f264014adfbf37b2660285b P d1379e91aa9c41629cd25262571beb2c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:59:38.919380 20766 tablet_bootstrap.cc:492] T f1da9b379f264014adfbf37b2660285b P d1379e91aa9c41629cd25262571beb2c: Bootstrap complete.
I20251023 07:59:38.919900 20766 ts_tablet_manager.cc:1403] T f1da9b379f264014adfbf37b2660285b P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.021s user 0.018s sys 0.000s
I20251023 07:59:38.921744 20766 raft_consensus.cc:359] T f1da9b379f264014adfbf37b2660285b P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:38.922367 20766 raft_consensus.cc:740] T f1da9b379f264014adfbf37b2660285b P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:38.923208 20766 consensus_queue.cc:260] T f1da9b379f264014adfbf37b2660285b P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:38.925534 20766 ts_tablet_manager.cc:1434] T f1da9b379f264014adfbf37b2660285b P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.005s user 0.007s sys 0.000s
I20251023 07:59:38.926270 20766 tablet_bootstrap.cc:492] T e2c26d408ee04105bd615b58287c82f9 P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:38.926111 20677 raft_consensus.cc:493] T cb866838666745f0a4462f124ac22f72 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d1379e91aa9c41629cd25262571beb2c)
I20251023 07:59:38.926935 20677 raft_consensus.cc:515] T cb866838666745f0a4462f124ac22f72 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:38.929738 20677 leader_election.cc:290] T cb866838666745f0a4462f124ac22f72 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865), 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309)
I20251023 07:59:38.933465 20077 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cb866838666745f0a4462f124ac22f72" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
W20251023 07:59:38.942345 20192 leader_election.cc:336] T cb866838666745f0a4462f124ac22f72 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Network error: Client connection negotiation failed: client connection to 127.16.126.1:37865: connect: Connection refused (error 111)
I20251023 07:59:38.942698 20192 leader_election.cc:304] T cb866838666745f0a4462f124ac22f72 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65876a2b197c4ea6918f5cab47ded25c; no voters: 35e7d1ade024444486e63cf1b81e9626, d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:38.943462 20677 raft_consensus.cc:2749] T cb866838666745f0a4462f124ac22f72 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251023 07:59:38.946516 20766 tablet_bootstrap.cc:492] T e2c26d408ee04105bd615b58287c82f9 P d1379e91aa9c41629cd25262571beb2c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:59:38.947429 20766 tablet_bootstrap.cc:492] T e2c26d408ee04105bd615b58287c82f9 P d1379e91aa9c41629cd25262571beb2c: Bootstrap complete.
I20251023 07:59:38.948057 20766 ts_tablet_manager.cc:1403] T e2c26d408ee04105bd615b58287c82f9 P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.022s user 0.011s sys 0.008s
I20251023 07:59:38.950587 20766 raft_consensus.cc:359] T e2c26d408ee04105bd615b58287c82f9 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:38.951222 20766 raft_consensus.cc:740] T e2c26d408ee04105bd615b58287c82f9 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:38.952030 20766 consensus_queue.cc:260] T e2c26d408ee04105bd615b58287c82f9 P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:38.954111 20766 ts_tablet_manager.cc:1434] T e2c26d408ee04105bd615b58287c82f9 P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20251023 07:59:38.954869 20766 tablet_bootstrap.cc:492] T 5bc7d7ca172742d1b528af8659661c2a P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:38.978580 20766 tablet_bootstrap.cc:492] T 5bc7d7ca172742d1b528af8659661c2a P d1379e91aa9c41629cd25262571beb2c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:59:38.979466 20766 tablet_bootstrap.cc:492] T 5bc7d7ca172742d1b528af8659661c2a P d1379e91aa9c41629cd25262571beb2c: Bootstrap complete.
I20251023 07:59:38.980093 20766 ts_tablet_manager.cc:1403] T 5bc7d7ca172742d1b528af8659661c2a P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.025s user 0.007s sys 0.014s
I20251023 07:59:38.982347 20766 raft_consensus.cc:359] T 5bc7d7ca172742d1b528af8659661c2a P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:38.982982 20766 raft_consensus.cc:740] T 5bc7d7ca172742d1b528af8659661c2a P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:38.983596 20766 consensus_queue.cc:260] T 5bc7d7ca172742d1b528af8659661c2a P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:38.985862 20766 ts_tablet_manager.cc:1434] T 5bc7d7ca172742d1b528af8659661c2a P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.005s user 0.006s sys 0.002s
I20251023 07:59:38.986636 20766 tablet_bootstrap.cc:492] T b7dcf1850ca541d6ab42bd11de70d8f4 P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:38.999413 16888 rpc_server.cc:307] RPC server started. Bound to: 127.16.126.1:37865
I20251023 07:59:38.999666 20766 tablet_bootstrap.cc:492] T b7dcf1850ca541d6ab42bd11de70d8f4 P d1379e91aa9c41629cd25262571beb2c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:59:38.999584 20843 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.126.1:37865 every 8 connection(s)
I20251023 07:59:39.000651 20766 tablet_bootstrap.cc:492] T b7dcf1850ca541d6ab42bd11de70d8f4 P d1379e91aa9c41629cd25262571beb2c: Bootstrap complete.
I20251023 07:59:39.001201 20766 ts_tablet_manager.cc:1403] T b7dcf1850ca541d6ab42bd11de70d8f4 P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.015s user 0.013s sys 0.000s
I20251023 07:59:39.003710 20766 raft_consensus.cc:359] T b7dcf1850ca541d6ab42bd11de70d8f4 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:39.004356 20766 raft_consensus.cc:740] T b7dcf1850ca541d6ab42bd11de70d8f4 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:39.004972 20766 consensus_queue.cc:260] T b7dcf1850ca541d6ab42bd11de70d8f4 P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:39.007198 20766 ts_tablet_manager.cc:1434] T b7dcf1850ca541d6ab42bd11de70d8f4 P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20251023 07:59:39.007968 20766 tablet_bootstrap.cc:492] T 82812175f15d4d3dae73f31641a1e583 P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:39.059449 20766 tablet_bootstrap.cc:492] T 82812175f15d4d3dae73f31641a1e583 P d1379e91aa9c41629cd25262571beb2c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:59:39.060451 20766 tablet_bootstrap.cc:492] T 82812175f15d4d3dae73f31641a1e583 P d1379e91aa9c41629cd25262571beb2c: Bootstrap complete.
I20251023 07:59:39.061193 20766 ts_tablet_manager.cc:1403] T 82812175f15d4d3dae73f31641a1e583 P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.053s user 0.029s sys 0.020s
I20251023 07:59:39.064424 20766 raft_consensus.cc:359] T 82812175f15d4d3dae73f31641a1e583 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:39.065138 20766 raft_consensus.cc:740] T 82812175f15d4d3dae73f31641a1e583 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:39.065994 20766 consensus_queue.cc:260] T 82812175f15d4d3dae73f31641a1e583 P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:39.076391 20766 ts_tablet_manager.cc:1434] T 82812175f15d4d3dae73f31641a1e583 P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.015s user 0.005s sys 0.008s
I20251023 07:59:39.077471 20766 tablet_bootstrap.cc:492] T 35c1ea979bda45aead7d1b8539f37637 P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:39.079341 20844 heartbeater.cc:344] Connected to a master server at 127.16.126.62:42363
I20251023 07:59:39.079814 20844 heartbeater.cc:461] Registering TS with master...
I20251023 07:59:39.080804 20844 heartbeater.cc:507] Master 127.16.126.62:42363 requested a full tablet report, sending...
I20251023 07:59:39.085860 20677 raft_consensus.cc:493] T f20a7a673ce6433eac41600d3573e314 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d1379e91aa9c41629cd25262571beb2c)
I20251023 07:59:39.086978 20677 raft_consensus.cc:515] T f20a7a673ce6433eac41600d3573e314 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:39.090598 20151 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f20a7a673ce6433eac41600d3573e314" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855" is_pre_election: true
I20251023 07:59:39.097658 20677 leader_election.cc:290] T f20a7a673ce6433eac41600d3573e314 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:39.086143 20767 raft_consensus.cc:493] T 0229047af3034761a2bf168928917afb P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d1379e91aa9c41629cd25262571beb2c)
I20251023 07:59:39.098881 20767 raft_consensus.cc:515] T 0229047af3034761a2bf168928917afb P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:39.100733 20817 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f20a7a673ce6433eac41600d3573e314" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:39.101183 20767 leader_election.cc:290] T 0229047af3034761a2bf168928917afb P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:39.101773 20817 raft_consensus.cc:2468] T f20a7a673ce6433eac41600d3573e314 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65876a2b197c4ea6918f5cab47ded25c in term 1.
I20251023 07:59:39.102185 20815 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0229047af3034761a2bf168928917afb" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
W20251023 07:59:39.103592 20044 leader_election.cc:343] T 0229047af3034761a2bf168928917afb P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:39.104358 20767 raft_consensus.cc:493] T 92fae2a393404d8998ad2747fbd08cc9 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d1379e91aa9c41629cd25262571beb2c)
I20251023 07:59:39.104954 20767 raft_consensus.cc:515] T 92fae2a393404d8998ad2747fbd08cc9 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:39.106707 20745 raft_consensus.cc:493] T 076aca7c8ecb4f34af0d457fcee0e585 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d1379e91aa9c41629cd25262571beb2c)
I20251023 07:59:39.107432 20767 leader_election.cc:290] T 92fae2a393404d8998ad2747fbd08cc9 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:39.107223 20745 raft_consensus.cc:515] T 076aca7c8ecb4f34af0d457fcee0e585 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:39.108317 20224 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "92fae2a393404d8998ad2747fbd08cc9" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c" is_pre_election: true
I20251023 07:59:39.109956 20223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0229047af3034761a2bf168928917afb" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c" is_pre_election: true
I20251023 07:59:39.111245 20815 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "92fae2a393404d8998ad2747fbd08cc9" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:39.111925 20745 leader_election.cc:290] T 076aca7c8ecb4f34af0d457fcee0e585 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:39.112942 20816 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "076aca7c8ecb4f34af0d457fcee0e585" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
W20251023 07:59:39.114324 20118 leader_election.cc:343] T 076aca7c8ecb4f34af0d457fcee0e585 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Illegal state: must be running to vote when last-logged opid is not known
W20251023 07:59:39.115422 20044 leader_election.cc:343] T 92fae2a393404d8998ad2747fbd08cc9 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:39.115976 20766 tablet_bootstrap.cc:492] T 35c1ea979bda45aead7d1b8539f37637 P d1379e91aa9c41629cd25262571beb2c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:59:39.116930 20766 tablet_bootstrap.cc:492] T 35c1ea979bda45aead7d1b8539f37637 P d1379e91aa9c41629cd25262571beb2c: Bootstrap complete.
I20251023 07:59:39.116767 20043 leader_election.cc:304] T 92fae2a393404d8998ad2747fbd08cc9 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35e7d1ade024444486e63cf1b81e9626; no voters: 65876a2b197c4ea6918f5cab47ded25c, d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:39.117640 20766 ts_tablet_manager.cc:1403] T 35c1ea979bda45aead7d1b8539f37637 P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.040s user 0.023s sys 0.011s
I20251023 07:59:39.118086 20043 leader_election.cc:304] T 0229047af3034761a2bf168928917afb P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35e7d1ade024444486e63cf1b81e9626; no voters: 65876a2b197c4ea6918f5cab47ded25c, d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:39.118273 20767 raft_consensus.cc:2749] T 92fae2a393404d8998ad2747fbd08cc9 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251023 07:59:39.118909 20669 raft_consensus.cc:2749] T 0229047af3034761a2bf168928917afb P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251023 07:59:39.120149 20766 raft_consensus.cc:359] T 35c1ea979bda45aead7d1b8539f37637 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:39.120874 20766 raft_consensus.cc:740] T 35c1ea979bda45aead7d1b8539f37637 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:39.121272 20745 raft_consensus.cc:493] T bd5baee3419c4a7aa0def773845ac48a P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d1379e91aa9c41629cd25262571beb2c)
I20251023 07:59:39.121618 20766 consensus_queue.cc:260] T 35c1ea979bda45aead7d1b8539f37637 P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:39.121820 20745 raft_consensus.cc:515] T bd5baee3419c4a7aa0def773845ac48a P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:39.123586 19900 ts_manager.cc:194] Re-registered known tserver with Master: d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:39.124081 20766 ts_tablet_manager.cc:1434] T 35c1ea979bda45aead7d1b8539f37637 P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20251023 07:59:39.124882 20766 tablet_bootstrap.cc:492] T f8ceeb2a7d7d45629aee9466b149251b P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:39.125779 20192 leader_election.cc:304] T f20a7a673ce6433eac41600d3573e314 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65876a2b197c4ea6918f5cab47ded25c, d1379e91aa9c41629cd25262571beb2c; no voters: 0f412334fb994ff0ab492afde64f5855
I20251023 07:59:39.127403 20677 raft_consensus.cc:2804] T f20a7a673ce6433eac41600d3573e314 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251023 07:59:39.127346 20815 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bd5baee3419c4a7aa0def773845ac48a" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:39.127928 20677 raft_consensus.cc:493] T f20a7a673ce6433eac41600d3573e314 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Starting leader election (detected failure of leader d1379e91aa9c41629cd25262571beb2c)
I20251023 07:59:39.128355 20677 raft_consensus.cc:3060] T f20a7a673ce6433eac41600d3573e314 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:39.129815 20077 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bd5baee3419c4a7aa0def773845ac48a" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
W20251023 07:59:39.130784 20118 leader_election.cc:343] T bd5baee3419c4a7aa0def773845ac48a P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:39.134799 20116 leader_election.cc:304] T bd5baee3419c4a7aa0def773845ac48a P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855; no voters: 35e7d1ade024444486e63cf1b81e9626, d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:39.135732 20771 raft_consensus.cc:2749] T bd5baee3419c4a7aa0def773845ac48a P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251023 07:59:39.136371 20677 raft_consensus.cc:515] T f20a7a673ce6433eac41600d3573e314 P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:39.132472 20223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "076aca7c8ecb4f34af0d457fcee0e585" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c" is_pre_election: true
I20251023 07:59:39.138571 20677 leader_election.cc:290] T f20a7a673ce6433eac41600d3573e314 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 2 election: Requested vote from peers 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:39.130857 20745 leader_election.cc:290] T bd5baee3419c4a7aa0def773845ac48a P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865), 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309)
I20251023 07:59:39.139753 20117 leader_election.cc:304] T 076aca7c8ecb4f34af0d457fcee0e585 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855; no voters: 65876a2b197c4ea6918f5cab47ded25c, d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:39.140151 20817 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f20a7a673ce6433eac41600d3573e314" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c"
I20251023 07:59:39.140867 20817 raft_consensus.cc:3060] T f20a7a673ce6433eac41600d3573e314 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:39.141522 20151 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f20a7a673ce6433eac41600d3573e314" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855"
I20251023 07:59:39.142264 20732 raft_consensus.cc:493] T b7dcf1850ca541d6ab42bd11de70d8f4 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d1379e91aa9c41629cd25262571beb2c)
I20251023 07:59:39.142802 20732 raft_consensus.cc:515] T b7dcf1850ca541d6ab42bd11de70d8f4 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:39.143654 20745 raft_consensus.cc:2749] T 076aca7c8ecb4f34af0d457fcee0e585 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251023 07:59:39.144856 20732 leader_election.cc:290] T b7dcf1850ca541d6ab42bd11de70d8f4 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:39.146497 20151 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7dcf1850ca541d6ab42bd11de70d8f4" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855" is_pre_election: true
I20251023 07:59:39.146849 20816 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7dcf1850ca541d6ab42bd11de70d8f4" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:39.147447 20745 raft_consensus.cc:493] T a9d3294d54be4be29569a460be5c8887 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d1379e91aa9c41629cd25262571beb2c)
I20251023 07:59:39.147555 20816 raft_consensus.cc:2468] T b7dcf1850ca541d6ab42bd11de70d8f4 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65876a2b197c4ea6918f5cab47ded25c in term 1.
I20251023 07:59:39.147946 20745 raft_consensus.cc:515] T a9d3294d54be4be29569a460be5c8887 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:39.151003 20192 leader_election.cc:304] T b7dcf1850ca541d6ab42bd11de70d8f4 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65876a2b197c4ea6918f5cab47ded25c, d1379e91aa9c41629cd25262571beb2c; no voters:
I20251023 07:59:39.151183 20771 raft_consensus.cc:493] T b7dcf1850ca541d6ab42bd11de70d8f4 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d1379e91aa9c41629cd25262571beb2c)
I20251023 07:59:39.151734 20771 raft_consensus.cc:515] T b7dcf1850ca541d6ab42bd11de70d8f4 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:39.158234 20817 raft_consensus.cc:2468] T f20a7a673ce6433eac41600d3573e314 P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65876a2b197c4ea6918f5cab47ded25c in term 2.
I20251023 07:59:39.159339 20677 raft_consensus.cc:2804] T b7dcf1850ca541d6ab42bd11de70d8f4 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251023 07:59:39.159767 20677 raft_consensus.cc:493] T b7dcf1850ca541d6ab42bd11de70d8f4 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Starting leader election (detected failure of leader d1379e91aa9c41629cd25262571beb2c)
I20251023 07:59:39.160126 20677 raft_consensus.cc:3060] T b7dcf1850ca541d6ab42bd11de70d8f4 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:39.160940 20745 leader_election.cc:290] T a9d3294d54be4be29569a460be5c8887 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:39.163524 20815 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a9d3294d54be4be29569a460be5c8887" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:39.164464 20815 raft_consensus.cc:2468] T a9d3294d54be4be29569a460be5c8887 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f412334fb994ff0ab492afde64f5855 in term 1.
I20251023 07:59:39.166191 20118 leader_election.cc:304] T a9d3294d54be4be29569a460be5c8887 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, d1379e91aa9c41629cd25262571beb2c; no voters:
I20251023 07:59:39.167340 20745 raft_consensus.cc:2804] T a9d3294d54be4be29569a460be5c8887 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251023 07:59:39.168974 20677 raft_consensus.cc:515] T b7dcf1850ca541d6ab42bd11de70d8f4 P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:39.172008 20771 leader_election.cc:290] T b7dcf1850ca541d6ab42bd11de70d8f4 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:39.177402 20677 leader_election.cc:290] T b7dcf1850ca541d6ab42bd11de70d8f4 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 2 election: Requested vote from peers 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:39.179989 20223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a9d3294d54be4be29569a460be5c8887" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c" is_pre_election: true
I20251023 07:59:39.180035 20220 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7dcf1850ca541d6ab42bd11de70d8f4" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c" is_pre_election: true
I20251023 07:59:39.181342 20220 raft_consensus.cc:2393] T b7dcf1850ca541d6ab42bd11de70d8f4 P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f412334fb994ff0ab492afde64f5855 in current term 2: Already voted for candidate 65876a2b197c4ea6918f5cab47ded25c in this term.
I20251023 07:59:39.182149 20192 leader_election.cc:304] T f20a7a673ce6433eac41600d3573e314 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65876a2b197c4ea6918f5cab47ded25c, d1379e91aa9c41629cd25262571beb2c; no voters: 0f412334fb994ff0ab492afde64f5855
I20251023 07:59:39.183542 20677 raft_consensus.cc:493] T 076aca7c8ecb4f34af0d457fcee0e585 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d1379e91aa9c41629cd25262571beb2c)
I20251023 07:59:39.183800 20855 raft_consensus.cc:2804] T f20a7a673ce6433eac41600d3573e314 P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:59:39.169399 20745 raft_consensus.cc:493] T a9d3294d54be4be29569a460be5c8887 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d1379e91aa9c41629cd25262571beb2c)
I20251023 07:59:39.184059 20677 raft_consensus.cc:515] T 076aca7c8ecb4f34af0d457fcee0e585 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:39.184407 20855 raft_consensus.cc:697] T f20a7a673ce6433eac41600d3573e314 P 65876a2b197c4ea6918f5cab47ded25c [term 2 LEADER]: Becoming Leader. State: Replica: 65876a2b197c4ea6918f5cab47ded25c, State: Running, Role: LEADER
I20251023 07:59:39.183758 20816 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7dcf1850ca541d6ab42bd11de70d8f4" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:39.186934 20816 raft_consensus.cc:2468] T b7dcf1850ca541d6ab42bd11de70d8f4 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f412334fb994ff0ab492afde64f5855 in term 1.
I20251023 07:59:39.186100 20855 consensus_queue.cc:237] T f20a7a673ce6433eac41600d3573e314 P 65876a2b197c4ea6918f5cab47ded25c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:39.188403 20118 leader_election.cc:304] T b7dcf1850ca541d6ab42bd11de70d8f4 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, d1379e91aa9c41629cd25262571beb2c; no voters:
I20251023 07:59:39.189389 20814 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7dcf1850ca541d6ab42bd11de70d8f4" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c"
I20251023 07:59:39.187028 20151 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7dcf1850ca541d6ab42bd11de70d8f4" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855"
I20251023 07:59:39.189884 20772 raft_consensus.cc:2804] T b7dcf1850ca541d6ab42bd11de70d8f4 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251023 07:59:39.190127 20814 raft_consensus.cc:3060] T b7dcf1850ca541d6ab42bd11de70d8f4 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:39.190605 20772 raft_consensus.cc:493] T b7dcf1850ca541d6ab42bd11de70d8f4 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d1379e91aa9c41629cd25262571beb2c)
I20251023 07:59:39.191167 20772 raft_consensus.cc:3060] T b7dcf1850ca541d6ab42bd11de70d8f4 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:39.203094 20814 raft_consensus.cc:2468] T b7dcf1850ca541d6ab42bd11de70d8f4 P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65876a2b197c4ea6918f5cab47ded25c in term 2.
I20251023 07:59:39.184454 20745 raft_consensus.cc:3060] T a9d3294d54be4be29569a460be5c8887 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:39.211865 20677 leader_election.cc:290] T 076aca7c8ecb4f34af0d457fcee0e585 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:39.213050 19900 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34894
I20251023 07:59:39.217728 20192 leader_election.cc:304] T b7dcf1850ca541d6ab42bd11de70d8f4 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65876a2b197c4ea6918f5cab47ded25c, d1379e91aa9c41629cd25262571beb2c; no voters:
I20251023 07:59:39.218974 20677 raft_consensus.cc:2804] T b7dcf1850ca541d6ab42bd11de70d8f4 P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:59:39.219844 20844 heartbeater.cc:499] Master 127.16.126.62:42363 was elected leader, sending a full tablet report...
I20251023 07:59:39.220134 20677 raft_consensus.cc:697] T b7dcf1850ca541d6ab42bd11de70d8f4 P 65876a2b197c4ea6918f5cab47ded25c [term 2 LEADER]: Becoming Leader. State: Replica: 65876a2b197c4ea6918f5cab47ded25c, State: Running, Role: LEADER
I20251023 07:59:39.222530 20817 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "076aca7c8ecb4f34af0d457fcee0e585" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:39.223659 20146 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "076aca7c8ecb4f34af0d457fcee0e585" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855" is_pre_election: true
I20251023 07:59:39.224582 20146 raft_consensus.cc:2468] T 076aca7c8ecb4f34af0d457fcee0e585 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65876a2b197c4ea6918f5cab47ded25c in term 1.
W20251023 07:59:39.225839 20192 leader_election.cc:343] T 076aca7c8ecb4f34af0d457fcee0e585 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:39.227226 20189 leader_election.cc:304] T 076aca7c8ecb4f34af0d457fcee0e585 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, 65876a2b197c4ea6918f5cab47ded25c; no voters: d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:39.225668 20677 consensus_queue.cc:237] T b7dcf1850ca541d6ab42bd11de70d8f4 P 65876a2b197c4ea6918f5cab47ded25c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:39.229851 20769 raft_consensus.cc:2804] T 076aca7c8ecb4f34af0d457fcee0e585 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251023 07:59:39.230237 20769 raft_consensus.cc:493] T 076aca7c8ecb4f34af0d457fcee0e585 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Starting leader election (detected failure of leader d1379e91aa9c41629cd25262571beb2c)
I20251023 07:59:39.230593 20769 raft_consensus.cc:3060] T 076aca7c8ecb4f34af0d457fcee0e585 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:39.250226 20771 raft_consensus.cc:493] T f20a7a673ce6433eac41600d3573e314 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d1379e91aa9c41629cd25262571beb2c)
I20251023 07:59:39.251228 20771 raft_consensus.cc:515] T f20a7a673ce6433eac41600d3573e314 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:39.252279 20669 raft_consensus.cc:493] T 7060af9ee4a34ecca18900b2f272e1d1 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d1379e91aa9c41629cd25262571beb2c)
I20251023 07:59:39.253010 20669 raft_consensus.cc:515] T 7060af9ee4a34ecca18900b2f272e1d1 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:39.254796 20771 leader_election.cc:290] T f20a7a673ce6433eac41600d3573e314 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:39.255460 20669 leader_election.cc:290] T 7060af9ee4a34ecca18900b2f272e1d1 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865), 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287)
I20251023 07:59:39.259017 20817 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7060af9ee4a34ecca18900b2f272e1d1" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:39.259550 20814 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f20a7a673ce6433eac41600d3573e314" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:39.260371 20814 raft_consensus.cc:2393] T f20a7a673ce6433eac41600d3573e314 P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f412334fb994ff0ab492afde64f5855 in current term 2: Already voted for candidate 65876a2b197c4ea6918f5cab47ded25c in this term.
I20251023 07:59:39.261237 20732 raft_consensus.cc:493] T 35c1ea979bda45aead7d1b8539f37637 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d1379e91aa9c41629cd25262571beb2c)
W20251023 07:59:39.260375 20044 leader_election.cc:343] T 7060af9ee4a34ecca18900b2f272e1d1 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:39.261830 20732 raft_consensus.cc:515] T 35c1ea979bda45aead7d1b8539f37637 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:39.265270 20077 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "35c1ea979bda45aead7d1b8539f37637" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
I20251023 07:59:39.267472 20146 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7060af9ee4a34ecca18900b2f272e1d1" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855" is_pre_election: true
I20251023 07:59:39.273126 20041 leader_election.cc:304] T 7060af9ee4a34ecca18900b2f272e1d1 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35e7d1ade024444486e63cf1b81e9626; no voters: 0f412334fb994ff0ab492afde64f5855, d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:39.275116 20671 raft_consensus.cc:2749] T 7060af9ee4a34ecca18900b2f272e1d1 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251023 07:59:39.277011 20732 leader_election.cc:290] T 35c1ea979bda45aead7d1b8539f37637 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865), 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309)
I20251023 07:59:39.282501 20220 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f20a7a673ce6433eac41600d3573e314" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c" is_pre_election: true
I20251023 07:59:39.289129 20766 tablet_bootstrap.cc:492] T f8ceeb2a7d7d45629aee9466b149251b P d1379e91aa9c41629cd25262571beb2c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:59:39.290622 20814 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "35c1ea979bda45aead7d1b8539f37637" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:39.291625 20814 raft_consensus.cc:2468] T 35c1ea979bda45aead7d1b8539f37637 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65876a2b197c4ea6918f5cab47ded25c in term 1.
I20251023 07:59:39.294732 20769 raft_consensus.cc:515] T 076aca7c8ecb4f34af0d457fcee0e585 P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:39.292955 20192 leader_election.cc:304] T 35c1ea979bda45aead7d1b8539f37637 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65876a2b197c4ea6918f5cab47ded25c, d1379e91aa9c41629cd25262571beb2c; no voters: 35e7d1ade024444486e63cf1b81e9626
I20251023 07:59:39.298549 20856 raft_consensus.cc:2804] T 35c1ea979bda45aead7d1b8539f37637 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251023 07:59:39.298938 20856 raft_consensus.cc:493] T 35c1ea979bda45aead7d1b8539f37637 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Starting leader election (detected failure of leader d1379e91aa9c41629cd25262571beb2c)
I20251023 07:59:39.299260 20856 raft_consensus.cc:3060] T 35c1ea979bda45aead7d1b8539f37637 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:39.290632 20766 tablet_bootstrap.cc:492] T f8ceeb2a7d7d45629aee9466b149251b P d1379e91aa9c41629cd25262571beb2c: Bootstrap complete.
I20251023 07:59:39.302270 20766 ts_tablet_manager.cc:1403] T f8ceeb2a7d7d45629aee9466b149251b P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.178s user 0.030s sys 0.028s
I20251023 07:59:39.304844 20766 raft_consensus.cc:359] T f8ceeb2a7d7d45629aee9466b149251b P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:39.309856 20769 leader_election.cc:290] T 076aca7c8ecb4f34af0d457fcee0e585 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 2 election: Requested vote from peers 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:39.311304 20771 raft_consensus.cc:493] T fa36a9cfa4fe43418245de193502470f P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d1379e91aa9c41629cd25262571beb2c)
I20251023 07:59:39.311749 20814 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "076aca7c8ecb4f34af0d457fcee0e585" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c"
I20251023 07:59:39.311909 20771 raft_consensus.cc:515] T fa36a9cfa4fe43418245de193502470f P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
W20251023 07:59:39.313694 20192 leader_election.cc:343] T 076aca7c8ecb4f34af0d457fcee0e585 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:39.309928 20766 raft_consensus.cc:740] T f8ceeb2a7d7d45629aee9466b149251b P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:39.315068 20769 raft_consensus.cc:493] T a9d3294d54be4be29569a460be5c8887 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d1379e91aa9c41629cd25262571beb2c)
I20251023 07:59:39.315053 20766 consensus_queue.cc:260] T f8ceeb2a7d7d45629aee9466b149251b P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:39.315650 20769 raft_consensus.cc:515] T a9d3294d54be4be29569a460be5c8887 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:39.315474 20772 raft_consensus.cc:515] T b7dcf1850ca541d6ab42bd11de70d8f4 P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:39.318022 20151 raft_consensus.cc:2393] T b7dcf1850ca541d6ab42bd11de70d8f4 P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 65876a2b197c4ea6918f5cab47ded25c in current term 2: Already voted for candidate 0f412334fb994ff0ab492afde64f5855 in this term.
I20251023 07:59:39.319235 20769 leader_election.cc:290] T a9d3294d54be4be29569a460be5c8887 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:39.320350 20814 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a9d3294d54be4be29569a460be5c8887" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:39.320333 20856 raft_consensus.cc:515] T 35c1ea979bda45aead7d1b8539f37637 P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:39.321256 20814 raft_consensus.cc:2468] T a9d3294d54be4be29569a460be5c8887 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65876a2b197c4ea6918f5cab47ded25c in term 1.
I20251023 07:59:39.323210 20862 raft_consensus.cc:493] T 7060af9ee4a34ecca18900b2f272e1d1 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d1379e91aa9c41629cd25262571beb2c)
I20251023 07:59:39.323262 20814 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "35c1ea979bda45aead7d1b8539f37637" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c"
I20251023 07:59:39.323566 20077 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "35c1ea979bda45aead7d1b8539f37637" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626"
I20251023 07:59:39.324208 20856 leader_election.cc:290] T 35c1ea979bda45aead7d1b8539f37637 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 2 election: Requested vote from peers d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865), 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309)
I20251023 07:59:39.324039 20862 raft_consensus.cc:515] T 7060af9ee4a34ecca18900b2f272e1d1 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:39.324127 20814 raft_consensus.cc:3060] T 35c1ea979bda45aead7d1b8539f37637 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:39.325606 20192 leader_election.cc:304] T a9d3294d54be4be29569a460be5c8887 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65876a2b197c4ea6918f5cab47ded25c, d1379e91aa9c41629cd25262571beb2c; no voters:
I20251023 07:59:39.326717 20856 raft_consensus.cc:2804] T a9d3294d54be4be29569a460be5c8887 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251023 07:59:39.327087 20856 raft_consensus.cc:493] T a9d3294d54be4be29569a460be5c8887 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Starting leader election (detected failure of leader d1379e91aa9c41629cd25262571beb2c)
I20251023 07:59:39.327196 20077 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7060af9ee4a34ecca18900b2f272e1d1" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
I20251023 07:59:39.327495 20856 raft_consensus.cc:3060] T a9d3294d54be4be29569a460be5c8887 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:39.327811 20077 raft_consensus.cc:2468] T 7060af9ee4a34ecca18900b2f272e1d1 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f412334fb994ff0ab492afde64f5855 in term 1.
I20251023 07:59:39.328763 20116 leader_election.cc:304] T 7060af9ee4a34ecca18900b2f272e1d1 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, 35e7d1ade024444486e63cf1b81e9626; no voters:
I20251023 07:59:39.329514 20862 leader_election.cc:290] T 7060af9ee4a34ecca18900b2f272e1d1 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865), 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309)
I20251023 07:59:39.330057 20862 raft_consensus.cc:2804] T 7060af9ee4a34ecca18900b2f272e1d1 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251023 07:59:39.330368 20862 raft_consensus.cc:493] T 7060af9ee4a34ecca18900b2f272e1d1 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d1379e91aa9c41629cd25262571beb2c)
I20251023 07:59:39.330718 20862 raft_consensus.cc:3060] T 7060af9ee4a34ecca18900b2f272e1d1 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:39.336339 20766 ts_tablet_manager.cc:1434] T f8ceeb2a7d7d45629aee9466b149251b P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.034s user 0.007s sys 0.000s
I20251023 07:59:39.337514 20766 tablet_bootstrap.cc:492] T c3527495b334413f82d0eca2c4d117b1 P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:39.340889 20817 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7060af9ee4a34ecca18900b2f272e1d1" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:39.342096 20814 raft_consensus.cc:2468] T 35c1ea979bda45aead7d1b8539f37637 P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65876a2b197c4ea6918f5cab47ded25c in term 2.
I20251023 07:59:39.343226 20767 raft_consensus.cc:493] T 35c1ea979bda45aead7d1b8539f37637 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d1379e91aa9c41629cd25262571beb2c)
I20251023 07:59:39.343775 20767 raft_consensus.cc:515] T 35c1ea979bda45aead7d1b8539f37637 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:39.344648 20860 raft_consensus.cc:493] T f1da9b379f264014adfbf37b2660285b P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d1379e91aa9c41629cd25262571beb2c)
I20251023 07:59:39.345173 20860 raft_consensus.cc:515] T f1da9b379f264014adfbf37b2660285b P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:39.345829 20767 leader_election.cc:290] T 35c1ea979bda45aead7d1b8539f37637 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
W20251023 07:59:39.346052 20118 leader_election.cc:343] T 7060af9ee4a34ecca18900b2f272e1d1 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:39.347134 20860 leader_election.cc:290] T f1da9b379f264014adfbf37b2660285b P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:39.347522 20223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "35c1ea979bda45aead7d1b8539f37637" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c" is_pre_election: true
I20251023 07:59:39.356748 20223 raft_consensus.cc:2393] T 35c1ea979bda45aead7d1b8539f37637 P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35e7d1ade024444486e63cf1b81e9626 in current term 2: Already voted for candidate 65876a2b197c4ea6918f5cab47ded25c in this term.
I20251023 07:59:39.351063 20856 raft_consensus.cc:515] T a9d3294d54be4be29569a460be5c8887 P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:39.358649 20856 leader_election.cc:290] T a9d3294d54be4be29569a460be5c8887 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 2 election: Requested vote from peers 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:39.359681 20146 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a9d3294d54be4be29569a460be5c8887" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855" is_pre_election: true
I20251023 07:59:39.361446 20772 leader_election.cc:290] T b7dcf1850ca541d6ab42bd11de70d8f4 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 2 election: Requested vote from peers 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:39.363047 20145 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a9d3294d54be4be29569a460be5c8887" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855"
I20251023 07:59:39.364790 20117 leader_election.cc:304] T f20a7a673ce6433eac41600d3573e314 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855; no voters: 65876a2b197c4ea6918f5cab47ded25c, d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:39.355569 20817 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "35c1ea979bda45aead7d1b8539f37637" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:39.369352 20862 raft_consensus.cc:515] T 7060af9ee4a34ecca18900b2f272e1d1 P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:39.370604 20817 raft_consensus.cc:2393] T 35c1ea979bda45aead7d1b8539f37637 P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35e7d1ade024444486e63cf1b81e9626 in current term 2: Already voted for candidate 65876a2b197c4ea6918f5cab47ded25c in this term.
I20251023 07:59:39.354156 20771 leader_election.cc:290] T fa36a9cfa4fe43418245de193502470f P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:39.371932 20044 leader_election.cc:304] T 35c1ea979bda45aead7d1b8539f37637 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35e7d1ade024444486e63cf1b81e9626; no voters: 65876a2b197c4ea6918f5cab47ded25c, d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:39.372498 20771 raft_consensus.cc:3060] T f20a7a673ce6433eac41600d3573e314 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:39.373273 20817 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a9d3294d54be4be29569a460be5c8887" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c"
I20251023 07:59:39.373529 20077 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7060af9ee4a34ecca18900b2f272e1d1" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626"
I20251023 07:59:39.374051 20077 raft_consensus.cc:3060] T 7060af9ee4a34ecca18900b2f272e1d1 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:39.374293 20192 leader_election.cc:304] T 35c1ea979bda45aead7d1b8539f37637 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65876a2b197c4ea6918f5cab47ded25c, d1379e91aa9c41629cd25262571beb2c; no voters: 35e7d1ade024444486e63cf1b81e9626
I20251023 07:59:39.376888 19900 catalog_manager.cc:5649] T f20a7a673ce6433eac41600d3573e314 P 65876a2b197c4ea6918f5cab47ded25c reported cstate change: term changed from 1 to 2, leader changed from d1379e91aa9c41629cd25262571beb2c (127.16.126.1) to 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4). New cstate: current_term: 2 leader_uuid: "65876a2b197c4ea6918f5cab47ded25c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:39.377671 20814 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f1da9b379f264014adfbf37b2660285b" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:39.378306 20814 raft_consensus.cc:2468] T f1da9b379f264014adfbf37b2660285b P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f412334fb994ff0ab492afde64f5855 in term 1.
I20251023 07:59:39.378657 20677 raft_consensus.cc:2804] T 35c1ea979bda45aead7d1b8539f37637 P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:59:39.379168 20677 raft_consensus.cc:697] T 35c1ea979bda45aead7d1b8539f37637 P 65876a2b197c4ea6918f5cab47ded25c [term 2 LEADER]: Becoming Leader. State: Replica: 65876a2b197c4ea6918f5cab47ded25c, State: Running, Role: LEADER
I20251023 07:59:39.379968 20677 consensus_queue.cc:237] T 35c1ea979bda45aead7d1b8539f37637 P 65876a2b197c4ea6918f5cab47ded25c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:39.381594 20859 raft_consensus.cc:3060] T 35c1ea979bda45aead7d1b8539f37637 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:39.371796 20862 leader_election.cc:290] T 7060af9ee4a34ecca18900b2f272e1d1 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 2 election: Requested vote from peers d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865), 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309)
I20251023 07:59:39.382579 20769 raft_consensus.cc:493] T f1da9b379f264014adfbf37b2660285b P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d1379e91aa9c41629cd25262571beb2c)
I20251023 07:59:39.383213 20769 raft_consensus.cc:515] T f1da9b379f264014adfbf37b2660285b P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:39.385540 20769 leader_election.cc:290] T f1da9b379f264014adfbf37b2660285b P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:39.387769 20814 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f1da9b379f264014adfbf37b2660285b" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:39.388470 20814 raft_consensus.cc:2468] T f1da9b379f264014adfbf37b2660285b P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65876a2b197c4ea6918f5cab47ded25c in term 1.
I20251023 07:59:39.389989 20192 leader_election.cc:304] T f1da9b379f264014adfbf37b2660285b P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65876a2b197c4ea6918f5cab47ded25c, d1379e91aa9c41629cd25262571beb2c; no voters:
I20251023 07:59:39.391084 20732 raft_consensus.cc:493] T 92fae2a393404d8998ad2747fbd08cc9 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d1379e91aa9c41629cd25262571beb2c)
I20251023 07:59:39.391680 20732 raft_consensus.cc:515] T 92fae2a393404d8998ad2747fbd08cc9 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:39.374051 20817 raft_consensus.cc:3060] T a9d3294d54be4be29569a460be5c8887 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:39.368588 20745 raft_consensus.cc:515] T a9d3294d54be4be29569a460be5c8887 P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
W20251023 07:59:39.369618 20041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.126.3:33287, user_credentials={real_user=slave}} blocked reactor thread for 96606.1us
I20251023 07:59:39.355489 20151 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "076aca7c8ecb4f34af0d457fcee0e585" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855"
I20251023 07:59:39.371068 20767 raft_consensus.cc:493] T fb985a87f45d43d68b172b937404e770 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d1379e91aa9c41629cd25262571beb2c)
I20251023 07:59:39.393882 20151 raft_consensus.cc:3060] T 076aca7c8ecb4f34af0d457fcee0e585 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:39.393958 20767 raft_consensus.cc:515] T fb985a87f45d43d68b172b937404e770 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:39.396131 20075 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "92fae2a393404d8998ad2747fbd08cc9" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
I20251023 07:59:39.396764 20075 raft_consensus.cc:2468] T 92fae2a393404d8998ad2747fbd08cc9 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65876a2b197c4ea6918f5cab47ded25c in term 1.
I20251023 07:59:39.393903 20732 leader_election.cc:290] T 92fae2a393404d8998ad2747fbd08cc9 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865), 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309)
I20251023 07:59:39.396131 20677 raft_consensus.cc:2804] T f1da9b379f264014adfbf37b2660285b P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251023 07:59:39.397957 20677 raft_consensus.cc:493] T f1da9b379f264014adfbf37b2660285b P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Starting leader election (detected failure of leader d1379e91aa9c41629cd25262571beb2c)
I20251023 07:59:39.398319 20677 raft_consensus.cc:3060] T f1da9b379f264014adfbf37b2660285b P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:39.398365 20190 leader_election.cc:304] T 92fae2a393404d8998ad2747fbd08cc9 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35e7d1ade024444486e63cf1b81e9626, 65876a2b197c4ea6918f5cab47ded25c; no voters:
I20251023 07:59:39.398909 20767 leader_election.cc:290] T fb985a87f45d43d68b172b937404e770 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865), 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287)
I20251023 07:59:39.399312 20732 raft_consensus.cc:2804] T 92fae2a393404d8998ad2747fbd08cc9 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251023 07:59:39.399703 20732 raft_consensus.cc:493] T 92fae2a393404d8998ad2747fbd08cc9 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Starting leader election (detected failure of leader d1379e91aa9c41629cd25262571beb2c)
I20251023 07:59:39.400060 20732 raft_consensus.cc:3060] T 92fae2a393404d8998ad2747fbd08cc9 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:39.396535 20814 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fa36a9cfa4fe43418245de193502470f" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:39.401223 20816 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fb985a87f45d43d68b172b937404e770" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:39.403259 20859 raft_consensus.cc:2749] T 35c1ea979bda45aead7d1b8539f37637 P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20251023 07:59:39.403872 20044 leader_election.cc:343] T fb985a87f45d43d68b172b937404e770 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:39.401103 20077 raft_consensus.cc:2468] T 7060af9ee4a34ecca18900b2f272e1d1 P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f412334fb994ff0ab492afde64f5855 in term 2.
I20251023 07:59:39.405918 20816 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "92fae2a393404d8998ad2747fbd08cc9" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:39.406036 20855 raft_consensus.cc:493] T fa36a9cfa4fe43418245de193502470f P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d1379e91aa9c41629cd25262571beb2c)
W20251023 07:59:39.407331 20192 leader_election.cc:343] T 92fae2a393404d8998ad2747fbd08cc9 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:39.408249 20855 raft_consensus.cc:515] T fa36a9cfa4fe43418245de193502470f P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:39.410326 20151 raft_consensus.cc:2468] T 076aca7c8ecb4f34af0d457fcee0e585 P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65876a2b197c4ea6918f5cab47ded25c in term 2.
I20251023 07:59:39.411929 20767 raft_consensus.cc:493] T cb866838666745f0a4462f124ac22f72 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d1379e91aa9c41629cd25262571beb2c)
I20251023 07:59:39.413287 20767 raft_consensus.cc:515] T cb866838666745f0a4462f124ac22f72 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:39.414081 20146 raft_consensus.cc:2393] T a9d3294d54be4be29569a460be5c8887 P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65876a2b197c4ea6918f5cab47ded25c in current term 2: Already voted for candidate 0f412334fb994ff0ab492afde64f5855 in this term.
I20251023 07:59:39.415293 20767 leader_election.cc:290] T cb866838666745f0a4462f124ac22f72 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:39.412614 20116 leader_election.cc:304] T 7060af9ee4a34ecca18900b2f272e1d1 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, 35e7d1ade024444486e63cf1b81e9626; no voters:
I20251023 07:59:39.417217 20223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cb866838666745f0a4462f124ac22f72" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c" is_pre_election: true
I20251023 07:59:39.417515 20863 raft_consensus.cc:2804] T 7060af9ee4a34ecca18900b2f272e1d1 P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:59:39.417907 20223 raft_consensus.cc:2468] T cb866838666745f0a4462f124ac22f72 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35e7d1ade024444486e63cf1b81e9626 in term 1.
I20251023 07:59:39.418063 20863 raft_consensus.cc:697] T 7060af9ee4a34ecca18900b2f272e1d1 P 0f412334fb994ff0ab492afde64f5855 [term 2 LEADER]: Becoming Leader. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Running, Role: LEADER
I20251023 07:59:39.416774 20816 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cb866838666745f0a4462f124ac22f72" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:39.418954 20863 consensus_queue.cc:237] T 7060af9ee4a34ecca18900b2f272e1d1 P 0f412334fb994ff0ab492afde64f5855 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:39.420157 20769 raft_consensus.cc:493] T c3527495b334413f82d0eca2c4d117b1 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d1379e91aa9c41629cd25262571beb2c)
I20251023 07:59:39.420357 20043 leader_election.cc:304] T cb866838666745f0a4462f124ac22f72 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35e7d1ade024444486e63cf1b81e9626, 65876a2b197c4ea6918f5cab47ded25c; no voters:
I20251023 07:59:39.420725 20769 raft_consensus.cc:515] T c3527495b334413f82d0eca2c4d117b1 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
W20251023 07:59:39.421447 20044 leader_election.cc:343] T cb866838666745f0a4462f124ac22f72 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:39.422641 20816 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fa36a9cfa4fe43418245de193502470f" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:39.422940 20769 leader_election.cc:290] T c3527495b334413f82d0eca2c4d117b1 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865), 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309)
I20251023 07:59:39.424053 20767 raft_consensus.cc:2804] T cb866838666745f0a4462f124ac22f72 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251023 07:59:39.424511 20767 raft_consensus.cc:493] T cb866838666745f0a4462f124ac22f72 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d1379e91aa9c41629cd25262571beb2c)
I20251023 07:59:39.424947 20767 raft_consensus.cc:3060] T cb866838666745f0a4462f124ac22f72 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Advancing to term 2
W20251023 07:59:39.425529 20192 leader_election.cc:343] T fa36a9cfa4fe43418245de193502470f P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:39.426251 20855 leader_election.cc:290] T fa36a9cfa4fe43418245de193502470f P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:39.427232 20732 raft_consensus.cc:515] T 92fae2a393404d8998ad2747fbd08cc9 P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:39.429817 20816 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c3527495b334413f82d0eca2c4d117b1" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:39.430202 20814 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "92fae2a393404d8998ad2747fbd08cc9" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c"
W20251023 07:59:39.431591 20192 leader_election.cc:343] T c3527495b334413f82d0eca2c4d117b1 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Illegal state: must be running to vote when last-logged opid is not known
W20251023 07:59:39.432217 20192 leader_election.cc:343] T 92fae2a393404d8998ad2747fbd08cc9 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:39.432960 20077 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c3527495b334413f82d0eca2c4d117b1" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
I20251023 07:59:39.434626 20190 leader_election.cc:304] T c3527495b334413f82d0eca2c4d117b1 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65876a2b197c4ea6918f5cab47ded25c; no voters: 35e7d1ade024444486e63cf1b81e9626, d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:39.435168 20817 raft_consensus.cc:2468] T a9d3294d54be4be29569a460be5c8887 P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65876a2b197c4ea6918f5cab47ded25c in term 2.
I20251023 07:59:39.435827 20855 raft_consensus.cc:2749] T c3527495b334413f82d0eca2c4d117b1 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251023 07:59:39.410364 20677 raft_consensus.cc:515] T f1da9b379f264014adfbf37b2660285b P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:39.438997 20814 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7060af9ee4a34ecca18900b2f272e1d1" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c"
I20251023 07:59:39.441882 20677 leader_election.cc:290] T f1da9b379f264014adfbf37b2660285b P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 2 election: Requested vote from peers 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:39.436674 20192 leader_election.cc:304] T a9d3294d54be4be29569a460be5c8887 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65876a2b197c4ea6918f5cab47ded25c, d1379e91aa9c41629cd25262571beb2c; no voters:
I20251023 07:59:39.443708 20677 raft_consensus.cc:2804] T a9d3294d54be4be29569a460be5c8887 P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:59:39.444195 20677 raft_consensus.cc:697] T a9d3294d54be4be29569a460be5c8887 P 65876a2b197c4ea6918f5cab47ded25c [term 2 LEADER]: Becoming Leader. State: Replica: 65876a2b197c4ea6918f5cab47ded25c, State: Running, Role: LEADER
I20251023 07:59:39.445034 20814 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f1da9b379f264014adfbf37b2660285b" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c"
I20251023 07:59:39.445035 20677 consensus_queue.cc:237] T a9d3294d54be4be29569a460be5c8887 P 65876a2b197c4ea6918f5cab47ded25c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:39.445873 20814 raft_consensus.cc:3060] T f1da9b379f264014adfbf37b2660285b P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:39.448325 20077 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "92fae2a393404d8998ad2747fbd08cc9" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626"
I20251023 07:59:39.451404 20732 leader_election.cc:290] T 92fae2a393404d8998ad2747fbd08cc9 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 2 election: Requested vote from peers d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865), 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309)
I20251023 07:59:39.451809 20771 raft_consensus.cc:2749] T f20a7a673ce6433eac41600d3573e314 P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251023 07:59:39.452245 20077 raft_consensus.cc:3060] T 92fae2a393404d8998ad2747fbd08cc9 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:39.453130 20745 leader_election.cc:290] T a9d3294d54be4be29569a460be5c8887 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 2 election: Requested vote from peers 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:39.455539 20220 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fa36a9cfa4fe43418245de193502470f" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c" is_pre_election: true
I20251023 07:59:39.457659 20814 raft_consensus.cc:2468] T f1da9b379f264014adfbf37b2660285b P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65876a2b197c4ea6918f5cab47ded25c in term 2.
I20251023 07:59:39.483242 20220 raft_consensus.cc:2468] T fa36a9cfa4fe43418245de193502470f P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f412334fb994ff0ab492afde64f5855 in term 1.
I20251023 07:59:39.459074 20222 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a9d3294d54be4be29569a460be5c8887" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c"
I20251023 07:59:39.459466 20863 raft_consensus.cc:493] T 5bc7d7ca172742d1b528af8659661c2a P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d1379e91aa9c41629cd25262571beb2c)
I20251023 07:59:39.485610 20117 leader_election.cc:304] T fa36a9cfa4fe43418245de193502470f P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, 65876a2b197c4ea6918f5cab47ded25c; no voters:
I20251023 07:59:39.485786 20863 raft_consensus.cc:515] T 5bc7d7ca172742d1b528af8659661c2a P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:39.486865 20745 raft_consensus.cc:2804] T fa36a9cfa4fe43418245de193502470f P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251023 07:59:39.487445 20745 raft_consensus.cc:493] T fa36a9cfa4fe43418245de193502470f P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d1379e91aa9c41629cd25262571beb2c)
I20251023 07:59:39.487926 20745 raft_consensus.cc:3060] T fa36a9cfa4fe43418245de193502470f P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:39.488000 20863 leader_election.cc:290] T 5bc7d7ca172742d1b528af8659661c2a P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:39.461863 20146 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f1da9b379f264014adfbf37b2660285b" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855" is_pre_election: true
I20251023 07:59:39.489209 20146 raft_consensus.cc:2468] T f1da9b379f264014adfbf37b2660285b P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65876a2b197c4ea6918f5cab47ded25c in term 1.
I20251023 07:59:39.465353 20862 raft_consensus.cc:493] T fb985a87f45d43d68b172b937404e770 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d1379e91aa9c41629cd25262571beb2c)
I20251023 07:59:39.490526 20862 raft_consensus.cc:515] T fb985a87f45d43d68b172b937404e770 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:39.468096 20118 leader_election.cc:304] T f1da9b379f264014adfbf37b2660285b P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, d1379e91aa9c41629cd25262571beb2c; no voters:
I20251023 07:59:39.492494 20862 leader_election.cc:290] T fb985a87f45d43d68b172b937404e770 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865), 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309)
W20251023 07:59:39.492941 20118 leader_election.cc:343] T fa36a9cfa4fe43418245de193502470f P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:39.469789 20145 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fa36a9cfa4fe43418245de193502470f" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855" is_pre_election: true
I20251023 07:59:39.470404 20151 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f1da9b379f264014adfbf37b2660285b" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855"
W20251023 07:59:39.493981 20118 leader_election.cc:343] T 7060af9ee4a34ecca18900b2f272e1d1 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:39.493027 20862 raft_consensus.cc:2804] T f1da9b379f264014adfbf37b2660285b P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251023 07:59:39.495164 20862 raft_consensus.cc:493] T f1da9b379f264014adfbf37b2660285b P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d1379e91aa9c41629cd25262571beb2c)
I20251023 07:59:39.467832 20150 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fb985a87f45d43d68b172b937404e770" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855" is_pre_election: true
I20251023 07:59:39.495551 20862 raft_consensus.cc:3060] T f1da9b379f264014adfbf37b2660285b P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:39.496016 20150 raft_consensus.cc:2468] T fb985a87f45d43d68b172b937404e770 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35e7d1ade024444486e63cf1b81e9626 in term 1.
I20251023 07:59:39.454734 20223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f1da9b379f264014adfbf37b2660285b" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c" is_pre_election: true
I20251023 07:59:39.497581 20223 raft_consensus.cc:2393] T f1da9b379f264014adfbf37b2660285b P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f412334fb994ff0ab492afde64f5855 in current term 2: Already voted for candidate 65876a2b197c4ea6918f5cab47ded25c in this term.
I20251023 07:59:39.497802 20745 raft_consensus.cc:515] T fa36a9cfa4fe43418245de193502470f P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:39.499169 20145 raft_consensus.cc:2393] T fa36a9cfa4fe43418245de193502470f P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65876a2b197c4ea6918f5cab47ded25c in current term 2: Already voted for candidate 0f412334fb994ff0ab492afde64f5855 in this term.
I20251023 07:59:39.503099 20041 leader_election.cc:304] T fb985a87f45d43d68b172b937404e770 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, 35e7d1ade024444486e63cf1b81e9626; no voters: d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:39.505541 20814 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a9d3294d54be4be29569a460be5c8887" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c"
I20251023 07:59:39.506544 20814 raft_consensus.cc:2393] T a9d3294d54be4be29569a460be5c8887 P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f412334fb994ff0ab492afde64f5855 in current term 2: Already voted for candidate 65876a2b197c4ea6918f5cab47ded25c in this term.
I20251023 07:59:39.507759 20815 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fb985a87f45d43d68b172b937404e770" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:39.509964 20077 raft_consensus.cc:2468] T 92fae2a393404d8998ad2747fbd08cc9 P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65876a2b197c4ea6918f5cab47ded25c in term 2.
I20251023 07:59:39.514847 20671 raft_consensus.cc:2804] T fb985a87f45d43d68b172b937404e770 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251023 07:59:39.515101 20816 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5bc7d7ca172742d1b528af8659661c2a" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:39.515911 20816 raft_consensus.cc:2468] T 5bc7d7ca172742d1b528af8659661c2a P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f412334fb994ff0ab492afde64f5855 in term 1.
I20251023 07:59:39.516194 20190 leader_election.cc:304] T 92fae2a393404d8998ad2747fbd08cc9 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35e7d1ade024444486e63cf1b81e9626, 65876a2b197c4ea6918f5cab47ded25c; no voters: d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:39.515314 20671 raft_consensus.cc:493] T fb985a87f45d43d68b172b937404e770 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d1379e91aa9c41629cd25262571beb2c)
I20251023 07:59:39.517220 20671 raft_consensus.cc:3060] T fb985a87f45d43d68b172b937404e770 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:39.517349 20677 raft_consensus.cc:2804] T 92fae2a393404d8998ad2747fbd08cc9 P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:59:39.517961 20677 raft_consensus.cc:697] T 92fae2a393404d8998ad2747fbd08cc9 P 65876a2b197c4ea6918f5cab47ded25c [term 2 LEADER]: Becoming Leader. State: Replica: 65876a2b197c4ea6918f5cab47ded25c, State: Running, Role: LEADER
I20251023 07:59:39.519018 20677 consensus_queue.cc:237] T 92fae2a393404d8998ad2747fbd08cc9 P 65876a2b197c4ea6918f5cab47ded25c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:39.455780 20189 leader_election.cc:304] T 076aca7c8ecb4f34af0d457fcee0e585 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, 65876a2b197c4ea6918f5cab47ded25c; no voters: d1379e91aa9c41629cd25262571beb2c
W20251023 07:59:39.524003 20189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.126.3:33287, user_credentials={real_user=slave}} blocked reactor thread for 68300.1us
I20251023 07:59:39.456241 20224 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7dcf1850ca541d6ab42bd11de70d8f4" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c"
W20251023 07:59:39.525768 20118 leader_election.cc:343] T fb985a87f45d43d68b172b937404e770 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:39.526437 20118 leader_election.cc:304] T 5bc7d7ca172742d1b528af8659661c2a P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, d1379e91aa9c41629cd25262571beb2c; no voters:
I20251023 07:59:39.458897 20859 raft_consensus.cc:493] T bd5baee3419c4a7aa0def773845ac48a P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d1379e91aa9c41629cd25262571beb2c)
I20251023 07:59:39.527050 20859 raft_consensus.cc:515] T bd5baee3419c4a7aa0def773845ac48a P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:39.485280 20192 leader_election.cc:304] T f1da9b379f264014adfbf37b2660285b P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65876a2b197c4ea6918f5cab47ded25c, d1379e91aa9c41629cd25262571beb2c; no voters:
I20251023 07:59:39.478065 20766 tablet_bootstrap.cc:492] T c3527495b334413f82d0eca2c4d117b1 P d1379e91aa9c41629cd25262571beb2c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:59:39.529084 20859 leader_election.cc:290] T bd5baee3419c4a7aa0def773845ac48a P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865), 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287)
W20251023 07:59:39.531028 20192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.126.1:37865, user_credentials={real_user=slave}} blocked reactor thread for 45869.8us
I20251023 07:59:39.533566 20224 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5bc7d7ca172742d1b528af8659661c2a" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c" is_pre_election: true
I20251023 07:59:39.533861 20117 leader_election.cc:304] T a9d3294d54be4be29569a460be5c8887 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855; no voters: 65876a2b197c4ea6918f5cab47ded25c, d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:39.534924 20863 raft_consensus.cc:2749] T a9d3294d54be4be29569a460be5c8887 P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20251023 07:59:39.535061 20745 leader_election.cc:290] T fa36a9cfa4fe43418245de193502470f P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 2 election: Requested vote from peers 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:39.453496 20817 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7dcf1850ca541d6ab42bd11de70d8f4" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c"
I20251023 07:59:39.537842 20817 raft_consensus.cc:2393] T b7dcf1850ca541d6ab42bd11de70d8f4 P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f412334fb994ff0ab492afde64f5855 in current term 2: Already voted for candidate 65876a2b197c4ea6918f5cab47ded25c in this term.
I20251023 07:59:39.529124 20766 tablet_bootstrap.cc:492] T c3527495b334413f82d0eca2c4d117b1 P d1379e91aa9c41629cd25262571beb2c: Bootstrap complete.
I20251023 07:59:39.539054 20118 leader_election.cc:304] T b7dcf1850ca541d6ab42bd11de70d8f4 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855; no voters: 65876a2b197c4ea6918f5cab47ded25c, d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:39.539956 20766 ts_tablet_manager.cc:1403] T c3527495b334413f82d0eca2c4d117b1 P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.203s user 0.027s sys 0.031s
I20251023 07:59:39.540444 20816 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fa36a9cfa4fe43418245de193502470f" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c"
I20251023 07:59:39.543365 20766 raft_consensus.cc:359] T c3527495b334413f82d0eca2c4d117b1 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:39.544126 20772 raft_consensus.cc:2749] T b7dcf1850ca541d6ab42bd11de70d8f4 P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20251023 07:59:39.544380 20766 raft_consensus.cc:740] T c3527495b334413f82d0eca2c4d117b1 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:39.530051 20769 raft_consensus.cc:2804] T 076aca7c8ecb4f34af0d457fcee0e585 P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:59:39.545564 20769 raft_consensus.cc:697] T 076aca7c8ecb4f34af0d457fcee0e585 P 65876a2b197c4ea6918f5cab47ded25c [term 2 LEADER]: Becoming Leader. State: Replica: 65876a2b197c4ea6918f5cab47ded25c, State: Running, Role: LEADER
I20251023 07:59:39.546711 20769 consensus_queue.cc:237] T 076aca7c8ecb4f34af0d457fcee0e585 P 65876a2b197c4ea6918f5cab47ded25c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:39.552525 20223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fa36a9cfa4fe43418245de193502470f" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c"
I20251023 07:59:39.553412 20223 raft_consensus.cc:3060] T fa36a9cfa4fe43418245de193502470f P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:39.530541 20189 leader_election.cc:304] T fa36a9cfa4fe43418245de193502470f P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65876a2b197c4ea6918f5cab47ded25c; no voters: 0f412334fb994ff0ab492afde64f5855, d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:39.531222 20855 raft_consensus.cc:2804] T f1da9b379f264014adfbf37b2660285b P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:59:39.555056 20862 raft_consensus.cc:515] T f1da9b379f264014adfbf37b2660285b P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:39.555866 20855 raft_consensus.cc:697] T f1da9b379f264014adfbf37b2660285b P 65876a2b197c4ea6918f5cab47ded25c [term 2 LEADER]: Becoming Leader. State: Replica: 65876a2b197c4ea6918f5cab47ded25c, State: Running, Role: LEADER
I20251023 07:59:39.556460 20151 raft_consensus.cc:2393] T f1da9b379f264014adfbf37b2660285b P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 65876a2b197c4ea6918f5cab47ded25c in current term 2: Already voted for candidate 0f412334fb994ff0ab492afde64f5855 in this term.
I20251023 07:59:39.529172 20731 raft_consensus.cc:2804] T 5bc7d7ca172742d1b528af8659661c2a P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251023 07:59:39.557979 20731 raft_consensus.cc:493] T 5bc7d7ca172742d1b528af8659661c2a P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d1379e91aa9c41629cd25262571beb2c)
I20251023 07:59:39.557298 20855 consensus_queue.cc:237] T f1da9b379f264014adfbf37b2660285b P 65876a2b197c4ea6918f5cab47ded25c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:39.543447 19897 catalog_manager.cc:5649] T 7060af9ee4a34ecca18900b2f272e1d1 P 0f412334fb994ff0ab492afde64f5855 reported cstate change: term changed from 1 to 2, leader changed from d1379e91aa9c41629cd25262571beb2c (127.16.126.1) to 0f412334fb994ff0ab492afde64f5855 (127.16.126.3). New cstate: current_term: 2 leader_uuid: "0f412334fb994ff0ab492afde64f5855" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } health_report { overall_health: HEALTHY } } }
I20251023 07:59:39.558437 20731 raft_consensus.cc:3060] T 5bc7d7ca172742d1b528af8659661c2a P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:39.471210 20767 raft_consensus.cc:515] T cb866838666745f0a4462f124ac22f72 P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
W20251023 07:59:39.543447 20118 leader_election.cc:343] T fa36a9cfa4fe43418245de193502470f P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:39.573688 20766 consensus_queue.cc:260] T c3527495b334413f82d0eca2c4d117b1 P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:39.579927 20766 ts_tablet_manager.cc:1434] T c3527495b334413f82d0eca2c4d117b1 P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.040s user 0.008s sys 0.000s
I20251023 07:59:39.581728 20766 tablet_bootstrap.cc:492] T 2ff74dfb94334c20b99ea84b985a27a5 P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:39.583505 20077 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fb985a87f45d43d68b172b937404e770" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
I20251023 07:59:39.566455 20732 raft_consensus.cc:493] T 0229047af3034761a2bf168928917afb P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d1379e91aa9c41629cd25262571beb2c)
I20251023 07:59:39.599403 20223 raft_consensus.cc:2468] T fa36a9cfa4fe43418245de193502470f P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f412334fb994ff0ab492afde64f5855 in term 2.
I20251023 07:59:39.588587 20224 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cb866838666745f0a4462f124ac22f72" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c"
I20251023 07:59:39.600684 20856 raft_consensus.cc:2749] T fa36a9cfa4fe43418245de193502470f P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20251023 07:59:39.621738 20041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.126.3:33287, user_credentials={real_user=slave}} blocked reactor thread for 118732us
I20251023 07:59:39.626845 20859 raft_consensus.cc:493] T c3527495b334413f82d0eca2c4d117b1 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d1379e91aa9c41629cd25262571beb2c)
I20251023 07:59:39.621443 20224 raft_consensus.cc:3060] T cb866838666745f0a4462f124ac22f72 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:39.627388 20859 raft_consensus.cc:515] T c3527495b334413f82d0eca2c4d117b1 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:39.613294 20767 leader_election.cc:290] T cb866838666745f0a4462f124ac22f72 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 2 election: Requested vote from peers 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:39.611093 20732 raft_consensus.cc:515] T 0229047af3034761a2bf168928917afb P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:39.616062 20671 raft_consensus.cc:515] T fb985a87f45d43d68b172b937404e770 P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:39.646607 20816 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bd5baee3419c4a7aa0def773845ac48a" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:39.648870 20855 raft_consensus.cc:493] T 5bc7d7ca172742d1b528af8659661c2a P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d1379e91aa9c41629cd25262571beb2c)
I20251023 07:59:39.629375 20859 leader_election.cc:290] T c3527495b334413f82d0eca2c4d117b1 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:39.666369 20117 leader_election.cc:304] T fa36a9cfa4fe43418245de193502470f P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, 65876a2b197c4ea6918f5cab47ded25c; no voters: d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:39.667410 20077 raft_consensus.cc:2393] T fb985a87f45d43d68b172b937404e770 P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f412334fb994ff0ab492afde64f5855 in current term 2: Already voted for candidate 35e7d1ade024444486e63cf1b81e9626 in this term.
I20251023 07:59:39.663712 20145 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bd5baee3419c4a7aa0def773845ac48a" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855" is_pre_election: true
I20251023 07:59:39.665202 20855 raft_consensus.cc:515] T 5bc7d7ca172742d1b528af8659661c2a P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
W20251023 07:59:39.712098 20117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.126.4:34955, user_credentials={real_user=slave}} blocked reactor thread for 45813.8us
I20251023 07:59:39.683463 20862 leader_election.cc:290] T f1da9b379f264014adfbf37b2660285b P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 2 election: Requested vote from peers 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:39.706629 20745 raft_consensus.cc:2804] T fa36a9cfa4fe43418245de193502470f P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:59:39.707139 20145 raft_consensus.cc:2468] T bd5baee3419c4a7aa0def773845ac48a P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35e7d1ade024444486e63cf1b81e9626 in term 1.
I20251023 07:59:39.711550 20222 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f1da9b379f264014adfbf37b2660285b" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c"
W20251023 07:59:39.726461 20875 log.cc:927] Time spent T 92fae2a393404d8998ad2747fbd08cc9 P 65876a2b197c4ea6918f5cab47ded25c: Append to log took a long time: real 0.096s user 0.001s sys 0.000s
I20251023 07:59:39.736959 20224 raft_consensus.cc:2468] T cb866838666745f0a4462f124ac22f72 P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35e7d1ade024444486e63cf1b81e9626 in term 2.
W20251023 07:59:39.739503 20189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.3:33287, user_credentials={real_user=slave}} blocked reactor thread for 87019.1us
I20251023 07:59:39.722040 20745 raft_consensus.cc:697] T fa36a9cfa4fe43418245de193502470f P 0f412334fb994ff0ab492afde64f5855 [term 2 LEADER]: Becoming Leader. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Running, Role: LEADER
I20251023 07:59:39.741855 20745 consensus_queue.cc:237] T fa36a9cfa4fe43418245de193502470f P 0f412334fb994ff0ab492afde64f5855 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:39.746004 19901 catalog_manager.cc:5649] T b7dcf1850ca541d6ab42bd11de70d8f4 P 65876a2b197c4ea6918f5cab47ded25c reported cstate change: term changed from 1 to 2, leader changed from d1379e91aa9c41629cd25262571beb2c (127.16.126.1) to 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4). New cstate: current_term: 2 leader_uuid: "65876a2b197c4ea6918f5cab47ded25c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:39.753101 19901 catalog_manager.cc:5649] T 35c1ea979bda45aead7d1b8539f37637 P 65876a2b197c4ea6918f5cab47ded25c reported cstate change: term changed from 1 to 2, leader changed from d1379e91aa9c41629cd25262571beb2c (127.16.126.1) to 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4). New cstate: current_term: 2 leader_uuid: "65876a2b197c4ea6918f5cab47ded25c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:39.744508 20811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f1da9b379f264014adfbf37b2660285b" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c"
I20251023 07:59:39.758903 20116 leader_election.cc:304] T fb985a87f45d43d68b172b937404e770 P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855; no voters: 35e7d1ade024444486e63cf1b81e9626, d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:39.733772 20817 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cb866838666745f0a4462f124ac22f72" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c"
I20251023 07:59:39.755745 19901 catalog_manager.cc:5649] T a9d3294d54be4be29569a460be5c8887 P 65876a2b197c4ea6918f5cab47ded25c reported cstate change: term changed from 1 to 2, leader changed from d1379e91aa9c41629cd25262571beb2c (127.16.126.1) to 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4). New cstate: current_term: 2 leader_uuid: "65876a2b197c4ea6918f5cab47ded25c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:39.722113 20731 raft_consensus.cc:515] T 5bc7d7ca172742d1b528af8659661c2a P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:39.773361 20811 raft_consensus.cc:2393] T f1da9b379f264014adfbf37b2660285b P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f412334fb994ff0ab492afde64f5855 in current term 2: Already voted for candidate 65876a2b197c4ea6918f5cab47ded25c in this term.
I20251023 07:59:39.773572 20813 raft_consensus.cc:1275] T f20a7a673ce6433eac41600d3573e314 P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Refusing update from remote peer 65876a2b197c4ea6918f5cab47ded25c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:39.772333 19901 catalog_manager.cc:5649] T 92fae2a393404d8998ad2747fbd08cc9 P 65876a2b197c4ea6918f5cab47ded25c reported cstate change: term changed from 1 to 2, leader changed from d1379e91aa9c41629cd25262571beb2c (127.16.126.1) to 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4). New cstate: current_term: 2 leader_uuid: "65876a2b197c4ea6918f5cab47ded25c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:39.777288 20881 raft_consensus.cc:3060] T fb985a87f45d43d68b172b937404e770 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:39.778141 20671 leader_election.cc:290] T fb985a87f45d43d68b172b937404e770 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 2 election: Requested vote from peers d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865), 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287)
I20251023 07:59:39.784247 20732 leader_election.cc:290] T 0229047af3034761a2bf168928917afb P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865), 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309)
W20251023 07:59:39.788445 20044 leader_election.cc:343] T bd5baee3419c4a7aa0def773845ac48a P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:39.796233 20731 leader_election.cc:290] T 5bc7d7ca172742d1b528af8659661c2a P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 2 election: Requested vote from peers 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:39.798791 20855 leader_election.cc:290] T 5bc7d7ca172742d1b528af8659661c2a P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:39.799777 20814 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c3527495b334413f82d0eca2c4d117b1" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:39.800534 20814 raft_consensus.cc:2468] T c3527495b334413f82d0eca2c4d117b1 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35e7d1ade024444486e63cf1b81e9626 in term 1.
I20251023 07:59:39.801961 20816 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fb985a87f45d43d68b172b937404e770" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c"
I20251023 07:59:39.804833 20732 consensus_queue.cc:1048] T f20a7a673ce6433eac41600d3573e314 P 65876a2b197c4ea6918f5cab47ded25c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:39.807286 20813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5bc7d7ca172742d1b528af8659661c2a" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:39.808059 20813 raft_consensus.cc:2468] T 5bc7d7ca172742d1b528af8659661c2a P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65876a2b197c4ea6918f5cab47ded25c in term 1.
I20251023 07:59:39.809319 20811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0229047af3034761a2bf168928917afb" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c" is_pre_election: true
I20251023 07:59:39.824991 20192 leader_election.cc:304] T 5bc7d7ca172742d1b528af8659661c2a P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65876a2b197c4ea6918f5cab47ded25c, d1379e91aa9c41629cd25262571beb2c; no voters:
W20251023 07:59:39.825937 20192 leader_election.cc:343] T 0229047af3034761a2bf168928917afb P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:39.826386 20888 raft_consensus.cc:2804] T 5bc7d7ca172742d1b528af8659661c2a P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251023 07:59:39.826818 20888 raft_consensus.cc:493] T 5bc7d7ca172742d1b528af8659661c2a P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Starting leader election (detected failure of leader d1379e91aa9c41629cd25262571beb2c)
I20251023 07:59:39.827185 20888 raft_consensus.cc:3060] T 5bc7d7ca172742d1b528af8659661c2a P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:39.827386 20815 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5bc7d7ca172742d1b528af8659661c2a" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c"
I20251023 07:59:39.828063 20815 raft_consensus.cc:3060] T 5bc7d7ca172742d1b528af8659661c2a P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:39.837320 19897 catalog_manager.cc:5649] T fa36a9cfa4fe43418245de193502470f P 0f412334fb994ff0ab492afde64f5855 reported cstate change: term changed from 1 to 2, leader changed from d1379e91aa9c41629cd25262571beb2c (127.16.126.1) to 0f412334fb994ff0ab492afde64f5855 (127.16.126.3). New cstate: current_term: 2 leader_uuid: "0f412334fb994ff0ab492afde64f5855" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: UNKNOWN } } }
W20251023 07:59:39.841379 20118 consensus_peers.cc:597] T 7060af9ee4a34ecca18900b2f272e1d1 P 0f412334fb994ff0ab492afde64f5855 -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20251023 07:59:39.853463 20044 leader_election.cc:343] T cb866838666745f0a4462f124ac22f72 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:39.855105 20044 leader_election.cc:304] T c3527495b334413f82d0eca2c4d117b1 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35e7d1ade024444486e63cf1b81e9626, d1379e91aa9c41629cd25262571beb2c; no voters:
W20251023 07:59:39.856846 20117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.4:34955, user_credentials={real_user=slave}} blocked reactor thread for 124995us
W20251023 07:59:39.866110 20044 leader_election.cc:343] T fb985a87f45d43d68b172b937404e770 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Illegal state: must be running to vote when last-logged opid is not known
W20251023 07:59:39.866466 20116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.126.2:42309, user_credentials={real_user=slave}} blocked reactor thread for 106534us
I20251023 07:59:39.866482 20223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c3527495b334413f82d0eca2c4d117b1" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c" is_pre_election: true
I20251023 07:59:39.861104 19901 catalog_manager.cc:5649] T 076aca7c8ecb4f34af0d457fcee0e585 P 65876a2b197c4ea6918f5cab47ded25c reported cstate change: term changed from 1 to 2, leader changed from d1379e91aa9c41629cd25262571beb2c (127.16.126.1) to 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4). New cstate: current_term: 2 leader_uuid: "65876a2b197c4ea6918f5cab47ded25c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:39.868446 20223 raft_consensus.cc:2468] T c3527495b334413f82d0eca2c4d117b1 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35e7d1ade024444486e63cf1b81e9626 in term 1.
I20251023 07:59:39.869676 19901 catalog_manager.cc:5649] T f1da9b379f264014adfbf37b2660285b P 65876a2b197c4ea6918f5cab47ded25c reported cstate change: term changed from 1 to 2, leader changed from d1379e91aa9c41629cd25262571beb2c (127.16.126.1) to 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4). New cstate: current_term: 2 leader_uuid: "65876a2b197c4ea6918f5cab47ded25c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:39.874143 20151 raft_consensus.cc:1275] T b7dcf1850ca541d6ab42bd11de70d8f4 P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Refusing update from remote peer 65876a2b197c4ea6918f5cab47ded25c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:39.882906 20150 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fb985a87f45d43d68b172b937404e770" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855"
I20251023 07:59:39.892187 20874 raft_consensus.cc:2804] T c3527495b334413f82d0eca2c4d117b1 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251023 07:59:39.892861 20874 raft_consensus.cc:493] T c3527495b334413f82d0eca2c4d117b1 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d1379e91aa9c41629cd25262571beb2c)
I20251023 07:59:39.893297 20874 raft_consensus.cc:3060] T c3527495b334413f82d0eca2c4d117b1 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:39.912710 20149 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5bc7d7ca172742d1b528af8659661c2a" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855" is_pre_election: true
I20251023 07:59:39.912854 20117 leader_election.cc:304] T f1da9b379f264014adfbf37b2660285b P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855; no voters: 65876a2b197c4ea6918f5cab47ded25c, d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:39.914822 20149 raft_consensus.cc:2393] T 5bc7d7ca172742d1b528af8659661c2a P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65876a2b197c4ea6918f5cab47ded25c in current term 2: Already voted for candidate 0f412334fb994ff0ab492afde64f5855 in this term.
I20251023 07:59:39.919445 20881 raft_consensus.cc:2749] T fb985a87f45d43d68b172b937404e770 P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251023 07:59:39.915226 20771 raft_consensus.cc:2749] T f1da9b379f264014adfbf37b2660285b P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20251023 07:59:39.936038 20894 consensus_queue.cc:1048] T b7dcf1850ca541d6ab42bd11de70d8f4 P 65876a2b197c4ea6918f5cab47ded25c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20251023 07:59:39.922715 20145 raft_consensus.cc:1275] T f20a7a673ce6433eac41600d3573e314 P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Refusing update from remote peer 65876a2b197c4ea6918f5cab47ded25c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:39.925915 20766 tablet_bootstrap.cc:492] T 2ff74dfb94334c20b99ea84b985a27a5 P d1379e91aa9c41629cd25262571beb2c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:59:39.946909 20041 leader_election.cc:304] T bd5baee3419c4a7aa0def773845ac48a P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, 35e7d1ade024444486e63cf1b81e9626; no voters: d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:39.951264 20766 tablet_bootstrap.cc:492] T 2ff74dfb94334c20b99ea84b985a27a5 P d1379e91aa9c41629cd25262571beb2c: Bootstrap complete.
I20251023 07:59:39.952898 20766 ts_tablet_manager.cc:1403] T 2ff74dfb94334c20b99ea84b985a27a5 P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.371s user 0.044s sys 0.058s
I20251023 07:59:39.953387 20222 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5bc7d7ca172742d1b528af8659661c2a" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c"
I20251023 07:59:39.955698 20766 raft_consensus.cc:359] T 2ff74dfb94334c20b99ea84b985a27a5 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:39.956409 20766 raft_consensus.cc:740] T 2ff74dfb94334c20b99ea84b985a27a5 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:39.957129 20766 consensus_queue.cc:260] T 2ff74dfb94334c20b99ea84b985a27a5 P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:39.952229 20886 raft_consensus.cc:2804] T bd5baee3419c4a7aa0def773845ac48a P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251023 07:59:39.958612 20886 raft_consensus.cc:493] T bd5baee3419c4a7aa0def773845ac48a P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d1379e91aa9c41629cd25262571beb2c)
I20251023 07:59:39.958985 20886 raft_consensus.cc:3060] T bd5baee3419c4a7aa0def773845ac48a P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:39.959758 20766 ts_tablet_manager.cc:1434] T 2ff74dfb94334c20b99ea84b985a27a5 P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20251023 07:59:39.961227 20766 tablet_bootstrap.cc:492] T 0973ba22912840bd9bded8b0376fa1e7 P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
W20251023 07:59:39.975054 20192 consensus_peers.cc:597] T 92fae2a393404d8998ad2747fbd08cc9 P 65876a2b197c4ea6918f5cab47ded25c -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:39.981782 20043 leader_election.cc:304] T cb866838666745f0a4462f124ac22f72 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35e7d1ade024444486e63cf1b81e9626, 65876a2b197c4ea6918f5cab47ded25c; no voters: d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:39.983708 20767 raft_consensus.cc:2804] T cb866838666745f0a4462f124ac22f72 P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:59:39.986188 20073 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0229047af3034761a2bf168928917afb" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626" is_pre_election: true
I20251023 07:59:39.986936 20073 raft_consensus.cc:2468] T 0229047af3034761a2bf168928917afb P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65876a2b197c4ea6918f5cab47ded25c in term 1.
I20251023 07:59:39.991704 20071 raft_consensus.cc:1275] T 35c1ea979bda45aead7d1b8539f37637 P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Refusing update from remote peer 65876a2b197c4ea6918f5cab47ded25c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:39.995635 20886 raft_consensus.cc:515] T bd5baee3419c4a7aa0def773845ac48a P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:40.000900 20888 raft_consensus.cc:515] T 5bc7d7ca172742d1b528af8659661c2a P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:40.003762 20874 raft_consensus.cc:515] T c3527495b334413f82d0eca2c4d117b1 P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:40.004998 20222 raft_consensus.cc:2393] T 5bc7d7ca172742d1b528af8659661c2a P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f412334fb994ff0ab492afde64f5855 in current term 2: Already voted for candidate 65876a2b197c4ea6918f5cab47ded25c in this term.
I20251023 07:59:40.006596 20888 leader_election.cc:290] T 5bc7d7ca172742d1b528af8659661c2a P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 2 election: Requested vote from peers 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:40.008858 20874 leader_election.cc:290] T c3527495b334413f82d0eca2c4d117b1 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 2 election: Requested vote from peers 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:40.009577 20813 raft_consensus.cc:1275] T 35c1ea979bda45aead7d1b8539f37637 P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Refusing update from remote peer 65876a2b197c4ea6918f5cab47ded25c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:40.012318 20814 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c3527495b334413f82d0eca2c4d117b1" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c"
I20251023 07:59:39.999356 20150 raft_consensus.cc:2468] T fb985a87f45d43d68b172b937404e770 P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35e7d1ade024444486e63cf1b81e9626 in term 2.
I20251023 07:59:40.015666 20148 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5bc7d7ca172742d1b528af8659661c2a" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855"
I20251023 07:59:40.016480 20148 raft_consensus.cc:2393] T 5bc7d7ca172742d1b528af8659661c2a P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 65876a2b197c4ea6918f5cab47ded25c in current term 2: Already voted for candidate 0f412334fb994ff0ab492afde64f5855 in this term.
I20251023 07:59:40.017973 20223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c3527495b334413f82d0eca2c4d117b1" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65876a2b197c4ea6918f5cab47ded25c"
I20251023 07:59:40.018164 20151 raft_consensus.cc:1275] T a9d3294d54be4be29569a460be5c8887 P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Refusing update from remote peer 65876a2b197c4ea6918f5cab47ded25c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:40.018548 20223 raft_consensus.cc:3060] T c3527495b334413f82d0eca2c4d117b1 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:40.012893 20814 raft_consensus.cc:3060] T c3527495b334413f82d0eca2c4d117b1 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:40.035048 20223 raft_consensus.cc:2468] T c3527495b334413f82d0eca2c4d117b1 P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35e7d1ade024444486e63cf1b81e9626 in term 2.
I20251023 07:59:39.984233 20767 raft_consensus.cc:697] T cb866838666745f0a4462f124ac22f72 P 35e7d1ade024444486e63cf1b81e9626 [term 2 LEADER]: Becoming Leader. State: Replica: 35e7d1ade024444486e63cf1b81e9626, State: Running, Role: LEADER
I20251023 07:59:40.036743 20889 consensus_queue.cc:1048] T f20a7a673ce6433eac41600d3573e314 P 65876a2b197c4ea6918f5cab47ded25c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20251023 07:59:40.037382 20043 leader_election.cc:304] T c3527495b334413f82d0eca2c4d117b1 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35e7d1ade024444486e63cf1b81e9626, 65876a2b197c4ea6918f5cab47ded25c; no voters:
I20251023 07:59:40.043659 20878 consensus_queue.cc:1048] T a9d3294d54be4be29569a460be5c8887 P 65876a2b197c4ea6918f5cab47ded25c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20251023 07:59:40.054775 20886 leader_election.cc:290] T bd5baee3419c4a7aa0def773845ac48a P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 2 election: Requested vote from peers d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865), 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287)
I20251023 07:59:40.064097 20041 leader_election.cc:304] T fb985a87f45d43d68b172b937404e770 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, 35e7d1ade024444486e63cf1b81e9626; no voters: d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:40.065089 20148 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bd5baee3419c4a7aa0def773845ac48a" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f412334fb994ff0ab492afde64f5855"
I20251023 07:59:40.065783 20148 raft_consensus.cc:3060] T bd5baee3419c4a7aa0def773845ac48a P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:40.065268 20880 raft_consensus.cc:2804] T c3527495b334413f82d0eca2c4d117b1 P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:59:40.068960 20767 consensus_queue.cc:237] T cb866838666745f0a4462f124ac22f72 P 35e7d1ade024444486e63cf1b81e9626 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:40.071115 20813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bd5baee3419c4a7aa0def773845ac48a" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c"
I20251023 07:59:40.072274 20880 raft_consensus.cc:697] T c3527495b334413f82d0eca2c4d117b1 P 35e7d1ade024444486e63cf1b81e9626 [term 2 LEADER]: Becoming Leader. State: Replica: 35e7d1ade024444486e63cf1b81e9626, State: Running, Role: LEADER
I20251023 07:59:40.072906 20895 raft_consensus.cc:2804] T fb985a87f45d43d68b172b937404e770 P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:59:40.073467 20895 raft_consensus.cc:697] T fb985a87f45d43d68b172b937404e770 P 35e7d1ade024444486e63cf1b81e9626 [term 2 LEADER]: Becoming Leader. State: Replica: 35e7d1ade024444486e63cf1b81e9626, State: Running, Role: LEADER
W20251023 07:59:40.073627 20044 leader_election.cc:343] T bd5baee3419c4a7aa0def773845ac48a P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:40.073542 20880 consensus_queue.cc:237] T c3527495b334413f82d0eca2c4d117b1 P 35e7d1ade024444486e63cf1b81e9626 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:40.074255 20895 consensus_queue.cc:237] T fb985a87f45d43d68b172b937404e770 P 35e7d1ade024444486e63cf1b81e9626 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:40.071120 20815 raft_consensus.cc:2468] T 5bc7d7ca172742d1b528af8659661c2a P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f412334fb994ff0ab492afde64f5855 in term 2.
I20251023 07:59:40.084059 20118 leader_election.cc:304] T 5bc7d7ca172742d1b528af8659661c2a P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, d1379e91aa9c41629cd25262571beb2c; no voters: 65876a2b197c4ea6918f5cab47ded25c
I20251023 07:59:40.081702 20815 raft_consensus.cc:1275] T a9d3294d54be4be29569a460be5c8887 P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Refusing update from remote peer 65876a2b197c4ea6918f5cab47ded25c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:40.093353 20766 tablet_bootstrap.cc:492] T 0973ba22912840bd9bded8b0376fa1e7 P d1379e91aa9c41629cd25262571beb2c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:59:40.081903 20894 consensus_queue.cc:1048] T 35c1ea979bda45aead7d1b8539f37637 P 65876a2b197c4ea6918f5cab47ded25c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20251023 07:59:40.097275 20766 tablet_bootstrap.cc:492] T 0973ba22912840bd9bded8b0376fa1e7 P d1379e91aa9c41629cd25262571beb2c: Bootstrap complete.
I20251023 07:59:40.095142 20813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5bc7d7ca172742d1b528af8659661c2a" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c"
I20251023 07:59:40.097568 20856 consensus_queue.cc:1048] T 35c1ea979bda45aead7d1b8539f37637 P 65876a2b197c4ea6918f5cab47ded25c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:40.098119 20813 raft_consensus.cc:2393] T 5bc7d7ca172742d1b528af8659661c2a P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 65876a2b197c4ea6918f5cab47ded25c in current term 2: Already voted for candidate 0f412334fb994ff0ab492afde64f5855 in this term.
I20251023 07:59:40.093607 20732 consensus_queue.cc:1048] T a9d3294d54be4be29569a460be5c8887 P 65876a2b197c4ea6918f5cab47ded25c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20251023 07:59:40.099851 20766 ts_tablet_manager.cc:1403] T 0973ba22912840bd9bded8b0376fa1e7 P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.139s user 0.035s sys 0.036s
I20251023 07:59:40.103035 20192 leader_election.cc:304] T 5bc7d7ca172742d1b528af8659661c2a P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65876a2b197c4ea6918f5cab47ded25c; no voters: 0f412334fb994ff0ab492afde64f5855, d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:40.135869 20766 raft_consensus.cc:359] T 0973ba22912840bd9bded8b0376fa1e7 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:40.100741 20076 raft_consensus.cc:1275] T 7060af9ee4a34ecca18900b2f272e1d1 P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Refusing update from remote peer 0f412334fb994ff0ab492afde64f5855: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:40.136662 20766 raft_consensus.cc:740] T 0973ba22912840bd9bded8b0376fa1e7 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:40.135553 20190 leader_election.cc:304] T 0229047af3034761a2bf168928917afb P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35e7d1ade024444486e63cf1b81e9626, 65876a2b197c4ea6918f5cab47ded25c; no voters: d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:40.088600 20862 raft_consensus.cc:2804] T 5bc7d7ca172742d1b528af8659661c2a P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:59:40.137702 20766 consensus_queue.cc:260] T 0973ba22912840bd9bded8b0376fa1e7 P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:40.108748 20811 raft_consensus.cc:1275] T b7dcf1850ca541d6ab42bd11de70d8f4 P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Refusing update from remote peer 65876a2b197c4ea6918f5cab47ded25c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:40.139771 20855 raft_consensus.cc:2804] T 0229047af3034761a2bf168928917afb P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251023 07:59:40.140174 20855 raft_consensus.cc:493] T 0229047af3034761a2bf168928917afb P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Starting leader election (detected failure of leader d1379e91aa9c41629cd25262571beb2c)
I20251023 07:59:40.140564 20855 raft_consensus.cc:3060] T 0229047af3034761a2bf168928917afb P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:40.134023 20732 raft_consensus.cc:2749] T 5bc7d7ca172742d1b528af8659661c2a P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20251023 07:59:40.137532 20148 raft_consensus.cc:2468] T bd5baee3419c4a7aa0def773845ac48a P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35e7d1ade024444486e63cf1b81e9626 in term 2.
I20251023 07:59:40.149948 20041 leader_election.cc:304] T bd5baee3419c4a7aa0def773845ac48a P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, 35e7d1ade024444486e63cf1b81e9626; no voters: d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:40.151084 20671 raft_consensus.cc:2804] T bd5baee3419c4a7aa0def773845ac48a P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:59:40.151505 20862 raft_consensus.cc:697] T 5bc7d7ca172742d1b528af8659661c2a P 0f412334fb994ff0ab492afde64f5855 [term 2 LEADER]: Becoming Leader. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Running, Role: LEADER
I20251023 07:59:40.151561 20671 raft_consensus.cc:697] T bd5baee3419c4a7aa0def773845ac48a P 35e7d1ade024444486e63cf1b81e9626 [term 2 LEADER]: Becoming Leader. State: Replica: 35e7d1ade024444486e63cf1b81e9626, State: Running, Role: LEADER
I20251023 07:59:40.152529 20896 consensus_queue.cc:1048] T 7060af9ee4a34ecca18900b2f272e1d1 P 0f412334fb994ff0ab492afde64f5855 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20251023 07:59:40.152732 20671 consensus_queue.cc:237] T bd5baee3419c4a7aa0def773845ac48a P 35e7d1ade024444486e63cf1b81e9626 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:40.155416 20862 consensus_queue.cc:237] T 5bc7d7ca172742d1b528af8659661c2a P 0f412334fb994ff0ab492afde64f5855 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:40.161465 20766 ts_tablet_manager.cc:1434] T 0973ba22912840bd9bded8b0376fa1e7 P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.061s user 0.005s sys 0.006s
I20251023 07:59:40.162473 20766 tablet_bootstrap.cc:492] T db045d1b86484fe9987f82ce426362e5 P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:40.206446 20811 raft_consensus.cc:1275] T f1da9b379f264014adfbf37b2660285b P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Refusing update from remote peer 65876a2b197c4ea6918f5cab47ded25c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:40.166435 20856 consensus_queue.cc:1048] T b7dcf1850ca541d6ab42bd11de70d8f4 P 65876a2b197c4ea6918f5cab47ded25c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20251023 07:59:40.234208 20221 raft_consensus.cc:1275] T fa36a9cfa4fe43418245de193502470f P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Refusing update from remote peer 0f412334fb994ff0ab492afde64f5855: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:40.237411 20076 raft_consensus.cc:1275] T 92fae2a393404d8998ad2747fbd08cc9 P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Refusing update from remote peer 65876a2b197c4ea6918f5cab47ded25c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:40.272060 20148 raft_consensus.cc:1275] T 076aca7c8ecb4f34af0d457fcee0e585 P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Refusing update from remote peer 65876a2b197c4ea6918f5cab47ded25c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:40.260285 20731 consensus_queue.cc:1048] T fa36a9cfa4fe43418245de193502470f P 0f412334fb994ff0ab492afde64f5855 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20251023 07:59:40.249972 20855 raft_consensus.cc:515] T 0229047af3034761a2bf168928917afb P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:40.312567 19901 catalog_manager.cc:5649] T cb866838666745f0a4462f124ac22f72 P 35e7d1ade024444486e63cf1b81e9626 reported cstate change: term changed from 1 to 2, leader changed from d1379e91aa9c41629cd25262571beb2c (127.16.126.1) to 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2). New cstate: current_term: 2 leader_uuid: "35e7d1ade024444486e63cf1b81e9626" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } health_report { overall_health: HEALTHY } } }
I20251023 07:59:40.334349 20145 raft_consensus.cc:1275] T f1da9b379f264014adfbf37b2660285b P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Refusing update from remote peer 65876a2b197c4ea6918f5cab47ded25c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20251023 07:59:40.366890 20906 log.cc:927] Time spent T c3527495b334413f82d0eca2c4d117b1 P 35e7d1ade024444486e63cf1b81e9626: Append to log took a long time: real 0.118s user 0.001s sys 0.000s
I20251023 07:59:40.375955 20810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0229047af3034761a2bf168928917afb" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d1379e91aa9c41629cd25262571beb2c"
I20251023 07:59:40.376041 20677 consensus_queue.cc:1048] T f1da9b379f264014adfbf37b2660285b P 65876a2b197c4ea6918f5cab47ded25c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20251023 07:59:40.361361 20814 raft_consensus.cc:2468] T c3527495b334413f82d0eca2c4d117b1 P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35e7d1ade024444486e63cf1b81e9626 in term 2.
W20251023 07:59:40.391665 20117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.4:34955, user_credentials={real_user=slave}} blocked reactor thread for 103109us
W20251023 07:59:40.435851 20118 consensus_peers.cc:597] T fa36a9cfa4fe43418245de193502470f P 0f412334fb994ff0ab492afde64f5855 -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:40.450814 20878 consensus_queue.cc:1048] T 92fae2a393404d8998ad2747fbd08cc9 P 65876a2b197c4ea6918f5cab47ded25c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20251023 07:59:40.400707 20889 consensus_queue.cc:1048] T 076aca7c8ecb4f34af0d457fcee0e585 P 65876a2b197c4ea6918f5cab47ded25c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20251023 07:59:40.450860 20856 consensus_queue.cc:1048] T f1da9b379f264014adfbf37b2660285b P 65876a2b197c4ea6918f5cab47ded25c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20251023 07:59:40.418565 20855 leader_election.cc:290] T 0229047af3034761a2bf168928917afb P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 2 election: Requested vote from peers d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865), 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309)
I20251023 07:59:40.470546 20076 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0229047af3034761a2bf168928917afb" candidate_uuid: "65876a2b197c4ea6918f5cab47ded25c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35e7d1ade024444486e63cf1b81e9626"
I20251023 07:59:40.471415 20076 raft_consensus.cc:3060] T 0229047af3034761a2bf168928917afb P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Advancing to term 2
W20251023 07:59:40.518326 20041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.3:33287, user_credentials={real_user=slave}} blocked reactor thread for 44718.1us
I20251023 07:59:40.528915 20766 tablet_bootstrap.cc:492] T db045d1b86484fe9987f82ce426362e5 P d1379e91aa9c41629cd25262571beb2c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:59:40.530063 20766 tablet_bootstrap.cc:492] T db045d1b86484fe9987f82ce426362e5 P d1379e91aa9c41629cd25262571beb2c: Bootstrap complete.
I20251023 07:59:40.530790 20766 ts_tablet_manager.cc:1403] T db045d1b86484fe9987f82ce426362e5 P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.369s user 0.050s sys 0.022s
I20251023 07:59:40.533197 20766 raft_consensus.cc:359] T db045d1b86484fe9987f82ce426362e5 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:40.535635 20766 raft_consensus.cc:740] T db045d1b86484fe9987f82ce426362e5 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:40.536198 20766 consensus_queue.cc:260] T db045d1b86484fe9987f82ce426362e5 P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:40.544029 20766 ts_tablet_manager.cc:1434] T db045d1b86484fe9987f82ce426362e5 P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.013s user 0.005s sys 0.000s
I20251023 07:59:40.544890 20766 tablet_bootstrap.cc:492] T d214412da5754dd0a08f25d50b5584f1 P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:40.546578 20076 raft_consensus.cc:2468] T 0229047af3034761a2bf168928917afb P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65876a2b197c4ea6918f5cab47ded25c in term 2.
W20251023 07:59:40.578002 20918 log.cc:927] Time spent T 35c1ea979bda45aead7d1b8539f37637 P 35e7d1ade024444486e63cf1b81e9626: Append to log took a long time: real 0.060s user 0.000s sys 0.000s
I20251023 07:59:40.577216 19900 catalog_manager.cc:5649] T 5bc7d7ca172742d1b528af8659661c2a P 0f412334fb994ff0ab492afde64f5855 reported cstate change: term changed from 1 to 2, leader changed from d1379e91aa9c41629cd25262571beb2c (127.16.126.1) to 0f412334fb994ff0ab492afde64f5855 (127.16.126.3). New cstate: current_term: 2 leader_uuid: "0f412334fb994ff0ab492afde64f5855" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: UNKNOWN } } }
W20251023 07:59:40.581256 20192 consensus_peers.cc:597] T 076aca7c8ecb4f34af0d457fcee0e585 P 65876a2b197c4ea6918f5cab47ded25c -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20251023 07:59:40.581763 20192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.1:37865, user_credentials={real_user=slave}} blocked reactor thread for 180593us
I20251023 07:59:40.595993 20813 raft_consensus.cc:1275] T c3527495b334413f82d0eca2c4d117b1 P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Refusing update from remote peer 35e7d1ade024444486e63cf1b81e9626: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:40.597198 19898 catalog_manager.cc:5649] T c3527495b334413f82d0eca2c4d117b1 P 35e7d1ade024444486e63cf1b81e9626 reported cstate change: term changed from 1 to 2, leader changed from d1379e91aa9c41629cd25262571beb2c (127.16.126.1) to 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2). New cstate: current_term: 2 leader_uuid: "35e7d1ade024444486e63cf1b81e9626" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } health_report { overall_health: HEALTHY } } }
I20251023 07:59:40.599105 19898 catalog_manager.cc:5649] T fb985a87f45d43d68b172b937404e770 P 35e7d1ade024444486e63cf1b81e9626 reported cstate change: term changed from 1 to 2, leader changed from d1379e91aa9c41629cd25262571beb2c (127.16.126.1) to 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2). New cstate: current_term: 2 leader_uuid: "35e7d1ade024444486e63cf1b81e9626" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:40.601039 19898 catalog_manager.cc:5649] T bd5baee3419c4a7aa0def773845ac48a P 35e7d1ade024444486e63cf1b81e9626 reported cstate change: term changed from 1 to 2, leader changed from d1379e91aa9c41629cd25262571beb2c (127.16.126.1) to 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2). New cstate: current_term: 2 leader_uuid: "35e7d1ade024444486e63cf1b81e9626" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } health_report { overall_health: UNKNOWN } } }
W20251023 07:59:40.585148 20192 leader_election.cc:343] T 0229047af3034761a2bf168928917afb P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:40.620761 20190 leader_election.cc:304] T 0229047af3034761a2bf168928917afb P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35e7d1ade024444486e63cf1b81e9626, 65876a2b197c4ea6918f5cab47ded25c; no voters: d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:40.624257 20855 raft_consensus.cc:2804] T 0229047af3034761a2bf168928917afb P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:59:40.628556 20855 raft_consensus.cc:697] T 0229047af3034761a2bf168928917afb P 65876a2b197c4ea6918f5cab47ded25c [term 2 LEADER]: Becoming Leader. State: Replica: 65876a2b197c4ea6918f5cab47ded25c, State: Running, Role: LEADER
I20251023 07:59:40.629513 20855 consensus_queue.cc:237] T 0229047af3034761a2bf168928917afb P 65876a2b197c4ea6918f5cab47ded25c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:40.641995 20221 raft_consensus.cc:1275] T c3527495b334413f82d0eca2c4d117b1 P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Refusing update from remote peer 35e7d1ade024444486e63cf1b81e9626: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:40.648154 20895 consensus_queue.cc:1048] T c3527495b334413f82d0eca2c4d117b1 P 35e7d1ade024444486e63cf1b81e9626 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20251023 07:59:40.653637 20669 consensus_queue.cc:1048] T c3527495b334413f82d0eca2c4d117b1 P 35e7d1ade024444486e63cf1b81e9626 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:40.659624 20149 raft_consensus.cc:1275] T fb985a87f45d43d68b172b937404e770 P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Refusing update from remote peer 35e7d1ade024444486e63cf1b81e9626: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:40.691314 19898 catalog_manager.cc:5649] T 0229047af3034761a2bf168928917afb P 65876a2b197c4ea6918f5cab47ded25c reported cstate change: term changed from 1 to 2, leader changed from d1379e91aa9c41629cd25262571beb2c (127.16.126.1) to 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4). New cstate: current_term: 2 leader_uuid: "65876a2b197c4ea6918f5cab47ded25c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:40.671995 20895 consensus_queue.cc:1048] T fb985a87f45d43d68b172b937404e770 P 35e7d1ade024444486e63cf1b81e9626 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
W20251023 07:59:40.723276 20044 consensus_peers.cc:597] T fb985a87f45d43d68b172b937404e770 P 35e7d1ade024444486e63cf1b81e9626 -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20251023 07:59:40.723812 20044 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.1:37865, user_credentials={real_user=slave}} blocked reactor thread for 54927.4us
W20251023 07:59:40.746702 20924 log.cc:927] Time spent T fa36a9cfa4fe43418245de193502470f P 65876a2b197c4ea6918f5cab47ded25c: Append to log took a long time: real 0.079s user 0.001s sys 0.000s
W20251023 07:59:40.757530 20044 consensus_peers.cc:597] T cfbe734be0c84115840c7c45f3398002 P 35e7d1ade024444486e63cf1b81e9626 -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20251023 07:59:40.756261 20221 raft_consensus.cc:1275] T cb866838666745f0a4462f124ac22f72 P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Refusing update from remote peer 35e7d1ade024444486e63cf1b81e9626: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:40.799844 20817 raft_consensus.cc:1275] T 5bc7d7ca172742d1b528af8659661c2a P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Refusing update from remote peer 0f412334fb994ff0ab492afde64f5855: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:40.802211 20863 consensus_queue.cc:1048] T 5bc7d7ca172742d1b528af8659661c2a P 0f412334fb994ff0ab492afde64f5855 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:40.804708 20886 consensus_queue.cc:1048] T cb866838666745f0a4462f124ac22f72 P 35e7d1ade024444486e63cf1b81e9626 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20251023 07:59:40.808327 20044 consensus_peers.cc:597] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P 35e7d1ade024444486e63cf1b81e9626 -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20251023 07:59:40.809414 20044 consensus_peers.cc:597] T 382a939856194537b68f791851ceaa65 P 35e7d1ade024444486e63cf1b81e9626 -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20251023 07:59:40.812391 20044 consensus_peers.cc:597] T 62e73cfc2bbc459aba34186c3231ed87 P 35e7d1ade024444486e63cf1b81e9626 -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20251023 07:59:40.823873 20146 raft_consensus.cc:1275] T bd5baee3419c4a7aa0def773845ac48a P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Refusing update from remote peer 35e7d1ade024444486e63cf1b81e9626: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20251023 07:59:40.824361 20192 consensus_peers.cc:597] T 58cef989d86d4b0c8401b4d6b2f890c0 P 65876a2b197c4ea6918f5cab47ded25c -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20251023 07:59:40.825033 20192 consensus_peers.cc:597] T ccba7896b7e1413293428358ffd0f8a0 P 65876a2b197c4ea6918f5cab47ded25c -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20251023 07:59:40.825585 20192 consensus_peers.cc:597] T 20f681957fa04333b8a04cbad085db57 P 65876a2b197c4ea6918f5cab47ded25c -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20251023 07:59:40.850930 20044 consensus_peers.cc:597] T 12b8704d81fe4e3cb14bfa975c73df29 P 35e7d1ade024444486e63cf1b81e9626 -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20251023 07:59:40.858796 20224 raft_consensus.cc:1275] T 5bc7d7ca172742d1b528af8659661c2a P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Refusing update from remote peer 0f412334fb994ff0ab492afde64f5855: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20251023 07:59:40.867681 20931 log.cc:927] Time spent T 35c1ea979bda45aead7d1b8539f37637 P 65876a2b197c4ea6918f5cab47ded25c: Append to log took a long time: real 0.125s user 0.001s sys 0.000s
W20251023 07:59:40.859972 20928 log.cc:927] Time spent T 0229047af3034761a2bf168928917afb P 65876a2b197c4ea6918f5cab47ded25c: Append to log took a long time: real 0.162s user 0.001s sys 0.000s
I20251023 07:59:40.842197 20886 consensus_queue.cc:1048] T bd5baee3419c4a7aa0def773845ac48a P 35e7d1ade024444486e63cf1b81e9626 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20251023 07:59:40.874796 20766 tablet_bootstrap.cc:492] T d214412da5754dd0a08f25d50b5584f1 P d1379e91aa9c41629cd25262571beb2c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20251023 07:59:40.875631 20118 consensus_peers.cc:597] T d51f1c713224480980c425d473226a02 P 0f412334fb994ff0ab492afde64f5855 -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20251023 07:59:40.876284 20044 consensus_peers.cc:597] T bd5baee3419c4a7aa0def773845ac48a P 35e7d1ade024444486e63cf1b81e9626 -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20251023 07:59:40.882898 20118 consensus_peers.cc:597] T 5855488965da49f4a33c7516f6a5596a P 0f412334fb994ff0ab492afde64f5855 -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20251023 07:59:40.888669 20771 consensus_queue.cc:1048] T 5bc7d7ca172742d1b528af8659661c2a P 0f412334fb994ff0ab492afde64f5855 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20251023 07:59:40.910808 20118 consensus_peers.cc:597] T aa253535ba594367a12fda3dea3b75d4 P 0f412334fb994ff0ab492afde64f5855 -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20251023 07:59:40.911878 20766 tablet_bootstrap.cc:492] T d214412da5754dd0a08f25d50b5584f1 P d1379e91aa9c41629cd25262571beb2c: Bootstrap complete.
I20251023 07:59:40.915738 20766 ts_tablet_manager.cc:1403] T d214412da5754dd0a08f25d50b5584f1 P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.371s user 0.014s sys 0.007s
W20251023 07:59:40.934610 20044 consensus_peers.cc:597] T cb866838666745f0a4462f124ac22f72 P 35e7d1ade024444486e63cf1b81e9626 -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:40.948649 20766 raft_consensus.cc:359] T d214412da5754dd0a08f25d50b5584f1 P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:40.951785 20766 raft_consensus.cc:740] T d214412da5754dd0a08f25d50b5584f1 P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:40.952726 20766 consensus_queue.cc:260] T d214412da5754dd0a08f25d50b5584f1 P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:40.960026 20766 ts_tablet_manager.cc:1434] T d214412da5754dd0a08f25d50b5584f1 P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.044s user 0.007s sys 0.000s
W20251023 07:59:40.999931 20044 consensus_peers.cc:597] T a9f4a5a96a444c099e7cefb12fe4c288 P 35e7d1ade024444486e63cf1b81e9626 -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20251023 07:59:41.002457 20766 tablet_bootstrap.cc:492] T 5855488965da49f4a33c7516f6a5596a P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
W20251023 07:59:41.008194 20044 consensus_peers.cc:597] T 09f7b5cd377e45be8bbd85052c93dcb3 P 35e7d1ade024444486e63cf1b81e9626 -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20251023 07:59:41.031765 20078 raft_consensus.cc:1275] T 0229047af3034761a2bf168928917afb P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Refusing update from remote peer 65876a2b197c4ea6918f5cab47ded25c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:41.034734 20855 consensus_queue.cc:1048] T 0229047af3034761a2bf168928917afb P 65876a2b197c4ea6918f5cab47ded25c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:41.047369 20766 tablet_bootstrap.cc:492] T 5855488965da49f4a33c7516f6a5596a P d1379e91aa9c41629cd25262571beb2c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:59:41.048312 20766 tablet_bootstrap.cc:492] T 5855488965da49f4a33c7516f6a5596a P d1379e91aa9c41629cd25262571beb2c: Bootstrap complete.
I20251023 07:59:41.048949 20766 ts_tablet_manager.cc:1403] T 5855488965da49f4a33c7516f6a5596a P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.049s user 0.012s sys 0.005s
I20251023 07:59:41.051388 20766 raft_consensus.cc:359] T 5855488965da49f4a33c7516f6a5596a P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:41.052071 20766 raft_consensus.cc:740] T 5855488965da49f4a33c7516f6a5596a P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:41.052960 20766 consensus_queue.cc:260] T 5855488965da49f4a33c7516f6a5596a P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
W20251023 07:59:41.054315 20118 consensus_peers.cc:597] T a1c85032f5ef4634a35c20eec56ae62f P 0f412334fb994ff0ab492afde64f5855 -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20251023 07:59:41.055431 20766 ts_tablet_manager.cc:1434] T 5855488965da49f4a33c7516f6a5596a P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20251023 07:59:41.056320 20766 tablet_bootstrap.cc:492] T cb866838666745f0a4462f124ac22f72 P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
W20251023 07:59:41.075598 20118 consensus_peers.cc:597] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P 0f412334fb994ff0ab492afde64f5855 -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20251023 07:59:41.099668 20192 consensus_peers.cc:597] T 0229047af3034761a2bf168928917afb P 65876a2b197c4ea6918f5cab47ded25c -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:41.116053 20766 tablet_bootstrap.cc:492] T cb866838666745f0a4462f124ac22f72 P d1379e91aa9c41629cd25262571beb2c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:59:41.117466 20766 tablet_bootstrap.cc:492] T cb866838666745f0a4462f124ac22f72 P d1379e91aa9c41629cd25262571beb2c: Bootstrap complete.
I20251023 07:59:41.118173 20766 ts_tablet_manager.cc:1403] T cb866838666745f0a4462f124ac22f72 P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.062s user 0.030s sys 0.012s
I20251023 07:59:41.121129 20766 raft_consensus.cc:359] T cb866838666745f0a4462f124ac22f72 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:41.121948 20766 raft_consensus.cc:740] T cb866838666745f0a4462f124ac22f72 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:41.122684 20766 consensus_queue.cc:260] T cb866838666745f0a4462f124ac22f72 P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:41.129421 20766 ts_tablet_manager.cc:1434] T cb866838666745f0a4462f124ac22f72 P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.011s user 0.006s sys 0.000s
I20251023 07:59:41.130353 20766 tablet_bootstrap.cc:492] T 0229047af3034761a2bf168928917afb P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:41.152508 20766 tablet_bootstrap.cc:492] T 0229047af3034761a2bf168928917afb P d1379e91aa9c41629cd25262571beb2c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:59:41.153524 20766 tablet_bootstrap.cc:492] T 0229047af3034761a2bf168928917afb P d1379e91aa9c41629cd25262571beb2c: Bootstrap complete.
I20251023 07:59:41.154240 20766 ts_tablet_manager.cc:1403] T 0229047af3034761a2bf168928917afb P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.024s user 0.019s sys 0.003s
I20251023 07:59:41.162150 20766 raft_consensus.cc:359] T 0229047af3034761a2bf168928917afb P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:41.162850 20766 raft_consensus.cc:740] T 0229047af3034761a2bf168928917afb P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:41.163858 20766 consensus_queue.cc:260] T 0229047af3034761a2bf168928917afb P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:41.169132 20766 ts_tablet_manager.cc:1434] T 0229047af3034761a2bf168928917afb P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.015s user 0.006s sys 0.001s
I20251023 07:59:41.170239 20766 tablet_bootstrap.cc:492] T 20f681957fa04333b8a04cbad085db57 P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:41.192596 20766 tablet_bootstrap.cc:492] T 20f681957fa04333b8a04cbad085db57 P d1379e91aa9c41629cd25262571beb2c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:59:41.193634 20766 tablet_bootstrap.cc:492] T 20f681957fa04333b8a04cbad085db57 P d1379e91aa9c41629cd25262571beb2c: Bootstrap complete.
I20251023 07:59:41.194327 20766 ts_tablet_manager.cc:1403] T 20f681957fa04333b8a04cbad085db57 P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.024s user 0.010s sys 0.007s
I20251023 07:59:41.196805 20766 raft_consensus.cc:359] T 20f681957fa04333b8a04cbad085db57 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:41.197540 20766 raft_consensus.cc:740] T 20f681957fa04333b8a04cbad085db57 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:41.198263 20766 consensus_queue.cc:260] T 20f681957fa04333b8a04cbad085db57 P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:41.204916 20766 ts_tablet_manager.cc:1434] T 20f681957fa04333b8a04cbad085db57 P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.010s user 0.006s sys 0.000s
I20251023 07:59:41.205847 20766 tablet_bootstrap.cc:492] T 92fae2a393404d8998ad2747fbd08cc9 P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:41.234989 20766 tablet_bootstrap.cc:492] T 92fae2a393404d8998ad2747fbd08cc9 P d1379e91aa9c41629cd25262571beb2c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:59:41.235994 20766 tablet_bootstrap.cc:492] T 92fae2a393404d8998ad2747fbd08cc9 P d1379e91aa9c41629cd25262571beb2c: Bootstrap complete.
I20251023 07:59:41.236722 20766 ts_tablet_manager.cc:1403] T 92fae2a393404d8998ad2747fbd08cc9 P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.031s user 0.015s sys 0.011s
I20251023 07:59:41.239342 20766 raft_consensus.cc:359] T 92fae2a393404d8998ad2747fbd08cc9 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:41.240090 20766 raft_consensus.cc:740] T 92fae2a393404d8998ad2747fbd08cc9 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:41.240760 20766 consensus_queue.cc:260] T 92fae2a393404d8998ad2747fbd08cc9 P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:41.243283 20766 ts_tablet_manager.cc:1434] T 92fae2a393404d8998ad2747fbd08cc9 P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20251023 07:59:41.244526 20766 tablet_bootstrap.cc:492] T 58cef989d86d4b0c8401b4d6b2f890c0 P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:41.266445 20766 tablet_bootstrap.cc:492] T 58cef989d86d4b0c8401b4d6b2f890c0 P d1379e91aa9c41629cd25262571beb2c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:59:41.267480 20766 tablet_bootstrap.cc:492] T 58cef989d86d4b0c8401b4d6b2f890c0 P d1379e91aa9c41629cd25262571beb2c: Bootstrap complete.
I20251023 07:59:41.268267 20766 ts_tablet_manager.cc:1403] T 58cef989d86d4b0c8401b4d6b2f890c0 P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.024s user 0.016s sys 0.004s
I20251023 07:59:41.270735 20766 raft_consensus.cc:359] T 58cef989d86d4b0c8401b4d6b2f890c0 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:41.271473 20766 raft_consensus.cc:740] T 58cef989d86d4b0c8401b4d6b2f890c0 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:41.272164 20766 consensus_queue.cc:260] T 58cef989d86d4b0c8401b4d6b2f890c0 P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:41.274922 20766 ts_tablet_manager.cc:1434] T 58cef989d86d4b0c8401b4d6b2f890c0 P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.006s user 0.009s sys 0.000s
I20251023 07:59:41.275792 20766 tablet_bootstrap.cc:492] T ccba7896b7e1413293428358ffd0f8a0 P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:41.297268 20766 tablet_bootstrap.cc:492] T ccba7896b7e1413293428358ffd0f8a0 P d1379e91aa9c41629cd25262571beb2c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:59:41.298375 20766 tablet_bootstrap.cc:492] T ccba7896b7e1413293428358ffd0f8a0 P d1379e91aa9c41629cd25262571beb2c: Bootstrap complete.
I20251023 07:59:41.299082 20766 ts_tablet_manager.cc:1403] T ccba7896b7e1413293428358ffd0f8a0 P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.024s user 0.012s sys 0.008s
I20251023 07:59:41.302488 20766 raft_consensus.cc:359] T ccba7896b7e1413293428358ffd0f8a0 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:41.303272 20766 raft_consensus.cc:740] T ccba7896b7e1413293428358ffd0f8a0 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:41.304044 20766 consensus_queue.cc:260] T ccba7896b7e1413293428358ffd0f8a0 P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:41.306514 20766 ts_tablet_manager.cc:1434] T ccba7896b7e1413293428358ffd0f8a0 P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20251023 07:59:41.307349 20766 tablet_bootstrap.cc:492] T 09f7b5cd377e45be8bbd85052c93dcb3 P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:41.322111 20766 tablet_bootstrap.cc:492] T 09f7b5cd377e45be8bbd85052c93dcb3 P d1379e91aa9c41629cd25262571beb2c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:59:41.323069 20766 tablet_bootstrap.cc:492] T 09f7b5cd377e45be8bbd85052c93dcb3 P d1379e91aa9c41629cd25262571beb2c: Bootstrap complete.
I20251023 07:59:41.323766 20766 ts_tablet_manager.cc:1403] T 09f7b5cd377e45be8bbd85052c93dcb3 P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.017s user 0.015s sys 0.000s
I20251023 07:59:41.325831 20766 raft_consensus.cc:359] T 09f7b5cd377e45be8bbd85052c93dcb3 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:41.326310 20766 raft_consensus.cc:740] T 09f7b5cd377e45be8bbd85052c93dcb3 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:41.326897 20766 consensus_queue.cc:260] T 09f7b5cd377e45be8bbd85052c93dcb3 P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:41.328851 20766 ts_tablet_manager.cc:1434] T 09f7b5cd377e45be8bbd85052c93dcb3 P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20251023 07:59:41.330158 20766 tablet_bootstrap.cc:492] T 62e73cfc2bbc459aba34186c3231ed87 P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:41.343151 20766 tablet_bootstrap.cc:492] T 62e73cfc2bbc459aba34186c3231ed87 P d1379e91aa9c41629cd25262571beb2c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:59:41.343887 20766 tablet_bootstrap.cc:492] T 62e73cfc2bbc459aba34186c3231ed87 P d1379e91aa9c41629cd25262571beb2c: Bootstrap complete.
I20251023 07:59:41.344419 20766 ts_tablet_manager.cc:1403] T 62e73cfc2bbc459aba34186c3231ed87 P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.014s user 0.011s sys 0.000s
I20251023 07:59:41.346081 20766 raft_consensus.cc:359] T 62e73cfc2bbc459aba34186c3231ed87 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:41.346904 20766 raft_consensus.cc:740] T 62e73cfc2bbc459aba34186c3231ed87 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:41.347450 20766 consensus_queue.cc:260] T 62e73cfc2bbc459aba34186c3231ed87 P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:41.349851 20766 ts_tablet_manager.cc:1434] T 62e73cfc2bbc459aba34186c3231ed87 P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.005s user 0.007s sys 0.000s
I20251023 07:59:41.351528 20766 tablet_bootstrap.cc:492] T d51f1c713224480980c425d473226a02 P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:41.370584 20766 tablet_bootstrap.cc:492] T d51f1c713224480980c425d473226a02 P d1379e91aa9c41629cd25262571beb2c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:59:41.371690 20766 tablet_bootstrap.cc:492] T d51f1c713224480980c425d473226a02 P d1379e91aa9c41629cd25262571beb2c: Bootstrap complete.
I20251023 07:59:41.372637 20766 ts_tablet_manager.cc:1403] T d51f1c713224480980c425d473226a02 P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.021s user 0.010s sys 0.005s
I20251023 07:59:41.375116 20766 raft_consensus.cc:359] T d51f1c713224480980c425d473226a02 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:41.375870 20766 raft_consensus.cc:740] T d51f1c713224480980c425d473226a02 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:41.376482 20766 consensus_queue.cc:260] T d51f1c713224480980c425d473226a02 P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:41.379173 20766 ts_tablet_manager.cc:1434] T d51f1c713224480980c425d473226a02 P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.006s user 0.006s sys 0.001s
I20251023 07:59:41.381246 20766 tablet_bootstrap.cc:492] T cfbe734be0c84115840c7c45f3398002 P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:41.384984 20809 raft_consensus.cc:3060] T 92fae2a393404d8998ad2747fbd08cc9 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:41.403712 20766 tablet_bootstrap.cc:492] T cfbe734be0c84115840c7c45f3398002 P d1379e91aa9c41629cd25262571beb2c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:59:41.405712 20766 tablet_bootstrap.cc:492] T cfbe734be0c84115840c7c45f3398002 P d1379e91aa9c41629cd25262571beb2c: Bootstrap complete.
I20251023 07:59:41.406426 20766 ts_tablet_manager.cc:1403] T cfbe734be0c84115840c7c45f3398002 P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.025s user 0.016s sys 0.005s
I20251023 07:59:41.408702 20766 raft_consensus.cc:359] T cfbe734be0c84115840c7c45f3398002 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:41.409765 20766 raft_consensus.cc:740] T cfbe734be0c84115840c7c45f3398002 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:41.410382 20766 consensus_queue.cc:260] T cfbe734be0c84115840c7c45f3398002 P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:41.412112 20766 ts_tablet_manager.cc:1434] T cfbe734be0c84115840c7c45f3398002 P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.005s user 0.004s sys 0.002s
I20251023 07:59:41.412882 20766 tablet_bootstrap.cc:492] T 076aca7c8ecb4f34af0d457fcee0e585 P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:41.428097 20766 tablet_bootstrap.cc:492] T 076aca7c8ecb4f34af0d457fcee0e585 P d1379e91aa9c41629cd25262571beb2c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:59:41.428824 20766 tablet_bootstrap.cc:492] T 076aca7c8ecb4f34af0d457fcee0e585 P d1379e91aa9c41629cd25262571beb2c: Bootstrap complete.
I20251023 07:59:41.429340 20766 ts_tablet_manager.cc:1403] T 076aca7c8ecb4f34af0d457fcee0e585 P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.017s user 0.011s sys 0.000s
I20251023 07:59:41.431054 20766 raft_consensus.cc:359] T 076aca7c8ecb4f34af0d457fcee0e585 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:41.431596 20766 raft_consensus.cc:740] T 076aca7c8ecb4f34af0d457fcee0e585 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:41.432155 20766 consensus_queue.cc:260] T 076aca7c8ecb4f34af0d457fcee0e585 P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:41.433835 20766 ts_tablet_manager.cc:1434] T 076aca7c8ecb4f34af0d457fcee0e585 P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20251023 07:59:41.435325 20766 tablet_bootstrap.cc:492] T fa36a9cfa4fe43418245de193502470f P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:41.442427 20809 raft_consensus.cc:3060] T cb866838666745f0a4462f124ac22f72 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:41.465292 20766 tablet_bootstrap.cc:492] T fa36a9cfa4fe43418245de193502470f P d1379e91aa9c41629cd25262571beb2c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:59:41.466280 20766 tablet_bootstrap.cc:492] T fa36a9cfa4fe43418245de193502470f P d1379e91aa9c41629cd25262571beb2c: Bootstrap complete.
I20251023 07:59:41.466969 20766 ts_tablet_manager.cc:1403] T fa36a9cfa4fe43418245de193502470f P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.032s user 0.016s sys 0.011s
I20251023 07:59:41.469604 20766 raft_consensus.cc:359] T fa36a9cfa4fe43418245de193502470f P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:41.471990 20766 raft_consensus.cc:740] T fa36a9cfa4fe43418245de193502470f P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:41.472610 20766 consensus_queue.cc:260] T fa36a9cfa4fe43418245de193502470f P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:41.474815 20766 ts_tablet_manager.cc:1434] T fa36a9cfa4fe43418245de193502470f P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20251023 07:59:41.475417 20766 tablet_bootstrap.cc:492] T 7060af9ee4a34ecca18900b2f272e1d1 P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:41.491425 20766 tablet_bootstrap.cc:492] T 7060af9ee4a34ecca18900b2f272e1d1 P d1379e91aa9c41629cd25262571beb2c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:59:41.492163 20766 tablet_bootstrap.cc:492] T 7060af9ee4a34ecca18900b2f272e1d1 P d1379e91aa9c41629cd25262571beb2c: Bootstrap complete.
I20251023 07:59:41.492704 20766 ts_tablet_manager.cc:1403] T 7060af9ee4a34ecca18900b2f272e1d1 P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.017s user 0.010s sys 0.003s
I20251023 07:59:41.494577 20766 raft_consensus.cc:359] T 7060af9ee4a34ecca18900b2f272e1d1 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:41.495091 20766 raft_consensus.cc:740] T 7060af9ee4a34ecca18900b2f272e1d1 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:41.495587 20766 consensus_queue.cc:260] T 7060af9ee4a34ecca18900b2f272e1d1 P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:41.497498 20766 ts_tablet_manager.cc:1434] T 7060af9ee4a34ecca18900b2f272e1d1 P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20251023 07:59:41.498448 20766 tablet_bootstrap.cc:492] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:41.504415 20809 raft_consensus.cc:3060] T 0229047af3034761a2bf168928917afb P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:41.527084 20766 tablet_bootstrap.cc:492] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P d1379e91aa9c41629cd25262571beb2c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:59:41.528036 20766 tablet_bootstrap.cc:492] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P d1379e91aa9c41629cd25262571beb2c: Bootstrap complete.
I20251023 07:59:41.528664 20766 ts_tablet_manager.cc:1403] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.030s user 0.023s sys 0.004s
I20251023 07:59:41.530795 20766 raft_consensus.cc:359] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:41.531432 20766 raft_consensus.cc:740] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:41.532056 20766 consensus_queue.cc:260] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:41.533916 20766 ts_tablet_manager.cc:1434] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.005s user 0.008s sys 0.000s
I20251023 07:59:41.535085 20766 tablet_bootstrap.cc:492] T 12b8704d81fe4e3cb14bfa975c73df29 P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:41.548493 20766 tablet_bootstrap.cc:492] T 12b8704d81fe4e3cb14bfa975c73df29 P d1379e91aa9c41629cd25262571beb2c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:59:41.549448 20766 tablet_bootstrap.cc:492] T 12b8704d81fe4e3cb14bfa975c73df29 P d1379e91aa9c41629cd25262571beb2c: Bootstrap complete.
I20251023 07:59:41.550108 20766 ts_tablet_manager.cc:1403] T 12b8704d81fe4e3cb14bfa975c73df29 P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.015s user 0.014s sys 0.000s
I20251023 07:59:41.551966 20766 raft_consensus.cc:359] T 12b8704d81fe4e3cb14bfa975c73df29 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:41.552428 20766 raft_consensus.cc:740] T 12b8704d81fe4e3cb14bfa975c73df29 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:41.552973 20766 consensus_queue.cc:260] T 12b8704d81fe4e3cb14bfa975c73df29 P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:41.554733 20766 ts_tablet_manager.cc:1434] T 12b8704d81fe4e3cb14bfa975c73df29 P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20251023 07:59:41.555779 20766 tablet_bootstrap.cc:492] T a1c85032f5ef4634a35c20eec56ae62f P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:41.563019 20809 raft_consensus.cc:3060] T 076aca7c8ecb4f34af0d457fcee0e585 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:41.571714 20766 tablet_bootstrap.cc:492] T a1c85032f5ef4634a35c20eec56ae62f P d1379e91aa9c41629cd25262571beb2c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:59:41.572700 20766 tablet_bootstrap.cc:492] T a1c85032f5ef4634a35c20eec56ae62f P d1379e91aa9c41629cd25262571beb2c: Bootstrap complete.
I20251023 07:59:41.573472 20766 ts_tablet_manager.cc:1403] T a1c85032f5ef4634a35c20eec56ae62f P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.018s user 0.013s sys 0.003s
I20251023 07:59:41.577054 20766 raft_consensus.cc:359] T a1c85032f5ef4634a35c20eec56ae62f P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:41.577615 20766 raft_consensus.cc:740] T a1c85032f5ef4634a35c20eec56ae62f P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:41.578158 20766 consensus_queue.cc:260] T a1c85032f5ef4634a35c20eec56ae62f P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:41.579783 20766 ts_tablet_manager.cc:1434] T a1c85032f5ef4634a35c20eec56ae62f P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20251023 07:59:41.580539 20766 tablet_bootstrap.cc:492] T fb985a87f45d43d68b172b937404e770 P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:41.593405 20766 tablet_bootstrap.cc:492] T fb985a87f45d43d68b172b937404e770 P d1379e91aa9c41629cd25262571beb2c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:59:41.594442 20766 tablet_bootstrap.cc:492] T fb985a87f45d43d68b172b937404e770 P d1379e91aa9c41629cd25262571beb2c: Bootstrap complete.
I20251023 07:59:41.595142 20766 ts_tablet_manager.cc:1403] T fb985a87f45d43d68b172b937404e770 P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.015s user 0.013s sys 0.000s
I20251023 07:59:41.597510 20766 raft_consensus.cc:359] T fb985a87f45d43d68b172b937404e770 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:41.598313 20766 raft_consensus.cc:740] T fb985a87f45d43d68b172b937404e770 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:41.599031 20766 consensus_queue.cc:260] T fb985a87f45d43d68b172b937404e770 P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:41.601504 20766 ts_tablet_manager.cc:1434] T fb985a87f45d43d68b172b937404e770 P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.006s user 0.004s sys 0.004s
I20251023 07:59:41.603399 20766 tablet_bootstrap.cc:492] T 382a939856194537b68f791851ceaa65 P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:41.616592 20766 tablet_bootstrap.cc:492] T 382a939856194537b68f791851ceaa65 P d1379e91aa9c41629cd25262571beb2c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:59:41.617630 20766 tablet_bootstrap.cc:492] T 382a939856194537b68f791851ceaa65 P d1379e91aa9c41629cd25262571beb2c: Bootstrap complete.
I20251023 07:59:41.618202 20766 ts_tablet_manager.cc:1403] T 382a939856194537b68f791851ceaa65 P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.016s user 0.010s sys 0.003s
I20251023 07:59:41.619799 20766 raft_consensus.cc:359] T 382a939856194537b68f791851ceaa65 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:41.620265 20766 raft_consensus.cc:740] T 382a939856194537b68f791851ceaa65 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:41.620793 20766 consensus_queue.cc:260] T 382a939856194537b68f791851ceaa65 P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:41.622366 20766 ts_tablet_manager.cc:1434] T 382a939856194537b68f791851ceaa65 P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20251023 07:59:41.623622 20766 tablet_bootstrap.cc:492] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:41.643662 20766 tablet_bootstrap.cc:492] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P d1379e91aa9c41629cd25262571beb2c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:59:41.644403 20766 tablet_bootstrap.cc:492] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P d1379e91aa9c41629cd25262571beb2c: Bootstrap complete.
I20251023 07:59:41.645080 20766 ts_tablet_manager.cc:1403] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.022s user 0.010s sys 0.000s
I20251023 07:59:41.647356 20766 raft_consensus.cc:359] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:41.648026 20766 raft_consensus.cc:740] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:41.648636 20766 consensus_queue.cc:260] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:41.651010 20766 ts_tablet_manager.cc:1434] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20251023 07:59:41.651799 20766 tablet_bootstrap.cc:492] T aa253535ba594367a12fda3dea3b75d4 P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:41.665050 20766 tablet_bootstrap.cc:492] T aa253535ba594367a12fda3dea3b75d4 P d1379e91aa9c41629cd25262571beb2c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:59:41.665788 20766 tablet_bootstrap.cc:492] T aa253535ba594367a12fda3dea3b75d4 P d1379e91aa9c41629cd25262571beb2c: Bootstrap complete.
I20251023 07:59:41.666426 20766 ts_tablet_manager.cc:1403] T aa253535ba594367a12fda3dea3b75d4 P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.015s user 0.010s sys 0.003s
I20251023 07:59:41.668044 20766 raft_consensus.cc:359] T aa253535ba594367a12fda3dea3b75d4 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:41.668488 20766 raft_consensus.cc:740] T aa253535ba594367a12fda3dea3b75d4 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:41.669070 20766 consensus_queue.cc:260] T aa253535ba594367a12fda3dea3b75d4 P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:41.671031 20766 ts_tablet_manager.cc:1434] T aa253535ba594367a12fda3dea3b75d4 P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20251023 07:59:41.672328 20766 tablet_bootstrap.cc:492] T a9f4a5a96a444c099e7cefb12fe4c288 P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:41.682107 20816 raft_consensus.cc:3060] T fb985a87f45d43d68b172b937404e770 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:41.703625 20766 tablet_bootstrap.cc:492] T a9f4a5a96a444c099e7cefb12fe4c288 P d1379e91aa9c41629cd25262571beb2c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:59:41.704602 20766 tablet_bootstrap.cc:492] T a9f4a5a96a444c099e7cefb12fe4c288 P d1379e91aa9c41629cd25262571beb2c: Bootstrap complete.
I20251023 07:59:41.705242 20766 ts_tablet_manager.cc:1403] T a9f4a5a96a444c099e7cefb12fe4c288 P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.033s user 0.017s sys 0.004s
I20251023 07:59:41.707512 20766 raft_consensus.cc:359] T a9f4a5a96a444c099e7cefb12fe4c288 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:41.708182 20766 raft_consensus.cc:740] T a9f4a5a96a444c099e7cefb12fe4c288 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:41.708847 20766 consensus_queue.cc:260] T a9f4a5a96a444c099e7cefb12fe4c288 P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:41.710548 20766 ts_tablet_manager.cc:1434] T a9f4a5a96a444c099e7cefb12fe4c288 P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20251023 07:59:41.711302 20766 tablet_bootstrap.cc:492] T bd5baee3419c4a7aa0def773845ac48a P d1379e91aa9c41629cd25262571beb2c: Bootstrap starting.
I20251023 07:59:41.725394 20766 tablet_bootstrap.cc:492] T bd5baee3419c4a7aa0def773845ac48a P d1379e91aa9c41629cd25262571beb2c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251023 07:59:41.726678 20766 tablet_bootstrap.cc:492] T bd5baee3419c4a7aa0def773845ac48a P d1379e91aa9c41629cd25262571beb2c: Bootstrap complete.
I20251023 07:59:41.727303 20766 ts_tablet_manager.cc:1403] T bd5baee3419c4a7aa0def773845ac48a P d1379e91aa9c41629cd25262571beb2c: Time spent bootstrapping tablet: real 0.016s user 0.010s sys 0.004s
I20251023 07:59:41.729560 20766 raft_consensus.cc:359] T bd5baee3419c4a7aa0def773845ac48a P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:41.730217 20766 raft_consensus.cc:740] T bd5baee3419c4a7aa0def773845ac48a P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Initialized, Role: FOLLOWER
I20251023 07:59:41.730914 20766 consensus_queue.cc:260] T bd5baee3419c4a7aa0def773845ac48a P d1379e91aa9c41629cd25262571beb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:41.733501 20766 ts_tablet_manager.cc:1434] T bd5baee3419c4a7aa0def773845ac48a P d1379e91aa9c41629cd25262571beb2c: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20251023 07:59:41.945407 20809 raft_consensus.cc:3060] T 7060af9ee4a34ecca18900b2f272e1d1 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:42.077878 20809 raft_consensus.cc:3060] T fa36a9cfa4fe43418245de193502470f P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:42.120249 20809 raft_consensus.cc:3060] T bd5baee3419c4a7aa0def773845ac48a P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Advancing to term 2
W20251023 07:59:44.973730 20192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.1:37865, user_credentials={real_user=slave}} blocked reactor thread for 202162us
W20251023 07:59:45.125025 20116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.2:42309, user_credentials={real_user=slave}} blocked reactor thread for 115933us
W20251023 07:59:45.870110 19932 debug-util.cc:398] Leaking SignalData structure 0x7b0800301d00 after lost signal to thread 16891
W20251023 07:59:45.871256 19932 debug-util.cc:398] Leaking SignalData structure 0x7b080035e620 after lost signal to thread 19935
W20251023 07:59:45.872514 19932 debug-util.cc:398] Leaking SignalData structure 0x7b08000c8ba0 after lost signal to thread 20102
W20251023 07:59:45.873629 19932 debug-util.cc:398] Leaking SignalData structure 0x7b0800114940 after lost signal to thread 20176
W20251023 07:59:45.874735 19932 debug-util.cc:398] Leaking SignalData structure 0x7b08002f4560 after lost signal to thread 20250
W20251023 07:59:45.876062 19932 debug-util.cc:398] Leaking SignalData structure 0x7b08001285e0 after lost signal to thread 20843
I20251023 07:59:49.195413 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:59:49.275398 20150 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "5855488965da49f4a33c7516f6a5596a"
dest_uuid: "0f412334fb994ff0ab492afde64f5855"
mode: GRACEFUL
new_leader_uuid: "d1379e91aa9c41629cd25262571beb2c"
from {username='slave'} at 127.0.0.1:39652
I20251023 07:59:49.276377 20150 raft_consensus.cc:606] T 5855488965da49f4a33c7516f6a5596a P 0f412334fb994ff0ab492afde64f5855 [term 1 LEADER]: Received request to transfer leadership to TS d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:49.281111 20150 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "a1c85032f5ef4634a35c20eec56ae62f"
dest_uuid: "0f412334fb994ff0ab492afde64f5855"
mode: GRACEFUL
new_leader_uuid: "d1379e91aa9c41629cd25262571beb2c"
from {username='slave'} at 127.0.0.1:39652
I20251023 07:59:49.281678 20150 raft_consensus.cc:606] T a1c85032f5ef4634a35c20eec56ae62f P 0f412334fb994ff0ab492afde64f5855 [term 1 LEADER]: Received request to transfer leadership to TS d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:49.288601 20150 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "b4b44015a24e47ddae24244c3fb1fff1"
dest_uuid: "0f412334fb994ff0ab492afde64f5855"
mode: GRACEFUL
new_leader_uuid: "35e7d1ade024444486e63cf1b81e9626"
from {username='slave'} at 127.0.0.1:39652
I20251023 07:59:49.289158 20150 raft_consensus.cc:606] T b4b44015a24e47ddae24244c3fb1fff1 P 0f412334fb994ff0ab492afde64f5855 [term 1 LEADER]: Received request to transfer leadership to TS 35e7d1ade024444486e63cf1b81e9626
I20251023 07:59:49.327380 20223 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "b7dcf1850ca541d6ab42bd11de70d8f4"
dest_uuid: "65876a2b197c4ea6918f5cab47ded25c"
mode: GRACEFUL
new_leader_uuid: "d1379e91aa9c41629cd25262571beb2c"
from {username='slave'} at 127.0.0.1:44048
I20251023 07:59:49.327952 20223 raft_consensus.cc:606] T b7dcf1850ca541d6ab42bd11de70d8f4 P 65876a2b197c4ea6918f5cab47ded25c [term 2 LEADER]: Received request to transfer leadership to TS d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:49.330569 20150 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "c6fd96e3f93945f7828a9a8593490daa"
dest_uuid: "0f412334fb994ff0ab492afde64f5855"
mode: GRACEFUL
new_leader_uuid: "d1379e91aa9c41629cd25262571beb2c"
from {username='slave'} at 127.0.0.1:39652
I20251023 07:59:49.331043 20150 raft_consensus.cc:606] T c6fd96e3f93945f7828a9a8593490daa P 0f412334fb994ff0ab492afde64f5855 [term 1 LEADER]: Received request to transfer leadership to TS d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:49.346377 20073 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "db045d1b86484fe9987f82ce426362e5"
dest_uuid: "35e7d1ade024444486e63cf1b81e9626"
mode: GRACEFUL
new_leader_uuid: "d1379e91aa9c41629cd25262571beb2c"
from {username='slave'} at 127.0.0.1:45642
I20251023 07:59:49.347039 20073 raft_consensus.cc:606] T db045d1b86484fe9987f82ce426362e5 P 35e7d1ade024444486e63cf1b81e9626 [term 1 LEADER]: Received request to transfer leadership to TS d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:49.352494 20150 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "e813343bd62640cc9976d0ae394aa315"
dest_uuid: "0f412334fb994ff0ab492afde64f5855"
mode: GRACEFUL
new_leader_uuid: "d1379e91aa9c41629cd25262571beb2c"
from {username='slave'} at 127.0.0.1:39652
I20251023 07:59:49.353062 20150 raft_consensus.cc:606] T e813343bd62640cc9976d0ae394aa315 P 0f412334fb994ff0ab492afde64f5855 [term 1 LEADER]: Received request to transfer leadership to TS d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:49.354652 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 7
I20251023 07:59:49.358153 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 07:59:49.359216 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:59:49.366204 20986 raft_consensus.cc:993] T db045d1b86484fe9987f82ce426362e5 P 35e7d1ade024444486e63cf1b81e9626: : Instructing follower d1379e91aa9c41629cd25262571beb2c to start an election
I20251023 07:59:49.366871 20986 raft_consensus.cc:1081] T db045d1b86484fe9987f82ce426362e5 P 35e7d1ade024444486e63cf1b81e9626 [term 1 LEADER]: Signalling peer d1379e91aa9c41629cd25262571beb2c to start an election
I20251023 07:59:49.368568 20816 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "db045d1b86484fe9987f82ce426362e5"
dest_uuid: "d1379e91aa9c41629cd25262571beb2c"
from {username='slave'} at 127.0.0.1:56404
I20251023 07:59:49.369215 20816 raft_consensus.cc:493] T db045d1b86484fe9987f82ce426362e5 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:59:49.372812 20816 raft_consensus.cc:3060] T db045d1b86484fe9987f82ce426362e5 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:49.388971 20816 raft_consensus.cc:515] T db045d1b86484fe9987f82ce426362e5 P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:49.400768 20816 leader_election.cc:290] T db045d1b86484fe9987f82ce426362e5 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 2 election: Requested vote from peers 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955), 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309)
I20251023 07:59:49.419297 20223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "db045d1b86484fe9987f82ce426362e5" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "65876a2b197c4ea6918f5cab47ded25c"
I20251023 07:59:49.420143 20223 raft_consensus.cc:3060] T db045d1b86484fe9987f82ce426362e5 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:49.428457 20073 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "db045d1b86484fe9987f82ce426362e5" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "35e7d1ade024444486e63cf1b81e9626"
I20251023 07:59:49.429196 20073 raft_consensus.cc:3055] T db045d1b86484fe9987f82ce426362e5 P 35e7d1ade024444486e63cf1b81e9626 [term 1 LEADER]: Stepping down as leader of term 1
I20251023 07:59:49.429546 20073 raft_consensus.cc:740] T db045d1b86484fe9987f82ce426362e5 P 35e7d1ade024444486e63cf1b81e9626 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35e7d1ade024444486e63cf1b81e9626, State: Running, Role: LEADER
I20251023 07:59:49.430399 20073 consensus_queue.cc:260] T db045d1b86484fe9987f82ce426362e5 P 35e7d1ade024444486e63cf1b81e9626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:49.435568 21005 raft_consensus.cc:993] T b4b44015a24e47ddae24244c3fb1fff1 P 0f412334fb994ff0ab492afde64f5855: : Instructing follower 35e7d1ade024444486e63cf1b81e9626 to start an election
I20251023 07:59:49.436120 21005 raft_consensus.cc:1081] T b4b44015a24e47ddae24244c3fb1fff1 P 0f412334fb994ff0ab492afde64f5855 [term 1 LEADER]: Signalling peer 35e7d1ade024444486e63cf1b81e9626 to start an election
I20251023 07:59:49.438522 20223 raft_consensus.cc:2468] T db045d1b86484fe9987f82ce426362e5 P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 2.
I20251023 07:59:49.440299 20762 leader_election.cc:304] T db045d1b86484fe9987f82ce426362e5 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65876a2b197c4ea6918f5cab47ded25c, d1379e91aa9c41629cd25262571beb2c; no voters:
I20251023 07:59:49.441239 20074 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "b4b44015a24e47ddae24244c3fb1fff1"
dest_uuid: "35e7d1ade024444486e63cf1b81e9626"
from {username='slave'} at 127.0.0.1:43636
I20251023 07:59:49.441891 20074 raft_consensus.cc:493] T b4b44015a24e47ddae24244c3fb1fff1 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:59:49.442257 20074 raft_consensus.cc:3060] T b4b44015a24e47ddae24244c3fb1fff1 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:49.451655 20074 raft_consensus.cc:515] T b4b44015a24e47ddae24244c3fb1fff1 P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:49.455420 20150 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b4b44015a24e47ddae24244c3fb1fff1" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0f412334fb994ff0ab492afde64f5855"
I20251023 07:59:49.456033 20150 raft_consensus.cc:3055] T b4b44015a24e47ddae24244c3fb1fff1 P 0f412334fb994ff0ab492afde64f5855 [term 1 LEADER]: Stepping down as leader of term 1
I20251023 07:59:49.456339 20150 raft_consensus.cc:740] T b4b44015a24e47ddae24244c3fb1fff1 P 0f412334fb994ff0ab492afde64f5855 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Running, Role: LEADER
I20251023 07:59:49.456815 20073 raft_consensus.cc:3060] T db045d1b86484fe9987f82ce426362e5 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:49.457055 20150 consensus_queue.cc:260] T b4b44015a24e47ddae24244c3fb1fff1 P 0f412334fb994ff0ab492afde64f5855 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:49.464334 20150 raft_consensus.cc:3060] T b4b44015a24e47ddae24244c3fb1fff1 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:49.482646 20223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b4b44015a24e47ddae24244c3fb1fff1" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "65876a2b197c4ea6918f5cab47ded25c"
I20251023 07:59:49.483385 20223 raft_consensus.cc:3060] T b4b44015a24e47ddae24244c3fb1fff1 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:49.508617 20073 raft_consensus.cc:2468] T db045d1b86484fe9987f82ce426362e5 P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 2.
I20251023 07:59:49.533545 20074 leader_election.cc:290] T b4b44015a24e47ddae24244c3fb1fff1 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 2 election: Requested vote from peers 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287), 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955)
I20251023 07:59:49.537683 20150 raft_consensus.cc:2468] T b4b44015a24e47ddae24244c3fb1fff1 P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35e7d1ade024444486e63cf1b81e9626 in term 2.
I20251023 07:59:49.539214 20041 leader_election.cc:304] T b4b44015a24e47ddae24244c3fb1fff1 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, 35e7d1ade024444486e63cf1b81e9626; no voters:
I20251023 07:59:49.540154 21000 raft_consensus.cc:2804] T b4b44015a24e47ddae24244c3fb1fff1 P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:59:49.540620 21000 raft_consensus.cc:697] T b4b44015a24e47ddae24244c3fb1fff1 P 35e7d1ade024444486e63cf1b81e9626 [term 2 LEADER]: Becoming Leader. State: Replica: 35e7d1ade024444486e63cf1b81e9626, State: Running, Role: LEADER
I20251023 07:59:49.541622 21000 consensus_queue.cc:237] T b4b44015a24e47ddae24244c3fb1fff1 P 35e7d1ade024444486e63cf1b81e9626 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
W20251023 07:59:49.546326 20762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.126.4:34955, user_credentials={real_user=slave}} blocked reactor thread for 106250us
I20251023 07:59:49.546528 21016 raft_consensus.cc:2804] T db045d1b86484fe9987f82ce426362e5 P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:59:49.553130 20223 raft_consensus.cc:2468] T b4b44015a24e47ddae24244c3fb1fff1 P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35e7d1ade024444486e63cf1b81e9626 in term 2.
I20251023 07:59:49.562259 21016 raft_consensus.cc:697] T db045d1b86484fe9987f82ce426362e5 P d1379e91aa9c41629cd25262571beb2c [term 2 LEADER]: Becoming Leader. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Running, Role: LEADER
I20251023 07:59:49.563333 21016 consensus_queue.cc:237] T db045d1b86484fe9987f82ce426362e5 P d1379e91aa9c41629cd25262571beb2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
W20251023 07:59:49.565176 20044 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.1:37865, user_credentials={real_user=slave}} blocked reactor thread for 67422.1us
I20251023 07:59:49.593992 20987 raft_consensus.cc:993] T a1c85032f5ef4634a35c20eec56ae62f P 0f412334fb994ff0ab492afde64f5855: : Instructing follower d1379e91aa9c41629cd25262571beb2c to start an election
I20251023 07:59:49.594426 20987 raft_consensus.cc:1081] T a1c85032f5ef4634a35c20eec56ae62f P 0f412334fb994ff0ab492afde64f5855 [term 1 LEADER]: Signalling peer d1379e91aa9c41629cd25262571beb2c to start an election
I20251023 07:59:49.595516 19896 catalog_manager.cc:5649] T db045d1b86484fe9987f82ce426362e5 P d1379e91aa9c41629cd25262571beb2c reported cstate change: term changed from 1 to 2, leader changed from 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2) to d1379e91aa9c41629cd25262571beb2c (127.16.126.1). New cstate: current_term: 2 leader_uuid: "d1379e91aa9c41629cd25262571beb2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:49.596344 20813 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "a1c85032f5ef4634a35c20eec56ae62f"
dest_uuid: "d1379e91aa9c41629cd25262571beb2c"
from {username='slave'} at 127.0.0.1:56390
I20251023 07:59:49.599675 20813 raft_consensus.cc:493] T a1c85032f5ef4634a35c20eec56ae62f P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:59:49.600041 20813 raft_consensus.cc:3060] T a1c85032f5ef4634a35c20eec56ae62f P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:49.607828 20813 raft_consensus.cc:515] T a1c85032f5ef4634a35c20eec56ae62f P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:49.610896 20813 leader_election.cc:290] T a1c85032f5ef4634a35c20eec56ae62f P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 2 election: Requested vote from peers 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287), 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955)
I20251023 07:59:49.613413 20223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a1c85032f5ef4634a35c20eec56ae62f" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "65876a2b197c4ea6918f5cab47ded25c"
I20251023 07:59:49.614112 20223 raft_consensus.cc:3060] T a1c85032f5ef4634a35c20eec56ae62f P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:49.615232 19898 catalog_manager.cc:5649] T b4b44015a24e47ddae24244c3fb1fff1 P 35e7d1ade024444486e63cf1b81e9626 reported cstate change: term changed from 1 to 2, leader changed from 0f412334fb994ff0ab492afde64f5855 (127.16.126.3) to 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2). New cstate: current_term: 2 leader_uuid: "35e7d1ade024444486e63cf1b81e9626" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:49.640710 20223 raft_consensus.cc:2468] T a1c85032f5ef4634a35c20eec56ae62f P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 2.
I20251023 07:59:49.653978 20146 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a1c85032f5ef4634a35c20eec56ae62f" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0f412334fb994ff0ab492afde64f5855"
I20251023 07:59:49.654771 20146 raft_consensus.cc:3055] T a1c85032f5ef4634a35c20eec56ae62f P 0f412334fb994ff0ab492afde64f5855 [term 1 LEADER]: Stepping down as leader of term 1
I20251023 07:59:49.655189 20146 raft_consensus.cc:740] T a1c85032f5ef4634a35c20eec56ae62f P 0f412334fb994ff0ab492afde64f5855 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Running, Role: LEADER
I20251023 07:59:49.656213 20146 consensus_queue.cc:260] T a1c85032f5ef4634a35c20eec56ae62f P 0f412334fb994ff0ab492afde64f5855 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:49.662907 20146 raft_consensus.cc:3060] T a1c85032f5ef4634a35c20eec56ae62f P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:49.670612 21009 raft_consensus.cc:993] T e813343bd62640cc9976d0ae394aa315 P 0f412334fb994ff0ab492afde64f5855: : Instructing follower d1379e91aa9c41629cd25262571beb2c to start an election
I20251023 07:59:49.671384 21009 raft_consensus.cc:1081] T e813343bd62640cc9976d0ae394aa315 P 0f412334fb994ff0ab492afde64f5855 [term 1 LEADER]: Signalling peer d1379e91aa9c41629cd25262571beb2c to start an election
I20251023 07:59:49.673712 20816 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "e813343bd62640cc9976d0ae394aa315"
dest_uuid: "d1379e91aa9c41629cd25262571beb2c"
from {username='slave'} at 127.0.0.1:56390
I20251023 07:59:49.674288 20816 raft_consensus.cc:493] T e813343bd62640cc9976d0ae394aa315 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:59:49.674620 20816 raft_consensus.cc:3060] T e813343bd62640cc9976d0ae394aa315 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:49.675976 20762 leader_election.cc:304] T a1c85032f5ef4634a35c20eec56ae62f P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65876a2b197c4ea6918f5cab47ded25c, d1379e91aa9c41629cd25262571beb2c; no voters:
I20251023 07:59:49.677109 21016 raft_consensus.cc:2804] T a1c85032f5ef4634a35c20eec56ae62f P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:59:49.677618 21016 raft_consensus.cc:697] T a1c85032f5ef4634a35c20eec56ae62f P d1379e91aa9c41629cd25262571beb2c [term 2 LEADER]: Becoming Leader. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Running, Role: LEADER
I20251023 07:59:49.678469 21016 consensus_queue.cc:237] T a1c85032f5ef4634a35c20eec56ae62f P d1379e91aa9c41629cd25262571beb2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:49.680187 20146 raft_consensus.cc:2468] T a1c85032f5ef4634a35c20eec56ae62f P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 2.
W20251023 07:59:49.686584 20044 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.1:37865, user_credentials={real_user=slave}} blocked reactor thread for 56531.4us
I20251023 07:59:49.694808 20816 raft_consensus.cc:515] T e813343bd62640cc9976d0ae394aa315 P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:49.697973 21004 raft_consensus.cc:993] T b7dcf1850ca541d6ab42bd11de70d8f4 P 65876a2b197c4ea6918f5cab47ded25c: : Instructing follower d1379e91aa9c41629cd25262571beb2c to start an election
I20251023 07:59:49.698436 21004 raft_consensus.cc:1081] T b7dcf1850ca541d6ab42bd11de70d8f4 P 65876a2b197c4ea6918f5cab47ded25c [term 2 LEADER]: Signalling peer d1379e91aa9c41629cd25262571beb2c to start an election
I20251023 07:59:49.697995 20073 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e813343bd62640cc9976d0ae394aa315" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "35e7d1ade024444486e63cf1b81e9626"
I20251023 07:59:49.699842 20073 raft_consensus.cc:3060] T e813343bd62640cc9976d0ae394aa315 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:49.700145 20816 leader_election.cc:290] T e813343bd62640cc9976d0ae394aa315 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 2 election: Requested vote from peers 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309), 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287)
I20251023 07:59:49.703068 21023 raft_consensus.cc:993] T 5855488965da49f4a33c7516f6a5596a P 0f412334fb994ff0ab492afde64f5855: : Instructing follower d1379e91aa9c41629cd25262571beb2c to start an election
I20251023 07:59:49.703549 21023 raft_consensus.cc:1081] T 5855488965da49f4a33c7516f6a5596a P 0f412334fb994ff0ab492afde64f5855 [term 1 LEADER]: Signalling peer d1379e91aa9c41629cd25262571beb2c to start an election
I20251023 07:59:49.705190 20809 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "5855488965da49f4a33c7516f6a5596a"
dest_uuid: "d1379e91aa9c41629cd25262571beb2c"
from {username='slave'} at 127.0.0.1:56390
I20251023 07:59:49.705775 20809 raft_consensus.cc:493] T 5855488965da49f4a33c7516f6a5596a P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:59:49.706089 20809 raft_consensus.cc:3060] T 5855488965da49f4a33c7516f6a5596a P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:49.709733 20146 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e813343bd62640cc9976d0ae394aa315" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0f412334fb994ff0ab492afde64f5855"
I20251023 07:59:49.710331 20146 raft_consensus.cc:3055] T e813343bd62640cc9976d0ae394aa315 P 0f412334fb994ff0ab492afde64f5855 [term 1 LEADER]: Stepping down as leader of term 1
I20251023 07:59:49.710649 20146 raft_consensus.cc:740] T e813343bd62640cc9976d0ae394aa315 P 0f412334fb994ff0ab492afde64f5855 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Running, Role: LEADER
I20251023 07:59:49.711454 20146 consensus_queue.cc:260] T e813343bd62640cc9976d0ae394aa315 P 0f412334fb994ff0ab492afde64f5855 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:49.712745 20146 raft_consensus.cc:3060] T e813343bd62640cc9976d0ae394aa315 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:49.713263 20073 raft_consensus.cc:2468] T e813343bd62640cc9976d0ae394aa315 P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 2.
I20251023 07:59:49.714569 20761 leader_election.cc:304] T e813343bd62640cc9976d0ae394aa315 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35e7d1ade024444486e63cf1b81e9626, d1379e91aa9c41629cd25262571beb2c; no voters:
I20251023 07:59:49.715451 21016 raft_consensus.cc:2804] T e813343bd62640cc9976d0ae394aa315 P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:59:49.715965 21016 raft_consensus.cc:697] T e813343bd62640cc9976d0ae394aa315 P d1379e91aa9c41629cd25262571beb2c [term 2 LEADER]: Becoming Leader. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Running, Role: LEADER
I20251023 07:59:49.717108 21016 consensus_queue.cc:237] T e813343bd62640cc9976d0ae394aa315 P d1379e91aa9c41629cd25262571beb2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:49.709657 20816 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "b7dcf1850ca541d6ab42bd11de70d8f4"
dest_uuid: "d1379e91aa9c41629cd25262571beb2c"
from {username='slave'} at 127.0.0.1:56406
I20251023 07:59:49.718492 20816 raft_consensus.cc:493] T b7dcf1850ca541d6ab42bd11de70d8f4 P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:59:49.718907 20816 raft_consensus.cc:3060] T b7dcf1850ca541d6ab42bd11de70d8f4 P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:59:49.722998 20146 raft_consensus.cc:2468] T e813343bd62640cc9976d0ae394aa315 P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 2.
I20251023 07:59:49.725627 19896 catalog_manager.cc:5649] T a1c85032f5ef4634a35c20eec56ae62f P d1379e91aa9c41629cd25262571beb2c reported cstate change: term changed from 1 to 2, leader changed from 0f412334fb994ff0ab492afde64f5855 (127.16.126.3) to d1379e91aa9c41629cd25262571beb2c (127.16.126.1). New cstate: current_term: 2 leader_uuid: "d1379e91aa9c41629cd25262571beb2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: HEALTHY } } }
I20251023 07:59:49.742165 20809 raft_consensus.cc:515] T 5855488965da49f4a33c7516f6a5596a P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:49.746346 20220 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5855488965da49f4a33c7516f6a5596a" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "65876a2b197c4ea6918f5cab47ded25c"
I20251023 07:59:49.746963 20220 raft_consensus.cc:3060] T 5855488965da49f4a33c7516f6a5596a P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:49.752635 20146 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5855488965da49f4a33c7516f6a5596a" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0f412334fb994ff0ab492afde64f5855"
I20251023 07:59:49.753393 20146 raft_consensus.cc:3055] T 5855488965da49f4a33c7516f6a5596a P 0f412334fb994ff0ab492afde64f5855 [term 1 LEADER]: Stepping down as leader of term 1
I20251023 07:59:49.753755 20146 raft_consensus.cc:740] T 5855488965da49f4a33c7516f6a5596a P 0f412334fb994ff0ab492afde64f5855 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Running, Role: LEADER
I20251023 07:59:49.754487 20220 raft_consensus.cc:2468] T 5855488965da49f4a33c7516f6a5596a P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 2.
I20251023 07:59:49.745730 20809 leader_election.cc:290] T 5855488965da49f4a33c7516f6a5596a P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 2 election: Requested vote from peers 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287), 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955)
I20251023 07:59:49.754631 20146 consensus_queue.cc:260] T 5855488965da49f4a33c7516f6a5596a P 0f412334fb994ff0ab492afde64f5855 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:49.755882 20762 leader_election.cc:304] T 5855488965da49f4a33c7516f6a5596a P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65876a2b197c4ea6918f5cab47ded25c, d1379e91aa9c41629cd25262571beb2c; no voters:
I20251023 07:59:49.756628 20146 raft_consensus.cc:3060] T 5855488965da49f4a33c7516f6a5596a P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:49.756807 21016 raft_consensus.cc:2804] T 5855488965da49f4a33c7516f6a5596a P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:59:49.757380 21016 raft_consensus.cc:697] T 5855488965da49f4a33c7516f6a5596a P d1379e91aa9c41629cd25262571beb2c [term 2 LEADER]: Becoming Leader. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Running, Role: LEADER
I20251023 07:59:49.758240 21016 consensus_queue.cc:237] T 5855488965da49f4a33c7516f6a5596a P d1379e91aa9c41629cd25262571beb2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:49.758531 19896 catalog_manager.cc:5649] T e813343bd62640cc9976d0ae394aa315 P d1379e91aa9c41629cd25262571beb2c reported cstate change: term changed from 1 to 2, leader changed from 0f412334fb994ff0ab492afde64f5855 (127.16.126.3) to d1379e91aa9c41629cd25262571beb2c (127.16.126.1). New cstate: current_term: 2 leader_uuid: "d1379e91aa9c41629cd25262571beb2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:49.762692 20816 raft_consensus.cc:515] T b7dcf1850ca541d6ab42bd11de70d8f4 P d1379e91aa9c41629cd25262571beb2c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:49.764815 20146 raft_consensus.cc:2468] T 5855488965da49f4a33c7516f6a5596a P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 2.
I20251023 07:59:49.768402 20816 leader_election.cc:290] T b7dcf1850ca541d6ab42bd11de70d8f4 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 3 election: Requested vote from peers 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287), 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955)
I20251023 07:59:49.771059 20146 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7dcf1850ca541d6ab42bd11de70d8f4" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0f412334fb994ff0ab492afde64f5855"
I20251023 07:59:49.771601 20220 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7dcf1850ca541d6ab42bd11de70d8f4" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "65876a2b197c4ea6918f5cab47ded25c"
I20251023 07:59:49.771909 20146 raft_consensus.cc:3060] T b7dcf1850ca541d6ab42bd11de70d8f4 P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:59:49.772212 20220 raft_consensus.cc:3055] T b7dcf1850ca541d6ab42bd11de70d8f4 P 65876a2b197c4ea6918f5cab47ded25c [term 2 LEADER]: Stepping down as leader of term 2
I20251023 07:59:49.772548 20220 raft_consensus.cc:740] T b7dcf1850ca541d6ab42bd11de70d8f4 P 65876a2b197c4ea6918f5cab47ded25c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 65876a2b197c4ea6918f5cab47ded25c, State: Running, Role: LEADER
I20251023 07:59:49.773254 20220 consensus_queue.cc:260] T b7dcf1850ca541d6ab42bd11de70d8f4 P 65876a2b197c4ea6918f5cab47ded25c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:49.774641 20220 raft_consensus.cc:3060] T b7dcf1850ca541d6ab42bd11de70d8f4 P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:59:49.786664 20146 raft_consensus.cc:2468] T b7dcf1850ca541d6ab42bd11de70d8f4 P 0f412334fb994ff0ab492afde64f5855 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 3.
I20251023 07:59:49.788273 20760 leader_election.cc:304] T b7dcf1850ca541d6ab42bd11de70d8f4 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, d1379e91aa9c41629cd25262571beb2c; no voters:
I20251023 07:59:49.788969 20220 raft_consensus.cc:2468] T b7dcf1850ca541d6ab42bd11de70d8f4 P 65876a2b197c4ea6918f5cab47ded25c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 3.
I20251023 07:59:49.794687 21016 raft_consensus.cc:2804] T b7dcf1850ca541d6ab42bd11de70d8f4 P d1379e91aa9c41629cd25262571beb2c [term 3 FOLLOWER]: Leader election won for term 3
I20251023 07:59:49.795392 21016 raft_consensus.cc:697] T b7dcf1850ca541d6ab42bd11de70d8f4 P d1379e91aa9c41629cd25262571beb2c [term 3 LEADER]: Becoming Leader. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Running, Role: LEADER
I20251023 07:59:49.796484 21016 consensus_queue.cc:237] T b7dcf1850ca541d6ab42bd11de70d8f4 P d1379e91aa9c41629cd25262571beb2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:49.804565 19896 catalog_manager.cc:5649] T 5855488965da49f4a33c7516f6a5596a P d1379e91aa9c41629cd25262571beb2c reported cstate change: term changed from 1 to 2, leader changed from 0f412334fb994ff0ab492afde64f5855 (127.16.126.3) to d1379e91aa9c41629cd25262571beb2c (127.16.126.1). New cstate: current_term: 2 leader_uuid: "d1379e91aa9c41629cd25262571beb2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: HEALTHY } } }
I20251023 07:59:49.812417 21023 raft_consensus.cc:993] T c6fd96e3f93945f7828a9a8593490daa P 0f412334fb994ff0ab492afde64f5855: : Instructing follower d1379e91aa9c41629cd25262571beb2c to start an election
I20251023 07:59:49.812952 20987 raft_consensus.cc:1081] T c6fd96e3f93945f7828a9a8593490daa P 0f412334fb994ff0ab492afde64f5855 [term 1 LEADER]: Signalling peer d1379e91aa9c41629cd25262571beb2c to start an election
I20251023 07:59:49.814517 20816 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "c6fd96e3f93945f7828a9a8593490daa"
dest_uuid: "d1379e91aa9c41629cd25262571beb2c"
from {username='slave'} at 127.0.0.1:56390
I20251023 07:59:49.817715 20816 raft_consensus.cc:493] T c6fd96e3f93945f7828a9a8593490daa P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:59:49.818118 20816 raft_consensus.cc:3060] T c6fd96e3f93945f7828a9a8593490daa P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:49.836616 19896 catalog_manager.cc:5649] T b7dcf1850ca541d6ab42bd11de70d8f4 P d1379e91aa9c41629cd25262571beb2c reported cstate change: term changed from 2 to 3, leader changed from 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4) to d1379e91aa9c41629cd25262571beb2c (127.16.126.1). New cstate: current_term: 3 leader_uuid: "d1379e91aa9c41629cd25262571beb2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: HEALTHY } } }
I20251023 07:59:49.839025 20816 raft_consensus.cc:515] T c6fd96e3f93945f7828a9a8593490daa P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:49.842940 20074 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6fd96e3f93945f7828a9a8593490daa" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "35e7d1ade024444486e63cf1b81e9626"
I20251023 07:59:49.843575 20074 raft_consensus.cc:3060] T c6fd96e3f93945f7828a9a8593490daa P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:49.847536 20816 leader_election.cc:290] T c6fd96e3f93945f7828a9a8593490daa P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 2 election: Requested vote from peers 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309), 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287)
I20251023 07:59:49.851382 20146 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6fd96e3f93945f7828a9a8593490daa" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0f412334fb994ff0ab492afde64f5855"
I20251023 07:59:49.852154 20146 raft_consensus.cc:3055] T c6fd96e3f93945f7828a9a8593490daa P 0f412334fb994ff0ab492afde64f5855 [term 1 LEADER]: Stepping down as leader of term 1
I20251023 07:59:49.853870 20146 raft_consensus.cc:740] T c6fd96e3f93945f7828a9a8593490daa P 0f412334fb994ff0ab492afde64f5855 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Running, Role: LEADER
I20251023 07:59:49.855129 20146 consensus_queue.cc:260] T c6fd96e3f93945f7828a9a8593490daa P 0f412334fb994ff0ab492afde64f5855 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:49.856639 20146 raft_consensus.cc:3060] T c6fd96e3f93945f7828a9a8593490daa P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:49.857458 20074 raft_consensus.cc:2468] T c6fd96e3f93945f7828a9a8593490daa P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 2.
I20251023 07:59:49.858755 20761 leader_election.cc:304] T c6fd96e3f93945f7828a9a8593490daa P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35e7d1ade024444486e63cf1b81e9626, d1379e91aa9c41629cd25262571beb2c; no voters:
I20251023 07:59:49.859656 21016 raft_consensus.cc:2804] T c6fd96e3f93945f7828a9a8593490daa P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:59:49.860160 21016 raft_consensus.cc:697] T c6fd96e3f93945f7828a9a8593490daa P d1379e91aa9c41629cd25262571beb2c [term 2 LEADER]: Becoming Leader. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Running, Role: LEADER
I20251023 07:59:49.861090 21016 consensus_queue.cc:237] T c6fd96e3f93945f7828a9a8593490daa P d1379e91aa9c41629cd25262571beb2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:49.868079 20146 raft_consensus.cc:2468] T c6fd96e3f93945f7828a9a8593490daa P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 2.
I20251023 07:59:49.877259 19896 catalog_manager.cc:5649] T c6fd96e3f93945f7828a9a8593490daa P d1379e91aa9c41629cd25262571beb2c reported cstate change: term changed from 1 to 2, leader changed from 0f412334fb994ff0ab492afde64f5855 (127.16.126.3) to d1379e91aa9c41629cd25262571beb2c (127.16.126.1). New cstate: current_term: 2 leader_uuid: "d1379e91aa9c41629cd25262571beb2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:49.948518 20220 raft_consensus.cc:1275] T db045d1b86484fe9987f82ce426362e5 P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Refusing update from remote peer d1379e91aa9c41629cd25262571beb2c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:49.949712 21016 consensus_queue.cc:1048] T db045d1b86484fe9987f82ce426362e5 P d1379e91aa9c41629cd25262571beb2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:49.963913 20074 raft_consensus.cc:1275] T db045d1b86484fe9987f82ce426362e5 P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Refusing update from remote peer d1379e91aa9c41629cd25262571beb2c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:49.965679 21016 consensus_queue.cc:1048] T db045d1b86484fe9987f82ce426362e5 P d1379e91aa9c41629cd25262571beb2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:49.966459 20220 raft_consensus.cc:1275] T b4b44015a24e47ddae24244c3fb1fff1 P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Refusing update from remote peer 35e7d1ade024444486e63cf1b81e9626: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:49.968104 21024 consensus_queue.cc:1048] T b4b44015a24e47ddae24244c3fb1fff1 P 35e7d1ade024444486e63cf1b81e9626 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:49.985399 20146 raft_consensus.cc:1275] T b4b44015a24e47ddae24244c3fb1fff1 P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Refusing update from remote peer 35e7d1ade024444486e63cf1b81e9626: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:49.987941 20986 consensus_queue.cc:1048] T b4b44015a24e47ddae24244c3fb1fff1 P 35e7d1ade024444486e63cf1b81e9626 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:50.138278 20073 raft_consensus.cc:1275] T e813343bd62640cc9976d0ae394aa315 P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Refusing update from remote peer d1379e91aa9c41629cd25262571beb2c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:50.139328 21016 consensus_queue.cc:1048] T e813343bd62640cc9976d0ae394aa315 P d1379e91aa9c41629cd25262571beb2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:50.147663 20146 raft_consensus.cc:1275] T e813343bd62640cc9976d0ae394aa315 P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Refusing update from remote peer d1379e91aa9c41629cd25262571beb2c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:50.149713 21042 consensus_queue.cc:1048] T e813343bd62640cc9976d0ae394aa315 P d1379e91aa9c41629cd25262571beb2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:50.230154 20146 raft_consensus.cc:1275] T a1c85032f5ef4634a35c20eec56ae62f P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Refusing update from remote peer d1379e91aa9c41629cd25262571beb2c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:50.231323 21042 consensus_queue.cc:1048] T a1c85032f5ef4634a35c20eec56ae62f P d1379e91aa9c41629cd25262571beb2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:50.239915 20223 raft_consensus.cc:1275] T a1c85032f5ef4634a35c20eec56ae62f P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Refusing update from remote peer d1379e91aa9c41629cd25262571beb2c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:50.241222 21042 consensus_queue.cc:1048] T a1c85032f5ef4634a35c20eec56ae62f P d1379e91aa9c41629cd25262571beb2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:50.279616 20223 raft_consensus.cc:1275] T 5855488965da49f4a33c7516f6a5596a P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Refusing update from remote peer d1379e91aa9c41629cd25262571beb2c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:50.280583 20146 raft_consensus.cc:1275] T b7dcf1850ca541d6ab42bd11de70d8f4 P 0f412334fb994ff0ab492afde64f5855 [term 3 FOLLOWER]: Refusing update from remote peer d1379e91aa9c41629cd25262571beb2c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251023 07:59:50.280865 21042 consensus_queue.cc:1048] T 5855488965da49f4a33c7516f6a5596a P d1379e91aa9c41629cd25262571beb2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:50.281976 21016 consensus_queue.cc:1048] T b7dcf1850ca541d6ab42bd11de70d8f4 P d1379e91aa9c41629cd25262571beb2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:59:50.296358 20223 raft_consensus.cc:1275] T b7dcf1850ca541d6ab42bd11de70d8f4 P 65876a2b197c4ea6918f5cab47ded25c [term 3 FOLLOWER]: Refusing update from remote peer d1379e91aa9c41629cd25262571beb2c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251023 07:59:50.335456 20146 raft_consensus.cc:1275] T 5855488965da49f4a33c7516f6a5596a P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Refusing update from remote peer d1379e91aa9c41629cd25262571beb2c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:50.337093 21048 consensus_queue.cc:1048] T 5855488965da49f4a33c7516f6a5596a P d1379e91aa9c41629cd25262571beb2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:50.332253 21042 consensus_queue.cc:1048] T b7dcf1850ca541d6ab42bd11de70d8f4 P d1379e91aa9c41629cd25262571beb2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
W20251023 07:59:50.341853 20762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.4:34955, user_credentials={real_user=slave}} blocked reactor thread for 44112.9us
I20251023 07:59:50.410923 20074 raft_consensus.cc:1275] T c6fd96e3f93945f7828a9a8593490daa P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Refusing update from remote peer d1379e91aa9c41629cd25262571beb2c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:50.412002 21042 consensus_queue.cc:1048] T c6fd96e3f93945f7828a9a8593490daa P d1379e91aa9c41629cd25262571beb2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:50.422510 20146 raft_consensus.cc:1275] T c6fd96e3f93945f7828a9a8593490daa P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Refusing update from remote peer d1379e91aa9c41629cd25262571beb2c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:50.424386 21048 consensus_queue.cc:1048] T c6fd96e3f93945f7828a9a8593490daa P d1379e91aa9c41629cd25262571beb2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:50.609993 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:59:50.654608 20220 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "0973ba22912840bd9bded8b0376fa1e7"
dest_uuid: "65876a2b197c4ea6918f5cab47ded25c"
mode: GRACEFUL
new_leader_uuid: "d1379e91aa9c41629cd25262571beb2c"
from {username='slave'} at 127.0.0.1:44048
I20251023 07:59:50.655102 20220 raft_consensus.cc:606] T 0973ba22912840bd9bded8b0376fa1e7 P 65876a2b197c4ea6918f5cab47ded25c [term 1 LEADER]: Received request to transfer leadership to TS d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:50.657183 20074 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "09f7b5cd377e45be8bbd85052c93dcb3"
dest_uuid: "35e7d1ade024444486e63cf1b81e9626"
mode: GRACEFUL
new_leader_uuid: "d1379e91aa9c41629cd25262571beb2c"
from {username='slave'} at 127.0.0.1:45642
I20251023 07:59:50.657680 20074 raft_consensus.cc:606] T 09f7b5cd377e45be8bbd85052c93dcb3 P 35e7d1ade024444486e63cf1b81e9626 [term 1 LEADER]: Received request to transfer leadership to TS d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:50.660005 20074 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "12b8704d81fe4e3cb14bfa975c73df29"
dest_uuid: "35e7d1ade024444486e63cf1b81e9626"
mode: GRACEFUL
new_leader_uuid: "d1379e91aa9c41629cd25262571beb2c"
from {username='slave'} at 127.0.0.1:45642
I20251023 07:59:50.660559 20074 raft_consensus.cc:606] T 12b8704d81fe4e3cb14bfa975c73df29 P 35e7d1ade024444486e63cf1b81e9626 [term 1 LEADER]: Received request to transfer leadership to TS d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:50.663177 20074 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "7062462192fc4895b5a9f6a34c4a132a"
dest_uuid: "35e7d1ade024444486e63cf1b81e9626"
mode: GRACEFUL
new_leader_uuid: "0f412334fb994ff0ab492afde64f5855"
from {username='slave'} at 127.0.0.1:45642
I20251023 07:59:50.663700 20074 raft_consensus.cc:606] T 7062462192fc4895b5a9f6a34c4a132a P 35e7d1ade024444486e63cf1b81e9626 [term 1 LEADER]: Received request to transfer leadership to TS 0f412334fb994ff0ab492afde64f5855
I20251023 07:59:50.666815 20150 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "d6cbef26ab7c4389b265743ae018e227"
dest_uuid: "0f412334fb994ff0ab492afde64f5855"
mode: GRACEFUL
new_leader_uuid: "d1379e91aa9c41629cd25262571beb2c"
from {username='slave'} at 127.0.0.1:39652
I20251023 07:59:50.667337 20150 raft_consensus.cc:606] T d6cbef26ab7c4389b265743ae018e227 P 0f412334fb994ff0ab492afde64f5855 [term 1 LEADER]: Received request to transfer leadership to TS d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:50.669751 20074 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "e08e797f71f1483a9c2b5899554a6dec"
dest_uuid: "35e7d1ade024444486e63cf1b81e9626"
mode: GRACEFUL
new_leader_uuid: "0f412334fb994ff0ab492afde64f5855"
from {username='slave'} at 127.0.0.1:45642
I20251023 07:59:50.670318 20074 raft_consensus.cc:606] T e08e797f71f1483a9c2b5899554a6dec P 35e7d1ade024444486e63cf1b81e9626 [term 1 LEADER]: Received request to transfer leadership to TS 0f412334fb994ff0ab492afde64f5855
I20251023 07:59:50.671370 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
I20251023 07:59:50.672614 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 07:59:50.673167 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:59:50.774020 21009 raft_consensus.cc:993] T d6cbef26ab7c4389b265743ae018e227 P 0f412334fb994ff0ab492afde64f5855: : Instructing follower d1379e91aa9c41629cd25262571beb2c to start an election
I20251023 07:59:50.774508 21023 raft_consensus.cc:1081] T d6cbef26ab7c4389b265743ae018e227 P 0f412334fb994ff0ab492afde64f5855 [term 1 LEADER]: Signalling peer d1379e91aa9c41629cd25262571beb2c to start an election
I20251023 07:59:50.775929 20813 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "d6cbef26ab7c4389b265743ae018e227"
dest_uuid: "d1379e91aa9c41629cd25262571beb2c"
from {username='slave'} at 127.0.0.1:56390
I20251023 07:59:50.776450 20813 raft_consensus.cc:493] T d6cbef26ab7c4389b265743ae018e227 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:59:50.776829 20813 raft_consensus.cc:3060] T d6cbef26ab7c4389b265743ae018e227 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:50.781564 20813 raft_consensus.cc:515] T d6cbef26ab7c4389b265743ae018e227 P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:50.782898 20813 leader_election.cc:290] T d6cbef26ab7c4389b265743ae018e227 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 2 election: Requested vote from peers 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309), 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287)
I20251023 07:59:50.783896 20150 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d6cbef26ab7c4389b265743ae018e227" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0f412334fb994ff0ab492afde64f5855"
I20251023 07:59:50.784032 20074 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d6cbef26ab7c4389b265743ae018e227" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "35e7d1ade024444486e63cf1b81e9626"
I20251023 07:59:50.784510 20150 raft_consensus.cc:3055] T d6cbef26ab7c4389b265743ae018e227 P 0f412334fb994ff0ab492afde64f5855 [term 1 LEADER]: Stepping down as leader of term 1
I20251023 07:59:50.784600 20074 raft_consensus.cc:3060] T d6cbef26ab7c4389b265743ae018e227 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:50.784857 20150 raft_consensus.cc:740] T d6cbef26ab7c4389b265743ae018e227 P 0f412334fb994ff0ab492afde64f5855 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Running, Role: LEADER
I20251023 07:59:50.785635 20150 consensus_queue.cc:260] T d6cbef26ab7c4389b265743ae018e227 P 0f412334fb994ff0ab492afde64f5855 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:50.786836 20150 raft_consensus.cc:3060] T d6cbef26ab7c4389b265743ae018e227 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:50.792614 20150 raft_consensus.cc:2468] T d6cbef26ab7c4389b265743ae018e227 P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 2.
I20251023 07:59:50.793547 20760 leader_election.cc:304] T d6cbef26ab7c4389b265743ae018e227 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, d1379e91aa9c41629cd25262571beb2c; no voters:
I20251023 07:59:50.793561 20074 raft_consensus.cc:2468] T d6cbef26ab7c4389b265743ae018e227 P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 2.
I20251023 07:59:50.794198 21048 raft_consensus.cc:2804] T d6cbef26ab7c4389b265743ae018e227 P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:59:50.794646 21048 raft_consensus.cc:697] T d6cbef26ab7c4389b265743ae018e227 P d1379e91aa9c41629cd25262571beb2c [term 2 LEADER]: Becoming Leader. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Running, Role: LEADER
I20251023 07:59:50.795310 21048 consensus_queue.cc:237] T d6cbef26ab7c4389b265743ae018e227 P d1379e91aa9c41629cd25262571beb2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:50.806849 19898 catalog_manager.cc:5649] T d6cbef26ab7c4389b265743ae018e227 P d1379e91aa9c41629cd25262571beb2c reported cstate change: term changed from 1 to 2, leader changed from 0f412334fb994ff0ab492afde64f5855 (127.16.126.3) to d1379e91aa9c41629cd25262571beb2c (127.16.126.1). New cstate: current_term: 2 leader_uuid: "d1379e91aa9c41629cd25262571beb2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:50.812484 21007 raft_consensus.cc:993] T 0973ba22912840bd9bded8b0376fa1e7 P 65876a2b197c4ea6918f5cab47ded25c: : Instructing follower d1379e91aa9c41629cd25262571beb2c to start an election
I20251023 07:59:50.813066 21004 raft_consensus.cc:1081] T 0973ba22912840bd9bded8b0376fa1e7 P 65876a2b197c4ea6918f5cab47ded25c [term 1 LEADER]: Signalling peer d1379e91aa9c41629cd25262571beb2c to start an election
I20251023 07:59:50.814487 20816 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "0973ba22912840bd9bded8b0376fa1e7"
dest_uuid: "d1379e91aa9c41629cd25262571beb2c"
from {username='slave'} at 127.0.0.1:56406
I20251023 07:59:50.815102 20816 raft_consensus.cc:493] T 0973ba22912840bd9bded8b0376fa1e7 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:59:50.815456 20816 raft_consensus.cc:3060] T 0973ba22912840bd9bded8b0376fa1e7 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:50.821966 20816 raft_consensus.cc:515] T 0973ba22912840bd9bded8b0376fa1e7 P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:50.823623 20816 leader_election.cc:290] T 0973ba22912840bd9bded8b0376fa1e7 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 2 election: Requested vote from peers 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955), 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309)
I20251023 07:59:50.824393 20223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0973ba22912840bd9bded8b0376fa1e7" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "65876a2b197c4ea6918f5cab47ded25c"
I20251023 07:59:50.824591 20074 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0973ba22912840bd9bded8b0376fa1e7" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "35e7d1ade024444486e63cf1b81e9626"
I20251023 07:59:50.824958 20223 raft_consensus.cc:3055] T 0973ba22912840bd9bded8b0376fa1e7 P 65876a2b197c4ea6918f5cab47ded25c [term 1 LEADER]: Stepping down as leader of term 1
I20251023 07:59:50.825161 20074 raft_consensus.cc:3060] T 0973ba22912840bd9bded8b0376fa1e7 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:50.825286 20223 raft_consensus.cc:740] T 0973ba22912840bd9bded8b0376fa1e7 P 65876a2b197c4ea6918f5cab47ded25c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 65876a2b197c4ea6918f5cab47ded25c, State: Running, Role: LEADER
I20251023 07:59:50.825999 20223 consensus_queue.cc:260] T 0973ba22912840bd9bded8b0376fa1e7 P 65876a2b197c4ea6918f5cab47ded25c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:50.826982 20223 raft_consensus.cc:3060] T 0973ba22912840bd9bded8b0376fa1e7 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:50.830796 20074 raft_consensus.cc:2468] T 0973ba22912840bd9bded8b0376fa1e7 P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 2.
I20251023 07:59:50.832094 20761 leader_election.cc:304] T 0973ba22912840bd9bded8b0376fa1e7 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35e7d1ade024444486e63cf1b81e9626, d1379e91aa9c41629cd25262571beb2c; no voters:
I20251023 07:59:50.832958 20223 raft_consensus.cc:2468] T 0973ba22912840bd9bded8b0376fa1e7 P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 2.
I20251023 07:59:50.832983 21048 raft_consensus.cc:2804] T 0973ba22912840bd9bded8b0376fa1e7 P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:59:50.834555 21048 raft_consensus.cc:697] T 0973ba22912840bd9bded8b0376fa1e7 P d1379e91aa9c41629cd25262571beb2c [term 2 LEADER]: Becoming Leader. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Running, Role: LEADER
I20251023 07:59:50.835314 21048 consensus_queue.cc:237] T 0973ba22912840bd9bded8b0376fa1e7 P d1379e91aa9c41629cd25262571beb2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:50.845002 19898 catalog_manager.cc:5649] T 0973ba22912840bd9bded8b0376fa1e7 P d1379e91aa9c41629cd25262571beb2c reported cstate change: term changed from 1 to 2, leader changed from 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4) to d1379e91aa9c41629cd25262571beb2c (127.16.126.1). New cstate: current_term: 2 leader_uuid: "d1379e91aa9c41629cd25262571beb2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:50.864383 20986 raft_consensus.cc:993] T 12b8704d81fe4e3cb14bfa975c73df29 P 35e7d1ade024444486e63cf1b81e9626: : Instructing follower d1379e91aa9c41629cd25262571beb2c to start an election
I20251023 07:59:50.864866 20986 raft_consensus.cc:1081] T 12b8704d81fe4e3cb14bfa975c73df29 P 35e7d1ade024444486e63cf1b81e9626 [term 1 LEADER]: Signalling peer d1379e91aa9c41629cd25262571beb2c to start an election
I20251023 07:59:50.868290 20816 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "12b8704d81fe4e3cb14bfa975c73df29"
dest_uuid: "d1379e91aa9c41629cd25262571beb2c"
from {username='slave'} at 127.0.0.1:56404
I20251023 07:59:50.869094 20816 raft_consensus.cc:493] T 12b8704d81fe4e3cb14bfa975c73df29 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:59:50.869626 20816 raft_consensus.cc:3060] T 12b8704d81fe4e3cb14bfa975c73df29 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:50.876765 20816 raft_consensus.cc:515] T 12b8704d81fe4e3cb14bfa975c73df29 P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:50.878202 20816 leader_election.cc:290] T 12b8704d81fe4e3cb14bfa975c73df29 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 2 election: Requested vote from peers 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309), 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287)
I20251023 07:59:50.879084 20150 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "12b8704d81fe4e3cb14bfa975c73df29" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0f412334fb994ff0ab492afde64f5855"
I20251023 07:59:50.879563 20150 raft_consensus.cc:3060] T 12b8704d81fe4e3cb14bfa975c73df29 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:50.879601 20074 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "12b8704d81fe4e3cb14bfa975c73df29" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "35e7d1ade024444486e63cf1b81e9626"
I20251023 07:59:50.880180 20074 raft_consensus.cc:3055] T 12b8704d81fe4e3cb14bfa975c73df29 P 35e7d1ade024444486e63cf1b81e9626 [term 1 LEADER]: Stepping down as leader of term 1
I20251023 07:59:50.880501 20074 raft_consensus.cc:740] T 12b8704d81fe4e3cb14bfa975c73df29 P 35e7d1ade024444486e63cf1b81e9626 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35e7d1ade024444486e63cf1b81e9626, State: Running, Role: LEADER
I20251023 07:59:50.881157 20074 consensus_queue.cc:260] T 12b8704d81fe4e3cb14bfa975c73df29 P 35e7d1ade024444486e63cf1b81e9626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:50.882347 20074 raft_consensus.cc:3060] T 12b8704d81fe4e3cb14bfa975c73df29 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:50.886240 20150 raft_consensus.cc:2468] T 12b8704d81fe4e3cb14bfa975c73df29 P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 2.
I20251023 07:59:50.887214 20760 leader_election.cc:304] T 12b8704d81fe4e3cb14bfa975c73df29 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, d1379e91aa9c41629cd25262571beb2c; no voters:
I20251023 07:59:50.888000 21048 raft_consensus.cc:2804] T 12b8704d81fe4e3cb14bfa975c73df29 P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:59:50.888413 21048 raft_consensus.cc:697] T 12b8704d81fe4e3cb14bfa975c73df29 P d1379e91aa9c41629cd25262571beb2c [term 2 LEADER]: Becoming Leader. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Running, Role: LEADER
I20251023 07:59:50.888833 20074 raft_consensus.cc:2468] T 12b8704d81fe4e3cb14bfa975c73df29 P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 2.
I20251023 07:59:50.889205 21048 consensus_queue.cc:237] T 12b8704d81fe4e3cb14bfa975c73df29 P d1379e91aa9c41629cd25262571beb2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:50.906209 19898 catalog_manager.cc:5649] T 12b8704d81fe4e3cb14bfa975c73df29 P d1379e91aa9c41629cd25262571beb2c reported cstate change: term changed from 1 to 2, leader changed from 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2) to d1379e91aa9c41629cd25262571beb2c (127.16.126.1). New cstate: current_term: 2 leader_uuid: "d1379e91aa9c41629cd25262571beb2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:50.952765 21024 raft_consensus.cc:993] T 09f7b5cd377e45be8bbd85052c93dcb3 P 35e7d1ade024444486e63cf1b81e9626: : Instructing follower d1379e91aa9c41629cd25262571beb2c to start an election
I20251023 07:59:50.953177 20986 raft_consensus.cc:1081] T 09f7b5cd377e45be8bbd85052c93dcb3 P 35e7d1ade024444486e63cf1b81e9626 [term 1 LEADER]: Signalling peer d1379e91aa9c41629cd25262571beb2c to start an election
I20251023 07:59:50.954398 20816 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "09f7b5cd377e45be8bbd85052c93dcb3"
dest_uuid: "d1379e91aa9c41629cd25262571beb2c"
from {username='slave'} at 127.0.0.1:56404
I20251023 07:59:50.954794 20816 raft_consensus.cc:493] T 09f7b5cd377e45be8bbd85052c93dcb3 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:59:50.955014 20816 raft_consensus.cc:3060] T 09f7b5cd377e45be8bbd85052c93dcb3 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:50.960156 20816 raft_consensus.cc:515] T 09f7b5cd377e45be8bbd85052c93dcb3 P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:50.962126 20816 leader_election.cc:290] T 09f7b5cd377e45be8bbd85052c93dcb3 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 2 election: Requested vote from peers 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309), 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287)
I20251023 07:59:50.962491 20074 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "09f7b5cd377e45be8bbd85052c93dcb3" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "35e7d1ade024444486e63cf1b81e9626"
I20251023 07:59:50.962801 20148 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "09f7b5cd377e45be8bbd85052c93dcb3" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0f412334fb994ff0ab492afde64f5855"
I20251023 07:59:50.963120 20074 raft_consensus.cc:3055] T 09f7b5cd377e45be8bbd85052c93dcb3 P 35e7d1ade024444486e63cf1b81e9626 [term 1 LEADER]: Stepping down as leader of term 1
I20251023 07:59:50.963393 20148 raft_consensus.cc:3060] T 09f7b5cd377e45be8bbd85052c93dcb3 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:50.963451 20074 raft_consensus.cc:740] T 09f7b5cd377e45be8bbd85052c93dcb3 P 35e7d1ade024444486e63cf1b81e9626 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35e7d1ade024444486e63cf1b81e9626, State: Running, Role: LEADER
I20251023 07:59:50.964385 20074 consensus_queue.cc:260] T 09f7b5cd377e45be8bbd85052c93dcb3 P 35e7d1ade024444486e63cf1b81e9626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:50.965287 20986 raft_consensus.cc:993] T 7062462192fc4895b5a9f6a34c4a132a P 35e7d1ade024444486e63cf1b81e9626: : Instructing follower 0f412334fb994ff0ab492afde64f5855 to start an election
I20251023 07:59:50.965492 20074 raft_consensus.cc:3060] T 09f7b5cd377e45be8bbd85052c93dcb3 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:50.966775 21024 raft_consensus.cc:1081] T 7062462192fc4895b5a9f6a34c4a132a P 35e7d1ade024444486e63cf1b81e9626 [term 1 LEADER]: Signalling peer 0f412334fb994ff0ab492afde64f5855 to start an election
I20251023 07:59:50.968568 20146 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "7062462192fc4895b5a9f6a34c4a132a"
dest_uuid: "0f412334fb994ff0ab492afde64f5855"
from {username='slave'} at 127.0.0.1:55112
I20251023 07:59:50.969116 20146 raft_consensus.cc:493] T 7062462192fc4895b5a9f6a34c4a132a P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:59:50.969480 20146 raft_consensus.cc:3060] T 7062462192fc4895b5a9f6a34c4a132a P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:50.970587 20148 raft_consensus.cc:2468] T 09f7b5cd377e45be8bbd85052c93dcb3 P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 2.
I20251023 07:59:50.971576 20760 leader_election.cc:304] T 09f7b5cd377e45be8bbd85052c93dcb3 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, d1379e91aa9c41629cd25262571beb2c; no voters:
I20251023 07:59:50.976373 21048 raft_consensus.cc:2804] T 09f7b5cd377e45be8bbd85052c93dcb3 P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:59:50.976672 20074 raft_consensus.cc:2468] T 09f7b5cd377e45be8bbd85052c93dcb3 P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 2.
I20251023 07:59:50.977180 21048 raft_consensus.cc:697] T 09f7b5cd377e45be8bbd85052c93dcb3 P d1379e91aa9c41629cd25262571beb2c [term 2 LEADER]: Becoming Leader. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Running, Role: LEADER
I20251023 07:59:50.978817 21048 consensus_queue.cc:237] T 09f7b5cd377e45be8bbd85052c93dcb3 P d1379e91aa9c41629cd25262571beb2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:50.983615 20146 raft_consensus.cc:515] T 7062462192fc4895b5a9f6a34c4a132a P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:50.986963 20078 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7062462192fc4895b5a9f6a34c4a132a" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "35e7d1ade024444486e63cf1b81e9626"
I20251023 07:59:50.987509 20078 raft_consensus.cc:3055] T 7062462192fc4895b5a9f6a34c4a132a P 35e7d1ade024444486e63cf1b81e9626 [term 1 LEADER]: Stepping down as leader of term 1
I20251023 07:59:50.987779 20078 raft_consensus.cc:740] T 7062462192fc4895b5a9f6a34c4a132a P 35e7d1ade024444486e63cf1b81e9626 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35e7d1ade024444486e63cf1b81e9626, State: Running, Role: LEADER
I20251023 07:59:50.988446 20078 consensus_queue.cc:260] T 7062462192fc4895b5a9f6a34c4a132a P 35e7d1ade024444486e63cf1b81e9626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:50.989490 20078 raft_consensus.cc:3060] T 7062462192fc4895b5a9f6a34c4a132a P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:50.990481 20146 leader_election.cc:290] T 7062462192fc4895b5a9f6a34c4a132a P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 2 election: Requested vote from peers 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309), 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955)
I20251023 07:59:50.992012 20220 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7062462192fc4895b5a9f6a34c4a132a" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "65876a2b197c4ea6918f5cab47ded25c"
I20251023 07:59:50.992515 20220 raft_consensus.cc:3060] T 7062462192fc4895b5a9f6a34c4a132a P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:50.993227 19898 catalog_manager.cc:5649] T 09f7b5cd377e45be8bbd85052c93dcb3 P d1379e91aa9c41629cd25262571beb2c reported cstate change: term changed from 1 to 2, leader changed from 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2) to d1379e91aa9c41629cd25262571beb2c (127.16.126.1). New cstate: current_term: 2 leader_uuid: "d1379e91aa9c41629cd25262571beb2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:50.999104 20078 raft_consensus.cc:2468] T 7062462192fc4895b5a9f6a34c4a132a P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f412334fb994ff0ab492afde64f5855 in term 2.
I20251023 07:59:51.000440 20116 leader_election.cc:304] T 7062462192fc4895b5a9f6a34c4a132a P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, 35e7d1ade024444486e63cf1b81e9626; no voters:
I20251023 07:59:51.001444 20220 raft_consensus.cc:2468] T 7062462192fc4895b5a9f6a34c4a132a P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f412334fb994ff0ab492afde64f5855 in term 2.
I20251023 07:59:51.001472 21023 raft_consensus.cc:2804] T 7062462192fc4895b5a9f6a34c4a132a P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:59:51.002236 21023 raft_consensus.cc:697] T 7062462192fc4895b5a9f6a34c4a132a P 0f412334fb994ff0ab492afde64f5855 [term 2 LEADER]: Becoming Leader. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Running, Role: LEADER
I20251023 07:59:51.003216 21023 consensus_queue.cc:237] T 7062462192fc4895b5a9f6a34c4a132a P 0f412334fb994ff0ab492afde64f5855 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:51.013799 19898 catalog_manager.cc:5649] T 7062462192fc4895b5a9f6a34c4a132a P 0f412334fb994ff0ab492afde64f5855 reported cstate change: term changed from 1 to 2, leader changed from 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2) to 0f412334fb994ff0ab492afde64f5855 (127.16.126.3). New cstate: current_term: 2 leader_uuid: "0f412334fb994ff0ab492afde64f5855" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:51.183638 21024 raft_consensus.cc:993] T e08e797f71f1483a9c2b5899554a6dec P 35e7d1ade024444486e63cf1b81e9626: : Instructing follower 0f412334fb994ff0ab492afde64f5855 to start an election
I20251023 07:59:51.184072 20986 raft_consensus.cc:1081] T e08e797f71f1483a9c2b5899554a6dec P 35e7d1ade024444486e63cf1b81e9626 [term 1 LEADER]: Signalling peer 0f412334fb994ff0ab492afde64f5855 to start an election
I20251023 07:59:51.185408 20146 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "e08e797f71f1483a9c2b5899554a6dec"
dest_uuid: "0f412334fb994ff0ab492afde64f5855"
from {username='slave'} at 127.0.0.1:55112
I20251023 07:59:51.185880 20146 raft_consensus.cc:493] T e08e797f71f1483a9c2b5899554a6dec P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:59:51.186128 20146 raft_consensus.cc:3060] T e08e797f71f1483a9c2b5899554a6dec P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:51.191221 20146 raft_consensus.cc:515] T e08e797f71f1483a9c2b5899554a6dec P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:51.193706 20074 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e08e797f71f1483a9c2b5899554a6dec" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "35e7d1ade024444486e63cf1b81e9626"
I20251023 07:59:51.193965 20220 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e08e797f71f1483a9c2b5899554a6dec" candidate_uuid: "0f412334fb994ff0ab492afde64f5855" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "65876a2b197c4ea6918f5cab47ded25c"
I20251023 07:59:51.194361 20074 raft_consensus.cc:3055] T e08e797f71f1483a9c2b5899554a6dec P 35e7d1ade024444486e63cf1b81e9626 [term 1 LEADER]: Stepping down as leader of term 1
I20251023 07:59:51.194466 20220 raft_consensus.cc:3060] T e08e797f71f1483a9c2b5899554a6dec P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:51.193385 20146 leader_election.cc:290] T e08e797f71f1483a9c2b5899554a6dec P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 2 election: Requested vote from peers 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309), 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955)
I20251023 07:59:51.194718 20074 raft_consensus.cc:740] T e08e797f71f1483a9c2b5899554a6dec P 35e7d1ade024444486e63cf1b81e9626 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35e7d1ade024444486e63cf1b81e9626, State: Running, Role: LEADER
I20251023 07:59:51.195577 20074 consensus_queue.cc:260] T e08e797f71f1483a9c2b5899554a6dec P 35e7d1ade024444486e63cf1b81e9626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:51.196780 20074 raft_consensus.cc:3060] T e08e797f71f1483a9c2b5899554a6dec P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:51.201614 20220 raft_consensus.cc:2468] T e08e797f71f1483a9c2b5899554a6dec P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f412334fb994ff0ab492afde64f5855 in term 2.
I20251023 07:59:51.202742 20117 leader_election.cc:304] T e08e797f71f1483a9c2b5899554a6dec P 0f412334fb994ff0ab492afde64f5855 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, 65876a2b197c4ea6918f5cab47ded25c; no voters:
I20251023 07:59:51.203493 21061 raft_consensus.cc:2804] T e08e797f71f1483a9c2b5899554a6dec P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:59:51.203639 20074 raft_consensus.cc:2468] T e08e797f71f1483a9c2b5899554a6dec P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f412334fb994ff0ab492afde64f5855 in term 2.
I20251023 07:59:51.203954 21061 raft_consensus.cc:697] T e08e797f71f1483a9c2b5899554a6dec P 0f412334fb994ff0ab492afde64f5855 [term 2 LEADER]: Becoming Leader. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Running, Role: LEADER
I20251023 07:59:51.204859 21061 consensus_queue.cc:237] T e08e797f71f1483a9c2b5899554a6dec P 0f412334fb994ff0ab492afde64f5855 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:51.213781 19898 catalog_manager.cc:5649] T e08e797f71f1483a9c2b5899554a6dec P 0f412334fb994ff0ab492afde64f5855 reported cstate change: term changed from 1 to 2, leader changed from 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2) to 0f412334fb994ff0ab492afde64f5855 (127.16.126.3). New cstate: current_term: 2 leader_uuid: "0f412334fb994ff0ab492afde64f5855" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:51.243156 20146 raft_consensus.cc:1275] T d6cbef26ab7c4389b265743ae018e227 P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Refusing update from remote peer d1379e91aa9c41629cd25262571beb2c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:51.244199 21048 consensus_queue.cc:1048] T d6cbef26ab7c4389b265743ae018e227 P d1379e91aa9c41629cd25262571beb2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:51.255812 20074 raft_consensus.cc:1275] T d6cbef26ab7c4389b265743ae018e227 P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Refusing update from remote peer d1379e91aa9c41629cd25262571beb2c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:51.257282 21042 consensus_queue.cc:1048] T d6cbef26ab7c4389b265743ae018e227 P d1379e91aa9c41629cd25262571beb2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:51.294514 20074 raft_consensus.cc:1275] T 12b8704d81fe4e3cb14bfa975c73df29 P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Refusing update from remote peer d1379e91aa9c41629cd25262571beb2c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:51.294608 20146 raft_consensus.cc:1275] T 12b8704d81fe4e3cb14bfa975c73df29 P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Refusing update from remote peer d1379e91aa9c41629cd25262571beb2c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:51.295923 21051 consensus_queue.cc:1048] T 12b8704d81fe4e3cb14bfa975c73df29 P d1379e91aa9c41629cd25262571beb2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:51.296693 21042 consensus_queue.cc:1048] T 12b8704d81fe4e3cb14bfa975c73df29 P d1379e91aa9c41629cd25262571beb2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:51.438295 20078 raft_consensus.cc:1275] T 0973ba22912840bd9bded8b0376fa1e7 P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Refusing update from remote peer d1379e91aa9c41629cd25262571beb2c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:51.439355 21051 consensus_queue.cc:1048] T 0973ba22912840bd9bded8b0376fa1e7 P d1379e91aa9c41629cd25262571beb2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:51.449249 20220 raft_consensus.cc:1275] T 0973ba22912840bd9bded8b0376fa1e7 P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Refusing update from remote peer d1379e91aa9c41629cd25262571beb2c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:51.450531 21074 consensus_queue.cc:1048] T 0973ba22912840bd9bded8b0376fa1e7 P d1379e91aa9c41629cd25262571beb2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:51.482667 20078 raft_consensus.cc:1275] T 09f7b5cd377e45be8bbd85052c93dcb3 P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Refusing update from remote peer d1379e91aa9c41629cd25262571beb2c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:51.483827 21074 consensus_queue.cc:1048] T 09f7b5cd377e45be8bbd85052c93dcb3 P d1379e91aa9c41629cd25262571beb2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:51.486088 20220 raft_consensus.cc:1275] T 7062462192fc4895b5a9f6a34c4a132a P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Refusing update from remote peer 0f412334fb994ff0ab492afde64f5855: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:51.487283 21023 consensus_queue.cc:1048] T 7062462192fc4895b5a9f6a34c4a132a P 0f412334fb994ff0ab492afde64f5855 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:51.491561 20148 raft_consensus.cc:1275] T 09f7b5cd377e45be8bbd85052c93dcb3 P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Refusing update from remote peer d1379e91aa9c41629cd25262571beb2c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:51.493135 21048 consensus_queue.cc:1048] T 09f7b5cd377e45be8bbd85052c93dcb3 P d1379e91aa9c41629cd25262571beb2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:51.523320 20078 raft_consensus.cc:1275] T 7062462192fc4895b5a9f6a34c4a132a P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Refusing update from remote peer 0f412334fb994ff0ab492afde64f5855: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:51.525245 21023 consensus_queue.cc:1048] T 7062462192fc4895b5a9f6a34c4a132a P 0f412334fb994ff0ab492afde64f5855 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:51.636477 20223 raft_consensus.cc:1275] T e08e797f71f1483a9c2b5899554a6dec P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Refusing update from remote peer 0f412334fb994ff0ab492afde64f5855: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:51.637725 21023 consensus_queue.cc:1048] T e08e797f71f1483a9c2b5899554a6dec P 0f412334fb994ff0ab492afde64f5855 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:51.638787 20078 raft_consensus.cc:1275] T e08e797f71f1483a9c2b5899554a6dec P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Refusing update from remote peer 0f412334fb994ff0ab492afde64f5855: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:51.640311 21023 consensus_queue.cc:1048] T e08e797f71f1483a9c2b5899554a6dec P 0f412334fb994ff0ab492afde64f5855 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:51.717764 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:59:51.760172 20223 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "35c1ea979bda45aead7d1b8539f37637"
dest_uuid: "65876a2b197c4ea6918f5cab47ded25c"
mode: GRACEFUL
new_leader_uuid: "d1379e91aa9c41629cd25262571beb2c"
from {username='slave'} at 127.0.0.1:44048
I20251023 07:59:51.760825 20223 raft_consensus.cc:606] T 35c1ea979bda45aead7d1b8539f37637 P 65876a2b197c4ea6918f5cab47ded25c [term 2 LEADER]: Received request to transfer leadership to TS d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:51.763648 20148 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "791953f9d44946eaa145c5857557a5e4"
dest_uuid: "0f412334fb994ff0ab492afde64f5855"
mode: GRACEFUL
new_leader_uuid: "35e7d1ade024444486e63cf1b81e9626"
from {username='slave'} at 127.0.0.1:39652
I20251023 07:59:51.764114 20148 raft_consensus.cc:606] T 791953f9d44946eaa145c5857557a5e4 P 0f412334fb994ff0ab492afde64f5855 [term 1 LEADER]: Received request to transfer leadership to TS 35e7d1ade024444486e63cf1b81e9626
I20251023 07:59:51.766523 20223 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "ccba7896b7e1413293428358ffd0f8a0"
dest_uuid: "65876a2b197c4ea6918f5cab47ded25c"
mode: GRACEFUL
new_leader_uuid: "d1379e91aa9c41629cd25262571beb2c"
from {username='slave'} at 127.0.0.1:44048
I20251023 07:59:51.767067 20223 raft_consensus.cc:606] T ccba7896b7e1413293428358ffd0f8a0 P 65876a2b197c4ea6918f5cab47ded25c [term 1 LEADER]: Received request to transfer leadership to TS d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:51.769455 20146 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "fa36a9cfa4fe43418245de193502470f"
dest_uuid: "0f412334fb994ff0ab492afde64f5855"
mode: GRACEFUL
new_leader_uuid: "d1379e91aa9c41629cd25262571beb2c"
from {username='slave'} at 127.0.0.1:39652
I20251023 07:59:51.770001 20146 raft_consensus.cc:606] T fa36a9cfa4fe43418245de193502470f P 0f412334fb994ff0ab492afde64f5855 [term 2 LEADER]: Received request to transfer leadership to TS d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:51.778242 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 4
I20251023 07:59:51.780143 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 07:59:51.780880 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:59:51.828128 21007 raft_consensus.cc:993] T 35c1ea979bda45aead7d1b8539f37637 P 65876a2b197c4ea6918f5cab47ded25c: : Instructing follower d1379e91aa9c41629cd25262571beb2c to start an election
I20251023 07:59:51.828606 21004 raft_consensus.cc:1081] T 35c1ea979bda45aead7d1b8539f37637 P 65876a2b197c4ea6918f5cab47ded25c [term 2 LEADER]: Signalling peer d1379e91aa9c41629cd25262571beb2c to start an election
I20251023 07:59:51.829825 20813 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "35c1ea979bda45aead7d1b8539f37637"
dest_uuid: "d1379e91aa9c41629cd25262571beb2c"
from {username='slave'} at 127.0.0.1:56406
I20251023 07:59:51.830258 20813 raft_consensus.cc:493] T 35c1ea979bda45aead7d1b8539f37637 P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:59:51.830529 20813 raft_consensus.cc:3060] T 35c1ea979bda45aead7d1b8539f37637 P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:59:51.835979 20813 raft_consensus.cc:515] T 35c1ea979bda45aead7d1b8539f37637 P d1379e91aa9c41629cd25262571beb2c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:51.837493 20813 leader_election.cc:290] T 35c1ea979bda45aead7d1b8539f37637 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 3 election: Requested vote from peers 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955), 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309)
I20251023 07:59:51.838156 20223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "35c1ea979bda45aead7d1b8539f37637" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "65876a2b197c4ea6918f5cab47ded25c"
I20251023 07:59:51.838388 20078 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "35c1ea979bda45aead7d1b8539f37637" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "35e7d1ade024444486e63cf1b81e9626"
I20251023 07:59:51.838817 20223 raft_consensus.cc:3055] T 35c1ea979bda45aead7d1b8539f37637 P 65876a2b197c4ea6918f5cab47ded25c [term 2 LEADER]: Stepping down as leader of term 2
I20251023 07:59:51.838951 20078 raft_consensus.cc:3060] T 35c1ea979bda45aead7d1b8539f37637 P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:59:51.839108 20223 raft_consensus.cc:740] T 35c1ea979bda45aead7d1b8539f37637 P 65876a2b197c4ea6918f5cab47ded25c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 65876a2b197c4ea6918f5cab47ded25c, State: Running, Role: LEADER
I20251023 07:59:51.839828 20223 consensus_queue.cc:260] T 35c1ea979bda45aead7d1b8539f37637 P 65876a2b197c4ea6918f5cab47ded25c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:51.840802 20223 raft_consensus.cc:3060] T 35c1ea979bda45aead7d1b8539f37637 P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:59:51.844605 20078 raft_consensus.cc:2468] T 35c1ea979bda45aead7d1b8539f37637 P 35e7d1ade024444486e63cf1b81e9626 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 3.
I20251023 07:59:51.845678 20761 leader_election.cc:304] T 35c1ea979bda45aead7d1b8539f37637 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35e7d1ade024444486e63cf1b81e9626, d1379e91aa9c41629cd25262571beb2c; no voters:
I20251023 07:59:51.846419 21042 raft_consensus.cc:2804] T 35c1ea979bda45aead7d1b8539f37637 P d1379e91aa9c41629cd25262571beb2c [term 3 FOLLOWER]: Leader election won for term 3
I20251023 07:59:51.846448 20223 raft_consensus.cc:2468] T 35c1ea979bda45aead7d1b8539f37637 P 65876a2b197c4ea6918f5cab47ded25c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 3.
I20251023 07:59:51.846907 21042 raft_consensus.cc:697] T 35c1ea979bda45aead7d1b8539f37637 P d1379e91aa9c41629cd25262571beb2c [term 3 LEADER]: Becoming Leader. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Running, Role: LEADER
I20251023 07:59:51.847716 21042 consensus_queue.cc:237] T 35c1ea979bda45aead7d1b8539f37637 P d1379e91aa9c41629cd25262571beb2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } }
I20251023 07:59:51.857285 19896 catalog_manager.cc:5649] T 35c1ea979bda45aead7d1b8539f37637 P d1379e91aa9c41629cd25262571beb2c reported cstate change: term changed from 2 to 3, leader changed from 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4) to d1379e91aa9c41629cd25262571beb2c (127.16.126.1). New cstate: current_term: 3 leader_uuid: "d1379e91aa9c41629cd25262571beb2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:51.947831 21023 raft_consensus.cc:993] T fa36a9cfa4fe43418245de193502470f P 0f412334fb994ff0ab492afde64f5855: : Instructing follower d1379e91aa9c41629cd25262571beb2c to start an election
I20251023 07:59:51.948413 21086 raft_consensus.cc:1081] T fa36a9cfa4fe43418245de193502470f P 0f412334fb994ff0ab492afde64f5855 [term 2 LEADER]: Signalling peer d1379e91aa9c41629cd25262571beb2c to start an election
I20251023 07:59:51.949870 20813 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "fa36a9cfa4fe43418245de193502470f"
dest_uuid: "d1379e91aa9c41629cd25262571beb2c"
from {username='slave'} at 127.0.0.1:56390
I20251023 07:59:51.950449 20813 raft_consensus.cc:493] T fa36a9cfa4fe43418245de193502470f P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:59:51.950785 20813 raft_consensus.cc:3060] T fa36a9cfa4fe43418245de193502470f P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:59:51.962266 20813 raft_consensus.cc:515] T fa36a9cfa4fe43418245de193502470f P d1379e91aa9c41629cd25262571beb2c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:51.964543 20148 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fa36a9cfa4fe43418245de193502470f" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0f412334fb994ff0ab492afde64f5855"
I20251023 07:59:51.965152 20148 raft_consensus.cc:3055] T fa36a9cfa4fe43418245de193502470f P 0f412334fb994ff0ab492afde64f5855 [term 2 LEADER]: Stepping down as leader of term 2
I20251023 07:59:51.965477 20148 raft_consensus.cc:740] T fa36a9cfa4fe43418245de193502470f P 0f412334fb994ff0ab492afde64f5855 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Running, Role: LEADER
I20251023 07:59:51.965965 20813 leader_election.cc:290] T fa36a9cfa4fe43418245de193502470f P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 3 election: Requested vote from peers 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287), 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955)
I20251023 07:59:51.966130 20220 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fa36a9cfa4fe43418245de193502470f" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "65876a2b197c4ea6918f5cab47ded25c"
I20251023 07:59:51.966704 20220 raft_consensus.cc:3060] T fa36a9cfa4fe43418245de193502470f P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:59:51.966171 20148 consensus_queue.cc:260] T fa36a9cfa4fe43418245de193502470f P 0f412334fb994ff0ab492afde64f5855 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:51.967510 20148 raft_consensus.cc:3060] T fa36a9cfa4fe43418245de193502470f P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Advancing to term 3
I20251023 07:59:51.972312 20220 raft_consensus.cc:2468] T fa36a9cfa4fe43418245de193502470f P 65876a2b197c4ea6918f5cab47ded25c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 3.
I20251023 07:59:51.973333 20762 leader_election.cc:304] T fa36a9cfa4fe43418245de193502470f P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65876a2b197c4ea6918f5cab47ded25c, d1379e91aa9c41629cd25262571beb2c; no voters:
I20251023 07:59:51.973743 20148 raft_consensus.cc:2468] T fa36a9cfa4fe43418245de193502470f P 0f412334fb994ff0ab492afde64f5855 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 3.
I20251023 07:59:51.974377 21051 raft_consensus.cc:2804] T fa36a9cfa4fe43418245de193502470f P d1379e91aa9c41629cd25262571beb2c [term 3 FOLLOWER]: Leader election won for term 3
I20251023 07:59:51.975087 21051 raft_consensus.cc:697] T fa36a9cfa4fe43418245de193502470f P d1379e91aa9c41629cd25262571beb2c [term 3 LEADER]: Becoming Leader. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Running, Role: LEADER
I20251023 07:59:51.976009 21051 consensus_queue.cc:237] T fa36a9cfa4fe43418245de193502470f P d1379e91aa9c41629cd25262571beb2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:51.986415 19896 catalog_manager.cc:5649] T fa36a9cfa4fe43418245de193502470f P d1379e91aa9c41629cd25262571beb2c reported cstate change: term changed from 2 to 3, leader changed from 0f412334fb994ff0ab492afde64f5855 (127.16.126.3) to d1379e91aa9c41629cd25262571beb2c (127.16.126.1). New cstate: current_term: 3 leader_uuid: "d1379e91aa9c41629cd25262571beb2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: HEALTHY } } }
I20251023 07:59:52.069420 21023 raft_consensus.cc:993] T 791953f9d44946eaa145c5857557a5e4 P 0f412334fb994ff0ab492afde64f5855: : Instructing follower 35e7d1ade024444486e63cf1b81e9626 to start an election
I20251023 07:59:52.069859 21086 raft_consensus.cc:1081] T 791953f9d44946eaa145c5857557a5e4 P 0f412334fb994ff0ab492afde64f5855 [term 1 LEADER]: Signalling peer 35e7d1ade024444486e63cf1b81e9626 to start an election
I20251023 07:59:52.071110 20078 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "791953f9d44946eaa145c5857557a5e4"
dest_uuid: "35e7d1ade024444486e63cf1b81e9626"
from {username='slave'} at 127.0.0.1:43636
I20251023 07:59:52.071838 20078 raft_consensus.cc:493] T 791953f9d44946eaa145c5857557a5e4 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:59:52.072170 20078 raft_consensus.cc:3060] T 791953f9d44946eaa145c5857557a5e4 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:52.078511 20078 raft_consensus.cc:515] T 791953f9d44946eaa145c5857557a5e4 P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:52.080736 20148 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "791953f9d44946eaa145c5857557a5e4" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0f412334fb994ff0ab492afde64f5855"
I20251023 07:59:52.080565 20078 leader_election.cc:290] T 791953f9d44946eaa145c5857557a5e4 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 2 election: Requested vote from peers 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287), 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955)
I20251023 07:59:52.081132 20220 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "791953f9d44946eaa145c5857557a5e4" candidate_uuid: "35e7d1ade024444486e63cf1b81e9626" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "65876a2b197c4ea6918f5cab47ded25c"
I20251023 07:59:52.082168 20220 raft_consensus.cc:3060] T 791953f9d44946eaa145c5857557a5e4 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:52.081491 20148 raft_consensus.cc:3055] T 791953f9d44946eaa145c5857557a5e4 P 0f412334fb994ff0ab492afde64f5855 [term 1 LEADER]: Stepping down as leader of term 1
I20251023 07:59:52.084146 20148 raft_consensus.cc:740] T 791953f9d44946eaa145c5857557a5e4 P 0f412334fb994ff0ab492afde64f5855 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f412334fb994ff0ab492afde64f5855, State: Running, Role: LEADER
I20251023 07:59:52.084882 20148 consensus_queue.cc:260] T 791953f9d44946eaa145c5857557a5e4 P 0f412334fb994ff0ab492afde64f5855 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:52.086133 20148 raft_consensus.cc:3060] T 791953f9d44946eaa145c5857557a5e4 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:52.090281 20220 raft_consensus.cc:2468] T 791953f9d44946eaa145c5857557a5e4 P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35e7d1ade024444486e63cf1b81e9626 in term 2.
I20251023 07:59:52.091495 20043 leader_election.cc:304] T 791953f9d44946eaa145c5857557a5e4 P 35e7d1ade024444486e63cf1b81e9626 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35e7d1ade024444486e63cf1b81e9626, 65876a2b197c4ea6918f5cab47ded25c; no voters:
I20251023 07:59:52.092275 20986 raft_consensus.cc:2804] T 791953f9d44946eaa145c5857557a5e4 P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:59:52.092679 20986 raft_consensus.cc:697] T 791953f9d44946eaa145c5857557a5e4 P 35e7d1ade024444486e63cf1b81e9626 [term 2 LEADER]: Becoming Leader. State: Replica: 35e7d1ade024444486e63cf1b81e9626, State: Running, Role: LEADER
I20251023 07:59:52.093104 20148 raft_consensus.cc:2468] T 791953f9d44946eaa145c5857557a5e4 P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35e7d1ade024444486e63cf1b81e9626 in term 2.
I20251023 07:59:52.093385 20986 consensus_queue.cc:237] T 791953f9d44946eaa145c5857557a5e4 P 35e7d1ade024444486e63cf1b81e9626 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } }
I20251023 07:59:52.115607 19898 catalog_manager.cc:5649] T 791953f9d44946eaa145c5857557a5e4 P 35e7d1ade024444486e63cf1b81e9626 reported cstate change: term changed from 1 to 2, leader changed from 0f412334fb994ff0ab492afde64f5855 (127.16.126.3) to 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2). New cstate: current_term: 2 leader_uuid: "35e7d1ade024444486e63cf1b81e9626" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:52.126955 21007 raft_consensus.cc:993] T ccba7896b7e1413293428358ffd0f8a0 P 65876a2b197c4ea6918f5cab47ded25c: : Instructing follower d1379e91aa9c41629cd25262571beb2c to start an election
I20251023 07:59:52.127379 21004 raft_consensus.cc:1081] T ccba7896b7e1413293428358ffd0f8a0 P 65876a2b197c4ea6918f5cab47ded25c [term 1 LEADER]: Signalling peer d1379e91aa9c41629cd25262571beb2c to start an election
I20251023 07:59:52.128582 20813 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "ccba7896b7e1413293428358ffd0f8a0"
dest_uuid: "d1379e91aa9c41629cd25262571beb2c"
from {username='slave'} at 127.0.0.1:56406
I20251023 07:59:52.129005 20813 raft_consensus.cc:493] T ccba7896b7e1413293428358ffd0f8a0 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:59:52.129330 20813 raft_consensus.cc:3060] T ccba7896b7e1413293428358ffd0f8a0 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:52.134654 20813 raft_consensus.cc:515] T ccba7896b7e1413293428358ffd0f8a0 P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:52.136595 20813 leader_election.cc:290] T ccba7896b7e1413293428358ffd0f8a0 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 2 election: Requested vote from peers 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287), 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4:34955)
I20251023 07:59:52.137152 20146 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ccba7896b7e1413293428358ffd0f8a0" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0f412334fb994ff0ab492afde64f5855"
I20251023 07:59:52.137814 20146 raft_consensus.cc:3060] T ccba7896b7e1413293428358ffd0f8a0 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:52.137192 20220 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ccba7896b7e1413293428358ffd0f8a0" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "65876a2b197c4ea6918f5cab47ded25c"
I20251023 07:59:52.138458 20220 raft_consensus.cc:3055] T ccba7896b7e1413293428358ffd0f8a0 P 65876a2b197c4ea6918f5cab47ded25c [term 1 LEADER]: Stepping down as leader of term 1
I20251023 07:59:52.138758 20220 raft_consensus.cc:740] T ccba7896b7e1413293428358ffd0f8a0 P 65876a2b197c4ea6918f5cab47ded25c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 65876a2b197c4ea6918f5cab47ded25c, State: Running, Role: LEADER
I20251023 07:59:52.139853 20220 consensus_queue.cc:260] T ccba7896b7e1413293428358ffd0f8a0 P 65876a2b197c4ea6918f5cab47ded25c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:52.140746 20220 raft_consensus.cc:3060] T ccba7896b7e1413293428358ffd0f8a0 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:52.143131 20146 raft_consensus.cc:2468] T ccba7896b7e1413293428358ffd0f8a0 P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 2.
I20251023 07:59:52.144186 20760 leader_election.cc:304] T ccba7896b7e1413293428358ffd0f8a0 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, d1379e91aa9c41629cd25262571beb2c; no voters:
I20251023 07:59:52.144882 21042 raft_consensus.cc:2804] T ccba7896b7e1413293428358ffd0f8a0 P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:59:52.145277 21042 raft_consensus.cc:697] T ccba7896b7e1413293428358ffd0f8a0 P d1379e91aa9c41629cd25262571beb2c [term 2 LEADER]: Becoming Leader. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Running, Role: LEADER
I20251023 07:59:52.146026 20220 raft_consensus.cc:2468] T ccba7896b7e1413293428358ffd0f8a0 P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 2.
I20251023 07:59:52.146116 21042 consensus_queue.cc:237] T ccba7896b7e1413293428358ffd0f8a0 P d1379e91aa9c41629cd25262571beb2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:52.160671 19898 catalog_manager.cc:5649] T ccba7896b7e1413293428358ffd0f8a0 P d1379e91aa9c41629cd25262571beb2c reported cstate change: term changed from 1 to 2, leader changed from 65876a2b197c4ea6918f5cab47ded25c (127.16.126.4) to d1379e91aa9c41629cd25262571beb2c (127.16.126.1). New cstate: current_term: 2 leader_uuid: "d1379e91aa9c41629cd25262571beb2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: HEALTHY } } }
I20251023 07:59:52.234323 20078 raft_consensus.cc:1275] T 35c1ea979bda45aead7d1b8539f37637 P 35e7d1ade024444486e63cf1b81e9626 [term 3 FOLLOWER]: Refusing update from remote peer d1379e91aa9c41629cd25262571beb2c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251023 07:59:52.235615 21042 consensus_queue.cc:1048] T 35c1ea979bda45aead7d1b8539f37637 P d1379e91aa9c41629cd25262571beb2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:59:52.245306 20223 raft_consensus.cc:1275] T 35c1ea979bda45aead7d1b8539f37637 P 65876a2b197c4ea6918f5cab47ded25c [term 3 FOLLOWER]: Refusing update from remote peer d1379e91aa9c41629cd25262571beb2c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251023 07:59:52.247035 21042 consensus_queue.cc:1048] T 35c1ea979bda45aead7d1b8539f37637 P d1379e91aa9c41629cd25262571beb2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:59:52.436867 20148 raft_consensus.cc:1275] T fa36a9cfa4fe43418245de193502470f P 0f412334fb994ff0ab492afde64f5855 [term 3 FOLLOWER]: Refusing update from remote peer d1379e91aa9c41629cd25262571beb2c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251023 07:59:52.438091 21042 consensus_queue.cc:1048] T fa36a9cfa4fe43418245de193502470f P d1379e91aa9c41629cd25262571beb2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:59:52.447199 20220 raft_consensus.cc:1275] T fa36a9cfa4fe43418245de193502470f P 65876a2b197c4ea6918f5cab47ded25c [term 3 FOLLOWER]: Refusing update from remote peer d1379e91aa9c41629cd25262571beb2c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251023 07:59:52.448655 21042 consensus_queue.cc:1048] T fa36a9cfa4fe43418245de193502470f P d1379e91aa9c41629cd25262571beb2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 07:59:52.504719 20223 raft_consensus.cc:1275] T 791953f9d44946eaa145c5857557a5e4 P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Refusing update from remote peer 35e7d1ade024444486e63cf1b81e9626: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:52.506048 21024 consensus_queue.cc:1048] T 791953f9d44946eaa145c5857557a5e4 P 35e7d1ade024444486e63cf1b81e9626 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:52.518946 20148 raft_consensus.cc:1275] T 791953f9d44946eaa145c5857557a5e4 P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Refusing update from remote peer 35e7d1ade024444486e63cf1b81e9626: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:52.520450 20986 consensus_queue.cc:1048] T 791953f9d44946eaa145c5857557a5e4 P 35e7d1ade024444486e63cf1b81e9626 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:52.683980 20223 raft_consensus.cc:1275] T ccba7896b7e1413293428358ffd0f8a0 P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Refusing update from remote peer d1379e91aa9c41629cd25262571beb2c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:52.685158 21097 consensus_queue.cc:1048] T ccba7896b7e1413293428358ffd0f8a0 P d1379e91aa9c41629cd25262571beb2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:52.694226 20148 raft_consensus.cc:1275] T ccba7896b7e1413293428358ffd0f8a0 P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Refusing update from remote peer d1379e91aa9c41629cd25262571beb2c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:52.695487 21097 consensus_queue.cc:1048] T ccba7896b7e1413293428358ffd0f8a0 P d1379e91aa9c41629cd25262571beb2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:52.821269 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:59:52.862777 20078 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "82812175f15d4d3dae73f31641a1e583"
dest_uuid: "35e7d1ade024444486e63cf1b81e9626"
mode: GRACEFUL
new_leader_uuid: "d1379e91aa9c41629cd25262571beb2c"
from {username='slave'} at 127.0.0.1:45642
I20251023 07:59:52.863258 20078 raft_consensus.cc:606] T 82812175f15d4d3dae73f31641a1e583 P 35e7d1ade024444486e63cf1b81e9626 [term 1 LEADER]: Received request to transfer leadership to TS d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:52.864269 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 1
I20251023 07:59:52.865391 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 07:59:52.865938 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:59:53.388015 21092 raft_consensus.cc:993] T 82812175f15d4d3dae73f31641a1e583 P 35e7d1ade024444486e63cf1b81e9626: : Instructing follower d1379e91aa9c41629cd25262571beb2c to start an election
I20251023 07:59:53.388892 20986 raft_consensus.cc:1081] T 82812175f15d4d3dae73f31641a1e583 P 35e7d1ade024444486e63cf1b81e9626 [term 1 LEADER]: Signalling peer d1379e91aa9c41629cd25262571beb2c to start an election
I20251023 07:59:53.391045 20813 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "82812175f15d4d3dae73f31641a1e583"
dest_uuid: "d1379e91aa9c41629cd25262571beb2c"
from {username='slave'} at 127.0.0.1:56404
I20251023 07:59:53.391799 20813 raft_consensus.cc:493] T 82812175f15d4d3dae73f31641a1e583 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:59:53.392180 20813 raft_consensus.cc:3060] T 82812175f15d4d3dae73f31641a1e583 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:53.399400 20813 raft_consensus.cc:515] T 82812175f15d4d3dae73f31641a1e583 P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:53.401695 20813 leader_election.cc:290] T 82812175f15d4d3dae73f31641a1e583 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 2 election: Requested vote from peers 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309), 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287)
I20251023 07:59:53.402870 20078 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82812175f15d4d3dae73f31641a1e583" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "35e7d1ade024444486e63cf1b81e9626"
I20251023 07:59:53.403252 20148 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82812175f15d4d3dae73f31641a1e583" candidate_uuid: "d1379e91aa9c41629cd25262571beb2c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0f412334fb994ff0ab492afde64f5855"
I20251023 07:59:53.403729 20078 raft_consensus.cc:3055] T 82812175f15d4d3dae73f31641a1e583 P 35e7d1ade024444486e63cf1b81e9626 [term 1 LEADER]: Stepping down as leader of term 1
I20251023 07:59:53.403988 20148 raft_consensus.cc:3060] T 82812175f15d4d3dae73f31641a1e583 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:53.404050 20078 raft_consensus.cc:740] T 82812175f15d4d3dae73f31641a1e583 P 35e7d1ade024444486e63cf1b81e9626 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35e7d1ade024444486e63cf1b81e9626, State: Running, Role: LEADER
I20251023 07:59:53.405560 20078 consensus_queue.cc:260] T 82812175f15d4d3dae73f31641a1e583 P 35e7d1ade024444486e63cf1b81e9626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:53.406984 20078 raft_consensus.cc:3060] T 82812175f15d4d3dae73f31641a1e583 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:53.410745 20148 raft_consensus.cc:2468] T 82812175f15d4d3dae73f31641a1e583 P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 2.
I20251023 07:59:53.411953 20760 leader_election.cc:304] T 82812175f15d4d3dae73f31641a1e583 P d1379e91aa9c41629cd25262571beb2c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f412334fb994ff0ab492afde64f5855, d1379e91aa9c41629cd25262571beb2c; no voters:
I20251023 07:59:53.412715 21113 raft_consensus.cc:2804] T 82812175f15d4d3dae73f31641a1e583 P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:59:53.413096 21113 raft_consensus.cc:697] T 82812175f15d4d3dae73f31641a1e583 P d1379e91aa9c41629cd25262571beb2c [term 2 LEADER]: Becoming Leader. State: Replica: d1379e91aa9c41629cd25262571beb2c, State: Running, Role: LEADER
I20251023 07:59:53.413223 20078 raft_consensus.cc:2468] T 82812175f15d4d3dae73f31641a1e583 P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1379e91aa9c41629cd25262571beb2c in term 2.
I20251023 07:59:53.414114 21113 consensus_queue.cc:237] T 82812175f15d4d3dae73f31641a1e583 P d1379e91aa9c41629cd25262571beb2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } }
I20251023 07:59:53.425860 19898 catalog_manager.cc:5649] T 82812175f15d4d3dae73f31641a1e583 P d1379e91aa9c41629cd25262571beb2c reported cstate change: term changed from 1 to 2, leader changed from 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2) to d1379e91aa9c41629cd25262571beb2c (127.16.126.1). New cstate: current_term: 2 leader_uuid: "d1379e91aa9c41629cd25262571beb2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:53.806093 20148 raft_consensus.cc:1275] T 82812175f15d4d3dae73f31641a1e583 P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Refusing update from remote peer d1379e91aa9c41629cd25262571beb2c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:53.807435 21113 consensus_queue.cc:1048] T 82812175f15d4d3dae73f31641a1e583 P d1379e91aa9c41629cd25262571beb2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:53.823710 20078 raft_consensus.cc:1275] T 82812175f15d4d3dae73f31641a1e583 P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Refusing update from remote peer d1379e91aa9c41629cd25262571beb2c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:53.830437 21112 consensus_queue.cc:1048] T 82812175f15d4d3dae73f31641a1e583 P d1379e91aa9c41629cd25262571beb2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e7d1ade024444486e63cf1b81e9626" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 42309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:53.970242 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:59:54.003638 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251023 07:59:54.004638 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 07:59:54.005208 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:59:54.036283 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 07:59:54.076560 16888 tablet_server.cc:178] TabletServer@127.16.126.1:37865 shutting down...
W20251023 07:59:54.081023 20044 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 59 similar messages]
W20251023 07:59:54.102093 20192 consensus_peers.cc:597] T e2c26d408ee04105bd615b58287c82f9 P 65876a2b197c4ea6918f5cab47ded25c -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251023 07:59:54.102761 20192 consensus_peers.cc:597] T 58cef989d86d4b0c8401b4d6b2f890c0 P 65876a2b197c4ea6918f5cab47ded25c -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251023 07:59:54.106472 20044 consensus_peers.cc:597] T c3527495b334413f82d0eca2c4d117b1 P 35e7d1ade024444486e63cf1b81e9626 -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251023 07:59:54.112972 20192 consensus_peers.cc:597] T 2ff74dfb94334c20b99ea84b985a27a5 P 65876a2b197c4ea6918f5cab47ded25c -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:54.127548 16888 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251023 07:59:54.128641 16888 tablet_replica.cc:333] stopping tablet replica
W20251023 07:59:54.129267 20192 consensus_peers.cc:597] T f20a7a673ce6433eac41600d3573e314 P 65876a2b197c4ea6918f5cab47ded25c -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:54.129702 16888 raft_consensus.cc:2243] T aa253535ba594367a12fda3dea3b75d4 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.130241 16888 raft_consensus.cc:2272] T aa253535ba594367a12fda3dea3b75d4 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.133487 16888 tablet_replica.cc:333] stopping tablet replica
I20251023 07:59:54.134531 16888 raft_consensus.cc:2243] T 382a939856194537b68f791851ceaa65 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.135128 16888 raft_consensus.cc:2272] T 382a939856194537b68f791851ceaa65 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.138360 16888 tablet_replica.cc:333] stopping tablet replica
I20251023 07:59:54.139293 16888 raft_consensus.cc:2243] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.139775 16888 raft_consensus.cc:2272] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.142796 16888 tablet_replica.cc:333] stopping tablet replica
I20251023 07:59:54.143638 16888 raft_consensus.cc:2243] T 7060af9ee4a34ecca18900b2f272e1d1 P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.144173 16888 raft_consensus.cc:2272] T 7060af9ee4a34ecca18900b2f272e1d1 P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.146886 16888 tablet_replica.cc:333] stopping tablet replica
I20251023 07:59:54.147436 16888 raft_consensus.cc:2243] T d51f1c713224480980c425d473226a02 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.147784 16888 raft_consensus.cc:2272] T d51f1c713224480980c425d473226a02 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.150661 16888 tablet_replica.cc:333] stopping tablet replica
I20251023 07:59:54.151387 16888 raft_consensus.cc:2243] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus shutting down.
W20251023 07:59:54.151855 20192 consensus_peers.cc:597] T 20f681957fa04333b8a04cbad085db57 P 65876a2b197c4ea6918f5cab47ded25c -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251023 07:59:54.151873 20044 consensus_peers.cc:597] T 382a939856194537b68f791851ceaa65 P 35e7d1ade024444486e63cf1b81e9626 -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:54.151940 16888 raft_consensus.cc:2272] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.154433 16888 tablet_replica.cc:333] stopping tablet replica
I20251023 07:59:54.155027 16888 raft_consensus.cc:2243] T 09f7b5cd377e45be8bbd85052c93dcb3 P d1379e91aa9c41629cd25262571beb2c [term 2 LEADER]: Raft consensus shutting down.
I20251023 07:59:54.155823 16888 raft_consensus.cc:2272] T 09f7b5cd377e45be8bbd85052c93dcb3 P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.157924 16888 tablet_replica.cc:333] stopping tablet replica
I20251023 07:59:54.158547 16888 raft_consensus.cc:2243] T 58cef989d86d4b0c8401b4d6b2f890c0 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.158969 16888 raft_consensus.cc:2272] T 58cef989d86d4b0c8401b4d6b2f890c0 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.161164 16888 tablet_replica.cc:333] stopping tablet replica
I20251023 07:59:54.162003 16888 raft_consensus.cc:2243] T a9f4a5a96a444c099e7cefb12fe4c288 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.162508 16888 raft_consensus.cc:2272] T a9f4a5a96a444c099e7cefb12fe4c288 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.165442 16888 tablet_replica.cc:333] stopping tablet replica
I20251023 07:59:54.166239 16888 raft_consensus.cc:2243] T 62e73cfc2bbc459aba34186c3231ed87 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.166719 16888 raft_consensus.cc:2272] T 62e73cfc2bbc459aba34186c3231ed87 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.169724 16888 tablet_replica.cc:333] stopping tablet replica
I20251023 07:59:54.170666 16888 raft_consensus.cc:2243] T ccba7896b7e1413293428358ffd0f8a0 P d1379e91aa9c41629cd25262571beb2c [term 2 LEADER]: Raft consensus shutting down.
I20251023 07:59:54.171798 16888 raft_consensus.cc:2272] T ccba7896b7e1413293428358ffd0f8a0 P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Raft consensus is shut down!
W20251023 07:59:54.173735 20118 consensus_peers.cc:597] T d214412da5754dd0a08f25d50b5584f1 P 0f412334fb994ff0ab492afde64f5855 -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:54.175558 16888 tablet_replica.cc:333] stopping tablet replica
I20251023 07:59:54.177325 16888 raft_consensus.cc:2243] T 92fae2a393404d8998ad2747fbd08cc9 P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.178020 16888 raft_consensus.cc:2272] T 92fae2a393404d8998ad2747fbd08cc9 P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.180449 16888 tablet_replica.cc:333] stopping tablet replica
I20251023 07:59:54.181020 16888 raft_consensus.cc:2243] T 20f681957fa04333b8a04cbad085db57 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.181476 16888 raft_consensus.cc:2272] T 20f681957fa04333b8a04cbad085db57 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.183681 16888 tablet_replica.cc:333] stopping tablet replica
I20251023 07:59:54.184465 16888 raft_consensus.cc:2243] T 0229047af3034761a2bf168928917afb P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.184973 16888 raft_consensus.cc:2272] T 0229047af3034761a2bf168928917afb P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.187570 16888 tablet_replica.cc:333] stopping tablet replica
I20251023 07:59:54.188097 16888 raft_consensus.cc:2243] T cb866838666745f0a4462f124ac22f72 P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.188498 16888 raft_consensus.cc:2272] T cb866838666745f0a4462f124ac22f72 P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.190537 16888 tablet_replica.cc:333] stopping tablet replica
I20251023 07:59:54.191095 16888 raft_consensus.cc:2243] T 5855488965da49f4a33c7516f6a5596a P d1379e91aa9c41629cd25262571beb2c [term 2 LEADER]: Raft consensus shutting down.
I20251023 07:59:54.191885 16888 raft_consensus.cc:2272] T 5855488965da49f4a33c7516f6a5596a P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.193965 16888 tablet_replica.cc:333] stopping tablet replica
I20251023 07:59:54.194702 16888 raft_consensus.cc:2243] T c6fd96e3f93945f7828a9a8593490daa P d1379e91aa9c41629cd25262571beb2c [term 2 LEADER]: Raft consensus shutting down.
I20251023 07:59:54.195778 16888 raft_consensus.cc:2272] T c6fd96e3f93945f7828a9a8593490daa P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Raft consensus is shut down!
W20251023 07:59:54.197515 20192 consensus_peers.cc:597] T a0ff2fc9a3c04716ab748f95a00dec76 P 65876a2b197c4ea6918f5cab47ded25c -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:54.198734 16888 tablet_replica.cc:333] stopping tablet replica
I20251023 07:59:54.199643 16888 raft_consensus.cc:2243] T d214412da5754dd0a08f25d50b5584f1 P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Raft consensus shutting down.
W20251023 07:59:54.199877 20118 consensus_peers.cc:597] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P 0f412334fb994ff0ab492afde64f5855 -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:54.200176 16888 raft_consensus.cc:2272] T d214412da5754dd0a08f25d50b5584f1 P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.202944 16888 tablet_replica.cc:333] stopping tablet replica
I20251023 07:59:54.203671 16888 raft_consensus.cc:2243] T a1c85032f5ef4634a35c20eec56ae62f P d1379e91aa9c41629cd25262571beb2c [term 2 LEADER]: Raft consensus shutting down.
W20251023 07:59:54.204612 20044 consensus_peers.cc:597] T fb985a87f45d43d68b172b937404e770 P 35e7d1ade024444486e63cf1b81e9626 -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:54.204711 16888 raft_consensus.cc:2272] T a1c85032f5ef4634a35c20eec56ae62f P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.207171 16888 tablet_replica.cc:333] stopping tablet replica
I20251023 07:59:54.207759 16888 raft_consensus.cc:2243] T db045d1b86484fe9987f82ce426362e5 P d1379e91aa9c41629cd25262571beb2c [term 2 LEADER]: Raft consensus shutting down.
I20251023 07:59:54.208535 16888 raft_consensus.cc:2272] T db045d1b86484fe9987f82ce426362e5 P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.210531 16888 tablet_replica.cc:333] stopping tablet replica
I20251023 07:59:54.211099 16888 raft_consensus.cc:2243] T fa36a9cfa4fe43418245de193502470f P d1379e91aa9c41629cd25262571beb2c [term 3 LEADER]: Raft consensus shutting down.
I20251023 07:59:54.211845 16888 raft_consensus.cc:2272] T fa36a9cfa4fe43418245de193502470f P d1379e91aa9c41629cd25262571beb2c [term 3 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.214057 16888 tablet_replica.cc:333] stopping tablet replica
I20251023 07:59:54.214674 16888 raft_consensus.cc:2243] T c3527495b334413f82d0eca2c4d117b1 P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.215128 16888 raft_consensus.cc:2272] T c3527495b334413f82d0eca2c4d117b1 P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.217507 16888 tablet_replica.cc:333] stopping tablet replica
I20251023 07:59:54.218051 16888 raft_consensus.cc:2243] T f8ceeb2a7d7d45629aee9466b149251b P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.218386 16888 raft_consensus.cc:2272] T f8ceeb2a7d7d45629aee9466b149251b P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.220440 16888 tablet_replica.cc:333] stopping tablet replica
I20251023 07:59:54.220942 16888 raft_consensus.cc:2243] T cfbe734be0c84115840c7c45f3398002 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.221264 16888 raft_consensus.cc:2272] T cfbe734be0c84115840c7c45f3398002 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.223160 16888 tablet_replica.cc:333] stopping tablet replica
I20251023 07:59:54.223649 16888 raft_consensus.cc:2243] T 0973ba22912840bd9bded8b0376fa1e7 P d1379e91aa9c41629cd25262571beb2c [term 2 LEADER]: Raft consensus shutting down.
I20251023 07:59:54.224390 16888 raft_consensus.cc:2272] T 0973ba22912840bd9bded8b0376fa1e7 P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.226745 16888 tablet_replica.cc:333] stopping tablet replica
I20251023 07:59:54.227566 16888 raft_consensus.cc:2243] T fb985a87f45d43d68b172b937404e770 P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.228220 16888 raft_consensus.cc:2272] T fb985a87f45d43d68b172b937404e770 P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Raft consensus is shut down!
W20251023 07:59:54.229265 20118 consensus_peers.cc:597] T d51f1c713224480980c425d473226a02 P 0f412334fb994ff0ab492afde64f5855 -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251023 07:59:54.229287 20192 consensus_peers.cc:597] T 13d572956c644586b0efbe8f63aecae5 P 65876a2b197c4ea6918f5cab47ded25c -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:54.230779 16888 tablet_replica.cc:333] stopping tablet replica
I20251023 07:59:54.231436 16888 raft_consensus.cc:2243] T 35c1ea979bda45aead7d1b8539f37637 P d1379e91aa9c41629cd25262571beb2c [term 3 LEADER]: Raft consensus shutting down.
I20251023 07:59:54.232241 16888 raft_consensus.cc:2272] T 35c1ea979bda45aead7d1b8539f37637 P d1379e91aa9c41629cd25262571beb2c [term 3 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.234694 16888 tablet_replica.cc:333] stopping tablet replica
I20251023 07:59:54.235292 16888 raft_consensus.cc:2243] T 2ff74dfb94334c20b99ea84b985a27a5 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.235709 16888 raft_consensus.cc:2272] T 2ff74dfb94334c20b99ea84b985a27a5 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.237720 16888 tablet_replica.cc:333] stopping tablet replica
I20251023 07:59:54.238276 16888 raft_consensus.cc:2243] T b7dcf1850ca541d6ab42bd11de70d8f4 P d1379e91aa9c41629cd25262571beb2c [term 3 LEADER]: Raft consensus shutting down.
I20251023 07:59:54.239082 16888 raft_consensus.cc:2272] T b7dcf1850ca541d6ab42bd11de70d8f4 P d1379e91aa9c41629cd25262571beb2c [term 3 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.241078 16888 tablet_replica.cc:333] stopping tablet replica
I20251023 07:59:54.241693 16888 raft_consensus.cc:2243] T 12b8704d81fe4e3cb14bfa975c73df29 P d1379e91aa9c41629cd25262571beb2c [term 2 LEADER]: Raft consensus shutting down.
I20251023 07:59:54.242456 16888 raft_consensus.cc:2272] T 12b8704d81fe4e3cb14bfa975c73df29 P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.244441 16888 tablet_replica.cc:333] stopping tablet replica
I20251023 07:59:54.244953 16888 raft_consensus.cc:2243] T 5bc7d7ca172742d1b528af8659661c2a P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.245397 16888 raft_consensus.cc:2272] T 5bc7d7ca172742d1b528af8659661c2a P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.247772 16888 tablet_replica.cc:333] stopping tablet replica
I20251023 07:59:54.248368 16888 raft_consensus.cc:2243] T e2c26d408ee04105bd615b58287c82f9 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.248752 16888 raft_consensus.cc:2272] T e2c26d408ee04105bd615b58287c82f9 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.251138 16888 tablet_replica.cc:333] stopping tablet replica
I20251023 07:59:54.251616 16888 raft_consensus.cc:2243] T bd5baee3419c4a7aa0def773845ac48a P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.251976 16888 raft_consensus.cc:2272] T bd5baee3419c4a7aa0def773845ac48a P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.254038 16888 tablet_replica.cc:333] stopping tablet replica
I20251023 07:59:54.254514 16888 raft_consensus.cc:2243] T e813343bd62640cc9976d0ae394aa315 P d1379e91aa9c41629cd25262571beb2c [term 2 LEADER]: Raft consensus shutting down.
I20251023 07:59:54.255216 16888 raft_consensus.cc:2272] T e813343bd62640cc9976d0ae394aa315 P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.257223 16888 tablet_replica.cc:333] stopping tablet replica
I20251023 07:59:54.257946 16888 raft_consensus.cc:2243] T 82812175f15d4d3dae73f31641a1e583 P d1379e91aa9c41629cd25262571beb2c [term 2 LEADER]: Raft consensus shutting down.
I20251023 07:59:54.258869 16888 raft_consensus.cc:2272] T 82812175f15d4d3dae73f31641a1e583 P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Raft consensus is shut down!
W20251023 07:59:54.261035 20044 consensus_peers.cc:597] T f8ceeb2a7d7d45629aee9466b149251b P 35e7d1ade024444486e63cf1b81e9626 -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:54.261461 16888 tablet_replica.cc:333] stopping tablet replica
I20251023 07:59:54.262099 16888 raft_consensus.cc:2243] T a0ff2fc9a3c04716ab748f95a00dec76 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.262495 16888 raft_consensus.cc:2272] T a0ff2fc9a3c04716ab748f95a00dec76 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.264638 16888 tablet_replica.cc:333] stopping tablet replica
I20251023 07:59:54.265148 16888 raft_consensus.cc:2243] T f524e775b99147de99cfb27d3785965d P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.265570 16888 raft_consensus.cc:2272] T f524e775b99147de99cfb27d3785965d P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.267549 16888 tablet_replica.cc:333] stopping tablet replica
I20251023 07:59:54.268070 16888 raft_consensus.cc:2243] T c52243b5fda44e2fba36f6319b4c13e3 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.268450 16888 raft_consensus.cc:2272] T c52243b5fda44e2fba36f6319b4c13e3 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.270582 16888 tablet_replica.cc:333] stopping tablet replica
I20251023 07:59:54.271103 16888 raft_consensus.cc:2243] T f20a7a673ce6433eac41600d3573e314 P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.271574 16888 raft_consensus.cc:2272] T f20a7a673ce6433eac41600d3573e314 P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.273744 16888 tablet_replica.cc:333] stopping tablet replica
I20251023 07:59:54.274240 16888 raft_consensus.cc:2243] T a468f7a5913245b58705dc4f8560dade P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.274636 16888 raft_consensus.cc:2272] T a468f7a5913245b58705dc4f8560dade P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.276438 16888 tablet_replica.cc:333] stopping tablet replica
I20251023 07:59:54.276968 16888 raft_consensus.cc:2243] T f1da9b379f264014adfbf37b2660285b P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.277380 16888 raft_consensus.cc:2272] T f1da9b379f264014adfbf37b2660285b P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.279234 16888 tablet_replica.cc:333] stopping tablet replica
I20251023 07:59:54.279834 16888 raft_consensus.cc:2243] T 076aca7c8ecb4f34af0d457fcee0e585 P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.280333 16888 raft_consensus.cc:2272] T 076aca7c8ecb4f34af0d457fcee0e585 P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.282523 16888 tablet_replica.cc:333] stopping tablet replica
I20251023 07:59:54.283097 16888 raft_consensus.cc:2243] T 13d572956c644586b0efbe8f63aecae5 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.283471 16888 raft_consensus.cc:2272] T 13d572956c644586b0efbe8f63aecae5 P d1379e91aa9c41629cd25262571beb2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.286643 16888 tablet_replica.cc:333] stopping tablet replica
I20251023 07:59:54.287160 16888 raft_consensus.cc:2243] T a9d3294d54be4be29569a460be5c8887 P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.287672 16888 raft_consensus.cc:2272] T a9d3294d54be4be29569a460be5c8887 P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Raft consensus is shut down!
W20251023 07:59:54.288990 20192 consensus_peers.cc:597] T 92fae2a393404d8998ad2747fbd08cc9 P 65876a2b197c4ea6918f5cab47ded25c -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:54.290395 16888 tablet_replica.cc:333] stopping tablet replica
I20251023 07:59:54.290992 16888 raft_consensus.cc:2243] T d6cbef26ab7c4389b265743ae018e227 P d1379e91aa9c41629cd25262571beb2c [term 2 LEADER]: Raft consensus shutting down.
I20251023 07:59:54.291815 16888 raft_consensus.cc:2272] T d6cbef26ab7c4389b265743ae018e227 P d1379e91aa9c41629cd25262571beb2c [term 2 FOLLOWER]: Raft consensus is shut down!
W20251023 07:59:54.303824 20118 consensus_peers.cc:597] T 7060af9ee4a34ecca18900b2f272e1d1 P 0f412334fb994ff0ab492afde64f5855 -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251023 07:59:54.307410 20044 consensus_peers.cc:597] T c52243b5fda44e2fba36f6319b4c13e3 P 35e7d1ade024444486e63cf1b81e9626 -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251023 07:59:54.317114 20118 consensus_peers.cc:597] T aa253535ba594367a12fda3dea3b75d4 P 0f412334fb994ff0ab492afde64f5855 -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251023 07:59:54.343969 20118 consensus_peers.cc:597] T f524e775b99147de99cfb27d3785965d P 0f412334fb994ff0ab492afde64f5855 -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:54.367079 16888 tablet_server.cc:195] TabletServer@127.16.126.1:37865 shutdown complete.
W20251023 07:59:54.368530 20044 consensus_peers.cc:597] T 62e73cfc2bbc459aba34186c3231ed87 P 35e7d1ade024444486e63cf1b81e9626 -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Status: Network error: Client connection negotiation failed: client connection to 127.16.126.1:37865: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251023 07:59:54.381232 20118 consensus_peers.cc:597] T 5bc7d7ca172742d1b528af8659661c2a P 0f412334fb994ff0ab492afde64f5855 -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Status: Network error: Client connection negotiation failed: client connection to 127.16.126.1:37865: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251023 07:59:54.395126 20044 consensus_peers.cc:597] T cfbe734be0c84115840c7c45f3398002 P 35e7d1ade024444486e63cf1b81e9626 -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Status: Network error: Client connection negotiation failed: client connection to 127.16.126.1:37865: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251023 07:59:54.399076 20044 consensus_peers.cc:597] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P 35e7d1ade024444486e63cf1b81e9626 -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Status: Network error: Client connection negotiation failed: client connection to 127.16.126.1:37865: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251023 07:59:54.437669 20044 consensus_peers.cc:597] T bd5baee3419c4a7aa0def773845ac48a P 35e7d1ade024444486e63cf1b81e9626 -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Status: Network error: Client connection negotiation failed: client connection to 127.16.126.1:37865: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251023 07:59:54.446200 20192 consensus_peers.cc:597] T a9d3294d54be4be29569a460be5c8887 P 65876a2b197c4ea6918f5cab47ded25c -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Status: Network error: Client connection negotiation failed: client connection to 127.16.126.1:37865: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:54.461743 16888 tablet_server.cc:178] TabletServer@127.16.126.2:0 shutting down...
W20251023 07:59:54.499483 20116 consensus_peers.cc:597] T aa253535ba594367a12fda3dea3b75d4 P 0f412334fb994ff0ab492afde64f5855 -> Peer 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309): Couldn't send request to peer 35e7d1ade024444486e63cf1b81e9626. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251023 07:59:54.500334 20116 consensus_peers.cc:597] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P 0f412334fb994ff0ab492afde64f5855 -> Peer 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309): Couldn't send request to peer 35e7d1ade024444486e63cf1b81e9626. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251023 07:59:54.501098 20116 consensus_peers.cc:597] T 6db769d91ae244679bcea825f9763446 P 0f412334fb994ff0ab492afde64f5855 -> Peer 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309): Couldn't send request to peer 35e7d1ade024444486e63cf1b81e9626. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251023 07:59:54.513033 20192 consensus_peers.cc:597] T f1da9b379f264014adfbf37b2660285b P 65876a2b197c4ea6918f5cab47ded25c -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Status: Network error: Client connection negotiation failed: client connection to 127.16.126.1:37865: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:54.513294 16888 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251023 07:59:54.514106 16888 tablet_replica.cc:333] T d51f1c713224480980c425d473226a02 P 35e7d1ade024444486e63cf1b81e9626: stopping tablet replica
I20251023 07:59:54.514839 16888 raft_consensus.cc:2243] T d51f1c713224480980c425d473226a02 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.515293 16888 raft_consensus.cc:2272] T d51f1c713224480980c425d473226a02 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.517354 16888 tablet_replica.cc:333] T 01844334149649bb83991b613a695fe2 P 35e7d1ade024444486e63cf1b81e9626: stopping tablet replica
I20251023 07:59:54.518139 16888 raft_consensus.cc:2243] T 01844334149649bb83991b613a695fe2 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.518553 16888 raft_consensus.cc:2272] T 01844334149649bb83991b613a695fe2 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.520550 16888 tablet_replica.cc:333] T 090551fa29ba48dd8d41263e14b8ec3c P 35e7d1ade024444486e63cf1b81e9626: stopping tablet replica
I20251023 07:59:54.521098 16888 raft_consensus.cc:2243] T 090551fa29ba48dd8d41263e14b8ec3c P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.521535 16888 raft_consensus.cc:2272] T 090551fa29ba48dd8d41263e14b8ec3c P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.523418 16888 tablet_replica.cc:333] T 35c1ea979bda45aead7d1b8539f37637 P 35e7d1ade024444486e63cf1b81e9626: stopping tablet replica
I20251023 07:59:54.524062 16888 raft_consensus.cc:2243] T 35c1ea979bda45aead7d1b8539f37637 P 35e7d1ade024444486e63cf1b81e9626 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.524523 16888 raft_consensus.cc:2272] T 35c1ea979bda45aead7d1b8539f37637 P 35e7d1ade024444486e63cf1b81e9626 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.526865 16888 tablet_replica.cc:333] T fb985a87f45d43d68b172b937404e770 P 35e7d1ade024444486e63cf1b81e9626: stopping tablet replica
I20251023 07:59:54.527621 16888 raft_consensus.cc:2243] T fb985a87f45d43d68b172b937404e770 P 35e7d1ade024444486e63cf1b81e9626 [term 2 LEADER]: Raft consensus shutting down.
W20251023 07:59:54.528321 20116 consensus_peers.cc:597] T 7d599e4b62364f04b966ca88e16b560a P 0f412334fb994ff0ab492afde64f5855 -> Peer 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309): Couldn't send request to peer 35e7d1ade024444486e63cf1b81e9626. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:54.528760 16888 raft_consensus.cc:2272] T fb985a87f45d43d68b172b937404e770 P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.531654 16888 tablet_replica.cc:333] T 382a939856194537b68f791851ceaa65 P 35e7d1ade024444486e63cf1b81e9626: stopping tablet replica
I20251023 07:59:54.532348 16888 raft_consensus.cc:2243] T 382a939856194537b68f791851ceaa65 P 35e7d1ade024444486e63cf1b81e9626 [term 1 LEADER]: Raft consensus shutting down.
W20251023 07:59:54.532382 20044 consensus_peers.cc:597] T a9f4a5a96a444c099e7cefb12fe4c288 P 35e7d1ade024444486e63cf1b81e9626 -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Status: Network error: Client connection negotiation failed: client connection to 127.16.126.1:37865: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251023 07:59:54.533213 20190 consensus_peers.cc:597] T 92fae2a393404d8998ad2747fbd08cc9 P 65876a2b197c4ea6918f5cab47ded25c -> Peer 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309): Couldn't send request to peer 35e7d1ade024444486e63cf1b81e9626. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:54.533514 16888 raft_consensus.cc:2272] T 382a939856194537b68f791851ceaa65 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Raft consensus is shut down!
W20251023 07:59:54.535563 20116 consensus_peers.cc:597] T d51f1c713224480980c425d473226a02 P 0f412334fb994ff0ab492afde64f5855 -> Peer 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309): Couldn't send request to peer 35e7d1ade024444486e63cf1b81e9626. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:54.535953 16888 tablet_replica.cc:333] T c469a3ace4204641be00f1b797fbffe9 P 35e7d1ade024444486e63cf1b81e9626: stopping tablet replica
I20251023 07:59:54.536583 16888 raft_consensus.cc:2243] T c469a3ace4204641be00f1b797fbffe9 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.536990 16888 raft_consensus.cc:2272] T c469a3ace4204641be00f1b797fbffe9 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.538856 16888 tablet_replica.cc:333] T d6cbef26ab7c4389b265743ae018e227 P 35e7d1ade024444486e63cf1b81e9626: stopping tablet replica
I20251023 07:59:54.539431 16888 raft_consensus.cc:2243] T d6cbef26ab7c4389b265743ae018e227 P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.539800 16888 raft_consensus.cc:2272] T d6cbef26ab7c4389b265743ae018e227 P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.542234 16888 tablet_replica.cc:333] T c3527495b334413f82d0eca2c4d117b1 P 35e7d1ade024444486e63cf1b81e9626: stopping tablet replica
I20251023 07:59:54.542866 16888 raft_consensus.cc:2243] T c3527495b334413f82d0eca2c4d117b1 P 35e7d1ade024444486e63cf1b81e9626 [term 2 LEADER]: Raft consensus shutting down.
I20251023 07:59:54.543895 16888 raft_consensus.cc:2272] T c3527495b334413f82d0eca2c4d117b1 P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.545958 16888 tablet_replica.cc:333] T 0973ba22912840bd9bded8b0376fa1e7 P 35e7d1ade024444486e63cf1b81e9626: stopping tablet replica
I20251023 07:59:54.546483 16888 raft_consensus.cc:2243] T 0973ba22912840bd9bded8b0376fa1e7 P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.546905 16888 raft_consensus.cc:2272] T 0973ba22912840bd9bded8b0376fa1e7 P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.548803 16888 tablet_replica.cc:333] T cfbe734be0c84115840c7c45f3398002 P 35e7d1ade024444486e63cf1b81e9626: stopping tablet replica
I20251023 07:59:54.549324 16888 raft_consensus.cc:2243] T cfbe734be0c84115840c7c45f3398002 P 35e7d1ade024444486e63cf1b81e9626 [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:54.550113 16888 raft_consensus.cc:2272] T cfbe734be0c84115840c7c45f3398002 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.552029 16888 tablet_replica.cc:333] T 8b6aca6db6ab43e8be0b6ec22dc96700 P 35e7d1ade024444486e63cf1b81e9626: stopping tablet replica
I20251023 07:59:54.552547 16888 raft_consensus.cc:2243] T 8b6aca6db6ab43e8be0b6ec22dc96700 P 35e7d1ade024444486e63cf1b81e9626 [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:54.553267 16888 raft_consensus.cc:2272] T 8b6aca6db6ab43e8be0b6ec22dc96700 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.555830 16888 tablet_replica.cc:333] T cb866838666745f0a4462f124ac22f72 P 35e7d1ade024444486e63cf1b81e9626: stopping tablet replica
I20251023 07:59:54.556648 16888 raft_consensus.cc:2243] T cb866838666745f0a4462f124ac22f72 P 35e7d1ade024444486e63cf1b81e9626 [term 2 LEADER]: Raft consensus shutting down.
I20251023 07:59:54.557744 16888 raft_consensus.cc:2272] T cb866838666745f0a4462f124ac22f72 P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.560251 16888 tablet_replica.cc:333] T ae516c440b7749f388e0e2f89a6a81b7 P 35e7d1ade024444486e63cf1b81e9626: stopping tablet replica
I20251023 07:59:54.560894 16888 raft_consensus.cc:2243] T ae516c440b7749f388e0e2f89a6a81b7 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.561372 16888 raft_consensus.cc:2272] T ae516c440b7749f388e0e2f89a6a81b7 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.563486 16888 tablet_replica.cc:333] T f8ceeb2a7d7d45629aee9466b149251b P 35e7d1ade024444486e63cf1b81e9626: stopping tablet replica
I20251023 07:59:54.564226 16888 raft_consensus.cc:2243] T f8ceeb2a7d7d45629aee9466b149251b P 35e7d1ade024444486e63cf1b81e9626 [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:54.565002 16888 raft_consensus.cc:2272] T f8ceeb2a7d7d45629aee9466b149251b P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.566871 16888 tablet_replica.cc:333] T bd5baee3419c4a7aa0def773845ac48a P 35e7d1ade024444486e63cf1b81e9626: stopping tablet replica
I20251023 07:59:54.567377 16888 raft_consensus.cc:2243] T bd5baee3419c4a7aa0def773845ac48a P 35e7d1ade024444486e63cf1b81e9626 [term 2 LEADER]: Raft consensus shutting down.
I20251023 07:59:54.568063 16888 raft_consensus.cc:2272] T bd5baee3419c4a7aa0def773845ac48a P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.570151 16888 tablet_replica.cc:333] T 82812175f15d4d3dae73f31641a1e583 P 35e7d1ade024444486e63cf1b81e9626: stopping tablet replica
I20251023 07:59:54.570744 16888 raft_consensus.cc:2243] T 82812175f15d4d3dae73f31641a1e583 P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.571152 16888 raft_consensus.cc:2272] T 82812175f15d4d3dae73f31641a1e583 P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.573735 16888 tablet_replica.cc:333] T e813343bd62640cc9976d0ae394aa315 P 35e7d1ade024444486e63cf1b81e9626: stopping tablet replica
W20251023 07:59:54.573740 20192 consensus_peers.cc:597] T 0229047af3034761a2bf168928917afb P 65876a2b197c4ea6918f5cab47ded25c -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Status: Network error: Client connection negotiation failed: client connection to 127.16.126.1:37865: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:54.574573 16888 raft_consensus.cc:2243] T e813343bd62640cc9976d0ae394aa315 P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.575083 16888 raft_consensus.cc:2272] T e813343bd62640cc9976d0ae394aa315 P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.577596 16888 tablet_replica.cc:333] T 09f7b5cd377e45be8bbd85052c93dcb3 P 35e7d1ade024444486e63cf1b81e9626: stopping tablet replica
I20251023 07:59:54.578290 16888 raft_consensus.cc:2243] T 09f7b5cd377e45be8bbd85052c93dcb3 P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Raft consensus shutting down.
W20251023 07:59:54.578759 20044 consensus_peers.cc:597] T a468f7a5913245b58705dc4f8560dade P 35e7d1ade024444486e63cf1b81e9626 -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Status: Network error: Client connection negotiation failed: client connection to 127.16.126.1:37865: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:54.578812 16888 raft_consensus.cc:2272] T 09f7b5cd377e45be8bbd85052c93dcb3 P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.580859 16888 tablet_replica.cc:333] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P 35e7d1ade024444486e63cf1b81e9626: stopping tablet replica
I20251023 07:59:54.581487 16888 raft_consensus.cc:2243] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P 35e7d1ade024444486e63cf1b81e9626 [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:54.582258 16888 raft_consensus.cc:2272] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.584240 16888 tablet_replica.cc:333] T b4b44015a24e47ddae24244c3fb1fff1 P 35e7d1ade024444486e63cf1b81e9626: stopping tablet replica
I20251023 07:59:54.584784 16888 raft_consensus.cc:2243] T b4b44015a24e47ddae24244c3fb1fff1 P 35e7d1ade024444486e63cf1b81e9626 [term 2 LEADER]: Raft consensus shutting down.
I20251023 07:59:54.585714 16888 raft_consensus.cc:2272] T b4b44015a24e47ddae24244c3fb1fff1 P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.587713 16888 tablet_replica.cc:333] T e2c26d408ee04105bd615b58287c82f9 P 35e7d1ade024444486e63cf1b81e9626: stopping tablet replica
I20251023 07:59:54.588269 16888 raft_consensus.cc:2243] T e2c26d408ee04105bd615b58287c82f9 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.588693 16888 raft_consensus.cc:2272] T e2c26d408ee04105bd615b58287c82f9 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.590549 16888 tablet_replica.cc:333] T e08e797f71f1483a9c2b5899554a6dec P 35e7d1ade024444486e63cf1b81e9626: stopping tablet replica
I20251023 07:59:54.591084 16888 raft_consensus.cc:2243] T e08e797f71f1483a9c2b5899554a6dec P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.591480 16888 raft_consensus.cc:2272] T e08e797f71f1483a9c2b5899554a6dec P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.593362 16888 tablet_replica.cc:333] T 7d599e4b62364f04b966ca88e16b560a P 35e7d1ade024444486e63cf1b81e9626: stopping tablet replica
I20251023 07:59:54.593945 16888 raft_consensus.cc:2243] T 7d599e4b62364f04b966ca88e16b560a P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.594345 16888 raft_consensus.cc:2272] T 7d599e4b62364f04b966ca88e16b560a P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.596097 16888 tablet_replica.cc:333] T c52243b5fda44e2fba36f6319b4c13e3 P 35e7d1ade024444486e63cf1b81e9626: stopping tablet replica
I20251023 07:59:54.596616 16888 raft_consensus.cc:2243] T c52243b5fda44e2fba36f6319b4c13e3 P 35e7d1ade024444486e63cf1b81e9626 [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:54.597349 16888 raft_consensus.cc:2272] T c52243b5fda44e2fba36f6319b4c13e3 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.599100 16888 tablet_replica.cc:333] T 2ff74dfb94334c20b99ea84b985a27a5 P 35e7d1ade024444486e63cf1b81e9626: stopping tablet replica
I20251023 07:59:54.599648 16888 raft_consensus.cc:2243] T 2ff74dfb94334c20b99ea84b985a27a5 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.600044 16888 raft_consensus.cc:2272] T 2ff74dfb94334c20b99ea84b985a27a5 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.602185 16888 tablet_replica.cc:333] T 791953f9d44946eaa145c5857557a5e4 P 35e7d1ade024444486e63cf1b81e9626: stopping tablet replica
I20251023 07:59:54.602718 16888 raft_consensus.cc:2243] T 791953f9d44946eaa145c5857557a5e4 P 35e7d1ade024444486e63cf1b81e9626 [term 2 LEADER]: Raft consensus shutting down.
I20251023 07:59:54.603490 16888 raft_consensus.cc:2272] T 791953f9d44946eaa145c5857557a5e4 P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.605297 16888 tablet_replica.cc:333] T 7060af9ee4a34ecca18900b2f272e1d1 P 35e7d1ade024444486e63cf1b81e9626: stopping tablet replica
I20251023 07:59:54.605931 16888 raft_consensus.cc:2243] T 7060af9ee4a34ecca18900b2f272e1d1 P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.606367 16888 raft_consensus.cc:2272] T 7060af9ee4a34ecca18900b2f272e1d1 P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.608073 16888 tablet_replica.cc:333] T dc81e0e89365425793f2851459b7e892 P 35e7d1ade024444486e63cf1b81e9626: stopping tablet replica
I20251023 07:59:54.608583 16888 raft_consensus.cc:2243] T dc81e0e89365425793f2851459b7e892 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.608961 16888 raft_consensus.cc:2272] T dc81e0e89365425793f2851459b7e892 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.610759 16888 tablet_replica.cc:333] T aa253535ba594367a12fda3dea3b75d4 P 35e7d1ade024444486e63cf1b81e9626: stopping tablet replica
I20251023 07:59:54.611255 16888 raft_consensus.cc:2243] T aa253535ba594367a12fda3dea3b75d4 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.611670 16888 raft_consensus.cc:2272] T aa253535ba594367a12fda3dea3b75d4 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.613418 16888 tablet_replica.cc:333] T 0229047af3034761a2bf168928917afb P 35e7d1ade024444486e63cf1b81e9626: stopping tablet replica
I20251023 07:59:54.613950 16888 raft_consensus.cc:2243] T 0229047af3034761a2bf168928917afb P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.614373 16888 raft_consensus.cc:2272] T 0229047af3034761a2bf168928917afb P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.616099 16888 tablet_replica.cc:333] T 12b8704d81fe4e3cb14bfa975c73df29 P 35e7d1ade024444486e63cf1b81e9626: stopping tablet replica
I20251023 07:59:54.616600 16888 raft_consensus.cc:2243] T 12b8704d81fe4e3cb14bfa975c73df29 P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.617014 16888 raft_consensus.cc:2272] T 12b8704d81fe4e3cb14bfa975c73df29 P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.619329 16888 tablet_replica.cc:333] T a468f7a5913245b58705dc4f8560dade P 35e7d1ade024444486e63cf1b81e9626: stopping tablet replica
I20251023 07:59:54.620046 16888 raft_consensus.cc:2243] T a468f7a5913245b58705dc4f8560dade P 35e7d1ade024444486e63cf1b81e9626 [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:54.621059 16888 raft_consensus.cc:2272] T a468f7a5913245b58705dc4f8560dade P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.623693 16888 tablet_replica.cc:333] T c6b6d87c63ca43999bf97916bd589275 P 35e7d1ade024444486e63cf1b81e9626: stopping tablet replica
W20251023 07:59:54.624028 20116 consensus_peers.cc:597] T 1fa44f181e6e44bfb1e566ef7b0778a0 P 0f412334fb994ff0ab492afde64f5855 -> Peer 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309): Couldn't send request to peer 35e7d1ade024444486e63cf1b81e9626. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:54.624421 16888 raft_consensus.cc:2243] T c6b6d87c63ca43999bf97916bd589275 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.625042 16888 raft_consensus.cc:2272] T c6b6d87c63ca43999bf97916bd589275 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.627514 16888 tablet_replica.cc:333] T 7062462192fc4895b5a9f6a34c4a132a P 35e7d1ade024444486e63cf1b81e9626: stopping tablet replica
I20251023 07:59:54.628260 16888 raft_consensus.cc:2243] T 7062462192fc4895b5a9f6a34c4a132a P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.628823 16888 raft_consensus.cc:2272] T 7062462192fc4895b5a9f6a34c4a132a P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.631026 16888 tablet_replica.cc:333] T db045d1b86484fe9987f82ce426362e5 P 35e7d1ade024444486e63cf1b81e9626: stopping tablet replica
I20251023 07:59:54.631575 16888 raft_consensus.cc:2243] T db045d1b86484fe9987f82ce426362e5 P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.631980 16888 raft_consensus.cc:2272] T db045d1b86484fe9987f82ce426362e5 P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.633986 16888 tablet_replica.cc:333] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P 35e7d1ade024444486e63cf1b81e9626: stopping tablet replica
I20251023 07:59:54.634725 16888 raft_consensus.cc:2243] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.635159 16888 raft_consensus.cc:2272] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.637274 16888 tablet_replica.cc:333] T 1fa44f181e6e44bfb1e566ef7b0778a0 P 35e7d1ade024444486e63cf1b81e9626: stopping tablet replica
I20251023 07:59:54.637830 16888 raft_consensus.cc:2243] T 1fa44f181e6e44bfb1e566ef7b0778a0 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.638221 16888 raft_consensus.cc:2272] T 1fa44f181e6e44bfb1e566ef7b0778a0 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.640718 16888 tablet_replica.cc:333] T 6db769d91ae244679bcea825f9763446 P 35e7d1ade024444486e63cf1b81e9626: stopping tablet replica
I20251023 07:59:54.641460 16888 raft_consensus.cc:2243] T 6db769d91ae244679bcea825f9763446 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.641997 16888 raft_consensus.cc:2272] T 6db769d91ae244679bcea825f9763446 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Raft consensus is shut down!
W20251023 07:59:54.643095 20190 consensus_peers.cc:597] T e2c26d408ee04105bd615b58287c82f9 P 65876a2b197c4ea6918f5cab47ded25c -> Peer 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309): Couldn't send request to peer 35e7d1ade024444486e63cf1b81e9626. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:54.644594 16888 tablet_replica.cc:333] T 62e73cfc2bbc459aba34186c3231ed87 P 35e7d1ade024444486e63cf1b81e9626: stopping tablet replica
I20251023 07:59:54.645574 16888 raft_consensus.cc:2243] T 62e73cfc2bbc459aba34186c3231ed87 P 35e7d1ade024444486e63cf1b81e9626 [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:54.646752 16888 raft_consensus.cc:2272] T 62e73cfc2bbc459aba34186c3231ed87 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Raft consensus is shut down!
W20251023 07:59:54.650871 20190 consensus_peers.cc:597] T 0229047af3034761a2bf168928917afb P 65876a2b197c4ea6918f5cab47ded25c -> Peer 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309): Couldn't send request to peer 35e7d1ade024444486e63cf1b81e9626. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:54.651446 16888 tablet_replica.cc:333] T a9f4a5a96a444c099e7cefb12fe4c288 P 35e7d1ade024444486e63cf1b81e9626: stopping tablet replica
I20251023 07:59:54.652314 16888 raft_consensus.cc:2243] T a9f4a5a96a444c099e7cefb12fe4c288 P 35e7d1ade024444486e63cf1b81e9626 [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:54.653343 16888 raft_consensus.cc:2272] T a9f4a5a96a444c099e7cefb12fe4c288 P 35e7d1ade024444486e63cf1b81e9626 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.655968 16888 tablet_replica.cc:333] T 92fae2a393404d8998ad2747fbd08cc9 P 35e7d1ade024444486e63cf1b81e9626: stopping tablet replica
I20251023 07:59:54.656672 16888 raft_consensus.cc:2243] T 92fae2a393404d8998ad2747fbd08cc9 P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.657220 16888 raft_consensus.cc:2272] T 92fae2a393404d8998ad2747fbd08cc9 P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Raft consensus is shut down!
W20251023 07:59:54.658600 20190 consensus_peers.cc:597] T c6b6d87c63ca43999bf97916bd589275 P 65876a2b197c4ea6918f5cab47ded25c -> Peer 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309): Couldn't send request to peer 35e7d1ade024444486e63cf1b81e9626. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:54.659713 16888 tablet_replica.cc:333] T c6fd96e3f93945f7828a9a8593490daa P 35e7d1ade024444486e63cf1b81e9626: stopping tablet replica
I20251023 07:59:54.660367 16888 raft_consensus.cc:2243] T c6fd96e3f93945f7828a9a8593490daa P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.660838 16888 raft_consensus.cc:2272] T c6fd96e3f93945f7828a9a8593490daa P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.663406 16888 tablet_replica.cc:333] T d214412da5754dd0a08f25d50b5584f1 P 35e7d1ade024444486e63cf1b81e9626: stopping tablet replica
I20251023 07:59:54.664037 16888 raft_consensus.cc:2243] T d214412da5754dd0a08f25d50b5584f1 P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.664527 16888 raft_consensus.cc:2272] T d214412da5754dd0a08f25d50b5584f1 P 35e7d1ade024444486e63cf1b81e9626 [term 2 FOLLOWER]: Raft consensus is shut down!
W20251023 07:59:54.677552 20192 consensus_peers.cc:597] T 076aca7c8ecb4f34af0d457fcee0e585 P 65876a2b197c4ea6918f5cab47ded25c -> Peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Couldn't send request to peer d1379e91aa9c41629cd25262571beb2c. Status: Network error: Client connection negotiation failed: client connection to 127.16.126.1:37865: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251023 07:59:54.683040 20190 consensus_peers.cc:597] T 2ff74dfb94334c20b99ea84b985a27a5 P 65876a2b197c4ea6918f5cab47ded25c -> Peer 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309): Couldn't send request to peer 35e7d1ade024444486e63cf1b81e9626. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:54.747107 16888 tablet_server.cc:195] TabletServer@127.16.126.2:0 shutdown complete.
W20251023 07:59:54.759685 20116 consensus_peers.cc:597] T d214412da5754dd0a08f25d50b5584f1 P 0f412334fb994ff0ab492afde64f5855 -> Peer 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309): Couldn't send request to peer 35e7d1ade024444486e63cf1b81e9626. Status: Network error: Client connection negotiation failed: client connection to 127.16.126.2:42309: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251023 07:59:54.769747 20116 consensus_peers.cc:597] T c469a3ace4204641be00f1b797fbffe9 P 0f412334fb994ff0ab492afde64f5855 -> Peer 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309): Couldn't send request to peer 35e7d1ade024444486e63cf1b81e9626. Status: Network error: Client connection negotiation failed: client connection to 127.16.126.2:42309: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251023 07:59:54.771836 20116 consensus_peers.cc:597] T 01844334149649bb83991b613a695fe2 P 0f412334fb994ff0ab492afde64f5855 -> Peer 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309): Couldn't send request to peer 35e7d1ade024444486e63cf1b81e9626. Status: Network error: Client connection negotiation failed: client connection to 127.16.126.2:42309: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:54.823930 16888 tablet_server.cc:178] TabletServer@127.16.126.3:0 shutting down...
I20251023 07:59:54.862810 16888 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251023 07:59:54.863719 16888 tablet_replica.cc:333] T b7dcf1850ca541d6ab42bd11de70d8f4 P 0f412334fb994ff0ab492afde64f5855: stopping tablet replica
I20251023 07:59:54.864763 16888 raft_consensus.cc:2243] T b7dcf1850ca541d6ab42bd11de70d8f4 P 0f412334fb994ff0ab492afde64f5855 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.865581 16888 raft_consensus.cc:2272] T b7dcf1850ca541d6ab42bd11de70d8f4 P 0f412334fb994ff0ab492afde64f5855 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.868005 16888 tablet_replica.cc:333] T d51f1c713224480980c425d473226a02 P 0f412334fb994ff0ab492afde64f5855: stopping tablet replica
I20251023 07:59:54.868630 16888 raft_consensus.cc:2243] T d51f1c713224480980c425d473226a02 P 0f412334fb994ff0ab492afde64f5855 [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:54.869460 16888 raft_consensus.cc:2272] T d51f1c713224480980c425d473226a02 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Raft consensus is shut down!
W20251023 07:59:54.871089 20116 consensus_peers.cc:597] T 7062462192fc4895b5a9f6a34c4a132a P 0f412334fb994ff0ab492afde64f5855 -> Peer 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309): Couldn't send request to peer 35e7d1ade024444486e63cf1b81e9626. Status: Network error: Client connection negotiation failed: client connection to 127.16.126.2:42309: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:54.871724 16888 tablet_replica.cc:333] T 01844334149649bb83991b613a695fe2 P 0f412334fb994ff0ab492afde64f5855: stopping tablet replica
I20251023 07:59:54.872666 16888 raft_consensus.cc:2243] T 01844334149649bb83991b613a695fe2 P 0f412334fb994ff0ab492afde64f5855 [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:54.873611 16888 raft_consensus.cc:2272] T 01844334149649bb83991b613a695fe2 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Raft consensus is shut down!
W20251023 07:59:54.874732 20189 consensus_peers.cc:597] T 076aca7c8ecb4f34af0d457fcee0e585 P 65876a2b197c4ea6918f5cab47ded25c -> Peer 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287): Couldn't send request to peer 0f412334fb994ff0ab492afde64f5855. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:54.876019 16888 tablet_replica.cc:333] T a1c85032f5ef4634a35c20eec56ae62f P 0f412334fb994ff0ab492afde64f5855: stopping tablet replica
I20251023 07:59:54.876739 16888 raft_consensus.cc:2243] T a1c85032f5ef4634a35c20eec56ae62f P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.877179 16888 raft_consensus.cc:2272] T a1c85032f5ef4634a35c20eec56ae62f P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.879784 16888 tablet_replica.cc:333] T 09f7b5cd377e45be8bbd85052c93dcb3 P 0f412334fb994ff0ab492afde64f5855: stopping tablet replica
W20251023 07:59:54.880362 20190 consensus_peers.cc:597] T dc81e0e89365425793f2851459b7e892 P 65876a2b197c4ea6918f5cab47ded25c -> Peer 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309): Couldn't send request to peer 35e7d1ade024444486e63cf1b81e9626. Status: Network error: Client connection negotiation failed: client connection to 127.16.126.2:42309: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:54.880568 16888 raft_consensus.cc:2243] T 09f7b5cd377e45be8bbd85052c93dcb3 P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.881136 16888 raft_consensus.cc:2272] T 09f7b5cd377e45be8bbd85052c93dcb3 P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.883064 16888 tablet_replica.cc:333] T fb985a87f45d43d68b172b937404e770 P 0f412334fb994ff0ab492afde64f5855: stopping tablet replica
I20251023 07:59:54.883615 16888 raft_consensus.cc:2243] T fb985a87f45d43d68b172b937404e770 P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.884066 16888 raft_consensus.cc:2272] T fb985a87f45d43d68b172b937404e770 P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.886615 16888 tablet_replica.cc:333] T f20a7a673ce6433eac41600d3573e314 P 0f412334fb994ff0ab492afde64f5855: stopping tablet replica
I20251023 07:59:54.887255 16888 raft_consensus.cc:2243] T f20a7a673ce6433eac41600d3573e314 P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Raft consensus shutting down.
W20251023 07:59:54.887548 20190 consensus_peers.cc:597] T ae516c440b7749f388e0e2f89a6a81b7 P 65876a2b197c4ea6918f5cab47ded25c -> Peer 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309): Couldn't send request to peer 35e7d1ade024444486e63cf1b81e9626. Status: Network error: Client connection negotiation failed: client connection to 127.16.126.2:42309: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:54.887778 16888 raft_consensus.cc:2272] T f20a7a673ce6433eac41600d3573e314 P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.890126 16888 tablet_replica.cc:333] T d6cbef26ab7c4389b265743ae018e227 P 0f412334fb994ff0ab492afde64f5855: stopping tablet replica
I20251023 07:59:54.890758 16888 raft_consensus.cc:2243] T d6cbef26ab7c4389b265743ae018e227 P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Raft consensus shutting down.
W20251023 07:59:54.890986 20189 consensus_peers.cc:597] T 13d572956c644586b0efbe8f63aecae5 P 65876a2b197c4ea6918f5cab47ded25c -> Peer 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287): Couldn't send request to peer 0f412334fb994ff0ab492afde64f5855. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:54.891312 16888 raft_consensus.cc:2272] T d6cbef26ab7c4389b265743ae018e227 P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.893846 16888 tablet_replica.cc:333] T 20f681957fa04333b8a04cbad085db57 P 0f412334fb994ff0ab492afde64f5855: stopping tablet replica
W20251023 07:59:54.894486 20189 consensus_peers.cc:597] T c6b6d87c63ca43999bf97916bd589275 P 65876a2b197c4ea6918f5cab47ded25c -> Peer 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287): Couldn't send request to peer 0f412334fb994ff0ab492afde64f5855. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:54.894589 16888 raft_consensus.cc:2243] T 20f681957fa04333b8a04cbad085db57 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.895237 16888 raft_consensus.cc:2272] T 20f681957fa04333b8a04cbad085db57 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.897171 16888 tablet_replica.cc:333] T ae516c440b7749f388e0e2f89a6a81b7 P 0f412334fb994ff0ab492afde64f5855: stopping tablet replica
I20251023 07:59:54.897809 16888 raft_consensus.cc:2243] T ae516c440b7749f388e0e2f89a6a81b7 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.898214 16888 raft_consensus.cc:2272] T ae516c440b7749f388e0e2f89a6a81b7 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.900508 16888 tablet_replica.cc:333] T cfbe734be0c84115840c7c45f3398002 P 0f412334fb994ff0ab492afde64f5855: stopping tablet replica
I20251023 07:59:54.901232 16888 raft_consensus.cc:2243] T cfbe734be0c84115840c7c45f3398002 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.901805 16888 raft_consensus.cc:2272] T cfbe734be0c84115840c7c45f3398002 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Raft consensus is shut down!
W20251023 07:59:54.903389 20116 consensus_peers.cc:597] T 7060af9ee4a34ecca18900b2f272e1d1 P 0f412334fb994ff0ab492afde64f5855 -> Peer 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309): Couldn't send request to peer 35e7d1ade024444486e63cf1b81e9626. Status: Network error: Client connection negotiation failed: client connection to 127.16.126.2:42309: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:54.904210 16888 tablet_replica.cc:333] T 8b6aca6db6ab43e8be0b6ec22dc96700 P 0f412334fb994ff0ab492afde64f5855: stopping tablet replica
I20251023 07:59:54.904814 16888 raft_consensus.cc:2243] T 8b6aca6db6ab43e8be0b6ec22dc96700 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.905190 16888 raft_consensus.cc:2272] T 8b6aca6db6ab43e8be0b6ec22dc96700 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.907043 16888 tablet_replica.cc:333] T bd5baee3419c4a7aa0def773845ac48a P 0f412334fb994ff0ab492afde64f5855: stopping tablet replica
I20251023 07:59:54.907593 16888 raft_consensus.cc:2243] T bd5baee3419c4a7aa0def773845ac48a P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.907969 16888 raft_consensus.cc:2272] T bd5baee3419c4a7aa0def773845ac48a P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.909832 16888 tablet_replica.cc:333] T 82812175f15d4d3dae73f31641a1e583 P 0f412334fb994ff0ab492afde64f5855: stopping tablet replica
I20251023 07:59:54.910357 16888 raft_consensus.cc:2243] T 82812175f15d4d3dae73f31641a1e583 P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.910765 16888 raft_consensus.cc:2272] T 82812175f15d4d3dae73f31641a1e583 P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.912541 16888 tablet_replica.cc:333] T e813343bd62640cc9976d0ae394aa315 P 0f412334fb994ff0ab492afde64f5855: stopping tablet replica
I20251023 07:59:54.913092 16888 raft_consensus.cc:2243] T e813343bd62640cc9976d0ae394aa315 P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.913516 16888 raft_consensus.cc:2272] T e813343bd62640cc9976d0ae394aa315 P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.915246 16888 tablet_replica.cc:333] T b4b44015a24e47ddae24244c3fb1fff1 P 0f412334fb994ff0ab492afde64f5855: stopping tablet replica
I20251023 07:59:54.915766 16888 raft_consensus.cc:2243] T b4b44015a24e47ddae24244c3fb1fff1 P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.916139 16888 raft_consensus.cc:2272] T b4b44015a24e47ddae24244c3fb1fff1 P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.918076 16888 tablet_replica.cc:333] T c6b6d87c63ca43999bf97916bd589275 P 0f412334fb994ff0ab492afde64f5855: stopping tablet replica
I20251023 07:59:54.918751 16888 raft_consensus.cc:2243] T c6b6d87c63ca43999bf97916bd589275 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.919289 16888 raft_consensus.cc:2272] T c6b6d87c63ca43999bf97916bd589275 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.921728 16888 tablet_replica.cc:333] T a468f7a5913245b58705dc4f8560dade P 0f412334fb994ff0ab492afde64f5855: stopping tablet replica
I20251023 07:59:54.922374 16888 raft_consensus.cc:2243] T a468f7a5913245b58705dc4f8560dade P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.922775 16888 raft_consensus.cc:2272] T a468f7a5913245b58705dc4f8560dade P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.924566 16888 tablet_replica.cc:333] T c469a3ace4204641be00f1b797fbffe9 P 0f412334fb994ff0ab492afde64f5855: stopping tablet replica
I20251023 07:59:54.925058 16888 raft_consensus.cc:2243] T c469a3ace4204641be00f1b797fbffe9 P 0f412334fb994ff0ab492afde64f5855 [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:54.925887 16888 raft_consensus.cc:2272] T c469a3ace4204641be00f1b797fbffe9 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.928375 16888 tablet_replica.cc:333] T 58cef989d86d4b0c8401b4d6b2f890c0 P 0f412334fb994ff0ab492afde64f5855: stopping tablet replica
I20251023 07:59:54.929123 16888 raft_consensus.cc:2243] T 58cef989d86d4b0c8401b4d6b2f890c0 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.929656 16888 raft_consensus.cc:2272] T 58cef989d86d4b0c8401b4d6b2f890c0 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.932195 16888 tablet_replica.cc:333] T e08e797f71f1483a9c2b5899554a6dec P 0f412334fb994ff0ab492afde64f5855: stopping tablet replica
I20251023 07:59:54.932969 16888 raft_consensus.cc:2243] T e08e797f71f1483a9c2b5899554a6dec P 0f412334fb994ff0ab492afde64f5855 [term 2 LEADER]: Raft consensus shutting down.
I20251023 07:59:54.933965 16888 raft_consensus.cc:2272] T e08e797f71f1483a9c2b5899554a6dec P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.936535 16888 tablet_replica.cc:333] T 791953f9d44946eaa145c5857557a5e4 P 0f412334fb994ff0ab492afde64f5855: stopping tablet replica
I20251023 07:59:54.937337 16888 raft_consensus.cc:2243] T 791953f9d44946eaa145c5857557a5e4 P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.937958 16888 raft_consensus.cc:2272] T 791953f9d44946eaa145c5857557a5e4 P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.940783 16888 tablet_replica.cc:333] T dc81e0e89365425793f2851459b7e892 P 0f412334fb994ff0ab492afde64f5855: stopping tablet replica
I20251023 07:59:54.941598 16888 raft_consensus.cc:2243] T dc81e0e89365425793f2851459b7e892 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.942150 16888 raft_consensus.cc:2272] T dc81e0e89365425793f2851459b7e892 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.944764 16888 tablet_replica.cc:333] T aa253535ba594367a12fda3dea3b75d4 P 0f412334fb994ff0ab492afde64f5855: stopping tablet replica
I20251023 07:59:54.945529 16888 raft_consensus.cc:2243] T aa253535ba594367a12fda3dea3b75d4 P 0f412334fb994ff0ab492afde64f5855 [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:54.946542 16888 raft_consensus.cc:2272] T aa253535ba594367a12fda3dea3b75d4 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.949069 16888 tablet_replica.cc:333] T a0ff2fc9a3c04716ab748f95a00dec76 P 0f412334fb994ff0ab492afde64f5855: stopping tablet replica
I20251023 07:59:54.949831 16888 raft_consensus.cc:2243] T a0ff2fc9a3c04716ab748f95a00dec76 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.950337 16888 raft_consensus.cc:2272] T a0ff2fc9a3c04716ab748f95a00dec76 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Raft consensus is shut down!
W20251023 07:59:54.952275 20189 consensus_peers.cc:597] T 20f681957fa04333b8a04cbad085db57 P 65876a2b197c4ea6918f5cab47ded25c -> Peer 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287): Couldn't send request to peer 0f412334fb994ff0ab492afde64f5855. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:54.952723 16888 tablet_replica.cc:333] T fa36a9cfa4fe43418245de193502470f P 0f412334fb994ff0ab492afde64f5855: stopping tablet replica
I20251023 07:59:54.953593 16888 raft_consensus.cc:2243] T fa36a9cfa4fe43418245de193502470f P 0f412334fb994ff0ab492afde64f5855 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.954120 16888 raft_consensus.cc:2272] T fa36a9cfa4fe43418245de193502470f P 0f412334fb994ff0ab492afde64f5855 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.956606 16888 tablet_replica.cc:333] T 5bc7d7ca172742d1b528af8659661c2a P 0f412334fb994ff0ab492afde64f5855: stopping tablet replica
I20251023 07:59:54.957361 16888 raft_consensus.cc:2243] T 5bc7d7ca172742d1b528af8659661c2a P 0f412334fb994ff0ab492afde64f5855 [term 2 LEADER]: Raft consensus shutting down.
I20251023 07:59:54.958442 16888 raft_consensus.cc:2272] T 5bc7d7ca172742d1b528af8659661c2a P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.961180 16888 tablet_replica.cc:333] T 12b8704d81fe4e3cb14bfa975c73df29 P 0f412334fb994ff0ab492afde64f5855: stopping tablet replica
I20251023 07:59:54.961979 16888 raft_consensus.cc:2243] T 12b8704d81fe4e3cb14bfa975c73df29 P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.962628 16888 raft_consensus.cc:2272] T 12b8704d81fe4e3cb14bfa975c73df29 P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.965282 16888 tablet_replica.cc:333] T f524e775b99147de99cfb27d3785965d P 0f412334fb994ff0ab492afde64f5855: stopping tablet replica
I20251023 07:59:54.966060 16888 raft_consensus.cc:2243] T f524e775b99147de99cfb27d3785965d P 0f412334fb994ff0ab492afde64f5855 [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:54.966887 16888 raft_consensus.cc:2272] T f524e775b99147de99cfb27d3785965d P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.970541 16888 tablet_replica.cc:333] T 7d599e4b62364f04b966ca88e16b560a P 0f412334fb994ff0ab492afde64f5855: stopping tablet replica
I20251023 07:59:54.971313 16888 raft_consensus.cc:2243] T 7d599e4b62364f04b966ca88e16b560a P 0f412334fb994ff0ab492afde64f5855 [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:54.972342 16888 raft_consensus.cc:2272] T 7d599e4b62364f04b966ca88e16b560a P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.974802 16888 tablet_replica.cc:333] T 7060af9ee4a34ecca18900b2f272e1d1 P 0f412334fb994ff0ab492afde64f5855: stopping tablet replica
I20251023 07:59:54.975554 16888 raft_consensus.cc:2243] T 7060af9ee4a34ecca18900b2f272e1d1 P 0f412334fb994ff0ab492afde64f5855 [term 2 LEADER]: Raft consensus shutting down.
I20251023 07:59:54.976487 16888 raft_consensus.cc:2272] T 7060af9ee4a34ecca18900b2f272e1d1 P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.978844 16888 tablet_replica.cc:333] T 6db769d91ae244679bcea825f9763446 P 0f412334fb994ff0ab492afde64f5855: stopping tablet replica
I20251023 07:59:54.979606 16888 raft_consensus.cc:2243] T 6db769d91ae244679bcea825f9763446 P 0f412334fb994ff0ab492afde64f5855 [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:54.980629 16888 raft_consensus.cc:2272] T 6db769d91ae244679bcea825f9763446 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.983152 16888 tablet_replica.cc:333] T ccba7896b7e1413293428358ffd0f8a0 P 0f412334fb994ff0ab492afde64f5855: stopping tablet replica
W20251023 07:59:54.983667 20116 consensus_peers.cc:597] T 090551fa29ba48dd8d41263e14b8ec3c P 0f412334fb994ff0ab492afde64f5855 -> Peer 35e7d1ade024444486e63cf1b81e9626 (127.16.126.2:42309): Couldn't send request to peer 35e7d1ade024444486e63cf1b81e9626. Status: Network error: Client connection negotiation failed: client connection to 127.16.126.2:42309: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:54.983851 16888 raft_consensus.cc:2243] T ccba7896b7e1413293428358ffd0f8a0 P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.984438 16888 raft_consensus.cc:2272] T ccba7896b7e1413293428358ffd0f8a0 P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.986871 16888 tablet_replica.cc:333] T 090551fa29ba48dd8d41263e14b8ec3c P 0f412334fb994ff0ab492afde64f5855: stopping tablet replica
I20251023 07:59:54.987604 16888 raft_consensus.cc:2243] T 090551fa29ba48dd8d41263e14b8ec3c P 0f412334fb994ff0ab492afde64f5855 [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:54.988566 16888 raft_consensus.cc:2272] T 090551fa29ba48dd8d41263e14b8ec3c P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.991045 16888 tablet_replica.cc:333] T 13d572956c644586b0efbe8f63aecae5 P 0f412334fb994ff0ab492afde64f5855: stopping tablet replica
I20251023 07:59:54.991757 16888 raft_consensus.cc:2243] T 13d572956c644586b0efbe8f63aecae5 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.992197 16888 raft_consensus.cc:2272] T 13d572956c644586b0efbe8f63aecae5 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.994732 16888 tablet_replica.cc:333] T 076aca7c8ecb4f34af0d457fcee0e585 P 0f412334fb994ff0ab492afde64f5855: stopping tablet replica
I20251023 07:59:54.995434 16888 raft_consensus.cc:2243] T 076aca7c8ecb4f34af0d457fcee0e585 P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:54.995914 16888 raft_consensus.cc:2272] T 076aca7c8ecb4f34af0d457fcee0e585 P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:54.998169 16888 tablet_replica.cc:333] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P 0f412334fb994ff0ab492afde64f5855: stopping tablet replica
I20251023 07:59:54.998881 16888 raft_consensus.cc:2243] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P 0f412334fb994ff0ab492afde64f5855 [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:54.999603 16888 raft_consensus.cc:2272] T 0fead0c9b2cd4e6cabadb0fe1cd8324b P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:55.001576 16888 tablet_replica.cc:333] T 1fa44f181e6e44bfb1e566ef7b0778a0 P 0f412334fb994ff0ab492afde64f5855: stopping tablet replica
I20251023 07:59:55.002111 16888 raft_consensus.cc:2243] T 1fa44f181e6e44bfb1e566ef7b0778a0 P 0f412334fb994ff0ab492afde64f5855 [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:55.002887 16888 raft_consensus.cc:2272] T 1fa44f181e6e44bfb1e566ef7b0778a0 P 0f412334fb994ff0ab492afde64f5855 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:55.004782 16888 tablet_replica.cc:333] T a9d3294d54be4be29569a460be5c8887 P 0f412334fb994ff0ab492afde64f5855: stopping tablet replica
I20251023 07:59:55.005260 16888 raft_consensus.cc:2243] T a9d3294d54be4be29569a460be5c8887 P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:55.005719 16888 raft_consensus.cc:2272] T a9d3294d54be4be29569a460be5c8887 P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:55.007505 16888 tablet_replica.cc:333] T f1da9b379f264014adfbf37b2660285b P 0f412334fb994ff0ab492afde64f5855: stopping tablet replica
I20251023 07:59:55.007988 16888 raft_consensus.cc:2243] T f1da9b379f264014adfbf37b2660285b P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:55.008421 16888 raft_consensus.cc:2272] T f1da9b379f264014adfbf37b2660285b P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:55.010192 16888 tablet_replica.cc:333] T 7062462192fc4895b5a9f6a34c4a132a P 0f412334fb994ff0ab492afde64f5855: stopping tablet replica
I20251023 07:59:55.010658 16888 raft_consensus.cc:2243] T 7062462192fc4895b5a9f6a34c4a132a P 0f412334fb994ff0ab492afde64f5855 [term 2 LEADER]: Raft consensus shutting down.
I20251023 07:59:55.011412 16888 raft_consensus.cc:2272] T 7062462192fc4895b5a9f6a34c4a132a P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:55.013139 16888 tablet_replica.cc:333] T d214412da5754dd0a08f25d50b5584f1 P 0f412334fb994ff0ab492afde64f5855: stopping tablet replica
I20251023 07:59:55.013670 16888 raft_consensus.cc:2243] T d214412da5754dd0a08f25d50b5584f1 P 0f412334fb994ff0ab492afde64f5855 [term 2 LEADER]: Raft consensus shutting down.
I20251023 07:59:55.014410 16888 raft_consensus.cc:2272] T d214412da5754dd0a08f25d50b5584f1 P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:55.016314 16888 tablet_replica.cc:333] T c6fd96e3f93945f7828a9a8593490daa P 0f412334fb994ff0ab492afde64f5855: stopping tablet replica
I20251023 07:59:55.016789 16888 raft_consensus.cc:2243] T c6fd96e3f93945f7828a9a8593490daa P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:55.017180 16888 raft_consensus.cc:2272] T c6fd96e3f93945f7828a9a8593490daa P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:55.018987 16888 tablet_replica.cc:333] T 5855488965da49f4a33c7516f6a5596a P 0f412334fb994ff0ab492afde64f5855: stopping tablet replica
I20251023 07:59:55.019412 16888 raft_consensus.cc:2243] T 5855488965da49f4a33c7516f6a5596a P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:55.019827 16888 raft_consensus.cc:2272] T 5855488965da49f4a33c7516f6a5596a P 0f412334fb994ff0ab492afde64f5855 [term 2 FOLLOWER]: Raft consensus is shut down!
W20251023 07:59:55.079165 20189 consensus_peers.cc:597] T 58cef989d86d4b0c8401b4d6b2f890c0 P 65876a2b197c4ea6918f5cab47ded25c -> Peer 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287): Couldn't send request to peer 0f412334fb994ff0ab492afde64f5855. Status: Network error: Client connection negotiation failed: client connection to 127.16.126.3:33287: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:55.099610 16888 tablet_server.cc:195] TabletServer@127.16.126.3:0 shutdown complete.
W20251023 07:59:55.106433 20189 consensus_peers.cc:597] T ae516c440b7749f388e0e2f89a6a81b7 P 65876a2b197c4ea6918f5cab47ded25c -> Peer 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287): Couldn't send request to peer 0f412334fb994ff0ab492afde64f5855. Status: Network error: Client connection negotiation failed: client connection to 127.16.126.3:33287: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:55.168116 16888 tablet_server.cc:178] TabletServer@127.16.126.4:0 shutting down...
W20251023 07:59:55.203763 20189 consensus_peers.cc:597] T a0ff2fc9a3c04716ab748f95a00dec76 P 65876a2b197c4ea6918f5cab47ded25c -> Peer 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287): Couldn't send request to peer 0f412334fb994ff0ab492afde64f5855. Status: Network error: Client connection negotiation failed: client connection to 127.16.126.3:33287: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:55.213034 16888 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251023 07:59:55.214079 16888 tablet_replica.cc:333] T b7dcf1850ca541d6ab42bd11de70d8f4 P 65876a2b197c4ea6918f5cab47ded25c: stopping tablet replica
I20251023 07:59:55.215068 16888 raft_consensus.cc:2243] T b7dcf1850ca541d6ab42bd11de70d8f4 P 65876a2b197c4ea6918f5cab47ded25c [term 3 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:55.215721 16888 raft_consensus.cc:2272] T b7dcf1850ca541d6ab42bd11de70d8f4 P 65876a2b197c4ea6918f5cab47ded25c [term 3 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:55.217999 16888 tablet_replica.cc:333] T 35c1ea979bda45aead7d1b8539f37637 P 65876a2b197c4ea6918f5cab47ded25c: stopping tablet replica
I20251023 07:59:55.218626 16888 raft_consensus.cc:2243] T 35c1ea979bda45aead7d1b8539f37637 P 65876a2b197c4ea6918f5cab47ded25c [term 3 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:55.219108 16888 raft_consensus.cc:2272] T 35c1ea979bda45aead7d1b8539f37637 P 65876a2b197c4ea6918f5cab47ded25c [term 3 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:55.220907 16888 tablet_replica.cc:333] T 01844334149649bb83991b613a695fe2 P 65876a2b197c4ea6918f5cab47ded25c: stopping tablet replica
I20251023 07:59:55.221526 16888 raft_consensus.cc:2243] T 01844334149649bb83991b613a695fe2 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:55.221966 16888 raft_consensus.cc:2272] T 01844334149649bb83991b613a695fe2 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:55.224434 16888 tablet_replica.cc:333] T 20f681957fa04333b8a04cbad085db57 P 65876a2b197c4ea6918f5cab47ded25c: stopping tablet replica
I20251023 07:59:55.225078 16888 raft_consensus.cc:2243] T 20f681957fa04333b8a04cbad085db57 P 65876a2b197c4ea6918f5cab47ded25c [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:55.225895 16888 raft_consensus.cc:2272] T 20f681957fa04333b8a04cbad085db57 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:55.227690 16888 tablet_replica.cc:333] T 0973ba22912840bd9bded8b0376fa1e7 P 65876a2b197c4ea6918f5cab47ded25c: stopping tablet replica
I20251023 07:59:55.228176 16888 raft_consensus.cc:2243] T 0973ba22912840bd9bded8b0376fa1e7 P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:55.228538 16888 raft_consensus.cc:2272] T 0973ba22912840bd9bded8b0376fa1e7 P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:55.230255 16888 tablet_replica.cc:333] T 382a939856194537b68f791851ceaa65 P 65876a2b197c4ea6918f5cab47ded25c: stopping tablet replica
I20251023 07:59:55.230768 16888 raft_consensus.cc:2243] T 382a939856194537b68f791851ceaa65 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:55.231133 16888 raft_consensus.cc:2272] T 382a939856194537b68f791851ceaa65 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:55.232859 16888 tablet_replica.cc:333] T 8b6aca6db6ab43e8be0b6ec22dc96700 P 65876a2b197c4ea6918f5cab47ded25c: stopping tablet replica
I20251023 07:59:55.233362 16888 raft_consensus.cc:2243] T 8b6aca6db6ab43e8be0b6ec22dc96700 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:55.233773 16888 raft_consensus.cc:2272] T 8b6aca6db6ab43e8be0b6ec22dc96700 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:55.235452 16888 tablet_replica.cc:333] T dc81e0e89365425793f2851459b7e892 P 65876a2b197c4ea6918f5cab47ded25c: stopping tablet replica
I20251023 07:59:55.235966 16888 raft_consensus.cc:2243] T dc81e0e89365425793f2851459b7e892 P 65876a2b197c4ea6918f5cab47ded25c [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:55.236717 16888 raft_consensus.cc:2272] T dc81e0e89365425793f2851459b7e892 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:55.238597 16888 tablet_replica.cc:333] T f20a7a673ce6433eac41600d3573e314 P 65876a2b197c4ea6918f5cab47ded25c: stopping tablet replica
I20251023 07:59:55.239337 16888 raft_consensus.cc:2243] T f20a7a673ce6433eac41600d3573e314 P 65876a2b197c4ea6918f5cab47ded25c [term 2 LEADER]: Raft consensus shutting down.
I20251023 07:59:55.240047 16888 raft_consensus.cc:2272] T f20a7a673ce6433eac41600d3573e314 P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:55.241801 16888 tablet_replica.cc:333] T f8ceeb2a7d7d45629aee9466b149251b P 65876a2b197c4ea6918f5cab47ded25c: stopping tablet replica
I20251023 07:59:55.242280 16888 raft_consensus.cc:2243] T f8ceeb2a7d7d45629aee9466b149251b P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:55.242686 16888 raft_consensus.cc:2272] T f8ceeb2a7d7d45629aee9466b149251b P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:55.244446 16888 tablet_replica.cc:333] T cb866838666745f0a4462f124ac22f72 P 65876a2b197c4ea6918f5cab47ded25c: stopping tablet replica
I20251023 07:59:55.245054 16888 raft_consensus.cc:2243] T cb866838666745f0a4462f124ac22f72 P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:55.245486 16888 raft_consensus.cc:2272] T cb866838666745f0a4462f124ac22f72 P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:55.247243 16888 tablet_replica.cc:333] T ae516c440b7749f388e0e2f89a6a81b7 P 65876a2b197c4ea6918f5cab47ded25c: stopping tablet replica
I20251023 07:59:55.247759 16888 raft_consensus.cc:2243] T ae516c440b7749f388e0e2f89a6a81b7 P 65876a2b197c4ea6918f5cab47ded25c [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:55.248471 16888 raft_consensus.cc:2272] T ae516c440b7749f388e0e2f89a6a81b7 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:55.250174 16888 tablet_replica.cc:333] T b4b44015a24e47ddae24244c3fb1fff1 P 65876a2b197c4ea6918f5cab47ded25c: stopping tablet replica
I20251023 07:59:55.250691 16888 raft_consensus.cc:2243] T b4b44015a24e47ddae24244c3fb1fff1 P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:55.251112 16888 raft_consensus.cc:2272] T b4b44015a24e47ddae24244c3fb1fff1 P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:55.252133 21100 raft_consensus.cc:493] T ccba7896b7e1413293428358ffd0f8a0 P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d1379e91aa9c41629cd25262571beb2c)
I20251023 07:59:55.252606 21100 raft_consensus.cc:515] T ccba7896b7e1413293428358ffd0f8a0 P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f412334fb994ff0ab492afde64f5855" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 33287 } } peers { permanent_uuid: "65876a2b197c4ea6918f5cab47ded25c" member_type: VOTER last_known_addr { host: "127.16.126.4" port: 34955 } } peers { permanent_uuid: "d1379e91aa9c41629cd25262571beb2c" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 37865 } }
I20251023 07:59:55.253582 16888 tablet_replica.cc:333] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P 65876a2b197c4ea6918f5cab47ded25c: stopping tablet replica
I20251023 07:59:55.254361 16888 raft_consensus.cc:2243] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:55.254537 21100 leader_election.cc:290] T ccba7896b7e1413293428358ffd0f8a0 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287), d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865)
I20251023 07:59:55.254902 16888 raft_consensus.cc:2272] T 0a62e9fdd3de46bcb61bebafbf9f7a2c P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Raft consensus is shut down!
W20251023 07:59:55.255923 20189 consensus_peers.cc:597] T f1da9b379f264014adfbf37b2660285b P 65876a2b197c4ea6918f5cab47ded25c -> Peer 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287): Couldn't send request to peer 0f412334fb994ff0ab492afde64f5855. Status: Network error: Client connection negotiation failed: client connection to 127.16.126.3:33287: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:55.257417 16888 tablet_replica.cc:333] T a0ff2fc9a3c04716ab748f95a00dec76 P 65876a2b197c4ea6918f5cab47ded25c: stopping tablet replica
W20251023 07:59:55.258054 20189 leader_election.cc:336] T ccba7896b7e1413293428358ffd0f8a0 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287): Network error: Client connection negotiation failed: client connection to 127.16.126.3:33287: connect: Connection refused (error 111)
I20251023 07:59:55.258128 16888 raft_consensus.cc:2243] T a0ff2fc9a3c04716ab748f95a00dec76 P 65876a2b197c4ea6918f5cab47ded25c [term 1 LEADER]: Raft consensus shutting down.
W20251023 07:59:55.258654 20192 leader_election.cc:336] T ccba7896b7e1413293428358ffd0f8a0 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d1379e91aa9c41629cd25262571beb2c (127.16.126.1:37865): Network error: Client connection negotiation failed: client connection to 127.16.126.1:37865: connect: Connection refused (error 111)
I20251023 07:59:55.258980 20192 leader_election.cc:304] T ccba7896b7e1413293428358ffd0f8a0 P 65876a2b197c4ea6918f5cab47ded25c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65876a2b197c4ea6918f5cab47ded25c; no voters: 0f412334fb994ff0ab492afde64f5855, d1379e91aa9c41629cd25262571beb2c
I20251023 07:59:55.259166 16888 raft_consensus.cc:2272] T a0ff2fc9a3c04716ab748f95a00dec76 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:55.259528 21100 raft_consensus.cc:2749] T ccba7896b7e1413293428358ffd0f8a0 P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251023 07:59:55.261665 16888 tablet_replica.cc:333] T c469a3ace4204641be00f1b797fbffe9 P 65876a2b197c4ea6918f5cab47ded25c: stopping tablet replica
I20251023 07:59:55.262319 16888 raft_consensus.cc:2243] T c469a3ace4204641be00f1b797fbffe9 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:55.262857 16888 raft_consensus.cc:2272] T c469a3ace4204641be00f1b797fbffe9 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Raft consensus is shut down!
W20251023 07:59:55.264896 20189 consensus_peers.cc:597] T a9d3294d54be4be29569a460be5c8887 P 65876a2b197c4ea6918f5cab47ded25c -> Peer 0f412334fb994ff0ab492afde64f5855 (127.16.126.3:33287): Couldn't send request to peer 0f412334fb994ff0ab492afde64f5855. Status: Network error: Client connection negotiation failed: client connection to 127.16.126.3:33287: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251023 07:59:55.265341 16888 tablet_replica.cc:333] T 58cef989d86d4b0c8401b4d6b2f890c0 P 65876a2b197c4ea6918f5cab47ded25c: stopping tablet replica
I20251023 07:59:55.265992 16888 raft_consensus.cc:2243] T 58cef989d86d4b0c8401b4d6b2f890c0 P 65876a2b197c4ea6918f5cab47ded25c [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:55.266695 16888 raft_consensus.cc:2272] T 58cef989d86d4b0c8401b4d6b2f890c0 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:55.268491 16888 tablet_replica.cc:333] T e2c26d408ee04105bd615b58287c82f9 P 65876a2b197c4ea6918f5cab47ded25c: stopping tablet replica
I20251023 07:59:55.269021 16888 raft_consensus.cc:2243] T e2c26d408ee04105bd615b58287c82f9 P 65876a2b197c4ea6918f5cab47ded25c [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:55.269769 16888 raft_consensus.cc:2272] T e2c26d408ee04105bd615b58287c82f9 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:55.271471 16888 tablet_replica.cc:333] T e08e797f71f1483a9c2b5899554a6dec P 65876a2b197c4ea6918f5cab47ded25c: stopping tablet replica
I20251023 07:59:55.272027 16888 raft_consensus.cc:2243] T e08e797f71f1483a9c2b5899554a6dec P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:55.272410 16888 raft_consensus.cc:2272] T e08e797f71f1483a9c2b5899554a6dec P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:55.274197 16888 tablet_replica.cc:333] T 5855488965da49f4a33c7516f6a5596a P 65876a2b197c4ea6918f5cab47ded25c: stopping tablet replica
I20251023 07:59:55.274717 16888 raft_consensus.cc:2243] T 5855488965da49f4a33c7516f6a5596a P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:55.275087 16888 raft_consensus.cc:2272] T 5855488965da49f4a33c7516f6a5596a P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:55.276865 16888 tablet_replica.cc:333] T f524e775b99147de99cfb27d3785965d P 65876a2b197c4ea6918f5cab47ded25c: stopping tablet replica
I20251023 07:59:55.277357 16888 raft_consensus.cc:2243] T f524e775b99147de99cfb27d3785965d P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:55.277768 16888 raft_consensus.cc:2272] T f524e775b99147de99cfb27d3785965d P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:55.279476 16888 tablet_replica.cc:333] T 7d599e4b62364f04b966ca88e16b560a P 65876a2b197c4ea6918f5cab47ded25c: stopping tablet replica
I20251023 07:59:55.279981 16888 raft_consensus.cc:2243] T 7d599e4b62364f04b966ca88e16b560a P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:55.280380 16888 raft_consensus.cc:2272] T 7d599e4b62364f04b966ca88e16b560a P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:55.282056 16888 tablet_replica.cc:333] T c52243b5fda44e2fba36f6319b4c13e3 P 65876a2b197c4ea6918f5cab47ded25c: stopping tablet replica
I20251023 07:59:55.282578 16888 raft_consensus.cc:2243] T c52243b5fda44e2fba36f6319b4c13e3 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:55.282975 16888 raft_consensus.cc:2272] T c52243b5fda44e2fba36f6319b4c13e3 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:55.284569 16888 tablet_replica.cc:333] T 2ff74dfb94334c20b99ea84b985a27a5 P 65876a2b197c4ea6918f5cab47ded25c: stopping tablet replica
I20251023 07:59:55.285048 16888 raft_consensus.cc:2243] T 2ff74dfb94334c20b99ea84b985a27a5 P 65876a2b197c4ea6918f5cab47ded25c [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:55.285851 16888 raft_consensus.cc:2272] T 2ff74dfb94334c20b99ea84b985a27a5 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:55.288015 16888 tablet_replica.cc:333] T 791953f9d44946eaa145c5857557a5e4 P 65876a2b197c4ea6918f5cab47ded25c: stopping tablet replica
I20251023 07:59:55.288651 16888 raft_consensus.cc:2243] T 791953f9d44946eaa145c5857557a5e4 P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:55.289037 16888 raft_consensus.cc:2272] T 791953f9d44946eaa145c5857557a5e4 P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:55.291208 16888 tablet_replica.cc:333] T 0229047af3034761a2bf168928917afb P 65876a2b197c4ea6918f5cab47ded25c: stopping tablet replica
I20251023 07:59:55.291719 16888 raft_consensus.cc:2243] T 0229047af3034761a2bf168928917afb P 65876a2b197c4ea6918f5cab47ded25c [term 2 LEADER]: Raft consensus shutting down.
I20251023 07:59:55.292392 16888 raft_consensus.cc:2272] T 0229047af3034761a2bf168928917afb P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:55.294027 16888 tablet_replica.cc:333] T c3527495b334413f82d0eca2c4d117b1 P 65876a2b197c4ea6918f5cab47ded25c: stopping tablet replica
I20251023 07:59:55.294545 16888 raft_consensus.cc:2243] T c3527495b334413f82d0eca2c4d117b1 P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:55.294936 16888 raft_consensus.cc:2272] T c3527495b334413f82d0eca2c4d117b1 P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:55.296568 16888 tablet_replica.cc:333] T fa36a9cfa4fe43418245de193502470f P 65876a2b197c4ea6918f5cab47ded25c: stopping tablet replica
I20251023 07:59:55.297049 16888 raft_consensus.cc:2243] T fa36a9cfa4fe43418245de193502470f P 65876a2b197c4ea6918f5cab47ded25c [term 3 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:55.297497 16888 raft_consensus.cc:2272] T fa36a9cfa4fe43418245de193502470f P 65876a2b197c4ea6918f5cab47ded25c [term 3 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:55.299371 16888 tablet_replica.cc:333] T c6b6d87c63ca43999bf97916bd589275 P 65876a2b197c4ea6918f5cab47ded25c: stopping tablet replica
I20251023 07:59:55.300096 16888 raft_consensus.cc:2243] T c6b6d87c63ca43999bf97916bd589275 P 65876a2b197c4ea6918f5cab47ded25c [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:55.300922 16888 raft_consensus.cc:2272] T c6b6d87c63ca43999bf97916bd589275 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:55.303241 16888 tablet_replica.cc:333] T 5bc7d7ca172742d1b528af8659661c2a P 65876a2b197c4ea6918f5cab47ded25c: stopping tablet replica
I20251023 07:59:55.303759 16888 raft_consensus.cc:2243] T 5bc7d7ca172742d1b528af8659661c2a P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:55.304157 16888 raft_consensus.cc:2272] T 5bc7d7ca172742d1b528af8659661c2a P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:55.306422 16888 tablet_replica.cc:333] T f1da9b379f264014adfbf37b2660285b P 65876a2b197c4ea6918f5cab47ded25c: stopping tablet replica
I20251023 07:59:55.307080 16888 raft_consensus.cc:2243] T f1da9b379f264014adfbf37b2660285b P 65876a2b197c4ea6918f5cab47ded25c [term 2 LEADER]: Raft consensus shutting down.
I20251023 07:59:55.307794 16888 raft_consensus.cc:2272] T f1da9b379f264014adfbf37b2660285b P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:55.309772 16888 tablet_replica.cc:333] T 7062462192fc4895b5a9f6a34c4a132a P 65876a2b197c4ea6918f5cab47ded25c: stopping tablet replica
I20251023 07:59:55.310546 16888 raft_consensus.cc:2243] T 7062462192fc4895b5a9f6a34c4a132a P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:55.311043 16888 raft_consensus.cc:2272] T 7062462192fc4895b5a9f6a34c4a132a P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:55.313264 16888 tablet_replica.cc:333] T a1c85032f5ef4634a35c20eec56ae62f P 65876a2b197c4ea6918f5cab47ded25c: stopping tablet replica
I20251023 07:59:55.313921 16888 raft_consensus.cc:2243] T a1c85032f5ef4634a35c20eec56ae62f P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:55.314405 16888 raft_consensus.cc:2272] T a1c85032f5ef4634a35c20eec56ae62f P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:55.316079 16888 tablet_replica.cc:333] T db045d1b86484fe9987f82ce426362e5 P 65876a2b197c4ea6918f5cab47ded25c: stopping tablet replica
I20251023 07:59:55.316570 16888 raft_consensus.cc:2243] T db045d1b86484fe9987f82ce426362e5 P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:55.316963 16888 raft_consensus.cc:2272] T db045d1b86484fe9987f82ce426362e5 P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:55.318756 16888 tablet_replica.cc:333] T 090551fa29ba48dd8d41263e14b8ec3c P 65876a2b197c4ea6918f5cab47ded25c: stopping tablet replica
I20251023 07:59:55.319227 16888 raft_consensus.cc:2243] T 090551fa29ba48dd8d41263e14b8ec3c P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:55.319600 16888 raft_consensus.cc:2272] T 090551fa29ba48dd8d41263e14b8ec3c P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:55.321319 16888 tablet_replica.cc:333] T 13d572956c644586b0efbe8f63aecae5 P 65876a2b197c4ea6918f5cab47ded25c: stopping tablet replica
I20251023 07:59:55.321818 16888 raft_consensus.cc:2243] T 13d572956c644586b0efbe8f63aecae5 P 65876a2b197c4ea6918f5cab47ded25c [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:55.322525 16888 raft_consensus.cc:2272] T 13d572956c644586b0efbe8f63aecae5 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:55.324178 16888 tablet_replica.cc:333] T 076aca7c8ecb4f34af0d457fcee0e585 P 65876a2b197c4ea6918f5cab47ded25c: stopping tablet replica
I20251023 07:59:55.324651 16888 raft_consensus.cc:2243] T 076aca7c8ecb4f34af0d457fcee0e585 P 65876a2b197c4ea6918f5cab47ded25c [term 2 LEADER]: Raft consensus shutting down.
I20251023 07:59:55.325380 16888 raft_consensus.cc:2272] T 076aca7c8ecb4f34af0d457fcee0e585 P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:55.327283 16888 tablet_replica.cc:333] T 6db769d91ae244679bcea825f9763446 P 65876a2b197c4ea6918f5cab47ded25c: stopping tablet replica
I20251023 07:59:55.327823 16888 raft_consensus.cc:2243] T 6db769d91ae244679bcea825f9763446 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:55.328203 16888 raft_consensus.cc:2272] T 6db769d91ae244679bcea825f9763446 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:55.329993 16888 tablet_replica.cc:333] T a9f4a5a96a444c099e7cefb12fe4c288 P 65876a2b197c4ea6918f5cab47ded25c: stopping tablet replica
I20251023 07:59:55.330618 16888 raft_consensus.cc:2243] T a9f4a5a96a444c099e7cefb12fe4c288 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:55.331008 16888 raft_consensus.cc:2272] T a9f4a5a96a444c099e7cefb12fe4c288 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:55.332945 16888 tablet_replica.cc:333] T ccba7896b7e1413293428358ffd0f8a0 P 65876a2b197c4ea6918f5cab47ded25c: stopping tablet replica
I20251023 07:59:55.333510 16888 raft_consensus.cc:2243] T ccba7896b7e1413293428358ffd0f8a0 P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:55.333876 16888 raft_consensus.cc:2272] T ccba7896b7e1413293428358ffd0f8a0 P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:55.335645 16888 tablet_replica.cc:333] T 92fae2a393404d8998ad2747fbd08cc9 P 65876a2b197c4ea6918f5cab47ded25c: stopping tablet replica
I20251023 07:59:55.336131 16888 raft_consensus.cc:2243] T 92fae2a393404d8998ad2747fbd08cc9 P 65876a2b197c4ea6918f5cab47ded25c [term 2 LEADER]: Raft consensus shutting down.
I20251023 07:59:55.336834 16888 raft_consensus.cc:2272] T 92fae2a393404d8998ad2747fbd08cc9 P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:55.338616 16888 tablet_replica.cc:333] T 62e73cfc2bbc459aba34186c3231ed87 P 65876a2b197c4ea6918f5cab47ded25c: stopping tablet replica
I20251023 07:59:55.339067 16888 raft_consensus.cc:2243] T 62e73cfc2bbc459aba34186c3231ed87 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:55.339424 16888 raft_consensus.cc:2272] T 62e73cfc2bbc459aba34186c3231ed87 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:55.341094 16888 tablet_replica.cc:333] T 1fa44f181e6e44bfb1e566ef7b0778a0 P 65876a2b197c4ea6918f5cab47ded25c: stopping tablet replica
I20251023 07:59:55.341581 16888 raft_consensus.cc:2243] T 1fa44f181e6e44bfb1e566ef7b0778a0 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 07:59:55.341948 16888 raft_consensus.cc:2272] T 1fa44f181e6e44bfb1e566ef7b0778a0 P 65876a2b197c4ea6918f5cab47ded25c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:55.343685 16888 tablet_replica.cc:333] T a9d3294d54be4be29569a460be5c8887 P 65876a2b197c4ea6918f5cab47ded25c: stopping tablet replica
I20251023 07:59:55.344133 16888 raft_consensus.cc:2243] T a9d3294d54be4be29569a460be5c8887 P 65876a2b197c4ea6918f5cab47ded25c [term 2 LEADER]: Raft consensus shutting down.
I20251023 07:59:55.344882 16888 raft_consensus.cc:2272] T a9d3294d54be4be29569a460be5c8887 P 65876a2b197c4ea6918f5cab47ded25c [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:55.407014 16888 tablet_server.cc:195] TabletServer@127.16.126.4:0 shutdown complete.
I20251023 07:59:55.466091 16888 master.cc:561] Master@127.16.126.62:42363 shutting down...
I20251023 07:59:55.490639 16888 raft_consensus.cc:2243] T 00000000000000000000000000000000 P e4ebfcaa20f24435b44962310834cb71 [term 1 LEADER]: Raft consensus shutting down.
I20251023 07:59:55.491199 16888 raft_consensus.cc:2272] T 00000000000000000000000000000000 P e4ebfcaa20f24435b44962310834cb71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 07:59:55.491505 16888 tablet_replica.cc:333] T 00000000000000000000000000000000 P e4ebfcaa20f24435b44962310834cb71: stopping tablet replica
I20251023 07:59:55.535696 16888 master.cc:583] Master@127.16.126.62:42363 shutdown complete.
[ OK ] LeaderRebalancerTest.RestartTserver (28769 ms)
[ RUN ] LeaderRebalancerTest.TestMaintenanceMode
/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/master/auto_leader_rebalancer-test.cc:475: Skipped
test is skipped; set KUDU_ALLOW_SLOW_TESTS=1 to run
[ SKIPPED ] LeaderRebalancerTest.TestMaintenanceMode (7 ms)
[----------] 5 tests from LeaderRebalancerTest (143838 ms total)
[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20251023 07:59:55.636665 16888 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.16.126.62:34345
I20251023 07:59:55.637856 16888 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251023 07:59:55.643441 21140 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251023 07:59:55.643731 21141 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251023 07:59:55.644404 21143 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251023 07:59:55.645565 16888 server_base.cc:1047] running on GCE node
I20251023 07:59:55.646579 16888 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251023 07:59:55.646763 16888 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251023 07:59:55.646881 16888 hybrid_clock.cc:648] HybridClock initialized: now 1761206395646865 us; error 0 us; skew 500 ppm
I20251023 07:59:55.647351 16888 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20251023 07:59:55.649766 16888 webserver.cc:492] Webserver started at http://127.16.126.62:37729/ using document root <none> and password file <none>
I20251023 07:59:55.650215 16888 fs_manager.cc:362] Metadata directory not provided
I20251023 07:59:55.650374 16888 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251023 07:59:55.650586 16888 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251023 07:59:55.651670 16888 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1761206251627710-16888-0/minicluster-data/master-0-root/instance:
uuid: "7b7e99cce269401ea04f24281106b86e"
format_stamp: "Formatted at 2025-10-23 07:59:55 on dist-test-slave-m488"
I20251023 07:59:55.657042 16888 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.004s sys 0.003s
I20251023 07:59:55.660450 21148 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251023 07:59:55.661150 16888 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20251023 07:59:55.661451 16888 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1761206251627710-16888-0/minicluster-data/master-0-root
uuid: "7b7e99cce269401ea04f24281106b86e"
format_stamp: "Formatted at 2025-10-23 07:59:55 on dist-test-slave-m488"
I20251023 07:59:55.661716 16888 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1761206251627710-16888-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1761206251627710-16888-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1761206251627710-16888-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251023 07:59:55.696975 16888 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251023 07:59:55.698339 16888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251023 07:59:55.738492 16888 rpc_server.cc:307] RPC server started. Bound to: 127.16.126.62:34345
I20251023 07:59:55.738597 21199 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.126.62:34345 every 8 connection(s)
I20251023 07:59:55.742501 21200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:55.753373 21200 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b7e99cce269401ea04f24281106b86e: Bootstrap starting.
I20251023 07:59:55.758311 21200 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7b7e99cce269401ea04f24281106b86e: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:55.762562 21200 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b7e99cce269401ea04f24281106b86e: No bootstrap required, opened a new log
I20251023 07:59:55.764777 21200 raft_consensus.cc:359] T 00000000000000000000000000000000 P 7b7e99cce269401ea04f24281106b86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b7e99cce269401ea04f24281106b86e" member_type: VOTER }
I20251023 07:59:55.765151 21200 raft_consensus.cc:385] T 00000000000000000000000000000000 P 7b7e99cce269401ea04f24281106b86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:55.765399 21200 raft_consensus.cc:740] T 00000000000000000000000000000000 P 7b7e99cce269401ea04f24281106b86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b7e99cce269401ea04f24281106b86e, State: Initialized, Role: FOLLOWER
I20251023 07:59:55.765970 21200 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7b7e99cce269401ea04f24281106b86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b7e99cce269401ea04f24281106b86e" member_type: VOTER }
I20251023 07:59:55.766422 21200 raft_consensus.cc:399] T 00000000000000000000000000000000 P 7b7e99cce269401ea04f24281106b86e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251023 07:59:55.766640 21200 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7b7e99cce269401ea04f24281106b86e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251023 07:59:55.766908 21200 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7b7e99cce269401ea04f24281106b86e [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:55.771523 21200 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7b7e99cce269401ea04f24281106b86e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b7e99cce269401ea04f24281106b86e" member_type: VOTER }
I20251023 07:59:55.772015 21200 leader_election.cc:304] T 00000000000000000000000000000000 P 7b7e99cce269401ea04f24281106b86e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7b7e99cce269401ea04f24281106b86e; no voters:
I20251023 07:59:55.773151 21200 leader_election.cc:290] T 00000000000000000000000000000000 P 7b7e99cce269401ea04f24281106b86e [CANDIDATE]: Term 1 election: Requested vote from peers
I20251023 07:59:55.773605 21203 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 7b7e99cce269401ea04f24281106b86e [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:59:55.774987 21203 raft_consensus.cc:697] T 00000000000000000000000000000000 P 7b7e99cce269401ea04f24281106b86e [term 1 LEADER]: Becoming Leader. State: Replica: 7b7e99cce269401ea04f24281106b86e, State: Running, Role: LEADER
I20251023 07:59:55.775653 21203 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7b7e99cce269401ea04f24281106b86e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b7e99cce269401ea04f24281106b86e" member_type: VOTER }
I20251023 07:59:55.776166 21200 sys_catalog.cc:565] T 00000000000000000000000000000000 P 7b7e99cce269401ea04f24281106b86e [sys.catalog]: configured and running, proceeding with master startup.
I20251023 07:59:55.780776 21205 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b7e99cce269401ea04f24281106b86e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7b7e99cce269401ea04f24281106b86e. Latest consensus state: current_term: 1 leader_uuid: "7b7e99cce269401ea04f24281106b86e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b7e99cce269401ea04f24281106b86e" member_type: VOTER } }
I20251023 07:59:55.780885 21204 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b7e99cce269401ea04f24281106b86e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7b7e99cce269401ea04f24281106b86e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b7e99cce269401ea04f24281106b86e" member_type: VOTER } }
I20251023 07:59:55.781912 21204 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b7e99cce269401ea04f24281106b86e [sys.catalog]: This master's current role is: LEADER
I20251023 07:59:55.781913 21205 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b7e99cce269401ea04f24281106b86e [sys.catalog]: This master's current role is: LEADER
I20251023 07:59:55.787174 21212 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251023 07:59:55.794772 21212 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251023 07:59:55.795761 16888 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20251023 07:59:55.803648 21212 catalog_manager.cc:1357] Generated new cluster ID: 5c562a9896e242c58deac7182e5f077f
I20251023 07:59:55.803898 21212 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251023 07:59:55.820171 21212 catalog_manager.cc:1380] Generated new certificate authority record
I20251023 07:59:55.821390 21212 catalog_manager.cc:1514] Loading token signing keys...
I20251023 07:59:55.834276 21212 catalog_manager.cc:6022] T 00000000000000000000000000000000 P 7b7e99cce269401ea04f24281106b86e: Generated new TSK 0
I20251023 07:59:55.834826 21212 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251023 07:59:55.862795 16888 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251023 07:59:55.868911 21221 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251023 07:59:55.870198 21222 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251023 07:59:55.872749 21224 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251023 07:59:55.875381 16888 server_base.cc:1047] running on GCE node
I20251023 07:59:55.876318 16888 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251023 07:59:55.876508 16888 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251023 07:59:55.876662 16888 hybrid_clock.cc:648] HybridClock initialized: now 1761206395876646 us; error 0 us; skew 500 ppm
I20251023 07:59:55.877257 16888 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20251023 07:59:55.879523 16888 webserver.cc:492] Webserver started at http://127.16.126.1:34633/ using document root <none> and password file <none>
I20251023 07:59:55.879999 16888 fs_manager.cc:362] Metadata directory not provided
I20251023 07:59:55.880188 16888 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251023 07:59:55.880437 16888 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251023 07:59:55.881556 16888 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1761206251627710-16888-0/minicluster-data/ts-0-root/instance:
uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b"
format_stamp: "Formatted at 2025-10-23 07:59:55 on dist-test-slave-m488"
I20251023 07:59:55.885900 16888 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20251023 07:59:55.889067 21229 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251023 07:59:55.889797 16888 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20251023 07:59:55.890071 16888 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1761206251627710-16888-0/minicluster-data/ts-0-root
uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b"
format_stamp: "Formatted at 2025-10-23 07:59:55 on dist-test-slave-m488"
I20251023 07:59:55.890344 16888 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1761206251627710-16888-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1761206251627710-16888-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1761206251627710-16888-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251023 07:59:55.927166 16888 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251023 07:59:55.928547 16888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251023 07:59:55.930816 16888 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251023 07:59:55.934455 16888 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251023 07:59:55.934729 16888 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251023 07:59:55.935035 16888 ts_tablet_manager.cc:616] Registered 0 tablets
I20251023 07:59:55.935225 16888 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251023 07:59:55.977005 16888 rpc_server.cc:307] RPC server started. Bound to: 127.16.126.1:36379
I20251023 07:59:55.977103 21291 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.126.1:36379 every 8 connection(s)
I20251023 07:59:55.981720 16888 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251023 07:59:55.989193 21296 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251023 07:59:55.991215 21297 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251023 07:59:55.993002 16888 server_base.cc:1047] running on GCE node
W20251023 07:59:55.994055 21299 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251023 07:59:55.994905 16888 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251023 07:59:55.995121 16888 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251023 07:59:55.995280 16888 hybrid_clock.cc:648] HybridClock initialized: now 1761206395995262 us; error 0 us; skew 500 ppm
I20251023 07:59:55.995791 16888 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20251023 07:59:55.998991 16888 webserver.cc:492] Webserver started at http://127.16.126.2:40145/ using document root <none> and password file <none>
I20251023 07:59:55.999481 21292 heartbeater.cc:344] Connected to a master server at 127.16.126.62:34345
I20251023 07:59:55.999576 16888 fs_manager.cc:362] Metadata directory not provided
I20251023 07:59:55.999886 21292 heartbeater.cc:461] Registering TS with master...
I20251023 07:59:55.999888 16888 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251023 07:59:56.000366 16888 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251023 07:59:56.000726 21292 heartbeater.cc:507] Master 127.16.126.62:34345 requested a full tablet report, sending...
I20251023 07:59:56.001529 16888 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1761206251627710-16888-0/minicluster-data/ts-1-root/instance:
uuid: "462a37ed579b46e78a75add632eabf23"
format_stamp: "Formatted at 2025-10-23 07:59:55 on dist-test-slave-m488"
I20251023 07:59:56.002727 21165 ts_manager.cc:194] Registered new tserver with Master: 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1:36379)
I20251023 07:59:56.004523 21165 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43218
I20251023 07:59:56.006472 16888 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.002s sys 0.002s
I20251023 07:59:56.010043 21304 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251023 07:59:56.010764 16888 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.002s
I20251023 07:59:56.011013 16888 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1761206251627710-16888-0/minicluster-data/ts-1-root
uuid: "462a37ed579b46e78a75add632eabf23"
format_stamp: "Formatted at 2025-10-23 07:59:55 on dist-test-slave-m488"
I20251023 07:59:56.011260 16888 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1761206251627710-16888-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1761206251627710-16888-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1761206251627710-16888-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251023 07:59:56.041942 16888 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251023 07:59:56.043139 16888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251023 07:59:56.044538 16888 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251023 07:59:56.046829 16888 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251023 07:59:56.047004 16888 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251023 07:59:56.047258 16888 ts_tablet_manager.cc:616] Registered 0 tablets
I20251023 07:59:56.047402 16888 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251023 07:59:56.088187 16888 rpc_server.cc:307] RPC server started. Bound to: 127.16.126.2:44879
I20251023 07:59:56.088337 21366 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.126.2:44879 every 8 connection(s)
I20251023 07:59:56.093189 16888 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251023 07:59:56.100428 21370 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251023 07:59:56.101218 21371 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251023 07:59:56.104066 16888 server_base.cc:1047] running on GCE node
W20251023 07:59:56.104527 21374 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251023 07:59:56.105597 21367 heartbeater.cc:344] Connected to a master server at 127.16.126.62:34345
I20251023 07:59:56.105679 16888 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251023 07:59:56.105981 16888 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251023 07:59:56.106009 21367 heartbeater.cc:461] Registering TS with master...
I20251023 07:59:56.106143 16888 hybrid_clock.cc:648] HybridClock initialized: now 1761206396106125 us; error 0 us; skew 500 ppm
I20251023 07:59:56.106813 16888 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20251023 07:59:56.106863 21367 heartbeater.cc:507] Master 127.16.126.62:34345 requested a full tablet report, sending...
I20251023 07:59:56.109167 21165 ts_manager.cc:194] Registered new tserver with Master: 462a37ed579b46e78a75add632eabf23 (127.16.126.2:44879)
I20251023 07:59:56.109454 16888 webserver.cc:492] Webserver started at http://127.16.126.3:41361/ using document root <none> and password file <none>
I20251023 07:59:56.110134 16888 fs_manager.cc:362] Metadata directory not provided
I20251023 07:59:56.110370 16888 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251023 07:59:56.110698 16888 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251023 07:59:56.111119 21165 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43226
I20251023 07:59:56.112310 16888 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1761206251627710-16888-0/minicluster-data/ts-2-root/instance:
uuid: "abf20d53faa04ffd9e2aec95f13abb8d"
format_stamp: "Formatted at 2025-10-23 07:59:56 on dist-test-slave-m488"
I20251023 07:59:56.116911 16888 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20251023 07:59:56.120144 21378 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251023 07:59:56.120858 16888 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20251023 07:59:56.121132 16888 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1761206251627710-16888-0/minicluster-data/ts-2-root
uuid: "abf20d53faa04ffd9e2aec95f13abb8d"
format_stamp: "Formatted at 2025-10-23 07:59:56 on dist-test-slave-m488"
I20251023 07:59:56.121400 16888 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1761206251627710-16888-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1761206251627710-16888-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1761206251627710-16888-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251023 07:59:56.146819 16888 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251023 07:59:56.148034 16888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251023 07:59:56.149503 16888 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251023 07:59:56.151867 16888 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251023 07:59:56.152042 16888 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251023 07:59:56.152292 16888 ts_tablet_manager.cc:616] Registered 0 tablets
I20251023 07:59:56.152434 16888 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251023 07:59:56.194269 16888 rpc_server.cc:307] RPC server started. Bound to: 127.16.126.3:36749
I20251023 07:59:56.194384 21440 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.126.3:36749 every 8 connection(s)
I20251023 07:59:56.207656 21441 heartbeater.cc:344] Connected to a master server at 127.16.126.62:34345
I20251023 07:59:56.208117 21441 heartbeater.cc:461] Registering TS with master...
I20251023 07:59:56.208856 21441 heartbeater.cc:507] Master 127.16.126.62:34345 requested a full tablet report, sending...
I20251023 07:59:56.210809 21165 ts_manager.cc:194] Registered new tserver with Master: abf20d53faa04ffd9e2aec95f13abb8d (127.16.126.3:36749)
I20251023 07:59:56.210968 16888 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013699972s
I20251023 07:59:56.212680 21165 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43240
I20251023 07:59:56.214299 16888 test_util.cc:276] Using random seed: -778085379
I20251023 07:59:56.236441 21165 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43254:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251023 07:59:56.239127 21165 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251023 07:59:56.310127 21405 tablet_service.cc:1505] Processing CreateTablet for tablet 30795d2458e943b5923542028d5c85a6 (DEFAULT_TABLE table=test-workload [id=0d473a58267f4458b911fd4a2eb0b740]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20251023 07:59:56.311705 21405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30795d2458e943b5923542028d5c85a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:56.314536 21404 tablet_service.cc:1505] Processing CreateTablet for tablet 0f6a4f63262e476193a5ed5fbb47bcdf (DEFAULT_TABLE table=test-workload [id=0d473a58267f4458b911fd4a2eb0b740]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20251023 07:59:56.315979 21404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f6a4f63262e476193a5ed5fbb47bcdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:56.317070 21403 tablet_service.cc:1505] Processing CreateTablet for tablet 0f4050c875ff487e89b8a8170c0b9125 (DEFAULT_TABLE table=test-workload [id=0d473a58267f4458b911fd4a2eb0b740]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20251023 07:59:56.318624 21403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f4050c875ff487e89b8a8170c0b9125. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:56.321282 21406 tablet_service.cc:1505] Processing CreateTablet for tablet 07bbde512054431eb0f36c0fc3ce25cf (DEFAULT_TABLE table=test-workload [id=0d473a58267f4458b911fd4a2eb0b740]), partition=RANGE (key) PARTITION VALUES < 238609294
I20251023 07:59:56.322674 21406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07bbde512054431eb0f36c0fc3ce25cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:56.322748 21402 tablet_service.cc:1505] Processing CreateTablet for tablet 927d27447e7e463c836f015eb15cc307 (DEFAULT_TABLE table=test-workload [id=0d473a58267f4458b911fd4a2eb0b740]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20251023 07:59:56.324019 21402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 927d27447e7e463c836f015eb15cc307. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:56.328122 21401 tablet_service.cc:1505] Processing CreateTablet for tablet a9ac30e967a44ca38d29e93d1cca6fb7 (DEFAULT_TABLE table=test-workload [id=0d473a58267f4458b911fd4a2eb0b740]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20251023 07:59:56.329572 21401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9ac30e967a44ca38d29e93d1cca6fb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:56.332526 21400 tablet_service.cc:1505] Processing CreateTablet for tablet 7341661a4a144d58a6f2f78391143c89 (DEFAULT_TABLE table=test-workload [id=0d473a58267f4458b911fd4a2eb0b740]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20251023 07:59:56.336051 21400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7341661a4a144d58a6f2f78391143c89. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:56.337747 21399 tablet_service.cc:1505] Processing CreateTablet for tablet 40eac800e4b24372ab2d12224be9bee4 (DEFAULT_TABLE table=test-workload [id=0d473a58267f4458b911fd4a2eb0b740]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20251023 07:59:56.339172 21399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40eac800e4b24372ab2d12224be9bee4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:56.348259 21398 tablet_service.cc:1505] Processing CreateTablet for tablet 3db5b343d92742c9a0fea1cfc7cc457e (DEFAULT_TABLE table=test-workload [id=0d473a58267f4458b911fd4a2eb0b740]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20251023 07:59:56.349782 21398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3db5b343d92742c9a0fea1cfc7cc457e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:56.351854 21257 tablet_service.cc:1505] Processing CreateTablet for tablet 07bbde512054431eb0f36c0fc3ce25cf (DEFAULT_TABLE table=test-workload [id=0d473a58267f4458b911fd4a2eb0b740]), partition=RANGE (key) PARTITION VALUES < 238609294
I20251023 07:59:56.353264 21257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07bbde512054431eb0f36c0fc3ce25cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:56.375466 21256 tablet_service.cc:1505] Processing CreateTablet for tablet 30795d2458e943b5923542028d5c85a6 (DEFAULT_TABLE table=test-workload [id=0d473a58267f4458b911fd4a2eb0b740]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20251023 07:59:56.376963 21256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30795d2458e943b5923542028d5c85a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:56.387254 21255 tablet_service.cc:1505] Processing CreateTablet for tablet 0f6a4f63262e476193a5ed5fbb47bcdf (DEFAULT_TABLE table=test-workload [id=0d473a58267f4458b911fd4a2eb0b740]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20251023 07:59:56.388770 21255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f6a4f63262e476193a5ed5fbb47bcdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:56.395246 21254 tablet_service.cc:1505] Processing CreateTablet for tablet 0f4050c875ff487e89b8a8170c0b9125 (DEFAULT_TABLE table=test-workload [id=0d473a58267f4458b911fd4a2eb0b740]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20251023 07:59:56.396762 21254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f4050c875ff487e89b8a8170c0b9125. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:56.399212 21253 tablet_service.cc:1505] Processing CreateTablet for tablet 927d27447e7e463c836f015eb15cc307 (DEFAULT_TABLE table=test-workload [id=0d473a58267f4458b911fd4a2eb0b740]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20251023 07:59:56.399717 21252 tablet_service.cc:1505] Processing CreateTablet for tablet a9ac30e967a44ca38d29e93d1cca6fb7 (DEFAULT_TABLE table=test-workload [id=0d473a58267f4458b911fd4a2eb0b740]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20251023 07:59:56.402834 21251 tablet_service.cc:1505] Processing CreateTablet for tablet 7341661a4a144d58a6f2f78391143c89 (DEFAULT_TABLE table=test-workload [id=0d473a58267f4458b911fd4a2eb0b740]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20251023 07:59:56.405834 21253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 927d27447e7e463c836f015eb15cc307. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:56.405889 21250 tablet_service.cc:1505] Processing CreateTablet for tablet 40eac800e4b24372ab2d12224be9bee4 (DEFAULT_TABLE table=test-workload [id=0d473a58267f4458b911fd4a2eb0b740]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20251023 07:59:56.407307 21250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40eac800e4b24372ab2d12224be9bee4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:56.408113 21252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9ac30e967a44ca38d29e93d1cca6fb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:56.413733 21251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7341661a4a144d58a6f2f78391143c89. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:56.423579 21249 tablet_service.cc:1505] Processing CreateTablet for tablet 3db5b343d92742c9a0fea1cfc7cc457e (DEFAULT_TABLE table=test-workload [id=0d473a58267f4458b911fd4a2eb0b740]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20251023 07:59:56.424410 21332 tablet_service.cc:1505] Processing CreateTablet for tablet 07bbde512054431eb0f36c0fc3ce25cf (DEFAULT_TABLE table=test-workload [id=0d473a58267f4458b911fd4a2eb0b740]), partition=RANGE (key) PARTITION VALUES < 238609294
I20251023 07:59:56.426751 21332 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07bbde512054431eb0f36c0fc3ce25cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:56.423662 21456 tablet_bootstrap.cc:492] T 0f6a4f63262e476193a5ed5fbb47bcdf P abf20d53faa04ffd9e2aec95f13abb8d: Bootstrap starting.
I20251023 07:59:56.425024 21249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3db5b343d92742c9a0fea1cfc7cc457e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:56.440248 21331 tablet_service.cc:1505] Processing CreateTablet for tablet 30795d2458e943b5923542028d5c85a6 (DEFAULT_TABLE table=test-workload [id=0d473a58267f4458b911fd4a2eb0b740]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20251023 07:59:56.441761 21331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30795d2458e943b5923542028d5c85a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:56.442193 21456 tablet_bootstrap.cc:654] T 0f6a4f63262e476193a5ed5fbb47bcdf P abf20d53faa04ffd9e2aec95f13abb8d: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:56.446877 21330 tablet_service.cc:1505] Processing CreateTablet for tablet 0f6a4f63262e476193a5ed5fbb47bcdf (DEFAULT_TABLE table=test-workload [id=0d473a58267f4458b911fd4a2eb0b740]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20251023 07:59:56.448264 21330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f6a4f63262e476193a5ed5fbb47bcdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:56.459425 21329 tablet_service.cc:1505] Processing CreateTablet for tablet 0f4050c875ff487e89b8a8170c0b9125 (DEFAULT_TABLE table=test-workload [id=0d473a58267f4458b911fd4a2eb0b740]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20251023 07:59:56.462186 21329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f4050c875ff487e89b8a8170c0b9125. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:56.472887 21328 tablet_service.cc:1505] Processing CreateTablet for tablet 927d27447e7e463c836f015eb15cc307 (DEFAULT_TABLE table=test-workload [id=0d473a58267f4458b911fd4a2eb0b740]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20251023 07:59:56.474893 21328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 927d27447e7e463c836f015eb15cc307. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:56.483327 21327 tablet_service.cc:1505] Processing CreateTablet for tablet a9ac30e967a44ca38d29e93d1cca6fb7 (DEFAULT_TABLE table=test-workload [id=0d473a58267f4458b911fd4a2eb0b740]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20251023 07:59:56.484737 21327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9ac30e967a44ca38d29e93d1cca6fb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:56.497891 21326 tablet_service.cc:1505] Processing CreateTablet for tablet 7341661a4a144d58a6f2f78391143c89 (DEFAULT_TABLE table=test-workload [id=0d473a58267f4458b911fd4a2eb0b740]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20251023 07:59:56.499434 21326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7341661a4a144d58a6f2f78391143c89. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:56.500339 21457 tablet_bootstrap.cc:492] T 07bbde512054431eb0f36c0fc3ce25cf P 189a9eeaf7ef4038aecadfbb80cf8c7b: Bootstrap starting.
I20251023 07:59:56.502744 21325 tablet_service.cc:1505] Processing CreateTablet for tablet 40eac800e4b24372ab2d12224be9bee4 (DEFAULT_TABLE table=test-workload [id=0d473a58267f4458b911fd4a2eb0b740]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20251023 07:59:56.504105 21325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40eac800e4b24372ab2d12224be9bee4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:56.506633 21324 tablet_service.cc:1505] Processing CreateTablet for tablet 3db5b343d92742c9a0fea1cfc7cc457e (DEFAULT_TABLE table=test-workload [id=0d473a58267f4458b911fd4a2eb0b740]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20251023 07:59:56.508035 21324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3db5b343d92742c9a0fea1cfc7cc457e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 07:59:56.538096 21457 tablet_bootstrap.cc:654] T 07bbde512054431eb0f36c0fc3ce25cf P 189a9eeaf7ef4038aecadfbb80cf8c7b: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:56.543259 21459 tablet_bootstrap.cc:492] T 07bbde512054431eb0f36c0fc3ce25cf P 462a37ed579b46e78a75add632eabf23: Bootstrap starting.
I20251023 07:59:56.544523 21456 tablet_bootstrap.cc:492] T 0f6a4f63262e476193a5ed5fbb47bcdf P abf20d53faa04ffd9e2aec95f13abb8d: No bootstrap required, opened a new log
I20251023 07:59:56.545081 21456 ts_tablet_manager.cc:1403] T 0f6a4f63262e476193a5ed5fbb47bcdf P abf20d53faa04ffd9e2aec95f13abb8d: Time spent bootstrapping tablet: real 0.122s user 0.007s sys 0.004s
I20251023 07:59:56.547322 21457 tablet_bootstrap.cc:492] T 07bbde512054431eb0f36c0fc3ce25cf P 189a9eeaf7ef4038aecadfbb80cf8c7b: No bootstrap required, opened a new log
I20251023 07:59:56.547896 21457 ts_tablet_manager.cc:1403] T 07bbde512054431eb0f36c0fc3ce25cf P 189a9eeaf7ef4038aecadfbb80cf8c7b: Time spent bootstrapping tablet: real 0.048s user 0.014s sys 0.000s
I20251023 07:59:56.547981 21456 raft_consensus.cc:359] T 0f6a4f63262e476193a5ed5fbb47bcdf P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:56.548607 21456 raft_consensus.cc:385] T 0f6a4f63262e476193a5ed5fbb47bcdf P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:56.548835 21456 raft_consensus.cc:740] T 0f6a4f63262e476193a5ed5fbb47bcdf P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf20d53faa04ffd9e2aec95f13abb8d, State: Initialized, Role: FOLLOWER
I20251023 07:59:56.549466 21456 consensus_queue.cc:260] T 0f6a4f63262e476193a5ed5fbb47bcdf P abf20d53faa04ffd9e2aec95f13abb8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:56.550308 21459 tablet_bootstrap.cc:654] T 07bbde512054431eb0f36c0fc3ce25cf P 462a37ed579b46e78a75add632eabf23: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:56.550762 21457 raft_consensus.cc:359] T 07bbde512054431eb0f36c0fc3ce25cf P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } }
I20251023 07:59:56.551558 21457 raft_consensus.cc:385] T 07bbde512054431eb0f36c0fc3ce25cf P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:56.551677 21441 heartbeater.cc:499] Master 127.16.126.62:34345 was elected leader, sending a full tablet report...
I20251023 07:59:56.551899 21457 raft_consensus.cc:740] T 07bbde512054431eb0f36c0fc3ce25cf P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 189a9eeaf7ef4038aecadfbb80cf8c7b, State: Initialized, Role: FOLLOWER
I20251023 07:59:56.552196 21456 ts_tablet_manager.cc:1434] T 0f6a4f63262e476193a5ed5fbb47bcdf P abf20d53faa04ffd9e2aec95f13abb8d: Time spent starting tablet: real 0.007s user 0.004s sys 0.004s
I20251023 07:59:56.553061 21456 tablet_bootstrap.cc:492] T 927d27447e7e463c836f015eb15cc307 P abf20d53faa04ffd9e2aec95f13abb8d: Bootstrap starting.
I20251023 07:59:56.552750 21457 consensus_queue.cc:260] T 07bbde512054431eb0f36c0fc3ce25cf P 189a9eeaf7ef4038aecadfbb80cf8c7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } }
I20251023 07:59:56.557340 21292 heartbeater.cc:499] Master 127.16.126.62:34345 was elected leader, sending a full tablet report...
I20251023 07:59:56.558660 21457 ts_tablet_manager.cc:1434] T 07bbde512054431eb0f36c0fc3ce25cf P 189a9eeaf7ef4038aecadfbb80cf8c7b: Time spent starting tablet: real 0.010s user 0.003s sys 0.004s
I20251023 07:59:56.558845 21459 tablet_bootstrap.cc:492] T 07bbde512054431eb0f36c0fc3ce25cf P 462a37ed579b46e78a75add632eabf23: No bootstrap required, opened a new log
I20251023 07:59:56.559407 21459 ts_tablet_manager.cc:1403] T 07bbde512054431eb0f36c0fc3ce25cf P 462a37ed579b46e78a75add632eabf23: Time spent bootstrapping tablet: real 0.017s user 0.011s sys 0.000s
I20251023 07:59:56.559926 21457 tablet_bootstrap.cc:492] T 0f6a4f63262e476193a5ed5fbb47bcdf P 189a9eeaf7ef4038aecadfbb80cf8c7b: Bootstrap starting.
I20251023 07:59:56.562634 21456 tablet_bootstrap.cc:654] T 927d27447e7e463c836f015eb15cc307 P abf20d53faa04ffd9e2aec95f13abb8d: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:56.567605 21457 tablet_bootstrap.cc:654] T 0f6a4f63262e476193a5ed5fbb47bcdf P 189a9eeaf7ef4038aecadfbb80cf8c7b: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:56.570510 21459 raft_consensus.cc:359] T 07bbde512054431eb0f36c0fc3ce25cf P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } }
I20251023 07:59:56.571631 21459 raft_consensus.cc:385] T 07bbde512054431eb0f36c0fc3ce25cf P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:56.572016 21459 raft_consensus.cc:740] T 07bbde512054431eb0f36c0fc3ce25cf P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 462a37ed579b46e78a75add632eabf23, State: Initialized, Role: FOLLOWER
I20251023 07:59:56.572937 21459 consensus_queue.cc:260] T 07bbde512054431eb0f36c0fc3ce25cf P 462a37ed579b46e78a75add632eabf23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } }
I20251023 07:59:56.583034 21459 ts_tablet_manager.cc:1434] T 07bbde512054431eb0f36c0fc3ce25cf P 462a37ed579b46e78a75add632eabf23: Time spent starting tablet: real 0.023s user 0.002s sys 0.013s
I20251023 07:59:56.583842 21367 heartbeater.cc:499] Master 127.16.126.62:34345 was elected leader, sending a full tablet report...
I20251023 07:59:56.592121 21459 tablet_bootstrap.cc:492] T 0f6a4f63262e476193a5ed5fbb47bcdf P 462a37ed579b46e78a75add632eabf23: Bootstrap starting.
I20251023 07:59:56.599058 21459 tablet_bootstrap.cc:654] T 0f6a4f63262e476193a5ed5fbb47bcdf P 462a37ed579b46e78a75add632eabf23: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:56.608662 21457 tablet_bootstrap.cc:492] T 0f6a4f63262e476193a5ed5fbb47bcdf P 189a9eeaf7ef4038aecadfbb80cf8c7b: No bootstrap required, opened a new log
I20251023 07:59:56.609193 21457 ts_tablet_manager.cc:1403] T 0f6a4f63262e476193a5ed5fbb47bcdf P 189a9eeaf7ef4038aecadfbb80cf8c7b: Time spent bootstrapping tablet: real 0.049s user 0.023s sys 0.023s
I20251023 07:59:56.609858 21456 tablet_bootstrap.cc:492] T 927d27447e7e463c836f015eb15cc307 P abf20d53faa04ffd9e2aec95f13abb8d: No bootstrap required, opened a new log
I20251023 07:59:56.610683 21456 ts_tablet_manager.cc:1403] T 927d27447e7e463c836f015eb15cc307 P abf20d53faa04ffd9e2aec95f13abb8d: Time spent bootstrapping tablet: real 0.058s user 0.019s sys 0.032s
I20251023 07:59:56.612079 21457 raft_consensus.cc:359] T 0f6a4f63262e476193a5ed5fbb47bcdf P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:56.613111 21457 raft_consensus.cc:385] T 0f6a4f63262e476193a5ed5fbb47bcdf P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:56.613453 21457 raft_consensus.cc:740] T 0f6a4f63262e476193a5ed5fbb47bcdf P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 189a9eeaf7ef4038aecadfbb80cf8c7b, State: Initialized, Role: FOLLOWER
I20251023 07:59:56.614290 21456 raft_consensus.cc:359] T 927d27447e7e463c836f015eb15cc307 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:56.614316 21457 consensus_queue.cc:260] T 0f6a4f63262e476193a5ed5fbb47bcdf P 189a9eeaf7ef4038aecadfbb80cf8c7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:56.615288 21459 tablet_bootstrap.cc:492] T 0f6a4f63262e476193a5ed5fbb47bcdf P 462a37ed579b46e78a75add632eabf23: No bootstrap required, opened a new log
I20251023 07:59:56.615828 21459 ts_tablet_manager.cc:1403] T 0f6a4f63262e476193a5ed5fbb47bcdf P 462a37ed579b46e78a75add632eabf23: Time spent bootstrapping tablet: real 0.024s user 0.013s sys 0.004s
I20251023 07:59:56.615798 21461 raft_consensus.cc:493] T 0f6a4f63262e476193a5ed5fbb47bcdf P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:56.616410 21461 raft_consensus.cc:515] T 0f6a4f63262e476193a5ed5fbb47bcdf P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:56.617923 21457 ts_tablet_manager.cc:1434] T 0f6a4f63262e476193a5ed5fbb47bcdf P 189a9eeaf7ef4038aecadfbb80cf8c7b: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20251023 07:59:56.618898 21457 tablet_bootstrap.cc:492] T 7341661a4a144d58a6f2f78391143c89 P 189a9eeaf7ef4038aecadfbb80cf8c7b: Bootstrap starting.
I20251023 07:59:56.618966 21459 raft_consensus.cc:359] T 0f6a4f63262e476193a5ed5fbb47bcdf P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:56.619045 21461 leader_election.cc:290] T 0f6a4f63262e476193a5ed5fbb47bcdf P abf20d53faa04ffd9e2aec95f13abb8d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1:36379), 462a37ed579b46e78a75add632eabf23 (127.16.126.2:44879)
I20251023 07:59:56.615216 21456 raft_consensus.cc:385] T 927d27447e7e463c836f015eb15cc307 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:56.626294 21457 tablet_bootstrap.cc:654] T 7341661a4a144d58a6f2f78391143c89 P 189a9eeaf7ef4038aecadfbb80cf8c7b: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:56.626528 21456 raft_consensus.cc:740] T 927d27447e7e463c836f015eb15cc307 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf20d53faa04ffd9e2aec95f13abb8d, State: Initialized, Role: FOLLOWER
I20251023 07:59:56.628139 21456 consensus_queue.cc:260] T 927d27447e7e463c836f015eb15cc307 P abf20d53faa04ffd9e2aec95f13abb8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:56.633952 21456 ts_tablet_manager.cc:1434] T 927d27447e7e463c836f015eb15cc307 P abf20d53faa04ffd9e2aec95f13abb8d: Time spent starting tablet: real 0.023s user 0.006s sys 0.001s
I20251023 07:59:56.636757 21456 tablet_bootstrap.cc:492] T 0f4050c875ff487e89b8a8170c0b9125 P abf20d53faa04ffd9e2aec95f13abb8d: Bootstrap starting.
I20251023 07:59:56.619899 21459 raft_consensus.cc:385] T 0f6a4f63262e476193a5ed5fbb47bcdf P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:56.639489 21459 raft_consensus.cc:740] T 0f6a4f63262e476193a5ed5fbb47bcdf P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 462a37ed579b46e78a75add632eabf23, State: Initialized, Role: FOLLOWER
I20251023 07:59:56.640612 21459 consensus_queue.cc:260] T 0f6a4f63262e476193a5ed5fbb47bcdf P 462a37ed579b46e78a75add632eabf23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:56.646494 21456 tablet_bootstrap.cc:654] T 0f4050c875ff487e89b8a8170c0b9125 P abf20d53faa04ffd9e2aec95f13abb8d: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:56.650365 21459 ts_tablet_manager.cc:1434] T 0f6a4f63262e476193a5ed5fbb47bcdf P 462a37ed579b46e78a75add632eabf23: Time spent starting tablet: real 0.034s user 0.008s sys 0.000s
I20251023 07:59:56.653227 21459 tablet_bootstrap.cc:492] T 30795d2458e943b5923542028d5c85a6 P 462a37ed579b46e78a75add632eabf23: Bootstrap starting.
I20251023 07:59:56.653081 21342 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0f6a4f63262e476193a5ed5fbb47bcdf" candidate_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "462a37ed579b46e78a75add632eabf23" is_pre_election: true
I20251023 07:59:56.653811 21342 raft_consensus.cc:2468] T 0f6a4f63262e476193a5ed5fbb47bcdf P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf20d53faa04ffd9e2aec95f13abb8d in term 0.
I20251023 07:59:56.659976 21459 tablet_bootstrap.cc:654] T 30795d2458e943b5923542028d5c85a6 P 462a37ed579b46e78a75add632eabf23: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:56.660490 21379 leader_election.cc:304] T 0f6a4f63262e476193a5ed5fbb47bcdf P abf20d53faa04ffd9e2aec95f13abb8d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 462a37ed579b46e78a75add632eabf23, abf20d53faa04ffd9e2aec95f13abb8d; no voters:
I20251023 07:59:56.661576 21461 raft_consensus.cc:2804] T 0f6a4f63262e476193a5ed5fbb47bcdf P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:56.661949 21461 raft_consensus.cc:493] T 0f6a4f63262e476193a5ed5fbb47bcdf P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:56.662019 21267 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0f6a4f63262e476193a5ed5fbb47bcdf" candidate_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" is_pre_election: true
I20251023 07:59:56.662353 21461 raft_consensus.cc:3060] T 0f6a4f63262e476193a5ed5fbb47bcdf P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:56.662761 21267 raft_consensus.cc:2468] T 0f6a4f63262e476193a5ed5fbb47bcdf P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf20d53faa04ffd9e2aec95f13abb8d in term 0.
I20251023 07:59:56.665292 21457 tablet_bootstrap.cc:492] T 7341661a4a144d58a6f2f78391143c89 P 189a9eeaf7ef4038aecadfbb80cf8c7b: No bootstrap required, opened a new log
I20251023 07:59:56.665953 21457 ts_tablet_manager.cc:1403] T 7341661a4a144d58a6f2f78391143c89 P 189a9eeaf7ef4038aecadfbb80cf8c7b: Time spent bootstrapping tablet: real 0.047s user 0.021s sys 0.014s
I20251023 07:59:56.668071 21456 tablet_bootstrap.cc:492] T 0f4050c875ff487e89b8a8170c0b9125 P abf20d53faa04ffd9e2aec95f13abb8d: No bootstrap required, opened a new log
I20251023 07:59:56.668432 21459 tablet_bootstrap.cc:492] T 30795d2458e943b5923542028d5c85a6 P 462a37ed579b46e78a75add632eabf23: No bootstrap required, opened a new log
I20251023 07:59:56.668740 21456 ts_tablet_manager.cc:1403] T 0f4050c875ff487e89b8a8170c0b9125 P abf20d53faa04ffd9e2aec95f13abb8d: Time spent bootstrapping tablet: real 0.032s user 0.012s sys 0.009s
I20251023 07:59:56.668943 21459 ts_tablet_manager.cc:1403] T 30795d2458e943b5923542028d5c85a6 P 462a37ed579b46e78a75add632eabf23: Time spent bootstrapping tablet: real 0.016s user 0.011s sys 0.000s
I20251023 07:59:56.669019 21457 raft_consensus.cc:359] T 7341661a4a144d58a6f2f78391143c89 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:56.669975 21457 raft_consensus.cc:385] T 7341661a4a144d58a6f2f78391143c89 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:56.670276 21457 raft_consensus.cc:740] T 7341661a4a144d58a6f2f78391143c89 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 189a9eeaf7ef4038aecadfbb80cf8c7b, State: Initialized, Role: FOLLOWER
I20251023 07:59:56.670429 21461 raft_consensus.cc:515] T 0f6a4f63262e476193a5ed5fbb47bcdf P abf20d53faa04ffd9e2aec95f13abb8d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:56.671132 21457 consensus_queue.cc:260] T 7341661a4a144d58a6f2f78391143c89 P 189a9eeaf7ef4038aecadfbb80cf8c7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:56.671993 21459 raft_consensus.cc:359] T 30795d2458e943b5923542028d5c85a6 P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:56.672745 21459 raft_consensus.cc:385] T 30795d2458e943b5923542028d5c85a6 P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:56.672394 21456 raft_consensus.cc:359] T 0f4050c875ff487e89b8a8170c0b9125 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:56.673059 21459 raft_consensus.cc:740] T 30795d2458e943b5923542028d5c85a6 P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 462a37ed579b46e78a75add632eabf23, State: Initialized, Role: FOLLOWER
I20251023 07:59:56.673384 21456 raft_consensus.cc:385] T 0f4050c875ff487e89b8a8170c0b9125 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:56.673381 21267 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0f6a4f63262e476193a5ed5fbb47bcdf" candidate_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b"
I20251023 07:59:56.673996 21456 raft_consensus.cc:740] T 0f4050c875ff487e89b8a8170c0b9125 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf20d53faa04ffd9e2aec95f13abb8d, State: Initialized, Role: FOLLOWER
I20251023 07:59:56.674226 21267 raft_consensus.cc:3060] T 0f6a4f63262e476193a5ed5fbb47bcdf P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:56.675069 21461 leader_election.cc:290] T 0f6a4f63262e476193a5ed5fbb47bcdf P abf20d53faa04ffd9e2aec95f13abb8d [CANDIDATE]: Term 1 election: Requested vote from peers 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1:36379), 462a37ed579b46e78a75add632eabf23 (127.16.126.2:44879)
I20251023 07:59:56.674928 21456 consensus_queue.cc:260] T 0f4050c875ff487e89b8a8170c0b9125 P abf20d53faa04ffd9e2aec95f13abb8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:56.673847 21459 consensus_queue.cc:260] T 30795d2458e943b5923542028d5c85a6 P 462a37ed579b46e78a75add632eabf23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:56.676841 21342 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0f6a4f63262e476193a5ed5fbb47bcdf" candidate_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "462a37ed579b46e78a75add632eabf23"
I20251023 07:59:56.677407 21342 raft_consensus.cc:3060] T 0f6a4f63262e476193a5ed5fbb47bcdf P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:56.678748 21459 ts_tablet_manager.cc:1434] T 30795d2458e943b5923542028d5c85a6 P 462a37ed579b46e78a75add632eabf23: Time spent starting tablet: real 0.009s user 0.009s sys 0.000s
I20251023 07:59:56.684649 21457 ts_tablet_manager.cc:1434] T 7341661a4a144d58a6f2f78391143c89 P 189a9eeaf7ef4038aecadfbb80cf8c7b: Time spent starting tablet: real 0.018s user 0.005s sys 0.002s
I20251023 07:59:56.684870 21267 raft_consensus.cc:2468] T 0f6a4f63262e476193a5ed5fbb47bcdf P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf20d53faa04ffd9e2aec95f13abb8d in term 1.
I20251023 07:59:56.684870 21342 raft_consensus.cc:2468] T 0f6a4f63262e476193a5ed5fbb47bcdf P 462a37ed579b46e78a75add632eabf23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf20d53faa04ffd9e2aec95f13abb8d in term 1.
I20251023 07:59:56.686089 21379 leader_election.cc:304] T 0f6a4f63262e476193a5ed5fbb47bcdf P abf20d53faa04ffd9e2aec95f13abb8d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a9eeaf7ef4038aecadfbb80cf8c7b, abf20d53faa04ffd9e2aec95f13abb8d; no voters:
I20251023 07:59:56.687579 21456 ts_tablet_manager.cc:1434] T 0f4050c875ff487e89b8a8170c0b9125 P abf20d53faa04ffd9e2aec95f13abb8d: Time spent starting tablet: real 0.018s user 0.003s sys 0.003s
I20251023 07:59:56.687929 21459 tablet_bootstrap.cc:492] T 3db5b343d92742c9a0fea1cfc7cc457e P 462a37ed579b46e78a75add632eabf23: Bootstrap starting.
I20251023 07:59:56.688702 21456 tablet_bootstrap.cc:492] T 40eac800e4b24372ab2d12224be9bee4 P abf20d53faa04ffd9e2aec95f13abb8d: Bootstrap starting.
I20251023 07:59:56.687531 21461 raft_consensus.cc:2804] T 0f6a4f63262e476193a5ed5fbb47bcdf P abf20d53faa04ffd9e2aec95f13abb8d [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:59:56.693895 21457 tablet_bootstrap.cc:492] T a9ac30e967a44ca38d29e93d1cca6fb7 P 189a9eeaf7ef4038aecadfbb80cf8c7b: Bootstrap starting.
I20251023 07:59:56.695287 21456 tablet_bootstrap.cc:654] T 40eac800e4b24372ab2d12224be9bee4 P abf20d53faa04ffd9e2aec95f13abb8d: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:56.697333 21461 raft_consensus.cc:697] T 0f6a4f63262e476193a5ed5fbb47bcdf P abf20d53faa04ffd9e2aec95f13abb8d [term 1 LEADER]: Becoming Leader. State: Replica: abf20d53faa04ffd9e2aec95f13abb8d, State: Running, Role: LEADER
I20251023 07:59:56.698352 21461 consensus_queue.cc:237] T 0f6a4f63262e476193a5ed5fbb47bcdf P abf20d53faa04ffd9e2aec95f13abb8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:56.695287 21459 tablet_bootstrap.cc:654] T 3db5b343d92742c9a0fea1cfc7cc457e P 462a37ed579b46e78a75add632eabf23: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:56.700603 21457 tablet_bootstrap.cc:654] T a9ac30e967a44ca38d29e93d1cca6fb7 P 189a9eeaf7ef4038aecadfbb80cf8c7b: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:56.707026 21466 raft_consensus.cc:493] T 30795d2458e943b5923542028d5c85a6 P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:56.707695 21466 raft_consensus.cc:515] T 30795d2458e943b5923542028d5c85a6 P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:56.713464 21164 catalog_manager.cc:5649] T 0f6a4f63262e476193a5ed5fbb47bcdf P abf20d53faa04ffd9e2aec95f13abb8d reported cstate change: term changed from 0 to 1, leader changed from <none> to abf20d53faa04ffd9e2aec95f13abb8d (127.16.126.3). New cstate: current_term: 1 leader_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } health_report { overall_health: HEALTHY } } }
I20251023 07:59:56.718600 21466 leader_election.cc:290] T 30795d2458e943b5923542028d5c85a6 P 462a37ed579b46e78a75add632eabf23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1:36379), abf20d53faa04ffd9e2aec95f13abb8d (127.16.126.3:36749)
I20251023 07:59:56.727993 21472 raft_consensus.cc:493] T 927d27447e7e463c836f015eb15cc307 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:56.728758 21472 raft_consensus.cc:515] T 927d27447e7e463c836f015eb15cc307 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:56.735102 21267 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "927d27447e7e463c836f015eb15cc307" candidate_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" is_pre_election: true
I20251023 07:59:56.736609 21472 leader_election.cc:290] T 927d27447e7e463c836f015eb15cc307 P abf20d53faa04ffd9e2aec95f13abb8d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1:36379), 462a37ed579b46e78a75add632eabf23 (127.16.126.2:44879)
W20251023 07:59:56.738277 21379 leader_election.cc:343] T 927d27447e7e463c836f015eb15cc307 P abf20d53faa04ffd9e2aec95f13abb8d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1:36379): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:56.744879 21456 tablet_bootstrap.cc:492] T 40eac800e4b24372ab2d12224be9bee4 P abf20d53faa04ffd9e2aec95f13abb8d: No bootstrap required, opened a new log
I20251023 07:59:56.745726 21463 raft_consensus.cc:493] T 07bbde512054431eb0f36c0fc3ce25cf P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:56.747359 21456 ts_tablet_manager.cc:1403] T 40eac800e4b24372ab2d12224be9bee4 P abf20d53faa04ffd9e2aec95f13abb8d: Time spent bootstrapping tablet: real 0.059s user 0.009s sys 0.013s
I20251023 07:59:56.747263 21463 raft_consensus.cc:515] T 07bbde512054431eb0f36c0fc3ce25cf P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } }
I20251023 07:59:56.749863 21463 leader_election.cc:290] T 07bbde512054431eb0f36c0fc3ce25cf P 189a9eeaf7ef4038aecadfbb80cf8c7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers abf20d53faa04ffd9e2aec95f13abb8d (127.16.126.3:36749), 462a37ed579b46e78a75add632eabf23 (127.16.126.2:44879)
I20251023 07:59:56.750412 21456 raft_consensus.cc:359] T 40eac800e4b24372ab2d12224be9bee4 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:56.751194 21456 raft_consensus.cc:385] T 40eac800e4b24372ab2d12224be9bee4 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:56.751536 21456 raft_consensus.cc:740] T 40eac800e4b24372ab2d12224be9bee4 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf20d53faa04ffd9e2aec95f13abb8d, State: Initialized, Role: FOLLOWER
I20251023 07:59:56.746440 21342 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "927d27447e7e463c836f015eb15cc307" candidate_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "462a37ed579b46e78a75add632eabf23" is_pre_election: true
I20251023 07:59:56.746764 21459 tablet_bootstrap.cc:492] T 3db5b343d92742c9a0fea1cfc7cc457e P 462a37ed579b46e78a75add632eabf23: No bootstrap required, opened a new log
I20251023 07:59:56.753252 21459 ts_tablet_manager.cc:1403] T 3db5b343d92742c9a0fea1cfc7cc457e P 462a37ed579b46e78a75add632eabf23: Time spent bootstrapping tablet: real 0.068s user 0.021s sys 0.029s
I20251023 07:59:56.756918 21459 raft_consensus.cc:359] T 3db5b343d92742c9a0fea1cfc7cc457e P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:56.757922 21459 raft_consensus.cc:385] T 3db5b343d92742c9a0fea1cfc7cc457e P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:56.758299 21459 raft_consensus.cc:740] T 3db5b343d92742c9a0fea1cfc7cc457e P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 462a37ed579b46e78a75add632eabf23, State: Initialized, Role: FOLLOWER
I20251023 07:59:56.759210 21459 consensus_queue.cc:260] T 3db5b343d92742c9a0fea1cfc7cc457e P 462a37ed579b46e78a75add632eabf23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:56.762161 21459 ts_tablet_manager.cc:1434] T 3db5b343d92742c9a0fea1cfc7cc457e P 462a37ed579b46e78a75add632eabf23: Time spent starting tablet: real 0.009s user 0.008s sys 0.000s
W20251023 07:59:56.762846 21379 leader_election.cc:343] T 927d27447e7e463c836f015eb15cc307 P abf20d53faa04ffd9e2aec95f13abb8d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 462a37ed579b46e78a75add632eabf23 (127.16.126.2:44879): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:56.763365 21459 tablet_bootstrap.cc:492] T 40eac800e4b24372ab2d12224be9bee4 P 462a37ed579b46e78a75add632eabf23: Bootstrap starting.
I20251023 07:59:56.763835 21457 tablet_bootstrap.cc:492] T a9ac30e967a44ca38d29e93d1cca6fb7 P 189a9eeaf7ef4038aecadfbb80cf8c7b: No bootstrap required, opened a new log
I20251023 07:59:56.752599 21456 consensus_queue.cc:260] T 40eac800e4b24372ab2d12224be9bee4 P abf20d53faa04ffd9e2aec95f13abb8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:56.764384 21457 ts_tablet_manager.cc:1403] T a9ac30e967a44ca38d29e93d1cca6fb7 P 189a9eeaf7ef4038aecadfbb80cf8c7b: Time spent bootstrapping tablet: real 0.076s user 0.014s sys 0.034s
I20251023 07:59:56.767374 21457 raft_consensus.cc:359] T a9ac30e967a44ca38d29e93d1cca6fb7 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:56.768090 21457 raft_consensus.cc:385] T a9ac30e967a44ca38d29e93d1cca6fb7 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:56.768402 21457 raft_consensus.cc:740] T a9ac30e967a44ca38d29e93d1cca6fb7 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 189a9eeaf7ef4038aecadfbb80cf8c7b, State: Initialized, Role: FOLLOWER
I20251023 07:59:56.769064 21457 consensus_queue.cc:260] T a9ac30e967a44ca38d29e93d1cca6fb7 P 189a9eeaf7ef4038aecadfbb80cf8c7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:56.763411 21379 leader_election.cc:304] T 927d27447e7e463c836f015eb15cc307 P abf20d53faa04ffd9e2aec95f13abb8d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf20d53faa04ffd9e2aec95f13abb8d; no voters: 189a9eeaf7ef4038aecadfbb80cf8c7b, 462a37ed579b46e78a75add632eabf23
I20251023 07:59:56.770766 21461 raft_consensus.cc:2749] T 927d27447e7e463c836f015eb15cc307 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:59:56.771687 21457 ts_tablet_manager.cc:1434] T a9ac30e967a44ca38d29e93d1cca6fb7 P 189a9eeaf7ef4038aecadfbb80cf8c7b: Time spent starting tablet: real 0.007s user 0.003s sys 0.003s
I20251023 07:59:56.772773 21457 tablet_bootstrap.cc:492] T 0f4050c875ff487e89b8a8170c0b9125 P 189a9eeaf7ef4038aecadfbb80cf8c7b: Bootstrap starting.
I20251023 07:59:56.773695 21456 ts_tablet_manager.cc:1434] T 40eac800e4b24372ab2d12224be9bee4 P abf20d53faa04ffd9e2aec95f13abb8d: Time spent starting tablet: real 0.026s user 0.007s sys 0.001s
I20251023 07:59:56.777137 21456 tablet_bootstrap.cc:492] T 30795d2458e943b5923542028d5c85a6 P abf20d53faa04ffd9e2aec95f13abb8d: Bootstrap starting.
I20251023 07:59:56.779385 21457 tablet_bootstrap.cc:654] T 0f4050c875ff487e89b8a8170c0b9125 P 189a9eeaf7ef4038aecadfbb80cf8c7b: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:56.783288 21416 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "30795d2458e943b5923542028d5c85a6" candidate_uuid: "462a37ed579b46e78a75add632eabf23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" is_pre_election: true
I20251023 07:59:56.786254 21456 tablet_bootstrap.cc:654] T 30795d2458e943b5923542028d5c85a6 P abf20d53faa04ffd9e2aec95f13abb8d: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:56.787384 21459 tablet_bootstrap.cc:654] T 40eac800e4b24372ab2d12224be9bee4 P 462a37ed579b46e78a75add632eabf23: Neither blocks nor log segments found. Creating new log.
W20251023 07:59:56.787762 21213 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
W20251023 07:59:56.789165 21308 leader_election.cc:343] T 30795d2458e943b5923542028d5c85a6 P 462a37ed579b46e78a75add632eabf23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abf20d53faa04ffd9e2aec95f13abb8d (127.16.126.3:36749): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:56.795627 21267 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "30795d2458e943b5923542028d5c85a6" candidate_uuid: "462a37ed579b46e78a75add632eabf23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" is_pre_election: true
I20251023 07:59:56.795974 21459 tablet_bootstrap.cc:492] T 40eac800e4b24372ab2d12224be9bee4 P 462a37ed579b46e78a75add632eabf23: No bootstrap required, opened a new log
I20251023 07:59:56.796476 21459 ts_tablet_manager.cc:1403] T 40eac800e4b24372ab2d12224be9bee4 P 462a37ed579b46e78a75add632eabf23: Time spent bootstrapping tablet: real 0.033s user 0.013s sys 0.000s
W20251023 07:59:56.797116 21305 leader_election.cc:343] T 30795d2458e943b5923542028d5c85a6 P 462a37ed579b46e78a75add632eabf23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1:36379): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:56.797636 21305 leader_election.cc:304] T 30795d2458e943b5923542028d5c85a6 P 462a37ed579b46e78a75add632eabf23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 462a37ed579b46e78a75add632eabf23; no voters: 189a9eeaf7ef4038aecadfbb80cf8c7b, abf20d53faa04ffd9e2aec95f13abb8d
I20251023 07:59:56.798897 21466 raft_consensus.cc:2749] T 30795d2458e943b5923542028d5c85a6 P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:59:56.802145 21459 raft_consensus.cc:359] T 40eac800e4b24372ab2d12224be9bee4 P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:56.802927 21459 raft_consensus.cc:385] T 40eac800e4b24372ab2d12224be9bee4 P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:56.803208 21459 raft_consensus.cc:740] T 40eac800e4b24372ab2d12224be9bee4 P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 462a37ed579b46e78a75add632eabf23, State: Initialized, Role: FOLLOWER
I20251023 07:59:56.805081 21459 consensus_queue.cc:260] T 40eac800e4b24372ab2d12224be9bee4 P 462a37ed579b46e78a75add632eabf23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:56.809290 21459 ts_tablet_manager.cc:1434] T 40eac800e4b24372ab2d12224be9bee4 P 462a37ed579b46e78a75add632eabf23: Time spent starting tablet: real 0.013s user 0.007s sys 0.000s
I20251023 07:59:56.809360 21457 tablet_bootstrap.cc:492] T 0f4050c875ff487e89b8a8170c0b9125 P 189a9eeaf7ef4038aecadfbb80cf8c7b: No bootstrap required, opened a new log
I20251023 07:59:56.810019 21457 ts_tablet_manager.cc:1403] T 0f4050c875ff487e89b8a8170c0b9125 P 189a9eeaf7ef4038aecadfbb80cf8c7b: Time spent bootstrapping tablet: real 0.037s user 0.019s sys 0.017s
I20251023 07:59:56.810381 21459 tablet_bootstrap.cc:492] T 0f4050c875ff487e89b8a8170c0b9125 P 462a37ed579b46e78a75add632eabf23: Bootstrap starting.
I20251023 07:59:56.813084 21457 raft_consensus.cc:359] T 0f4050c875ff487e89b8a8170c0b9125 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:56.813912 21457 raft_consensus.cc:385] T 0f4050c875ff487e89b8a8170c0b9125 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:56.814302 21457 raft_consensus.cc:740] T 0f4050c875ff487e89b8a8170c0b9125 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 189a9eeaf7ef4038aecadfbb80cf8c7b, State: Initialized, Role: FOLLOWER
I20251023 07:59:56.815027 21457 consensus_queue.cc:260] T 0f4050c875ff487e89b8a8170c0b9125 P 189a9eeaf7ef4038aecadfbb80cf8c7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:56.815703 21342 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "07bbde512054431eb0f36c0fc3ce25cf" candidate_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "462a37ed579b46e78a75add632eabf23" is_pre_election: true
I20251023 07:59:56.816483 21342 raft_consensus.cc:2468] T 07bbde512054431eb0f36c0fc3ce25cf P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a9eeaf7ef4038aecadfbb80cf8c7b in term 0.
I20251023 07:59:56.817025 21416 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "07bbde512054431eb0f36c0fc3ce25cf" candidate_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" is_pre_election: true
I20251023 07:59:56.817385 21459 tablet_bootstrap.cc:654] T 0f4050c875ff487e89b8a8170c0b9125 P 462a37ed579b46e78a75add632eabf23: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:56.817633 21457 ts_tablet_manager.cc:1434] T 0f4050c875ff487e89b8a8170c0b9125 P 189a9eeaf7ef4038aecadfbb80cf8c7b: Time spent starting tablet: real 0.007s user 0.006s sys 0.001s
I20251023 07:59:56.817797 21230 leader_election.cc:304] T 07bbde512054431eb0f36c0fc3ce25cf P 189a9eeaf7ef4038aecadfbb80cf8c7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a9eeaf7ef4038aecadfbb80cf8c7b, 462a37ed579b46e78a75add632eabf23; no voters:
I20251023 07:59:56.821122 21457 tablet_bootstrap.cc:492] T 927d27447e7e463c836f015eb15cc307 P 189a9eeaf7ef4038aecadfbb80cf8c7b: Bootstrap starting.
I20251023 07:59:56.818217 21456 tablet_bootstrap.cc:492] T 30795d2458e943b5923542028d5c85a6 P abf20d53faa04ffd9e2aec95f13abb8d: No bootstrap required, opened a new log
I20251023 07:59:56.821858 21463 raft_consensus.cc:2804] T 07bbde512054431eb0f36c0fc3ce25cf P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:56.822117 21456 ts_tablet_manager.cc:1403] T 30795d2458e943b5923542028d5c85a6 P abf20d53faa04ffd9e2aec95f13abb8d: Time spent bootstrapping tablet: real 0.045s user 0.024s sys 0.004s
I20251023 07:59:56.822315 21463 raft_consensus.cc:493] T 07bbde512054431eb0f36c0fc3ce25cf P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:56.822810 21463 raft_consensus.cc:3060] T 07bbde512054431eb0f36c0fc3ce25cf P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:56.826131 21456 raft_consensus.cc:359] T 30795d2458e943b5923542028d5c85a6 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:56.827200 21456 raft_consensus.cc:385] T 30795d2458e943b5923542028d5c85a6 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:56.827581 21456 raft_consensus.cc:740] T 30795d2458e943b5923542028d5c85a6 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf20d53faa04ffd9e2aec95f13abb8d, State: Initialized, Role: FOLLOWER
I20251023 07:59:56.828541 21456 consensus_queue.cc:260] T 30795d2458e943b5923542028d5c85a6 P abf20d53faa04ffd9e2aec95f13abb8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
W20251023 07:59:56.829885 21233 leader_election.cc:343] T 07bbde512054431eb0f36c0fc3ce25cf P 189a9eeaf7ef4038aecadfbb80cf8c7b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abf20d53faa04ffd9e2aec95f13abb8d (127.16.126.3:36749): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:56.832533 21456 ts_tablet_manager.cc:1434] T 30795d2458e943b5923542028d5c85a6 P abf20d53faa04ffd9e2aec95f13abb8d: Time spent starting tablet: real 0.010s user 0.008s sys 0.000s
I20251023 07:59:56.834012 21456 tablet_bootstrap.cc:492] T 7341661a4a144d58a6f2f78391143c89 P abf20d53faa04ffd9e2aec95f13abb8d: Bootstrap starting.
I20251023 07:59:56.838475 21463 raft_consensus.cc:515] T 07bbde512054431eb0f36c0fc3ce25cf P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } }
I20251023 07:59:56.841683 21342 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "07bbde512054431eb0f36c0fc3ce25cf" candidate_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "462a37ed579b46e78a75add632eabf23"
I20251023 07:59:56.842247 21342 raft_consensus.cc:3060] T 07bbde512054431eb0f36c0fc3ce25cf P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:56.842401 21416 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "07bbde512054431eb0f36c0fc3ce25cf" candidate_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf20d53faa04ffd9e2aec95f13abb8d"
W20251023 07:59:56.843904 21233 leader_election.cc:343] T 07bbde512054431eb0f36c0fc3ce25cf P 189a9eeaf7ef4038aecadfbb80cf8c7b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer abf20d53faa04ffd9e2aec95f13abb8d (127.16.126.3:36749): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:56.844545 21463 leader_election.cc:290] T 07bbde512054431eb0f36c0fc3ce25cf P 189a9eeaf7ef4038aecadfbb80cf8c7b [CANDIDATE]: Term 1 election: Requested vote from peers abf20d53faa04ffd9e2aec95f13abb8d (127.16.126.3:36749), 462a37ed579b46e78a75add632eabf23 (127.16.126.2:44879)
I20251023 07:59:56.848464 21457 tablet_bootstrap.cc:654] T 927d27447e7e463c836f015eb15cc307 P 189a9eeaf7ef4038aecadfbb80cf8c7b: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:56.849937 21342 raft_consensus.cc:2468] T 07bbde512054431eb0f36c0fc3ce25cf P 462a37ed579b46e78a75add632eabf23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a9eeaf7ef4038aecadfbb80cf8c7b in term 1.
I20251023 07:59:56.852185 21230 leader_election.cc:304] T 07bbde512054431eb0f36c0fc3ce25cf P 189a9eeaf7ef4038aecadfbb80cf8c7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a9eeaf7ef4038aecadfbb80cf8c7b, 462a37ed579b46e78a75add632eabf23; no voters: abf20d53faa04ffd9e2aec95f13abb8d
I20251023 07:59:56.853418 21463 raft_consensus.cc:2804] T 07bbde512054431eb0f36c0fc3ce25cf P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:59:56.854704 21463 raft_consensus.cc:697] T 07bbde512054431eb0f36c0fc3ce25cf P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 LEADER]: Becoming Leader. State: Replica: 189a9eeaf7ef4038aecadfbb80cf8c7b, State: Running, Role: LEADER
I20251023 07:59:56.855589 21459 tablet_bootstrap.cc:492] T 0f4050c875ff487e89b8a8170c0b9125 P 462a37ed579b46e78a75add632eabf23: No bootstrap required, opened a new log
I20251023 07:59:56.855598 21456 tablet_bootstrap.cc:654] T 7341661a4a144d58a6f2f78391143c89 P abf20d53faa04ffd9e2aec95f13abb8d: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:56.856194 21459 ts_tablet_manager.cc:1403] T 0f4050c875ff487e89b8a8170c0b9125 P 462a37ed579b46e78a75add632eabf23: Time spent bootstrapping tablet: real 0.046s user 0.015s sys 0.028s
I20251023 07:59:56.856258 21463 consensus_queue.cc:237] T 07bbde512054431eb0f36c0fc3ce25cf P 189a9eeaf7ef4038aecadfbb80cf8c7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } }
I20251023 07:59:56.857124 21457 tablet_bootstrap.cc:492] T 927d27447e7e463c836f015eb15cc307 P 189a9eeaf7ef4038aecadfbb80cf8c7b: No bootstrap required, opened a new log
I20251023 07:59:56.857697 21457 ts_tablet_manager.cc:1403] T 927d27447e7e463c836f015eb15cc307 P 189a9eeaf7ef4038aecadfbb80cf8c7b: Time spent bootstrapping tablet: real 0.037s user 0.016s sys 0.000s
I20251023 07:59:56.859310 21459 raft_consensus.cc:359] T 0f4050c875ff487e89b8a8170c0b9125 P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:56.861239 21459 raft_consensus.cc:385] T 0f4050c875ff487e89b8a8170c0b9125 P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:56.860541 21457 raft_consensus.cc:359] T 927d27447e7e463c836f015eb15cc307 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:56.861627 21459 raft_consensus.cc:740] T 0f4050c875ff487e89b8a8170c0b9125 P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 462a37ed579b46e78a75add632eabf23, State: Initialized, Role: FOLLOWER
I20251023 07:59:56.861827 21457 raft_consensus.cc:385] T 927d27447e7e463c836f015eb15cc307 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:56.862324 21457 raft_consensus.cc:740] T 927d27447e7e463c836f015eb15cc307 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 189a9eeaf7ef4038aecadfbb80cf8c7b, State: Initialized, Role: FOLLOWER
I20251023 07:59:56.862598 21459 consensus_queue.cc:260] T 0f4050c875ff487e89b8a8170c0b9125 P 462a37ed579b46e78a75add632eabf23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:56.863113 21457 consensus_queue.cc:260] T 927d27447e7e463c836f015eb15cc307 P 189a9eeaf7ef4038aecadfbb80cf8c7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:56.865345 21456 tablet_bootstrap.cc:492] T 7341661a4a144d58a6f2f78391143c89 P abf20d53faa04ffd9e2aec95f13abb8d: No bootstrap required, opened a new log
I20251023 07:59:56.865931 21456 ts_tablet_manager.cc:1403] T 7341661a4a144d58a6f2f78391143c89 P abf20d53faa04ffd9e2aec95f13abb8d: Time spent bootstrapping tablet: real 0.032s user 0.012s sys 0.004s
I20251023 07:59:56.867955 21459 ts_tablet_manager.cc:1434] T 0f4050c875ff487e89b8a8170c0b9125 P 462a37ed579b46e78a75add632eabf23: Time spent starting tablet: real 0.011s user 0.007s sys 0.000s
I20251023 07:59:56.869024 21459 tablet_bootstrap.cc:492] T a9ac30e967a44ca38d29e93d1cca6fb7 P 462a37ed579b46e78a75add632eabf23: Bootstrap starting.
I20251023 07:59:56.869459 21165 catalog_manager.cc:5649] T 07bbde512054431eb0f36c0fc3ce25cf P 189a9eeaf7ef4038aecadfbb80cf8c7b reported cstate change: term changed from 0 to 1, leader changed from <none> to 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1). New cstate: current_term: 1 leader_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } health_report { overall_health: HEALTHY } } }
I20251023 07:59:56.868835 21456 raft_consensus.cc:359] T 7341661a4a144d58a6f2f78391143c89 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:56.870787 21456 raft_consensus.cc:385] T 7341661a4a144d58a6f2f78391143c89 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:56.871110 21456 raft_consensus.cc:740] T 7341661a4a144d58a6f2f78391143c89 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf20d53faa04ffd9e2aec95f13abb8d, State: Initialized, Role: FOLLOWER
I20251023 07:59:56.866207 21457 ts_tablet_manager.cc:1434] T 927d27447e7e463c836f015eb15cc307 P 189a9eeaf7ef4038aecadfbb80cf8c7b: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20251023 07:59:56.871961 21456 consensus_queue.cc:260] T 7341661a4a144d58a6f2f78391143c89 P abf20d53faa04ffd9e2aec95f13abb8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:56.872546 21457 tablet_bootstrap.cc:492] T 3db5b343d92742c9a0fea1cfc7cc457e P 189a9eeaf7ef4038aecadfbb80cf8c7b: Bootstrap starting.
I20251023 07:59:56.879423 21459 tablet_bootstrap.cc:654] T a9ac30e967a44ca38d29e93d1cca6fb7 P 462a37ed579b46e78a75add632eabf23: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:56.880174 21456 ts_tablet_manager.cc:1434] T 7341661a4a144d58a6f2f78391143c89 P abf20d53faa04ffd9e2aec95f13abb8d: Time spent starting tablet: real 0.014s user 0.005s sys 0.002s
I20251023 07:59:56.879423 21457 tablet_bootstrap.cc:654] T 3db5b343d92742c9a0fea1cfc7cc457e P 189a9eeaf7ef4038aecadfbb80cf8c7b: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:56.881898 21456 tablet_bootstrap.cc:492] T 07bbde512054431eb0f36c0fc3ce25cf P abf20d53faa04ffd9e2aec95f13abb8d: Bootstrap starting.
I20251023 07:59:56.889966 21456 tablet_bootstrap.cc:654] T 07bbde512054431eb0f36c0fc3ce25cf P abf20d53faa04ffd9e2aec95f13abb8d: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:56.891898 21457 tablet_bootstrap.cc:492] T 3db5b343d92742c9a0fea1cfc7cc457e P 189a9eeaf7ef4038aecadfbb80cf8c7b: No bootstrap required, opened a new log
I20251023 07:59:56.892453 21457 ts_tablet_manager.cc:1403] T 3db5b343d92742c9a0fea1cfc7cc457e P 189a9eeaf7ef4038aecadfbb80cf8c7b: Time spent bootstrapping tablet: real 0.020s user 0.014s sys 0.000s
I20251023 07:59:56.895299 21457 raft_consensus.cc:359] T 3db5b343d92742c9a0fea1cfc7cc457e P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:56.895777 21456 tablet_bootstrap.cc:492] T 07bbde512054431eb0f36c0fc3ce25cf P abf20d53faa04ffd9e2aec95f13abb8d: No bootstrap required, opened a new log
I20251023 07:59:56.896029 21457 raft_consensus.cc:385] T 3db5b343d92742c9a0fea1cfc7cc457e P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:56.896030 21461 raft_consensus.cc:493] T 40eac800e4b24372ab2d12224be9bee4 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:56.896308 21456 ts_tablet_manager.cc:1403] T 07bbde512054431eb0f36c0fc3ce25cf P abf20d53faa04ffd9e2aec95f13abb8d: Time spent bootstrapping tablet: real 0.015s user 0.010s sys 0.001s
I20251023 07:59:56.896581 21457 raft_consensus.cc:740] T 3db5b343d92742c9a0fea1cfc7cc457e P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 189a9eeaf7ef4038aecadfbb80cf8c7b, State: Initialized, Role: FOLLOWER
I20251023 07:59:56.896826 21461 raft_consensus.cc:515] T 40eac800e4b24372ab2d12224be9bee4 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:56.897500 21457 consensus_queue.cc:260] T 3db5b343d92742c9a0fea1cfc7cc457e P 189a9eeaf7ef4038aecadfbb80cf8c7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:56.898901 21461 leader_election.cc:290] T 40eac800e4b24372ab2d12224be9bee4 P abf20d53faa04ffd9e2aec95f13abb8d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1:36379), 462a37ed579b46e78a75add632eabf23 (127.16.126.2:44879)
I20251023 07:59:56.899489 21456 raft_consensus.cc:359] T 07bbde512054431eb0f36c0fc3ce25cf P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } }
I20251023 07:59:56.899911 21457 ts_tablet_manager.cc:1434] T 3db5b343d92742c9a0fea1cfc7cc457e P 189a9eeaf7ef4038aecadfbb80cf8c7b: Time spent starting tablet: real 0.007s user 0.003s sys 0.003s
I20251023 07:59:56.900113 21459 tablet_bootstrap.cc:492] T a9ac30e967a44ca38d29e93d1cca6fb7 P 462a37ed579b46e78a75add632eabf23: No bootstrap required, opened a new log
I20251023 07:59:56.900280 21456 raft_consensus.cc:385] T 07bbde512054431eb0f36c0fc3ce25cf P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:56.900625 21456 raft_consensus.cc:740] T 07bbde512054431eb0f36c0fc3ce25cf P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf20d53faa04ffd9e2aec95f13abb8d, State: Initialized, Role: FOLLOWER
I20251023 07:59:56.901050 21457 tablet_bootstrap.cc:492] T 30795d2458e943b5923542028d5c85a6 P 189a9eeaf7ef4038aecadfbb80cf8c7b: Bootstrap starting.
I20251023 07:59:56.900699 21459 ts_tablet_manager.cc:1403] T a9ac30e967a44ca38d29e93d1cca6fb7 P 462a37ed579b46e78a75add632eabf23: Time spent bootstrapping tablet: real 0.032s user 0.011s sys 0.007s
I20251023 07:59:56.901325 21267 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "40eac800e4b24372ab2d12224be9bee4" candidate_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" is_pre_election: true
I20251023 07:59:56.901360 21456 consensus_queue.cc:260] T 07bbde512054431eb0f36c0fc3ce25cf P abf20d53faa04ffd9e2aec95f13abb8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } }
I20251023 07:59:56.903851 21342 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "40eac800e4b24372ab2d12224be9bee4" candidate_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "462a37ed579b46e78a75add632eabf23" is_pre_election: true
I20251023 07:59:56.903998 21456 ts_tablet_manager.cc:1434] T 07bbde512054431eb0f36c0fc3ce25cf P abf20d53faa04ffd9e2aec95f13abb8d: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20251023 07:59:56.904531 21342 raft_consensus.cc:2468] T 40eac800e4b24372ab2d12224be9bee4 P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf20d53faa04ffd9e2aec95f13abb8d in term 0.
I20251023 07:59:56.904075 21459 raft_consensus.cc:359] T a9ac30e967a44ca38d29e93d1cca6fb7 P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:56.905018 21459 raft_consensus.cc:385] T a9ac30e967a44ca38d29e93d1cca6fb7 P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:56.905315 21459 raft_consensus.cc:740] T a9ac30e967a44ca38d29e93d1cca6fb7 P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 462a37ed579b46e78a75add632eabf23, State: Initialized, Role: FOLLOWER
W20251023 07:59:56.905498 21379 leader_election.cc:343] T 40eac800e4b24372ab2d12224be9bee4 P abf20d53faa04ffd9e2aec95f13abb8d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1:36379): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:56.906508 21472 raft_consensus.cc:493] T 0f4050c875ff487e89b8a8170c0b9125 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:56.906203 21459 consensus_queue.cc:260] T a9ac30e967a44ca38d29e93d1cca6fb7 P 462a37ed579b46e78a75add632eabf23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:56.907028 21472 raft_consensus.cc:515] T 0f4050c875ff487e89b8a8170c0b9125 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:56.907455 21456 tablet_bootstrap.cc:492] T a9ac30e967a44ca38d29e93d1cca6fb7 P abf20d53faa04ffd9e2aec95f13abb8d: Bootstrap starting.
I20251023 07:59:56.907806 21457 tablet_bootstrap.cc:654] T 30795d2458e943b5923542028d5c85a6 P 189a9eeaf7ef4038aecadfbb80cf8c7b: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:56.909013 21472 leader_election.cc:290] T 0f4050c875ff487e89b8a8170c0b9125 P abf20d53faa04ffd9e2aec95f13abb8d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1:36379), 462a37ed579b46e78a75add632eabf23 (127.16.126.2:44879)
I20251023 07:59:56.913484 21459 ts_tablet_manager.cc:1434] T a9ac30e967a44ca38d29e93d1cca6fb7 P 462a37ed579b46e78a75add632eabf23: Time spent starting tablet: real 0.012s user 0.007s sys 0.000s
I20251023 07:59:56.914542 21459 tablet_bootstrap.cc:492] T 7341661a4a144d58a6f2f78391143c89 P 462a37ed579b46e78a75add632eabf23: Bootstrap starting.
I20251023 07:59:56.914836 21379 leader_election.cc:304] T 40eac800e4b24372ab2d12224be9bee4 P abf20d53faa04ffd9e2aec95f13abb8d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 462a37ed579b46e78a75add632eabf23, abf20d53faa04ffd9e2aec95f13abb8d; no voters: 189a9eeaf7ef4038aecadfbb80cf8c7b
I20251023 07:59:56.915791 21456 tablet_bootstrap.cc:654] T a9ac30e967a44ca38d29e93d1cca6fb7 P abf20d53faa04ffd9e2aec95f13abb8d: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:56.916857 21267 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0f4050c875ff487e89b8a8170c0b9125" candidate_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" is_pre_election: true
I20251023 07:59:56.919833 21342 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0f4050c875ff487e89b8a8170c0b9125" candidate_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "462a37ed579b46e78a75add632eabf23" is_pre_election: true
I20251023 07:59:56.920506 21342 raft_consensus.cc:2468] T 0f4050c875ff487e89b8a8170c0b9125 P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf20d53faa04ffd9e2aec95f13abb8d in term 0.
I20251023 07:59:56.921653 21267 raft_consensus.cc:2468] T 0f4050c875ff487e89b8a8170c0b9125 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf20d53faa04ffd9e2aec95f13abb8d in term 0.
I20251023 07:59:56.927364 21379 leader_election.cc:304] T 0f4050c875ff487e89b8a8170c0b9125 P abf20d53faa04ffd9e2aec95f13abb8d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a9eeaf7ef4038aecadfbb80cf8c7b, abf20d53faa04ffd9e2aec95f13abb8d; no voters:
I20251023 07:59:56.928668 21459 tablet_bootstrap.cc:654] T 7341661a4a144d58a6f2f78391143c89 P 462a37ed579b46e78a75add632eabf23: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:56.928011 21461 raft_consensus.cc:2804] T 40eac800e4b24372ab2d12224be9bee4 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:56.929414 21461 raft_consensus.cc:493] T 40eac800e4b24372ab2d12224be9bee4 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:56.929828 21461 raft_consensus.cc:3060] T 40eac800e4b24372ab2d12224be9bee4 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:56.934373 21472 raft_consensus.cc:2804] T 0f4050c875ff487e89b8a8170c0b9125 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:56.936121 21456 tablet_bootstrap.cc:492] T a9ac30e967a44ca38d29e93d1cca6fb7 P abf20d53faa04ffd9e2aec95f13abb8d: No bootstrap required, opened a new log
I20251023 07:59:56.941264 21472 raft_consensus.cc:493] T 0f4050c875ff487e89b8a8170c0b9125 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:56.941624 21456 ts_tablet_manager.cc:1403] T a9ac30e967a44ca38d29e93d1cca6fb7 P abf20d53faa04ffd9e2aec95f13abb8d: Time spent bootstrapping tablet: real 0.034s user 0.016s sys 0.013s
I20251023 07:59:56.941745 21472 raft_consensus.cc:3060] T 0f4050c875ff487e89b8a8170c0b9125 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:56.945290 21456 raft_consensus.cc:359] T a9ac30e967a44ca38d29e93d1cca6fb7 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:56.946219 21456 raft_consensus.cc:385] T a9ac30e967a44ca38d29e93d1cca6fb7 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:56.946561 21456 raft_consensus.cc:740] T a9ac30e967a44ca38d29e93d1cca6fb7 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf20d53faa04ffd9e2aec95f13abb8d, State: Initialized, Role: FOLLOWER
I20251023 07:59:56.947388 21456 consensus_queue.cc:260] T a9ac30e967a44ca38d29e93d1cca6fb7 P abf20d53faa04ffd9e2aec95f13abb8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:56.948035 21463 raft_consensus.cc:493] T a9ac30e967a44ca38d29e93d1cca6fb7 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:56.940495 21459 tablet_bootstrap.cc:492] T 7341661a4a144d58a6f2f78391143c89 P 462a37ed579b46e78a75add632eabf23: No bootstrap required, opened a new log
I20251023 07:59:56.948596 21463 raft_consensus.cc:515] T a9ac30e967a44ca38d29e93d1cca6fb7 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:56.949589 21459 ts_tablet_manager.cc:1403] T 7341661a4a144d58a6f2f78391143c89 P 462a37ed579b46e78a75add632eabf23: Time spent bootstrapping tablet: real 0.035s user 0.011s sys 0.005s
I20251023 07:59:56.950731 21463 leader_election.cc:290] T a9ac30e967a44ca38d29e93d1cca6fb7 P 189a9eeaf7ef4038aecadfbb80cf8c7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 462a37ed579b46e78a75add632eabf23 (127.16.126.2:44879), abf20d53faa04ffd9e2aec95f13abb8d (127.16.126.3:36749)
I20251023 07:59:56.953027 21459 raft_consensus.cc:359] T 7341661a4a144d58a6f2f78391143c89 P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:56.954118 21459 raft_consensus.cc:385] T 7341661a4a144d58a6f2f78391143c89 P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:56.954381 21342 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a9ac30e967a44ca38d29e93d1cca6fb7" candidate_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "462a37ed579b46e78a75add632eabf23" is_pre_election: true
I20251023 07:59:56.954514 21459 raft_consensus.cc:740] T 7341661a4a144d58a6f2f78391143c89 P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 462a37ed579b46e78a75add632eabf23, State: Initialized, Role: FOLLOWER
I20251023 07:59:56.953534 21416 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a9ac30e967a44ca38d29e93d1cca6fb7" candidate_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" is_pre_election: true
I20251023 07:59:56.956159 21416 raft_consensus.cc:2468] T a9ac30e967a44ca38d29e93d1cca6fb7 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a9eeaf7ef4038aecadfbb80cf8c7b in term 0.
I20251023 07:59:56.956276 21459 consensus_queue.cc:260] T 7341661a4a144d58a6f2f78391143c89 P 462a37ed579b46e78a75add632eabf23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:56.957765 21233 leader_election.cc:304] T a9ac30e967a44ca38d29e93d1cca6fb7 P 189a9eeaf7ef4038aecadfbb80cf8c7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a9eeaf7ef4038aecadfbb80cf8c7b, abf20d53faa04ffd9e2aec95f13abb8d; no voters:
I20251023 07:59:56.958663 21463 raft_consensus.cc:2804] T a9ac30e967a44ca38d29e93d1cca6fb7 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:56.959013 21463 raft_consensus.cc:493] T a9ac30e967a44ca38d29e93d1cca6fb7 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:56.959343 21463 raft_consensus.cc:3060] T a9ac30e967a44ca38d29e93d1cca6fb7 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:56.959384 21459 ts_tablet_manager.cc:1434] T 7341661a4a144d58a6f2f78391143c89 P 462a37ed579b46e78a75add632eabf23: Time spent starting tablet: real 0.009s user 0.007s sys 0.000s
I20251023 07:59:56.960762 21459 tablet_bootstrap.cc:492] T 927d27447e7e463c836f015eb15cc307 P 462a37ed579b46e78a75add632eabf23: Bootstrap starting.
I20251023 07:59:56.961577 21466 raft_consensus.cc:493] T 7341661a4a144d58a6f2f78391143c89 P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:56.955098 21342 raft_consensus.cc:2468] T a9ac30e967a44ca38d29e93d1cca6fb7 P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a9eeaf7ef4038aecadfbb80cf8c7b in term 0.
I20251023 07:59:56.961946 21487 raft_consensus.cc:493] T 7341661a4a144d58a6f2f78391143c89 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:56.962119 21466 raft_consensus.cc:515] T 7341661a4a144d58a6f2f78391143c89 P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:56.962483 21487 raft_consensus.cc:515] T 7341661a4a144d58a6f2f78391143c89 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:56.964179 21466 leader_election.cc:290] T 7341661a4a144d58a6f2f78391143c89 P 462a37ed579b46e78a75add632eabf23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1:36379), abf20d53faa04ffd9e2aec95f13abb8d (127.16.126.3:36749)
I20251023 07:59:56.964381 21487 leader_election.cc:290] T 7341661a4a144d58a6f2f78391143c89 P 189a9eeaf7ef4038aecadfbb80cf8c7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 462a37ed579b46e78a75add632eabf23 (127.16.126.2:44879), abf20d53faa04ffd9e2aec95f13abb8d (127.16.126.3:36749)
I20251023 07:59:56.966202 21341 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7341661a4a144d58a6f2f78391143c89" candidate_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "462a37ed579b46e78a75add632eabf23" is_pre_election: true
I20251023 07:59:56.967006 21456 ts_tablet_manager.cc:1434] T a9ac30e967a44ca38d29e93d1cca6fb7 P abf20d53faa04ffd9e2aec95f13abb8d: Time spent starting tablet: real 0.025s user 0.008s sys 0.000s
I20251023 07:59:56.966892 21341 raft_consensus.cc:2468] T 7341661a4a144d58a6f2f78391143c89 P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a9eeaf7ef4038aecadfbb80cf8c7b in term 0.
I20251023 07:59:56.967474 21415 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7341661a4a144d58a6f2f78391143c89" candidate_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" is_pre_election: true
I20251023 07:59:56.968117 21415 raft_consensus.cc:2468] T 7341661a4a144d58a6f2f78391143c89 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a9eeaf7ef4038aecadfbb80cf8c7b in term 0.
I20251023 07:59:56.968114 21456 tablet_bootstrap.cc:492] T 3db5b343d92742c9a0fea1cfc7cc457e P abf20d53faa04ffd9e2aec95f13abb8d: Bootstrap starting.
I20251023 07:59:56.970916 21459 tablet_bootstrap.cc:654] T 927d27447e7e463c836f015eb15cc307 P 462a37ed579b46e78a75add632eabf23: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:56.974538 21230 leader_election.cc:304] T 7341661a4a144d58a6f2f78391143c89 P 189a9eeaf7ef4038aecadfbb80cf8c7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a9eeaf7ef4038aecadfbb80cf8c7b, 462a37ed579b46e78a75add632eabf23; no voters:
I20251023 07:59:56.975767 21416 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7341661a4a144d58a6f2f78391143c89" candidate_uuid: "462a37ed579b46e78a75add632eabf23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" is_pre_election: true
I20251023 07:59:56.976771 21416 raft_consensus.cc:2468] T 7341661a4a144d58a6f2f78391143c89 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 462a37ed579b46e78a75add632eabf23 in term 0.
I20251023 07:59:56.978406 21487 raft_consensus.cc:2804] T 7341661a4a144d58a6f2f78391143c89 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:56.979028 21487 raft_consensus.cc:493] T 7341661a4a144d58a6f2f78391143c89 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:56.979550 21487 raft_consensus.cc:3060] T 7341661a4a144d58a6f2f78391143c89 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:56.982201 21456 tablet_bootstrap.cc:654] T 3db5b343d92742c9a0fea1cfc7cc457e P abf20d53faa04ffd9e2aec95f13abb8d: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:56.985138 21267 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7341661a4a144d58a6f2f78391143c89" candidate_uuid: "462a37ed579b46e78a75add632eabf23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" is_pre_election: true
I20251023 07:59:56.987597 21308 leader_election.cc:304] T 7341661a4a144d58a6f2f78391143c89 P 462a37ed579b46e78a75add632eabf23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 462a37ed579b46e78a75add632eabf23, abf20d53faa04ffd9e2aec95f13abb8d; no voters:
I20251023 07:59:56.999126 21499 raft_consensus.cc:493] T 3db5b343d92742c9a0fea1cfc7cc457e P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:56.999739 21499 raft_consensus.cc:515] T 3db5b343d92742c9a0fea1cfc7cc457e P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:57.003023 21266 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3db5b343d92742c9a0fea1cfc7cc457e" candidate_uuid: "462a37ed579b46e78a75add632eabf23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" is_pre_election: true
I20251023 07:59:57.003722 21266 raft_consensus.cc:2468] T 3db5b343d92742c9a0fea1cfc7cc457e P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 462a37ed579b46e78a75add632eabf23 in term 0.
I20251023 07:59:57.004971 21305 leader_election.cc:304] T 3db5b343d92742c9a0fea1cfc7cc457e P 462a37ed579b46e78a75add632eabf23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a9eeaf7ef4038aecadfbb80cf8c7b, 462a37ed579b46e78a75add632eabf23; no voters:
I20251023 07:59:56.996703 21466 raft_consensus.cc:2804] T 7341661a4a144d58a6f2f78391143c89 P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:57.006088 21466 raft_consensus.cc:493] T 7341661a4a144d58a6f2f78391143c89 P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:57.007438 21466 raft_consensus.cc:3060] T 7341661a4a144d58a6f2f78391143c89 P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:57.008605 21457 tablet_bootstrap.cc:492] T 30795d2458e943b5923542028d5c85a6 P 189a9eeaf7ef4038aecadfbb80cf8c7b: No bootstrap required, opened a new log
I20251023 07:59:57.008808 21461 raft_consensus.cc:515] T 40eac800e4b24372ab2d12224be9bee4 P abf20d53faa04ffd9e2aec95f13abb8d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:57.011520 21463 raft_consensus.cc:515] T a9ac30e967a44ca38d29e93d1cca6fb7 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:57.012688 21266 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "40eac800e4b24372ab2d12224be9bee4" candidate_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b"
I20251023 07:59:57.009186 21457 ts_tablet_manager.cc:1403] T 30795d2458e943b5923542028d5c85a6 P 189a9eeaf7ef4038aecadfbb80cf8c7b: Time spent bootstrapping tablet: real 0.108s user 0.025s sys 0.062s
I20251023 07:59:57.018662 21457 raft_consensus.cc:359] T 30795d2458e943b5923542028d5c85a6 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:57.021422 21457 raft_consensus.cc:385] T 30795d2458e943b5923542028d5c85a6 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:57.021823 21457 raft_consensus.cc:740] T 30795d2458e943b5923542028d5c85a6 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 189a9eeaf7ef4038aecadfbb80cf8c7b, State: Initialized, Role: FOLLOWER
I20251023 07:59:57.015444 21342 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a9ac30e967a44ca38d29e93d1cca6fb7" candidate_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "462a37ed579b46e78a75add632eabf23"
I20251023 07:59:57.022639 21457 consensus_queue.cc:260] T 30795d2458e943b5923542028d5c85a6 P 189a9eeaf7ef4038aecadfbb80cf8c7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:57.018937 21461 leader_election.cc:290] T 40eac800e4b24372ab2d12224be9bee4 P abf20d53faa04ffd9e2aec95f13abb8d [CANDIDATE]: Term 1 election: Requested vote from peers 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1:36379), 462a37ed579b46e78a75add632eabf23 (127.16.126.2:44879)
I20251023 07:59:57.029618 21499 leader_election.cc:290] T 3db5b343d92742c9a0fea1cfc7cc457e P 462a37ed579b46e78a75add632eabf23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1:36379), abf20d53faa04ffd9e2aec95f13abb8d (127.16.126.3:36749)
I20251023 07:59:57.018844 21341 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "40eac800e4b24372ab2d12224be9bee4" candidate_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "462a37ed579b46e78a75add632eabf23"
I20251023 07:59:57.032634 21459 tablet_bootstrap.cc:492] T 927d27447e7e463c836f015eb15cc307 P 462a37ed579b46e78a75add632eabf23: No bootstrap required, opened a new log
I20251023 07:59:57.033316 21459 ts_tablet_manager.cc:1403] T 927d27447e7e463c836f015eb15cc307 P 462a37ed579b46e78a75add632eabf23: Time spent bootstrapping tablet: real 0.073s user 0.021s sys 0.003s
I20251023 07:59:57.033699 21456 tablet_bootstrap.cc:492] T 3db5b343d92742c9a0fea1cfc7cc457e P abf20d53faa04ffd9e2aec95f13abb8d: No bootstrap required, opened a new log
I20251023 07:59:57.034327 21456 ts_tablet_manager.cc:1403] T 3db5b343d92742c9a0fea1cfc7cc457e P abf20d53faa04ffd9e2aec95f13abb8d: Time spent bootstrapping tablet: real 0.066s user 0.028s sys 0.025s
I20251023 07:59:57.036782 21459 raft_consensus.cc:359] T 927d27447e7e463c836f015eb15cc307 P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:57.037774 21459 raft_consensus.cc:385] T 927d27447e7e463c836f015eb15cc307 P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:57.037676 21456 raft_consensus.cc:359] T 3db5b343d92742c9a0fea1cfc7cc457e P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:57.038286 21459 raft_consensus.cc:740] T 927d27447e7e463c836f015eb15cc307 P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 462a37ed579b46e78a75add632eabf23, State: Initialized, Role: FOLLOWER
I20251023 07:59:57.038674 21456 raft_consensus.cc:385] T 3db5b343d92742c9a0fea1cfc7cc457e P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:57.039083 21499 raft_consensus.cc:2804] T 3db5b343d92742c9a0fea1cfc7cc457e P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:57.039090 21456 raft_consensus.cc:740] T 3db5b343d92742c9a0fea1cfc7cc457e P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf20d53faa04ffd9e2aec95f13abb8d, State: Initialized, Role: FOLLOWER
I20251023 07:59:57.039793 21499 raft_consensus.cc:493] T 3db5b343d92742c9a0fea1cfc7cc457e P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:57.040318 21499 raft_consensus.cc:3060] T 3db5b343d92742c9a0fea1cfc7cc457e P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:57.040474 21456 consensus_queue.cc:260] T 3db5b343d92742c9a0fea1cfc7cc457e P abf20d53faa04ffd9e2aec95f13abb8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:57.042476 21457 ts_tablet_manager.cc:1434] T 30795d2458e943b5923542028d5c85a6 P 189a9eeaf7ef4038aecadfbb80cf8c7b: Time spent starting tablet: real 0.027s user 0.013s sys 0.003s
I20251023 07:59:57.042390 21459 consensus_queue.cc:260] T 927d27447e7e463c836f015eb15cc307 P 462a37ed579b46e78a75add632eabf23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:57.044013 21456 ts_tablet_manager.cc:1434] T 3db5b343d92742c9a0fea1cfc7cc457e P abf20d53faa04ffd9e2aec95f13abb8d: Time spent starting tablet: real 0.009s user 0.008s sys 0.000s
I20251023 07:59:57.044739 21459 ts_tablet_manager.cc:1434] T 927d27447e7e463c836f015eb15cc307 P 462a37ed579b46e78a75add632eabf23: Time spent starting tablet: real 0.011s user 0.005s sys 0.000s
I20251023 07:59:57.045295 21457 tablet_bootstrap.cc:492] T 40eac800e4b24372ab2d12224be9bee4 P 189a9eeaf7ef4038aecadfbb80cf8c7b: Bootstrap starting.
I20251023 07:59:57.023298 21463 leader_election.cc:290] T a9ac30e967a44ca38d29e93d1cca6fb7 P 189a9eeaf7ef4038aecadfbb80cf8c7b [CANDIDATE]: Term 1 election: Requested vote from peers 462a37ed579b46e78a75add632eabf23 (127.16.126.2:44879), abf20d53faa04ffd9e2aec95f13abb8d (127.16.126.3:36749)
I20251023 07:59:57.030251 21342 raft_consensus.cc:3060] T a9ac30e967a44ca38d29e93d1cca6fb7 P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:57.048280 21416 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3db5b343d92742c9a0fea1cfc7cc457e" candidate_uuid: "462a37ed579b46e78a75add632eabf23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" is_pre_election: true
I20251023 07:59:57.048944 21416 raft_consensus.cc:2468] T 3db5b343d92742c9a0fea1cfc7cc457e P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 462a37ed579b46e78a75add632eabf23 in term 0.
I20251023 07:59:57.042433 21502 raft_consensus.cc:493] T 927d27447e7e463c836f015eb15cc307 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:57.049976 21502 raft_consensus.cc:515] T 927d27447e7e463c836f015eb15cc307 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:57.052225 21416 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a9ac30e967a44ca38d29e93d1cca6fb7" candidate_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf20d53faa04ffd9e2aec95f13abb8d"
I20251023 07:59:57.052862 21416 raft_consensus.cc:3060] T a9ac30e967a44ca38d29e93d1cca6fb7 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:57.054811 21415 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "927d27447e7e463c836f015eb15cc307" candidate_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" is_pre_election: true
I20251023 07:59:57.055315 21502 leader_election.cc:290] T 927d27447e7e463c836f015eb15cc307 P 189a9eeaf7ef4038aecadfbb80cf8c7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 462a37ed579b46e78a75add632eabf23 (127.16.126.2:44879), abf20d53faa04ffd9e2aec95f13abb8d (127.16.126.3:36749)
I20251023 07:59:57.055483 21415 raft_consensus.cc:2468] T 927d27447e7e463c836f015eb15cc307 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a9eeaf7ef4038aecadfbb80cf8c7b in term 0.
I20251023 07:59:57.056443 21457 tablet_bootstrap.cc:654] T 40eac800e4b24372ab2d12224be9bee4 P 189a9eeaf7ef4038aecadfbb80cf8c7b: Neither blocks nor log segments found. Creating new log.
I20251023 07:59:57.056329 21499 raft_consensus.cc:515] T 3db5b343d92742c9a0fea1cfc7cc457e P 462a37ed579b46e78a75add632eabf23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:57.016314 21472 raft_consensus.cc:515] T 0f4050c875ff487e89b8a8170c0b9125 P abf20d53faa04ffd9e2aec95f13abb8d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:57.046758 21341 raft_consensus.cc:3060] T 40eac800e4b24372ab2d12224be9bee4 P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:57.015031 21487 raft_consensus.cc:515] T 7341661a4a144d58a6f2f78391143c89 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:57.059516 21340 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "927d27447e7e463c836f015eb15cc307" candidate_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "462a37ed579b46e78a75add632eabf23" is_pre_election: true
I20251023 07:59:57.061985 21340 raft_consensus.cc:2468] T 927d27447e7e463c836f015eb15cc307 P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a9eeaf7ef4038aecadfbb80cf8c7b in term 0.
I20251023 07:59:57.062666 21487 leader_election.cc:290] T 7341661a4a144d58a6f2f78391143c89 P 189a9eeaf7ef4038aecadfbb80cf8c7b [CANDIDATE]: Term 1 election: Requested vote from peers 462a37ed579b46e78a75add632eabf23 (127.16.126.2:44879), abf20d53faa04ffd9e2aec95f13abb8d (127.16.126.3:36749)
I20251023 07:59:57.063755 21230 leader_election.cc:304] T 927d27447e7e463c836f015eb15cc307 P 189a9eeaf7ef4038aecadfbb80cf8c7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a9eeaf7ef4038aecadfbb80cf8c7b, 462a37ed579b46e78a75add632eabf23; no voters:
I20251023 07:59:57.064884 21267 raft_consensus.cc:2393] T 7341661a4a144d58a6f2f78391143c89 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 462a37ed579b46e78a75add632eabf23 in current term 1: Already voted for candidate 189a9eeaf7ef4038aecadfbb80cf8c7b in this term.
I20251023 07:59:57.059415 21499 leader_election.cc:290] T 3db5b343d92742c9a0fea1cfc7cc457e P 462a37ed579b46e78a75add632eabf23 [CANDIDATE]: Term 1 election: Requested vote from peers 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1:36379), abf20d53faa04ffd9e2aec95f13abb8d (127.16.126.3:36749)
I20251023 07:59:57.066738 21472 leader_election.cc:290] T 0f4050c875ff487e89b8a8170c0b9125 P abf20d53faa04ffd9e2aec95f13abb8d [CANDIDATE]: Term 1 election: Requested vote from peers 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1:36379), 462a37ed579b46e78a75add632eabf23 (127.16.126.2:44879)
I20251023 07:59:57.057294 21466 raft_consensus.cc:515] T 7341661a4a144d58a6f2f78391143c89 P 462a37ed579b46e78a75add632eabf23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:57.067754 21340 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7341661a4a144d58a6f2f78391143c89" candidate_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "462a37ed579b46e78a75add632eabf23"
I20251023 07:59:57.068828 21340 raft_consensus.cc:2393] T 7341661a4a144d58a6f2f78391143c89 P 462a37ed579b46e78a75add632eabf23 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 189a9eeaf7ef4038aecadfbb80cf8c7b in current term 1: Already voted for candidate 462a37ed579b46e78a75add632eabf23 in this term.
I20251023 07:59:57.069061 21466 leader_election.cc:290] T 7341661a4a144d58a6f2f78391143c89 P 462a37ed579b46e78a75add632eabf23 [CANDIDATE]: Term 1 election: Requested vote from peers 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1:36379), abf20d53faa04ffd9e2aec95f13abb8d (127.16.126.3:36749)
W20251023 07:59:57.059484 21379 leader_election.cc:343] T 40eac800e4b24372ab2d12224be9bee4 P abf20d53faa04ffd9e2aec95f13abb8d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1:36379): Illegal state: must be running to vote when last-logged opid is not known
I20251023 07:59:57.071403 21415 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3db5b343d92742c9a0fea1cfc7cc457e" candidate_uuid: "462a37ed579b46e78a75add632eabf23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf20d53faa04ffd9e2aec95f13abb8d"
I20251023 07:59:57.071981 21415 raft_consensus.cc:3060] T 3db5b343d92742c9a0fea1cfc7cc457e P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:57.072347 21340 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0f4050c875ff487e89b8a8170c0b9125" candidate_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "462a37ed579b46e78a75add632eabf23"
I20251023 07:59:57.073134 21340 raft_consensus.cc:3060] T 0f4050c875ff487e89b8a8170c0b9125 P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:57.079150 21487 raft_consensus.cc:2804] T 927d27447e7e463c836f015eb15cc307 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:57.079777 21487 raft_consensus.cc:493] T 927d27447e7e463c836f015eb15cc307 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:57.080214 21487 raft_consensus.cc:3060] T 927d27447e7e463c836f015eb15cc307 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:57.082321 21414 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7341661a4a144d58a6f2f78391143c89" candidate_uuid: "462a37ed579b46e78a75add632eabf23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf20d53faa04ffd9e2aec95f13abb8d"
I20251023 07:59:57.083279 21414 raft_consensus.cc:3060] T 7341661a4a144d58a6f2f78391143c89 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:57.085876 21266 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3db5b343d92742c9a0fea1cfc7cc457e" candidate_uuid: "462a37ed579b46e78a75add632eabf23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b"
I20251023 07:59:57.086549 21266 raft_consensus.cc:3060] T 3db5b343d92742c9a0fea1cfc7cc457e P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:57.087880 21413 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7341661a4a144d58a6f2f78391143c89" candidate_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf20d53faa04ffd9e2aec95f13abb8d"
I20251023 07:59:57.090054 21415 raft_consensus.cc:2468] T 3db5b343d92742c9a0fea1cfc7cc457e P abf20d53faa04ffd9e2aec95f13abb8d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 462a37ed579b46e78a75add632eabf23 in term 1.
I20251023 07:59:57.091305 21308 leader_election.cc:304] T 3db5b343d92742c9a0fea1cfc7cc457e P 462a37ed579b46e78a75add632eabf23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 462a37ed579b46e78a75add632eabf23, abf20d53faa04ffd9e2aec95f13abb8d; no voters:
I20251023 07:59:57.092423 21499 raft_consensus.cc:2804] T 3db5b343d92742c9a0fea1cfc7cc457e P 462a37ed579b46e78a75add632eabf23 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:59:57.092825 21233 leader_election.cc:304] T 7341661a4a144d58a6f2f78391143c89 P 189a9eeaf7ef4038aecadfbb80cf8c7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a9eeaf7ef4038aecadfbb80cf8c7b; no voters: 462a37ed579b46e78a75add632eabf23, abf20d53faa04ffd9e2aec95f13abb8d
I20251023 07:59:57.092857 21265 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7341661a4a144d58a6f2f78391143c89" candidate_uuid: "462a37ed579b46e78a75add632eabf23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b"
I20251023 07:59:57.094151 21265 raft_consensus.cc:2393] T 7341661a4a144d58a6f2f78391143c89 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 462a37ed579b46e78a75add632eabf23 in current term 1: Already voted for candidate 189a9eeaf7ef4038aecadfbb80cf8c7b in this term.
I20251023 07:59:57.094614 21502 raft_consensus.cc:2749] T 7341661a4a144d58a6f2f78391143c89 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20251023 07:59:57.092921 21499 raft_consensus.cc:697] T 3db5b343d92742c9a0fea1cfc7cc457e P 462a37ed579b46e78a75add632eabf23 [term 1 LEADER]: Becoming Leader. State: Replica: 462a37ed579b46e78a75add632eabf23, State: Running, Role: LEADER
I20251023 07:59:57.096140 21499 consensus_queue.cc:237] T 3db5b343d92742c9a0fea1cfc7cc457e P 462a37ed579b46e78a75add632eabf23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:57.096588 21267 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0f4050c875ff487e89b8a8170c0b9125" candidate_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b"
I20251023 07:59:57.097383 21267 raft_consensus.cc:3060] T 0f4050c875ff487e89b8a8170c0b9125 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:57.104708 21266 raft_consensus.cc:2468] T 3db5b343d92742c9a0fea1cfc7cc457e P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 462a37ed579b46e78a75add632eabf23 in term 1.
I20251023 07:59:57.109329 21341 raft_consensus.cc:2468] T 40eac800e4b24372ab2d12224be9bee4 P 462a37ed579b46e78a75add632eabf23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf20d53faa04ffd9e2aec95f13abb8d in term 1.
I20251023 07:59:57.096148 21342 raft_consensus.cc:2468] T a9ac30e967a44ca38d29e93d1cca6fb7 P 462a37ed579b46e78a75add632eabf23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a9eeaf7ef4038aecadfbb80cf8c7b in term 1.
I20251023 07:59:57.111922 21379 leader_election.cc:304] T 40eac800e4b24372ab2d12224be9bee4 P abf20d53faa04ffd9e2aec95f13abb8d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 462a37ed579b46e78a75add632eabf23, abf20d53faa04ffd9e2aec95f13abb8d; no voters: 189a9eeaf7ef4038aecadfbb80cf8c7b
I20251023 07:59:57.112740 21230 leader_election.cc:304] T a9ac30e967a44ca38d29e93d1cca6fb7 P 189a9eeaf7ef4038aecadfbb80cf8c7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a9eeaf7ef4038aecadfbb80cf8c7b, 462a37ed579b46e78a75add632eabf23; no voters:
I20251023 07:59:57.113268 21472 raft_consensus.cc:2804] T 40eac800e4b24372ab2d12224be9bee4 P abf20d53faa04ffd9e2aec95f13abb8d [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:59:57.113827 21472 raft_consensus.cc:697] T 40eac800e4b24372ab2d12224be9bee4 P abf20d53faa04ffd9e2aec95f13abb8d [term 1 LEADER]: Becoming Leader. State: Replica: abf20d53faa04ffd9e2aec95f13abb8d, State: Running, Role: LEADER
I20251023 07:59:57.114614 21472 consensus_queue.cc:237] T 40eac800e4b24372ab2d12224be9bee4 P abf20d53faa04ffd9e2aec95f13abb8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:57.115973 21416 raft_consensus.cc:2468] T a9ac30e967a44ca38d29e93d1cca6fb7 P abf20d53faa04ffd9e2aec95f13abb8d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a9eeaf7ef4038aecadfbb80cf8c7b in term 1.
I20251023 07:59:57.116345 21502 raft_consensus.cc:2804] T a9ac30e967a44ca38d29e93d1cca6fb7 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:59:57.116839 21502 raft_consensus.cc:697] T a9ac30e967a44ca38d29e93d1cca6fb7 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 LEADER]: Becoming Leader. State: Replica: 189a9eeaf7ef4038aecadfbb80cf8c7b, State: Running, Role: LEADER
I20251023 07:59:57.117138 21496 raft_consensus.cc:493] T 30795d2458e943b5923542028d5c85a6 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:57.117674 21502 consensus_queue.cc:237] T a9ac30e967a44ca38d29e93d1cca6fb7 P 189a9eeaf7ef4038aecadfbb80cf8c7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:57.117650 21496 raft_consensus.cc:515] T 30795d2458e943b5923542028d5c85a6 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:57.122363 21496 leader_election.cc:290] T 30795d2458e943b5923542028d5c85a6 P abf20d53faa04ffd9e2aec95f13abb8d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1:36379), 462a37ed579b46e78a75add632eabf23 (127.16.126.2:44879)
I20251023 07:59:57.123899 21342 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "30795d2458e943b5923542028d5c85a6" candidate_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "462a37ed579b46e78a75add632eabf23" is_pre_election: true
I20251023 07:59:57.124639 21342 raft_consensus.cc:2468] T 30795d2458e943b5923542028d5c85a6 P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf20d53faa04ffd9e2aec95f13abb8d in term 0.
I20251023 07:59:57.125926 21379 leader_election.cc:304] T 30795d2458e943b5923542028d5c85a6 P abf20d53faa04ffd9e2aec95f13abb8d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 462a37ed579b46e78a75add632eabf23, abf20d53faa04ffd9e2aec95f13abb8d; no voters:
I20251023 07:59:57.126668 21266 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "30795d2458e943b5923542028d5c85a6" candidate_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" is_pre_election: true
I20251023 07:59:57.127283 21496 raft_consensus.cc:2804] T 30795d2458e943b5923542028d5c85a6 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 07:59:57.127666 21266 raft_consensus.cc:2468] T 30795d2458e943b5923542028d5c85a6 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf20d53faa04ffd9e2aec95f13abb8d in term 0.
I20251023 07:59:57.127907 21496 raft_consensus.cc:493] T 30795d2458e943b5923542028d5c85a6 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 07:59:57.128472 21496 raft_consensus.cc:3060] T 30795d2458e943b5923542028d5c85a6 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:57.129364 21461 consensus_queue.cc:1048] T 0f6a4f63262e476193a5ed5fbb47bcdf P abf20d53faa04ffd9e2aec95f13abb8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:59:57.131942 21414 raft_consensus.cc:2468] T 7341661a4a144d58a6f2f78391143c89 P abf20d53faa04ffd9e2aec95f13abb8d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 462a37ed579b46e78a75add632eabf23 in term 1.
I20251023 07:59:57.133209 21308 leader_election.cc:304] T 7341661a4a144d58a6f2f78391143c89 P 462a37ed579b46e78a75add632eabf23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 462a37ed579b46e78a75add632eabf23, abf20d53faa04ffd9e2aec95f13abb8d; no voters: 189a9eeaf7ef4038aecadfbb80cf8c7b
I20251023 07:59:57.138190 21457 tablet_bootstrap.cc:492] T 40eac800e4b24372ab2d12224be9bee4 P 189a9eeaf7ef4038aecadfbb80cf8c7b: No bootstrap required, opened a new log
I20251023 07:59:57.138728 21457 ts_tablet_manager.cc:1403] T 40eac800e4b24372ab2d12224be9bee4 P 189a9eeaf7ef4038aecadfbb80cf8c7b: Time spent bootstrapping tablet: real 0.094s user 0.045s sys 0.031s
I20251023 07:59:57.141463 21457 raft_consensus.cc:359] T 40eac800e4b24372ab2d12224be9bee4 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:57.141058 21165 catalog_manager.cc:5649] T 3db5b343d92742c9a0fea1cfc7cc457e P 462a37ed579b46e78a75add632eabf23 reported cstate change: term changed from 0 to 1, leader changed from <none> to 462a37ed579b46e78a75add632eabf23 (127.16.126.2). New cstate: current_term: 1 leader_uuid: "462a37ed579b46e78a75add632eabf23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:57.141947 21499 raft_consensus.cc:2804] T 7341661a4a144d58a6f2f78391143c89 P 462a37ed579b46e78a75add632eabf23 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:59:57.142172 21457 raft_consensus.cc:385] T 40eac800e4b24372ab2d12224be9bee4 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 07:59:57.142576 21457 raft_consensus.cc:740] T 40eac800e4b24372ab2d12224be9bee4 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 189a9eeaf7ef4038aecadfbb80cf8c7b, State: Initialized, Role: FOLLOWER
I20251023 07:59:57.142654 21499 raft_consensus.cc:697] T 7341661a4a144d58a6f2f78391143c89 P 462a37ed579b46e78a75add632eabf23 [term 1 LEADER]: Becoming Leader. State: Replica: 462a37ed579b46e78a75add632eabf23, State: Running, Role: LEADER
I20251023 07:59:57.143226 21457 consensus_queue.cc:260] T 40eac800e4b24372ab2d12224be9bee4 P 189a9eeaf7ef4038aecadfbb80cf8c7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:57.143920 21499 consensus_queue.cc:237] T 7341661a4a144d58a6f2f78391143c89 P 462a37ed579b46e78a75add632eabf23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:57.145768 21457 ts_tablet_manager.cc:1434] T 40eac800e4b24372ab2d12224be9bee4 P 189a9eeaf7ef4038aecadfbb80cf8c7b: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20251023 07:59:57.155903 21496 raft_consensus.cc:515] T 30795d2458e943b5923542028d5c85a6 P abf20d53faa04ffd9e2aec95f13abb8d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:57.159726 21265 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "30795d2458e943b5923542028d5c85a6" candidate_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b"
I20251023 07:59:57.160861 21265 raft_consensus.cc:3060] T 30795d2458e943b5923542028d5c85a6 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:57.161098 21342 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "30795d2458e943b5923542028d5c85a6" candidate_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "462a37ed579b46e78a75add632eabf23"
I20251023 07:59:57.161947 21342 raft_consensus.cc:3060] T 30795d2458e943b5923542028d5c85a6 P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:57.165683 21472 raft_consensus.cc:493] T 07bbde512054431eb0f36c0fc3ce25cf P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:57.166240 21472 raft_consensus.cc:515] T 07bbde512054431eb0f36c0fc3ce25cf P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } }
I20251023 07:59:57.168390 21472 leader_election.cc:290] T 07bbde512054431eb0f36c0fc3ce25cf P abf20d53faa04ffd9e2aec95f13abb8d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 462a37ed579b46e78a75add632eabf23 (127.16.126.2:44879), 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1:36379)
I20251023 07:59:57.169703 21341 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "07bbde512054431eb0f36c0fc3ce25cf" candidate_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "462a37ed579b46e78a75add632eabf23" is_pre_election: true
I20251023 07:59:57.170562 21341 raft_consensus.cc:2393] T 07bbde512054431eb0f36c0fc3ce25cf P 462a37ed579b46e78a75add632eabf23 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf20d53faa04ffd9e2aec95f13abb8d in current term 1: Already voted for candidate 189a9eeaf7ef4038aecadfbb80cf8c7b in this term.
I20251023 07:59:57.170373 21164 catalog_manager.cc:5649] T 40eac800e4b24372ab2d12224be9bee4 P abf20d53faa04ffd9e2aec95f13abb8d reported cstate change: term changed from 0 to 1, leader changed from <none> to abf20d53faa04ffd9e2aec95f13abb8d (127.16.126.3). New cstate: current_term: 1 leader_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } health_report { overall_health: HEALTHY } } }
I20251023 07:59:57.172694 21342 raft_consensus.cc:2468] T 30795d2458e943b5923542028d5c85a6 P 462a37ed579b46e78a75add632eabf23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf20d53faa04ffd9e2aec95f13abb8d in term 1.
I20251023 07:59:57.173847 21264 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "07bbde512054431eb0f36c0fc3ce25cf" candidate_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" is_pre_election: true
I20251023 07:59:57.173940 21379 leader_election.cc:304] T 30795d2458e943b5923542028d5c85a6 P abf20d53faa04ffd9e2aec95f13abb8d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 462a37ed579b46e78a75add632eabf23, abf20d53faa04ffd9e2aec95f13abb8d; no voters:
I20251023 07:59:57.174502 21267 raft_consensus.cc:2468] T 0f4050c875ff487e89b8a8170c0b9125 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf20d53faa04ffd9e2aec95f13abb8d in term 1.
I20251023 07:59:57.174970 21472 raft_consensus.cc:2804] T 30795d2458e943b5923542028d5c85a6 P abf20d53faa04ffd9e2aec95f13abb8d [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:59:57.175691 21472 raft_consensus.cc:697] T 30795d2458e943b5923542028d5c85a6 P abf20d53faa04ffd9e2aec95f13abb8d [term 1 LEADER]: Becoming Leader. State: Replica: abf20d53faa04ffd9e2aec95f13abb8d, State: Running, Role: LEADER
I20251023 07:59:57.175972 21379 leader_election.cc:304] T 07bbde512054431eb0f36c0fc3ce25cf P abf20d53faa04ffd9e2aec95f13abb8d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf20d53faa04ffd9e2aec95f13abb8d; no voters: 189a9eeaf7ef4038aecadfbb80cf8c7b, 462a37ed579b46e78a75add632eabf23
I20251023 07:59:57.176173 21487 raft_consensus.cc:515] T 927d27447e7e463c836f015eb15cc307 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:57.176855 21461 raft_consensus.cc:3060] T 07bbde512054431eb0f36c0fc3ce25cf P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:57.178491 21487 leader_election.cc:290] T 927d27447e7e463c836f015eb15cc307 P 189a9eeaf7ef4038aecadfbb80cf8c7b [CANDIDATE]: Term 1 election: Requested vote from peers 462a37ed579b46e78a75add632eabf23 (127.16.126.2:44879), abf20d53faa04ffd9e2aec95f13abb8d (127.16.126.3:36749)
I20251023 07:59:57.180362 21340 raft_consensus.cc:2468] T 0f4050c875ff487e89b8a8170c0b9125 P 462a37ed579b46e78a75add632eabf23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf20d53faa04ffd9e2aec95f13abb8d in term 1.
I20251023 07:59:57.182250 21341 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "927d27447e7e463c836f015eb15cc307" candidate_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "462a37ed579b46e78a75add632eabf23"
I20251023 07:59:57.181895 21472 consensus_queue.cc:237] T 30795d2458e943b5923542028d5c85a6 P abf20d53faa04ffd9e2aec95f13abb8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:57.182904 21341 raft_consensus.cc:3060] T 927d27447e7e463c836f015eb15cc307 P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:57.185330 21496 leader_election.cc:290] T 30795d2458e943b5923542028d5c85a6 P abf20d53faa04ffd9e2aec95f13abb8d [CANDIDATE]: Term 1 election: Requested vote from peers 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1:36379), 462a37ed579b46e78a75add632eabf23 (127.16.126.2:44879)
I20251023 07:59:57.185875 21461 raft_consensus.cc:2749] T 07bbde512054431eb0f36c0fc3ce25cf P abf20d53faa04ffd9e2aec95f13abb8d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:59:57.187835 21414 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "927d27447e7e463c836f015eb15cc307" candidate_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf20d53faa04ffd9e2aec95f13abb8d"
I20251023 07:59:57.188464 21414 raft_consensus.cc:3060] T 927d27447e7e463c836f015eb15cc307 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:57.189625 21379 leader_election.cc:304] T 0f4050c875ff487e89b8a8170c0b9125 P abf20d53faa04ffd9e2aec95f13abb8d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a9eeaf7ef4038aecadfbb80cf8c7b, abf20d53faa04ffd9e2aec95f13abb8d; no voters:
I20251023 07:59:57.190690 21461 raft_consensus.cc:2804] T 0f4050c875ff487e89b8a8170c0b9125 P abf20d53faa04ffd9e2aec95f13abb8d [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:59:57.191156 21461 raft_consensus.cc:697] T 0f4050c875ff487e89b8a8170c0b9125 P abf20d53faa04ffd9e2aec95f13abb8d [term 1 LEADER]: Becoming Leader. State: Replica: abf20d53faa04ffd9e2aec95f13abb8d, State: Running, Role: LEADER
I20251023 07:59:57.191756 21341 raft_consensus.cc:2468] T 927d27447e7e463c836f015eb15cc307 P 462a37ed579b46e78a75add632eabf23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a9eeaf7ef4038aecadfbb80cf8c7b in term 1.
I20251023 07:59:57.194597 21265 raft_consensus.cc:2468] T 30795d2458e943b5923542028d5c85a6 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf20d53faa04ffd9e2aec95f13abb8d in term 1.
I20251023 07:59:57.197610 21414 raft_consensus.cc:2468] T 927d27447e7e463c836f015eb15cc307 P abf20d53faa04ffd9e2aec95f13abb8d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a9eeaf7ef4038aecadfbb80cf8c7b in term 1.
I20251023 07:59:57.193251 21230 leader_election.cc:304] T 927d27447e7e463c836f015eb15cc307 P 189a9eeaf7ef4038aecadfbb80cf8c7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a9eeaf7ef4038aecadfbb80cf8c7b, 462a37ed579b46e78a75add632eabf23; no voters:
I20251023 07:59:57.192035 21461 consensus_queue.cc:237] T 0f4050c875ff487e89b8a8170c0b9125 P abf20d53faa04ffd9e2aec95f13abb8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:57.203342 21163 catalog_manager.cc:5649] T 7341661a4a144d58a6f2f78391143c89 P 462a37ed579b46e78a75add632eabf23 reported cstate change: term changed from 0 to 1, leader changed from <none> to 462a37ed579b46e78a75add632eabf23 (127.16.126.2). New cstate: current_term: 1 leader_uuid: "462a37ed579b46e78a75add632eabf23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:57.208808 21502 raft_consensus.cc:2804] T 927d27447e7e463c836f015eb15cc307 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 FOLLOWER]: Leader election won for term 1
I20251023 07:59:57.209834 21502 raft_consensus.cc:697] T 927d27447e7e463c836f015eb15cc307 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 LEADER]: Becoming Leader. State: Replica: 189a9eeaf7ef4038aecadfbb80cf8c7b, State: Running, Role: LEADER
I20251023 07:59:57.210980 21472 consensus_queue.cc:1048] T 0f6a4f63262e476193a5ed5fbb47bcdf P abf20d53faa04ffd9e2aec95f13abb8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:59:57.202163 21164 catalog_manager.cc:5649] T a9ac30e967a44ca38d29e93d1cca6fb7 P 189a9eeaf7ef4038aecadfbb80cf8c7b reported cstate change: term changed from 0 to 1, leader changed from <none> to 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1). New cstate: current_term: 1 leader_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:57.211194 21502 consensus_queue.cc:237] T 927d27447e7e463c836f015eb15cc307 P 189a9eeaf7ef4038aecadfbb80cf8c7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:57.221710 21165 catalog_manager.cc:5649] T 30795d2458e943b5923542028d5c85a6 P abf20d53faa04ffd9e2aec95f13abb8d reported cstate change: term changed from 0 to 1, leader changed from <none> to abf20d53faa04ffd9e2aec95f13abb8d (127.16.126.3). New cstate: current_term: 1 leader_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } health_report { overall_health: HEALTHY } } }
I20251023 07:59:57.225374 21165 catalog_manager.cc:5649] T 0f4050c875ff487e89b8a8170c0b9125 P abf20d53faa04ffd9e2aec95f13abb8d reported cstate change: term changed from 0 to 1, leader changed from <none> to abf20d53faa04ffd9e2aec95f13abb8d (127.16.126.3). New cstate: current_term: 1 leader_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } health_report { overall_health: HEALTHY } } }
I20251023 07:59:57.233492 21164 catalog_manager.cc:5649] T 927d27447e7e463c836f015eb15cc307 P 189a9eeaf7ef4038aecadfbb80cf8c7b reported cstate change: term changed from 0 to 1, leader changed from <none> to 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1). New cstate: current_term: 1 leader_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:57.247481 21502 consensus_queue.cc:1048] T 07bbde512054431eb0f36c0fc3ce25cf P 189a9eeaf7ef4038aecadfbb80cf8c7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:59:57.261888 21501 consensus_queue.cc:1048] T 07bbde512054431eb0f36c0fc3ce25cf P 189a9eeaf7ef4038aecadfbb80cf8c7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:59:57.282107 21414 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "30795d2458e943b5923542028d5c85a6"
dest_uuid: "abf20d53faa04ffd9e2aec95f13abb8d"
mode: GRACEFUL
new_leader_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b"
from {username='slave'} at 127.0.0.1:56814
I20251023 07:59:57.282917 21414 raft_consensus.cc:606] T 30795d2458e943b5923542028d5c85a6 P abf20d53faa04ffd9e2aec95f13abb8d [term 1 LEADER]: Received request to transfer leadership to TS 189a9eeaf7ef4038aecadfbb80cf8c7b
I20251023 07:59:57.287675 21414 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "0f6a4f63262e476193a5ed5fbb47bcdf"
dest_uuid: "abf20d53faa04ffd9e2aec95f13abb8d"
mode: GRACEFUL
new_leader_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b"
from {username='slave'} at 127.0.0.1:56814
I20251023 07:59:57.288123 21414 raft_consensus.cc:606] T 0f6a4f63262e476193a5ed5fbb47bcdf P abf20d53faa04ffd9e2aec95f13abb8d [term 1 LEADER]: Received request to transfer leadership to TS 189a9eeaf7ef4038aecadfbb80cf8c7b
I20251023 07:59:57.292622 21414 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "0f4050c875ff487e89b8a8170c0b9125"
dest_uuid: "abf20d53faa04ffd9e2aec95f13abb8d"
mode: GRACEFUL
new_leader_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b"
from {username='slave'} at 127.0.0.1:56814
I20251023 07:59:57.293080 21414 raft_consensus.cc:606] T 0f4050c875ff487e89b8a8170c0b9125 P abf20d53faa04ffd9e2aec95f13abb8d [term 1 LEADER]: Received request to transfer leadership to TS 189a9eeaf7ef4038aecadfbb80cf8c7b
I20251023 07:59:57.306277 21265 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "927d27447e7e463c836f015eb15cc307"
dest_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b"
mode: GRACEFUL
new_leader_uuid: "462a37ed579b46e78a75add632eabf23"
from {username='slave'} at 127.0.0.1:34202
I20251023 07:59:57.306789 21265 raft_consensus.cc:606] T 927d27447e7e463c836f015eb15cc307 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 LEADER]: Received request to transfer leadership to TS 462a37ed579b46e78a75add632eabf23
I20251023 07:59:57.309257 21501 raft_consensus.cc:493] T 40eac800e4b24372ab2d12224be9bee4 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 07:59:57.309773 21501 raft_consensus.cc:515] T 40eac800e4b24372ab2d12224be9bee4 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:57.311548 21501 leader_election.cc:290] T 40eac800e4b24372ab2d12224be9bee4 P 189a9eeaf7ef4038aecadfbb80cf8c7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 462a37ed579b46e78a75add632eabf23 (127.16.126.2:44879), abf20d53faa04ffd9e2aec95f13abb8d (127.16.126.3:36749)
I20251023 07:59:57.312139 21341 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "40eac800e4b24372ab2d12224be9bee4" candidate_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "462a37ed579b46e78a75add632eabf23" is_pre_election: true
I20251023 07:59:57.312638 21265 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "a9ac30e967a44ca38d29e93d1cca6fb7"
dest_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b"
mode: GRACEFUL
new_leader_uuid: "462a37ed579b46e78a75add632eabf23"
from {username='slave'} at 127.0.0.1:34202
I20251023 07:59:57.312929 21341 raft_consensus.cc:2393] T 40eac800e4b24372ab2d12224be9bee4 P 462a37ed579b46e78a75add632eabf23 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 189a9eeaf7ef4038aecadfbb80cf8c7b in current term 1: Already voted for candidate abf20d53faa04ffd9e2aec95f13abb8d in this term.
I20251023 07:59:57.312862 21414 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "40eac800e4b24372ab2d12224be9bee4" candidate_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" is_pre_election: true
I20251023 07:59:57.313309 21265 raft_consensus.cc:606] T a9ac30e967a44ca38d29e93d1cca6fb7 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 LEADER]: Received request to transfer leadership to TS 462a37ed579b46e78a75add632eabf23
I20251023 07:59:57.314550 21233 leader_election.cc:304] T 40eac800e4b24372ab2d12224be9bee4 P 189a9eeaf7ef4038aecadfbb80cf8c7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a9eeaf7ef4038aecadfbb80cf8c7b; no voters: 462a37ed579b46e78a75add632eabf23, abf20d53faa04ffd9e2aec95f13abb8d
I20251023 07:59:57.315564 21501 raft_consensus.cc:3060] T 40eac800e4b24372ab2d12224be9bee4 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Advancing to term 1
I20251023 07:59:57.321832 21501 raft_consensus.cc:2749] T 40eac800e4b24372ab2d12224be9bee4 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 07:59:57.321676 21414 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "40eac800e4b24372ab2d12224be9bee4"
dest_uuid: "abf20d53faa04ffd9e2aec95f13abb8d"
mode: GRACEFUL
new_leader_uuid: "462a37ed579b46e78a75add632eabf23"
from {username='slave'} at 127.0.0.1:56814
I20251023 07:59:57.322515 21414 raft_consensus.cc:606] T 40eac800e4b24372ab2d12224be9bee4 P abf20d53faa04ffd9e2aec95f13abb8d [term 1 LEADER]: Received request to transfer leadership to TS 462a37ed579b46e78a75add632eabf23
I20251023 07:59:57.334583 21341 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "3db5b343d92742c9a0fea1cfc7cc457e"
dest_uuid: "462a37ed579b46e78a75add632eabf23"
mode: GRACEFUL
new_leader_uuid: "abf20d53faa04ffd9e2aec95f13abb8d"
from {username='slave'} at 127.0.0.1:38566
I20251023 07:59:57.335071 21341 raft_consensus.cc:606] T 3db5b343d92742c9a0fea1cfc7cc457e P 462a37ed579b46e78a75add632eabf23 [term 1 LEADER]: Received request to transfer leadership to TS abf20d53faa04ffd9e2aec95f13abb8d
I20251023 07:59:57.533028 21499 consensus_queue.cc:1048] T 3db5b343d92742c9a0fea1cfc7cc457e P 462a37ed579b46e78a75add632eabf23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:59:57.539288 21466 raft_consensus.cc:993] T 3db5b343d92742c9a0fea1cfc7cc457e P 462a37ed579b46e78a75add632eabf23: : Instructing follower abf20d53faa04ffd9e2aec95f13abb8d to start an election
I20251023 07:59:57.539920 21500 raft_consensus.cc:1081] T 3db5b343d92742c9a0fea1cfc7cc457e P 462a37ed579b46e78a75add632eabf23 [term 1 LEADER]: Signalling peer abf20d53faa04ffd9e2aec95f13abb8d to start an election
I20251023 07:59:57.541764 21416 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "3db5b343d92742c9a0fea1cfc7cc457e"
dest_uuid: "abf20d53faa04ffd9e2aec95f13abb8d"
from {username='slave'} at 127.0.0.1:56790
I20251023 07:59:57.543027 21416 raft_consensus.cc:493] T 3db5b343d92742c9a0fea1cfc7cc457e P abf20d53faa04ffd9e2aec95f13abb8d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:59:57.543442 21416 raft_consensus.cc:3060] T 3db5b343d92742c9a0fea1cfc7cc457e P abf20d53faa04ffd9e2aec95f13abb8d [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:57.546644 21499 consensus_queue.cc:1048] T 3db5b343d92742c9a0fea1cfc7cc457e P 462a37ed579b46e78a75add632eabf23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:59:57.551715 21416 raft_consensus.cc:515] T 3db5b343d92742c9a0fea1cfc7cc457e P abf20d53faa04ffd9e2aec95f13abb8d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:57.553908 21416 leader_election.cc:290] T 3db5b343d92742c9a0fea1cfc7cc457e P abf20d53faa04ffd9e2aec95f13abb8d [CANDIDATE]: Term 2 election: Requested vote from peers 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1:36379), 462a37ed579b46e78a75add632eabf23 (127.16.126.2:44879)
I20251023 07:59:57.554633 21267 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3db5b343d92742c9a0fea1cfc7cc457e" candidate_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b"
I20251023 07:59:57.555285 21267 raft_consensus.cc:3060] T 3db5b343d92742c9a0fea1cfc7cc457e P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:57.557838 21341 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3db5b343d92742c9a0fea1cfc7cc457e" candidate_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "462a37ed579b46e78a75add632eabf23"
I20251023 07:59:57.558533 21341 raft_consensus.cc:3055] T 3db5b343d92742c9a0fea1cfc7cc457e P 462a37ed579b46e78a75add632eabf23 [term 1 LEADER]: Stepping down as leader of term 1
I20251023 07:59:57.558868 21341 raft_consensus.cc:740] T 3db5b343d92742c9a0fea1cfc7cc457e P 462a37ed579b46e78a75add632eabf23 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 462a37ed579b46e78a75add632eabf23, State: Running, Role: LEADER
I20251023 07:59:57.559511 21341 consensus_queue.cc:260] T 3db5b343d92742c9a0fea1cfc7cc457e P 462a37ed579b46e78a75add632eabf23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:57.560345 21341 raft_consensus.cc:3060] T 3db5b343d92742c9a0fea1cfc7cc457e P 462a37ed579b46e78a75add632eabf23 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:57.560781 21267 raft_consensus.cc:2468] T 3db5b343d92742c9a0fea1cfc7cc457e P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf20d53faa04ffd9e2aec95f13abb8d in term 2.
I20251023 07:59:57.562047 21379 leader_election.cc:304] T 3db5b343d92742c9a0fea1cfc7cc457e P abf20d53faa04ffd9e2aec95f13abb8d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a9eeaf7ef4038aecadfbb80cf8c7b, abf20d53faa04ffd9e2aec95f13abb8d; no voters:
I20251023 07:59:57.562898 21472 raft_consensus.cc:2804] T 3db5b343d92742c9a0fea1cfc7cc457e P abf20d53faa04ffd9e2aec95f13abb8d [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:59:57.563412 21472 raft_consensus.cc:697] T 3db5b343d92742c9a0fea1cfc7cc457e P abf20d53faa04ffd9e2aec95f13abb8d [term 2 LEADER]: Becoming Leader. State: Replica: abf20d53faa04ffd9e2aec95f13abb8d, State: Running, Role: LEADER
I20251023 07:59:57.564200 21472 consensus_queue.cc:237] T 3db5b343d92742c9a0fea1cfc7cc457e P abf20d53faa04ffd9e2aec95f13abb8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:57.570118 21341 raft_consensus.cc:2468] T 3db5b343d92742c9a0fea1cfc7cc457e P 462a37ed579b46e78a75add632eabf23 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf20d53faa04ffd9e2aec95f13abb8d in term 2.
I20251023 07:59:57.571391 21163 catalog_manager.cc:5649] T 3db5b343d92742c9a0fea1cfc7cc457e P abf20d53faa04ffd9e2aec95f13abb8d reported cstate change: term changed from 1 to 2, leader changed from 462a37ed579b46e78a75add632eabf23 (127.16.126.2) to abf20d53faa04ffd9e2aec95f13abb8d (127.16.126.3). New cstate: current_term: 2 leader_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } health_report { overall_health: HEALTHY } } }
I20251023 07:59:57.580824 21472 consensus_queue.cc:1048] T 40eac800e4b24372ab2d12224be9bee4 P abf20d53faa04ffd9e2aec95f13abb8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:59:57.589144 21461 consensus_queue.cc:1048] T 30795d2458e943b5923542028d5c85a6 P abf20d53faa04ffd9e2aec95f13abb8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:59:57.592792 21472 consensus_queue.cc:1048] T 40eac800e4b24372ab2d12224be9bee4 P abf20d53faa04ffd9e2aec95f13abb8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:59:57.598464 21496 raft_consensus.cc:993] T 30795d2458e943b5923542028d5c85a6 P abf20d53faa04ffd9e2aec95f13abb8d: : Instructing follower 189a9eeaf7ef4038aecadfbb80cf8c7b to start an election
I20251023 07:59:57.598984 21496 raft_consensus.cc:1081] T 30795d2458e943b5923542028d5c85a6 P abf20d53faa04ffd9e2aec95f13abb8d [term 1 LEADER]: Signalling peer 189a9eeaf7ef4038aecadfbb80cf8c7b to start an election
I20251023 07:59:57.601764 21466 consensus_queue.cc:1048] T 7341661a4a144d58a6f2f78391143c89 P 462a37ed579b46e78a75add632eabf23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:59:57.609580 21265 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "30795d2458e943b5923542028d5c85a6"
dest_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b"
from {username='slave'} at 127.0.0.1:34182
I20251023 07:59:57.610165 21265 raft_consensus.cc:493] T 30795d2458e943b5923542028d5c85a6 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:59:57.610579 21265 raft_consensus.cc:3060] T 30795d2458e943b5923542028d5c85a6 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:57.615998 21510 consensus_queue.cc:1048] T 30795d2458e943b5923542028d5c85a6 P abf20d53faa04ffd9e2aec95f13abb8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:59:57.617772 21510 consensus_queue.cc:1048] T 0f4050c875ff487e89b8a8170c0b9125 P abf20d53faa04ffd9e2aec95f13abb8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:59:57.618534 21265 raft_consensus.cc:515] T 30795d2458e943b5923542028d5c85a6 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:57.619024 21510 raft_consensus.cc:993] T 40eac800e4b24372ab2d12224be9bee4 P abf20d53faa04ffd9e2aec95f13abb8d: : Instructing follower 462a37ed579b46e78a75add632eabf23 to start an election
I20251023 07:59:57.619500 21510 raft_consensus.cc:1081] T 40eac800e4b24372ab2d12224be9bee4 P abf20d53faa04ffd9e2aec95f13abb8d [term 1 LEADER]: Signalling peer 462a37ed579b46e78a75add632eabf23 to start an election
I20251023 07:59:57.620505 21501 consensus_queue.cc:1048] T 927d27447e7e463c836f015eb15cc307 P 189a9eeaf7ef4038aecadfbb80cf8c7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:59:57.621073 21265 leader_election.cc:290] T 30795d2458e943b5923542028d5c85a6 P 189a9eeaf7ef4038aecadfbb80cf8c7b [CANDIDATE]: Term 2 election: Requested vote from peers 462a37ed579b46e78a75add632eabf23 (127.16.126.2:44879), abf20d53faa04ffd9e2aec95f13abb8d (127.16.126.3:36749)
I20251023 07:59:57.621730 21341 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "30795d2458e943b5923542028d5c85a6" candidate_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "462a37ed579b46e78a75add632eabf23"
I20251023 07:59:57.622175 21416 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "30795d2458e943b5923542028d5c85a6" candidate_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "abf20d53faa04ffd9e2aec95f13abb8d"
I20251023 07:59:57.622277 21341 raft_consensus.cc:3060] T 30795d2458e943b5923542028d5c85a6 P 462a37ed579b46e78a75add632eabf23 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:57.622725 21416 raft_consensus.cc:3055] T 30795d2458e943b5923542028d5c85a6 P abf20d53faa04ffd9e2aec95f13abb8d [term 1 LEADER]: Stepping down as leader of term 1
I20251023 07:59:57.623092 21416 raft_consensus.cc:740] T 30795d2458e943b5923542028d5c85a6 P abf20d53faa04ffd9e2aec95f13abb8d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: abf20d53faa04ffd9e2aec95f13abb8d, State: Running, Role: LEADER
I20251023 07:59:57.623942 21416 consensus_queue.cc:260] T 30795d2458e943b5923542028d5c85a6 P abf20d53faa04ffd9e2aec95f13abb8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:57.624843 21416 raft_consensus.cc:3060] T 30795d2458e943b5923542028d5c85a6 P abf20d53faa04ffd9e2aec95f13abb8d [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:57.627264 21340 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "40eac800e4b24372ab2d12224be9bee4"
dest_uuid: "462a37ed579b46e78a75add632eabf23"
from {username='slave'} at 127.0.0.1:38548
I20251023 07:59:57.627938 21340 raft_consensus.cc:493] T 40eac800e4b24372ab2d12224be9bee4 P 462a37ed579b46e78a75add632eabf23 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:59:57.628319 21340 raft_consensus.cc:3060] T 40eac800e4b24372ab2d12224be9bee4 P 462a37ed579b46e78a75add632eabf23 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:57.637322 21500 consensus_queue.cc:1048] T 7341661a4a144d58a6f2f78391143c89 P 462a37ed579b46e78a75add632eabf23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:59:57.639415 21463 consensus_queue.cc:1048] T 927d27447e7e463c836f015eb15cc307 P 189a9eeaf7ef4038aecadfbb80cf8c7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:59:57.652130 21340 raft_consensus.cc:515] T 40eac800e4b24372ab2d12224be9bee4 P 462a37ed579b46e78a75add632eabf23 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:57.660274 21340 leader_election.cc:290] T 40eac800e4b24372ab2d12224be9bee4 P 462a37ed579b46e78a75add632eabf23 [CANDIDATE]: Term 2 election: Requested vote from peers 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1:36379), abf20d53faa04ffd9e2aec95f13abb8d (127.16.126.3:36749)
I20251023 07:59:57.661696 21413 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "40eac800e4b24372ab2d12224be9bee4" candidate_uuid: "462a37ed579b46e78a75add632eabf23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "abf20d53faa04ffd9e2aec95f13abb8d"
I20251023 07:59:57.662348 21265 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "40eac800e4b24372ab2d12224be9bee4" candidate_uuid: "462a37ed579b46e78a75add632eabf23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b"
I20251023 07:59:57.663053 21265 raft_consensus.cc:3060] T 40eac800e4b24372ab2d12224be9bee4 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:57.665068 21416 raft_consensus.cc:2468] T 30795d2458e943b5923542028d5c85a6 P abf20d53faa04ffd9e2aec95f13abb8d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a9eeaf7ef4038aecadfbb80cf8c7b in term 2.
I20251023 07:59:57.662393 21413 raft_consensus.cc:3055] T 40eac800e4b24372ab2d12224be9bee4 P abf20d53faa04ffd9e2aec95f13abb8d [term 1 LEADER]: Stepping down as leader of term 1
I20251023 07:59:57.666702 21233 leader_election.cc:304] T 30795d2458e943b5923542028d5c85a6 P 189a9eeaf7ef4038aecadfbb80cf8c7b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a9eeaf7ef4038aecadfbb80cf8c7b, abf20d53faa04ffd9e2aec95f13abb8d; no voters:
I20251023 07:59:57.667155 21413 raft_consensus.cc:740] T 40eac800e4b24372ab2d12224be9bee4 P abf20d53faa04ffd9e2aec95f13abb8d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: abf20d53faa04ffd9e2aec95f13abb8d, State: Running, Role: LEADER
I20251023 07:59:57.667651 21463 raft_consensus.cc:2804] T 30795d2458e943b5923542028d5c85a6 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:59:57.658396 21341 raft_consensus.cc:2468] T 30795d2458e943b5923542028d5c85a6 P 462a37ed579b46e78a75add632eabf23 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a9eeaf7ef4038aecadfbb80cf8c7b in term 2.
I20251023 07:59:57.668140 21463 raft_consensus.cc:697] T 30795d2458e943b5923542028d5c85a6 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 2 LEADER]: Becoming Leader. State: Replica: 189a9eeaf7ef4038aecadfbb80cf8c7b, State: Running, Role: LEADER
I20251023 07:59:57.667932 21413 consensus_queue.cc:260] T 40eac800e4b24372ab2d12224be9bee4 P abf20d53faa04ffd9e2aec95f13abb8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:57.668561 21342 raft_consensus.cc:1240] T 30795d2458e943b5923542028d5c85a6 P 462a37ed579b46e78a75add632eabf23 [term 2 FOLLOWER]: Rejecting Update request from peer abf20d53faa04ffd9e2aec95f13abb8d for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20251023 07:59:57.669294 21413 raft_consensus.cc:3060] T 40eac800e4b24372ab2d12224be9bee4 P abf20d53faa04ffd9e2aec95f13abb8d [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:57.669009 21463 consensus_queue.cc:237] T 30795d2458e943b5923542028d5c85a6 P 189a9eeaf7ef4038aecadfbb80cf8c7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:57.679590 21472 consensus_queue.cc:1048] T 0f4050c875ff487e89b8a8170c0b9125 P abf20d53faa04ffd9e2aec95f13abb8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 07:59:57.680831 21487 consensus_queue.cc:1048] T a9ac30e967a44ca38d29e93d1cca6fb7 P 189a9eeaf7ef4038aecadfbb80cf8c7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:59:57.680581 21413 raft_consensus.cc:2468] T 40eac800e4b24372ab2d12224be9bee4 P abf20d53faa04ffd9e2aec95f13abb8d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 462a37ed579b46e78a75add632eabf23 in term 2.
I20251023 07:59:57.685331 21308 leader_election.cc:304] T 40eac800e4b24372ab2d12224be9bee4 P 462a37ed579b46e78a75add632eabf23 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 462a37ed579b46e78a75add632eabf23, abf20d53faa04ffd9e2aec95f13abb8d; no voters:
I20251023 07:59:57.686578 21500 raft_consensus.cc:2804] T 40eac800e4b24372ab2d12224be9bee4 P 462a37ed579b46e78a75add632eabf23 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:59:57.687094 21500 raft_consensus.cc:697] T 40eac800e4b24372ab2d12224be9bee4 P 462a37ed579b46e78a75add632eabf23 [term 2 LEADER]: Becoming Leader. State: Replica: 462a37ed579b46e78a75add632eabf23, State: Running, Role: LEADER
I20251023 07:59:57.688024 21500 consensus_queue.cc:237] T 40eac800e4b24372ab2d12224be9bee4 P 462a37ed579b46e78a75add632eabf23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:57.686714 21265 raft_consensus.cc:2468] T 40eac800e4b24372ab2d12224be9bee4 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 462a37ed579b46e78a75add632eabf23 in term 2.
I20251023 07:59:57.691746 21461 raft_consensus.cc:993] T 0f4050c875ff487e89b8a8170c0b9125 P abf20d53faa04ffd9e2aec95f13abb8d: : Instructing follower 189a9eeaf7ef4038aecadfbb80cf8c7b to start an election
I20251023 07:59:57.692253 21461 raft_consensus.cc:1081] T 0f4050c875ff487e89b8a8170c0b9125 P abf20d53faa04ffd9e2aec95f13abb8d [term 1 LEADER]: Signalling peer 189a9eeaf7ef4038aecadfbb80cf8c7b to start an election
I20251023 07:59:57.694496 21266 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "0f4050c875ff487e89b8a8170c0b9125"
dest_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b"
from {username='slave'} at 127.0.0.1:34182
I20251023 07:59:57.695986 21266 raft_consensus.cc:493] T 0f4050c875ff487e89b8a8170c0b9125 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:59:57.696811 21266 raft_consensus.cc:3060] T 0f4050c875ff487e89b8a8170c0b9125 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:57.698298 21487 raft_consensus.cc:993] T 927d27447e7e463c836f015eb15cc307 P 189a9eeaf7ef4038aecadfbb80cf8c7b: : Instructing follower 462a37ed579b46e78a75add632eabf23 to start an election
I20251023 07:59:57.698786 21487 raft_consensus.cc:1081] T 927d27447e7e463c836f015eb15cc307 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 LEADER]: Signalling peer 462a37ed579b46e78a75add632eabf23 to start an election
I20251023 07:59:57.699548 21487 raft_consensus.cc:993] T a9ac30e967a44ca38d29e93d1cca6fb7 P 189a9eeaf7ef4038aecadfbb80cf8c7b: : Instructing follower 462a37ed579b46e78a75add632eabf23 to start an election
I20251023 07:59:57.700150 21463 raft_consensus.cc:1081] T a9ac30e967a44ca38d29e93d1cca6fb7 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 LEADER]: Signalling peer 462a37ed579b46e78a75add632eabf23 to start an election
I20251023 07:59:57.703990 21338 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "a9ac30e967a44ca38d29e93d1cca6fb7"
dest_uuid: "462a37ed579b46e78a75add632eabf23"
from {username='slave'} at 127.0.0.1:38550
I20251023 07:59:57.704797 21338 raft_consensus.cc:493] T a9ac30e967a44ca38d29e93d1cca6fb7 P 462a37ed579b46e78a75add632eabf23 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:59:57.705281 21338 raft_consensus.cc:3060] T a9ac30e967a44ca38d29e93d1cca6fb7 P 462a37ed579b46e78a75add632eabf23 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:57.710582 21502 consensus_queue.cc:1048] T a9ac30e967a44ca38d29e93d1cca6fb7 P 189a9eeaf7ef4038aecadfbb80cf8c7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:59:57.719791 21338 raft_consensus.cc:515] T a9ac30e967a44ca38d29e93d1cca6fb7 P 462a37ed579b46e78a75add632eabf23 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:57.720854 21340 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "927d27447e7e463c836f015eb15cc307"
dest_uuid: "462a37ed579b46e78a75add632eabf23"
from {username='slave'} at 127.0.0.1:38550
I20251023 07:59:57.726333 21340 raft_consensus.cc:493] T 927d27447e7e463c836f015eb15cc307 P 462a37ed579b46e78a75add632eabf23 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:59:57.726732 21340 raft_consensus.cc:3060] T 927d27447e7e463c836f015eb15cc307 P 462a37ed579b46e78a75add632eabf23 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:57.725266 21266 raft_consensus.cc:515] T 0f4050c875ff487e89b8a8170c0b9125 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:57.734409 21340 raft_consensus.cc:515] T 927d27447e7e463c836f015eb15cc307 P 462a37ed579b46e78a75add632eabf23 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:57.735013 21165 catalog_manager.cc:5649] T 40eac800e4b24372ab2d12224be9bee4 P 462a37ed579b46e78a75add632eabf23 reported cstate change: term changed from 1 to 2, leader changed from abf20d53faa04ffd9e2aec95f13abb8d (127.16.126.3) to 462a37ed579b46e78a75add632eabf23 (127.16.126.2). New cstate: current_term: 2 leader_uuid: "462a37ed579b46e78a75add632eabf23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:57.737107 21265 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "927d27447e7e463c836f015eb15cc307" candidate_uuid: "462a37ed579b46e78a75add632eabf23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b"
I20251023 07:59:57.737908 21265 raft_consensus.cc:3055] T 927d27447e7e463c836f015eb15cc307 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 LEADER]: Stepping down as leader of term 1
I20251023 07:59:57.738234 21265 raft_consensus.cc:740] T 927d27447e7e463c836f015eb15cc307 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 189a9eeaf7ef4038aecadfbb80cf8c7b, State: Running, Role: LEADER
I20251023 07:59:57.739073 21265 consensus_queue.cc:260] T 927d27447e7e463c836f015eb15cc307 P 189a9eeaf7ef4038aecadfbb80cf8c7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:57.739255 21163 catalog_manager.cc:5649] T 30795d2458e943b5923542028d5c85a6 P 189a9eeaf7ef4038aecadfbb80cf8c7b reported cstate change: term changed from 1 to 2, leader changed from abf20d53faa04ffd9e2aec95f13abb8d (127.16.126.3) to 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1). New cstate: current_term: 2 leader_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:57.742869 21338 leader_election.cc:290] T a9ac30e967a44ca38d29e93d1cca6fb7 P 462a37ed579b46e78a75add632eabf23 [CANDIDATE]: Term 2 election: Requested vote from peers 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1:36379), abf20d53faa04ffd9e2aec95f13abb8d (127.16.126.3:36749)
I20251023 07:59:57.743573 21415 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a9ac30e967a44ca38d29e93d1cca6fb7" candidate_uuid: "462a37ed579b46e78a75add632eabf23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "abf20d53faa04ffd9e2aec95f13abb8d"
I20251023 07:59:57.744252 21415 raft_consensus.cc:3060] T a9ac30e967a44ca38d29e93d1cca6fb7 P abf20d53faa04ffd9e2aec95f13abb8d [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:57.745146 21267 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a9ac30e967a44ca38d29e93d1cca6fb7" candidate_uuid: "462a37ed579b46e78a75add632eabf23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b"
I20251023 07:59:57.745821 21267 raft_consensus.cc:3055] T a9ac30e967a44ca38d29e93d1cca6fb7 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 LEADER]: Stepping down as leader of term 1
I20251023 07:59:57.746111 21267 raft_consensus.cc:740] T a9ac30e967a44ca38d29e93d1cca6fb7 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 189a9eeaf7ef4038aecadfbb80cf8c7b, State: Running, Role: LEADER
I20251023 07:59:57.746712 21266 leader_election.cc:290] T 0f4050c875ff487e89b8a8170c0b9125 P 189a9eeaf7ef4038aecadfbb80cf8c7b [CANDIDATE]: Term 2 election: Requested vote from peers 462a37ed579b46e78a75add632eabf23 (127.16.126.2:44879), abf20d53faa04ffd9e2aec95f13abb8d (127.16.126.3:36749)
I20251023 07:59:57.746896 21267 consensus_queue.cc:260] T a9ac30e967a44ca38d29e93d1cca6fb7 P 189a9eeaf7ef4038aecadfbb80cf8c7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:57.747664 21338 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0f4050c875ff487e89b8a8170c0b9125" candidate_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "462a37ed579b46e78a75add632eabf23"
I20251023 07:59:57.748054 21414 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0f4050c875ff487e89b8a8170c0b9125" candidate_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "abf20d53faa04ffd9e2aec95f13abb8d"
I20251023 07:59:57.748256 21338 raft_consensus.cc:3060] T 0f4050c875ff487e89b8a8170c0b9125 P 462a37ed579b46e78a75add632eabf23 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:57.748327 21267 raft_consensus.cc:3060] T a9ac30e967a44ca38d29e93d1cca6fb7 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:57.748636 21414 raft_consensus.cc:3055] T 0f4050c875ff487e89b8a8170c0b9125 P abf20d53faa04ffd9e2aec95f13abb8d [term 1 LEADER]: Stepping down as leader of term 1
I20251023 07:59:57.749038 21414 raft_consensus.cc:740] T 0f4050c875ff487e89b8a8170c0b9125 P abf20d53faa04ffd9e2aec95f13abb8d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: abf20d53faa04ffd9e2aec95f13abb8d, State: Running, Role: LEADER
I20251023 07:59:57.749863 21414 consensus_queue.cc:260] T 0f4050c875ff487e89b8a8170c0b9125 P abf20d53faa04ffd9e2aec95f13abb8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:57.750960 21414 raft_consensus.cc:3060] T 0f4050c875ff487e89b8a8170c0b9125 P abf20d53faa04ffd9e2aec95f13abb8d [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:57.751272 21265 raft_consensus.cc:3060] T 927d27447e7e463c836f015eb15cc307 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:57.755910 21338 raft_consensus.cc:2468] T 0f4050c875ff487e89b8a8170c0b9125 P 462a37ed579b46e78a75add632eabf23 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a9eeaf7ef4038aecadfbb80cf8c7b in term 2.
I20251023 07:59:57.756073 21267 raft_consensus.cc:2468] T a9ac30e967a44ca38d29e93d1cca6fb7 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 462a37ed579b46e78a75add632eabf23 in term 2.
I20251023 07:59:57.757164 21305 leader_election.cc:304] T a9ac30e967a44ca38d29e93d1cca6fb7 P 462a37ed579b46e78a75add632eabf23 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a9eeaf7ef4038aecadfbb80cf8c7b, 462a37ed579b46e78a75add632eabf23; no voters:
I20251023 07:59:57.757356 21230 leader_election.cc:304] T 0f4050c875ff487e89b8a8170c0b9125 P 189a9eeaf7ef4038aecadfbb80cf8c7b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a9eeaf7ef4038aecadfbb80cf8c7b, 462a37ed579b46e78a75add632eabf23; no voters:
I20251023 07:59:57.758075 21500 raft_consensus.cc:2804] T a9ac30e967a44ca38d29e93d1cca6fb7 P 462a37ed579b46e78a75add632eabf23 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:59:57.758584 21500 raft_consensus.cc:697] T a9ac30e967a44ca38d29e93d1cca6fb7 P 462a37ed579b46e78a75add632eabf23 [term 2 LEADER]: Becoming Leader. State: Replica: 462a37ed579b46e78a75add632eabf23, State: Running, Role: LEADER
I20251023 07:59:57.759464 21500 consensus_queue.cc:237] T a9ac30e967a44ca38d29e93d1cca6fb7 P 462a37ed579b46e78a75add632eabf23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:57.761968 21534 raft_consensus.cc:2804] T 0f4050c875ff487e89b8a8170c0b9125 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:59:57.762773 21534 raft_consensus.cc:697] T 0f4050c875ff487e89b8a8170c0b9125 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 2 LEADER]: Becoming Leader. State: Replica: 189a9eeaf7ef4038aecadfbb80cf8c7b, State: Running, Role: LEADER
I20251023 07:59:57.763482 21415 raft_consensus.cc:2468] T a9ac30e967a44ca38d29e93d1cca6fb7 P abf20d53faa04ffd9e2aec95f13abb8d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 462a37ed579b46e78a75add632eabf23 in term 2.
I20251023 07:59:57.760800 21265 raft_consensus.cc:2468] T 927d27447e7e463c836f015eb15cc307 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 462a37ed579b46e78a75add632eabf23 in term 2.
I20251023 07:59:57.765292 21461 raft_consensus.cc:993] T 0f6a4f63262e476193a5ed5fbb47bcdf P abf20d53faa04ffd9e2aec95f13abb8d: : Instructing follower 189a9eeaf7ef4038aecadfbb80cf8c7b to start an election
I20251023 07:59:57.765825 21461 raft_consensus.cc:1081] T 0f6a4f63262e476193a5ed5fbb47bcdf P abf20d53faa04ffd9e2aec95f13abb8d [term 1 LEADER]: Signalling peer 189a9eeaf7ef4038aecadfbb80cf8c7b to start an election
I20251023 07:59:57.764310 21534 consensus_queue.cc:237] T 0f4050c875ff487e89b8a8170c0b9125 P 189a9eeaf7ef4038aecadfbb80cf8c7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:57.766016 21305 leader_election.cc:304] T 927d27447e7e463c836f015eb15cc307 P 462a37ed579b46e78a75add632eabf23 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a9eeaf7ef4038aecadfbb80cf8c7b, 462a37ed579b46e78a75add632eabf23; no voters:
I20251023 07:59:57.766768 21340 leader_election.cc:290] T 927d27447e7e463c836f015eb15cc307 P 462a37ed579b46e78a75add632eabf23 [CANDIDATE]: Term 2 election: Requested vote from peers 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1:36379), abf20d53faa04ffd9e2aec95f13abb8d (127.16.126.3:36749)
I20251023 07:59:57.766959 21416 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "927d27447e7e463c836f015eb15cc307" candidate_uuid: "462a37ed579b46e78a75add632eabf23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "abf20d53faa04ffd9e2aec95f13abb8d"
I20251023 07:59:57.767777 21416 raft_consensus.cc:3060] T 927d27447e7e463c836f015eb15cc307 P abf20d53faa04ffd9e2aec95f13abb8d [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:57.766980 21500 raft_consensus.cc:2804] T 927d27447e7e463c836f015eb15cc307 P 462a37ed579b46e78a75add632eabf23 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:59:57.769416 21500 raft_consensus.cc:697] T 927d27447e7e463c836f015eb15cc307 P 462a37ed579b46e78a75add632eabf23 [term 2 LEADER]: Becoming Leader. State: Replica: 462a37ed579b46e78a75add632eabf23, State: Running, Role: LEADER
I20251023 07:59:57.770316 21500 consensus_queue.cc:237] T 927d27447e7e463c836f015eb15cc307 P 462a37ed579b46e78a75add632eabf23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:57.772997 21265 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "0f6a4f63262e476193a5ed5fbb47bcdf"
dest_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b"
from {username='slave'} at 127.0.0.1:34182
I20251023 07:59:57.773820 21265 raft_consensus.cc:493] T 0f6a4f63262e476193a5ed5fbb47bcdf P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 07:59:57.774264 21265 raft_consensus.cc:3060] T 0f6a4f63262e476193a5ed5fbb47bcdf P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:57.775079 21414 raft_consensus.cc:2468] T 0f4050c875ff487e89b8a8170c0b9125 P abf20d53faa04ffd9e2aec95f13abb8d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a9eeaf7ef4038aecadfbb80cf8c7b in term 2.
I20251023 07:59:57.775715 21416 raft_consensus.cc:2468] T 927d27447e7e463c836f015eb15cc307 P abf20d53faa04ffd9e2aec95f13abb8d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 462a37ed579b46e78a75add632eabf23 in term 2.
I20251023 07:59:57.781481 21265 raft_consensus.cc:515] T 0f6a4f63262e476193a5ed5fbb47bcdf P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:57.783727 21265 leader_election.cc:290] T 0f6a4f63262e476193a5ed5fbb47bcdf P 189a9eeaf7ef4038aecadfbb80cf8c7b [CANDIDATE]: Term 2 election: Requested vote from peers 462a37ed579b46e78a75add632eabf23 (127.16.126.2:44879), abf20d53faa04ffd9e2aec95f13abb8d (127.16.126.3:36749)
I20251023 07:59:57.785923 21340 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0f6a4f63262e476193a5ed5fbb47bcdf" candidate_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "462a37ed579b46e78a75add632eabf23"
I20251023 07:59:57.786720 21340 raft_consensus.cc:3060] T 0f6a4f63262e476193a5ed5fbb47bcdf P 462a37ed579b46e78a75add632eabf23 [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:57.787001 21414 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0f6a4f63262e476193a5ed5fbb47bcdf" candidate_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "abf20d53faa04ffd9e2aec95f13abb8d"
I20251023 07:59:57.787676 21414 raft_consensus.cc:3055] T 0f6a4f63262e476193a5ed5fbb47bcdf P abf20d53faa04ffd9e2aec95f13abb8d [term 1 LEADER]: Stepping down as leader of term 1
I20251023 07:59:57.788036 21414 raft_consensus.cc:740] T 0f6a4f63262e476193a5ed5fbb47bcdf P abf20d53faa04ffd9e2aec95f13abb8d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: abf20d53faa04ffd9e2aec95f13abb8d, State: Running, Role: LEADER
I20251023 07:59:57.788878 21414 consensus_queue.cc:260] T 0f6a4f63262e476193a5ed5fbb47bcdf P abf20d53faa04ffd9e2aec95f13abb8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:57.790150 21414 raft_consensus.cc:3060] T 0f6a4f63262e476193a5ed5fbb47bcdf P abf20d53faa04ffd9e2aec95f13abb8d [term 1 FOLLOWER]: Advancing to term 2
I20251023 07:59:57.794329 21164 catalog_manager.cc:5649] T 0f4050c875ff487e89b8a8170c0b9125 P 189a9eeaf7ef4038aecadfbb80cf8c7b reported cstate change: term changed from 1 to 2, leader changed from abf20d53faa04ffd9e2aec95f13abb8d (127.16.126.3) to 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1). New cstate: current_term: 2 leader_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:57.798169 21340 raft_consensus.cc:2468] T 0f6a4f63262e476193a5ed5fbb47bcdf P 462a37ed579b46e78a75add632eabf23 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a9eeaf7ef4038aecadfbb80cf8c7b in term 2.
I20251023 07:59:57.799296 21414 raft_consensus.cc:2468] T 0f6a4f63262e476193a5ed5fbb47bcdf P abf20d53faa04ffd9e2aec95f13abb8d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a9eeaf7ef4038aecadfbb80cf8c7b in term 2.
I20251023 07:59:57.800518 21233 leader_election.cc:304] T 0f6a4f63262e476193a5ed5fbb47bcdf P 189a9eeaf7ef4038aecadfbb80cf8c7b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a9eeaf7ef4038aecadfbb80cf8c7b, abf20d53faa04ffd9e2aec95f13abb8d; no voters:
I20251023 07:59:57.801297 21534 raft_consensus.cc:2804] T 0f6a4f63262e476193a5ed5fbb47bcdf P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 2 FOLLOWER]: Leader election won for term 2
I20251023 07:59:57.801822 21534 raft_consensus.cc:697] T 0f6a4f63262e476193a5ed5fbb47bcdf P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 2 LEADER]: Becoming Leader. State: Replica: 189a9eeaf7ef4038aecadfbb80cf8c7b, State: Running, Role: LEADER
I20251023 07:59:57.802650 21534 consensus_queue.cc:237] T 0f6a4f63262e476193a5ed5fbb47bcdf P 189a9eeaf7ef4038aecadfbb80cf8c7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 07:59:57.807273 21163 catalog_manager.cc:5649] T 927d27447e7e463c836f015eb15cc307 P 462a37ed579b46e78a75add632eabf23 reported cstate change: term changed from 1 to 2, leader changed from 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1) to 462a37ed579b46e78a75add632eabf23 (127.16.126.2). New cstate: current_term: 2 leader_uuid: "462a37ed579b46e78a75add632eabf23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:57.808787 21163 catalog_manager.cc:5649] T a9ac30e967a44ca38d29e93d1cca6fb7 P 462a37ed579b46e78a75add632eabf23 reported cstate change: term changed from 1 to 2, leader changed from 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1) to 462a37ed579b46e78a75add632eabf23 (127.16.126.2). New cstate: current_term: 2 leader_uuid: "462a37ed579b46e78a75add632eabf23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:57.811723 21164 catalog_manager.cc:5649] T 0f6a4f63262e476193a5ed5fbb47bcdf P 189a9eeaf7ef4038aecadfbb80cf8c7b reported cstate change: term changed from 1 to 2, leader changed from abf20d53faa04ffd9e2aec95f13abb8d (127.16.126.3) to 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1). New cstate: current_term: 2 leader_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } health_report { overall_health: UNKNOWN } } }
I20251023 07:59:57.950533 21340 raft_consensus.cc:1275] T 3db5b343d92742c9a0fea1cfc7cc457e P 462a37ed579b46e78a75add632eabf23 [term 2 FOLLOWER]: Refusing update from remote peer abf20d53faa04ffd9e2aec95f13abb8d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:57.951699 21472 consensus_queue.cc:1048] T 3db5b343d92742c9a0fea1cfc7cc457e P abf20d53faa04ffd9e2aec95f13abb8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:57.959028 21265 raft_consensus.cc:1275] T 3db5b343d92742c9a0fea1cfc7cc457e P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 2 FOLLOWER]: Refusing update from remote peer abf20d53faa04ffd9e2aec95f13abb8d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:57.961040 21496 consensus_queue.cc:1048] T 3db5b343d92742c9a0fea1cfc7cc457e P abf20d53faa04ffd9e2aec95f13abb8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:58.066681 21340 raft_consensus.cc:1275] T 30795d2458e943b5923542028d5c85a6 P 462a37ed579b46e78a75add632eabf23 [term 2 FOLLOWER]: Refusing update from remote peer 189a9eeaf7ef4038aecadfbb80cf8c7b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:58.067869 21534 consensus_queue.cc:1048] T 30795d2458e943b5923542028d5c85a6 P 189a9eeaf7ef4038aecadfbb80cf8c7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 07:59:58.076673 21414 raft_consensus.cc:1275] T 30795d2458e943b5923542028d5c85a6 P abf20d53faa04ffd9e2aec95f13abb8d [term 2 FOLLOWER]: Refusing update from remote peer 189a9eeaf7ef4038aecadfbb80cf8c7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:58.078428 21487 consensus_queue.cc:1048] T 30795d2458e943b5923542028d5c85a6 P 189a9eeaf7ef4038aecadfbb80cf8c7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:58.129701 21265 raft_consensus.cc:1275] T 40eac800e4b24372ab2d12224be9bee4 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 2 FOLLOWER]: Refusing update from remote peer 462a37ed579b46e78a75add632eabf23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:58.131093 21499 consensus_queue.cc:1048] T 40eac800e4b24372ab2d12224be9bee4 P 462a37ed579b46e78a75add632eabf23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:58.139160 21414 raft_consensus.cc:1275] T 40eac800e4b24372ab2d12224be9bee4 P abf20d53faa04ffd9e2aec95f13abb8d [term 2 FOLLOWER]: Refusing update from remote peer 462a37ed579b46e78a75add632eabf23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:58.140985 21466 consensus_queue.cc:1048] T 40eac800e4b24372ab2d12224be9bee4 P 462a37ed579b46e78a75add632eabf23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:58.151265 21265 raft_consensus.cc:1275] T 927d27447e7e463c836f015eb15cc307 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 2 FOLLOWER]: Refusing update from remote peer 462a37ed579b46e78a75add632eabf23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:58.152452 21466 consensus_queue.cc:1048] T 927d27447e7e463c836f015eb15cc307 P 462a37ed579b46e78a75add632eabf23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:58.160991 21414 raft_consensus.cc:1275] T 927d27447e7e463c836f015eb15cc307 P abf20d53faa04ffd9e2aec95f13abb8d [term 2 FOLLOWER]: Refusing update from remote peer 462a37ed579b46e78a75add632eabf23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:58.163803 21267 raft_consensus.cc:1275] T a9ac30e967a44ca38d29e93d1cca6fb7 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 2 FOLLOWER]: Refusing update from remote peer 462a37ed579b46e78a75add632eabf23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:58.162664 21499 consensus_queue.cc:1048] T 927d27447e7e463c836f015eb15cc307 P 462a37ed579b46e78a75add632eabf23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:58.165838 21538 consensus_queue.cc:1048] T a9ac30e967a44ca38d29e93d1cca6fb7 P 462a37ed579b46e78a75add632eabf23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20251023 07:59:58.174916 21414 raft_consensus.cc:1275] T a9ac30e967a44ca38d29e93d1cca6fb7 P abf20d53faa04ffd9e2aec95f13abb8d [term 2 FOLLOWER]: Refusing update from remote peer 462a37ed579b46e78a75add632eabf23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:58.175995 21466 consensus_queue.cc:1048] T a9ac30e967a44ca38d29e93d1cca6fb7 P 462a37ed579b46e78a75add632eabf23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:58.219148 21340 raft_consensus.cc:1275] T 0f4050c875ff487e89b8a8170c0b9125 P 462a37ed579b46e78a75add632eabf23 [term 2 FOLLOWER]: Refusing update from remote peer 189a9eeaf7ef4038aecadfbb80cf8c7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:58.220054 21338 raft_consensus.cc:1275] T 0f6a4f63262e476193a5ed5fbb47bcdf P 462a37ed579b46e78a75add632eabf23 [term 2 FOLLOWER]: Refusing update from remote peer 189a9eeaf7ef4038aecadfbb80cf8c7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:58.220640 21487 consensus_queue.cc:1048] T 0f4050c875ff487e89b8a8170c0b9125 P 189a9eeaf7ef4038aecadfbb80cf8c7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:58.221459 21502 consensus_queue.cc:1048] T 0f6a4f63262e476193a5ed5fbb47bcdf P 189a9eeaf7ef4038aecadfbb80cf8c7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:58.228989 21414 raft_consensus.cc:1275] T 0f6a4f63262e476193a5ed5fbb47bcdf P abf20d53faa04ffd9e2aec95f13abb8d [term 2 FOLLOWER]: Refusing update from remote peer 189a9eeaf7ef4038aecadfbb80cf8c7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:58.231305 21416 raft_consensus.cc:1275] T 0f4050c875ff487e89b8a8170c0b9125 P abf20d53faa04ffd9e2aec95f13abb8d [term 2 FOLLOWER]: Refusing update from remote peer 189a9eeaf7ef4038aecadfbb80cf8c7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 07:59:58.231374 21502 consensus_queue.cc:1048] T 0f6a4f63262e476193a5ed5fbb47bcdf P 189a9eeaf7ef4038aecadfbb80cf8c7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 07:59:58.232661 21501 consensus_queue.cc:1048] T 0f4050c875ff487e89b8a8170c0b9125 P 189a9eeaf7ef4038aecadfbb80cf8c7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 08:00:00.336591 16888 test_util.cc:276] Using random seed: -773963090
I20251023 08:00:00.360869 21164 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43258:
name: "soft_deleted_table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251023 08:00:00.363058 21164 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251023 08:00:00.411098 21255 tablet_service.cc:1505] Processing CreateTablet for tablet dbc2b9be96eb4372849d84bf61f9dc9a (DEFAULT_TABLE table=soft_deleted_table [id=ff4befe1408048d1a719c07d9bc1c9e5]), partition=RANGE (key) PARTITION VALUES < 238609294
I20251023 08:00:00.412469 21255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbc2b9be96eb4372849d84bf61f9dc9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:00.413384 21398 tablet_service.cc:1505] Processing CreateTablet for tablet dbc2b9be96eb4372849d84bf61f9dc9a (DEFAULT_TABLE table=soft_deleted_table [id=ff4befe1408048d1a719c07d9bc1c9e5]), partition=RANGE (key) PARTITION VALUES < 238609294
I20251023 08:00:00.412073 21328 tablet_service.cc:1505] Processing CreateTablet for tablet dbc2b9be96eb4372849d84bf61f9dc9a (DEFAULT_TABLE table=soft_deleted_table [id=ff4befe1408048d1a719c07d9bc1c9e5]), partition=RANGE (key) PARTITION VALUES < 238609294
I20251023 08:00:00.414685 21398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbc2b9be96eb4372849d84bf61f9dc9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:00.415261 21328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbc2b9be96eb4372849d84bf61f9dc9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:00.415127 21250 tablet_service.cc:1505] Processing CreateTablet for tablet 7d2bc5448c3a4be6b037deea58e8e721 (DEFAULT_TABLE table=soft_deleted_table [id=ff4befe1408048d1a719c07d9bc1c9e5]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20251023 08:00:00.416433 21250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d2bc5448c3a4be6b037deea58e8e721. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:00.430222 21326 tablet_service.cc:1505] Processing CreateTablet for tablet 7d2bc5448c3a4be6b037deea58e8e721 (DEFAULT_TABLE table=soft_deleted_table [id=ff4befe1408048d1a719c07d9bc1c9e5]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20251023 08:00:00.431715 21326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d2bc5448c3a4be6b037deea58e8e721. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:00.432833 21401 tablet_service.cc:1505] Processing CreateTablet for tablet 7d2bc5448c3a4be6b037deea58e8e721 (DEFAULT_TABLE table=soft_deleted_table [id=ff4befe1408048d1a719c07d9bc1c9e5]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20251023 08:00:00.434235 21401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d2bc5448c3a4be6b037deea58e8e721. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:00.438185 21252 tablet_service.cc:1505] Processing CreateTablet for tablet 94c7110bc7d84a09886191fcf82e530f (DEFAULT_TABLE table=soft_deleted_table [id=ff4befe1408048d1a719c07d9bc1c9e5]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20251023 08:00:00.439576 21252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94c7110bc7d84a09886191fcf82e530f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:00.450522 21332 tablet_service.cc:1505] Processing CreateTablet for tablet 94c7110bc7d84a09886191fcf82e530f (DEFAULT_TABLE table=soft_deleted_table [id=ff4befe1408048d1a719c07d9bc1c9e5]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20251023 08:00:00.451997 21332 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94c7110bc7d84a09886191fcf82e530f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:00.455593 21555 tablet_bootstrap.cc:492] T dbc2b9be96eb4372849d84bf61f9dc9a P abf20d53faa04ffd9e2aec95f13abb8d: Bootstrap starting.
I20251023 08:00:00.459403 21398 tablet_service.cc:1505] Processing CreateTablet for tablet 94c7110bc7d84a09886191fcf82e530f (DEFAULT_TABLE table=soft_deleted_table [id=ff4befe1408048d1a719c07d9bc1c9e5]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20251023 08:00:00.464501 21556 tablet_bootstrap.cc:492] T dbc2b9be96eb4372849d84bf61f9dc9a P 189a9eeaf7ef4038aecadfbb80cf8c7b: Bootstrap starting.
I20251023 08:00:00.465127 21398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94c7110bc7d84a09886191fcf82e530f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:00.463583 21404 tablet_service.cc:1505] Processing CreateTablet for tablet 660ad6de5e3c4d0a932f73640864f54b (DEFAULT_TABLE table=soft_deleted_table [id=ff4befe1408048d1a719c07d9bc1c9e5]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20251023 08:00:00.466115 21257 tablet_service.cc:1505] Processing CreateTablet for tablet 96cc067b744f4c04b020f42d519288d7 (DEFAULT_TABLE table=soft_deleted_table [id=ff4befe1408048d1a719c07d9bc1c9e5]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20251023 08:00:00.467907 21403 tablet_service.cc:1505] Processing CreateTablet for tablet 96cc067b744f4c04b020f42d519288d7 (DEFAULT_TABLE table=soft_deleted_table [id=ff4befe1408048d1a719c07d9bc1c9e5]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20251023 08:00:00.468411 21327 tablet_service.cc:1505] Processing CreateTablet for tablet 96cc067b744f4c04b020f42d519288d7 (DEFAULT_TABLE table=soft_deleted_table [id=ff4befe1408048d1a719c07d9bc1c9e5]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20251023 08:00:00.468797 21257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96cc067b744f4c04b020f42d519288d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:00.462393 21329 tablet_service.cc:1505] Processing CreateTablet for tablet 660ad6de5e3c4d0a932f73640864f54b (DEFAULT_TABLE table=soft_deleted_table [id=ff4befe1408048d1a719c07d9bc1c9e5]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20251023 08:00:00.469321 21403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96cc067b744f4c04b020f42d519288d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:00.469937 21327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96cc067b744f4c04b020f42d519288d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:00.470278 21404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 660ad6de5e3c4d0a932f73640864f54b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:00.472713 21329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 660ad6de5e3c4d0a932f73640864f54b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:00.483227 21255 tablet_service.cc:1505] Processing CreateTablet for tablet 660ad6de5e3c4d0a932f73640864f54b (DEFAULT_TABLE table=soft_deleted_table [id=ff4befe1408048d1a719c07d9bc1c9e5]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20251023 08:00:00.485106 21255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 660ad6de5e3c4d0a932f73640864f54b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:00.502192 21555 tablet_bootstrap.cc:654] T dbc2b9be96eb4372849d84bf61f9dc9a P abf20d53faa04ffd9e2aec95f13abb8d: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:00.504065 21256 tablet_service.cc:1505] Processing CreateTablet for tablet a0e6c38393ac49009a25e9806355d2e4 (DEFAULT_TABLE table=soft_deleted_table [id=ff4befe1408048d1a719c07d9bc1c9e5]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20251023 08:00:00.505565 21256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0e6c38393ac49009a25e9806355d2e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:00.514796 21556 tablet_bootstrap.cc:654] T dbc2b9be96eb4372849d84bf61f9dc9a P 189a9eeaf7ef4038aecadfbb80cf8c7b: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:00.522910 21326 tablet_service.cc:1505] Processing CreateTablet for tablet a0e6c38393ac49009a25e9806355d2e4 (DEFAULT_TABLE table=soft_deleted_table [id=ff4befe1408048d1a719c07d9bc1c9e5]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20251023 08:00:00.524896 21326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0e6c38393ac49009a25e9806355d2e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:00.531690 21401 tablet_service.cc:1505] Processing CreateTablet for tablet a0e6c38393ac49009a25e9806355d2e4 (DEFAULT_TABLE table=soft_deleted_table [id=ff4befe1408048d1a719c07d9bc1c9e5]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20251023 08:00:00.532459 21252 tablet_service.cc:1505] Processing CreateTablet for tablet a27543620a6846028a73e83fb89458d5 (DEFAULT_TABLE table=soft_deleted_table [id=ff4befe1408048d1a719c07d9bc1c9e5]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20251023 08:00:00.533200 21401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0e6c38393ac49009a25e9806355d2e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:00.536667 21406 tablet_service.cc:1505] Processing CreateTablet for tablet a27543620a6846028a73e83fb89458d5 (DEFAULT_TABLE table=soft_deleted_table [id=ff4befe1408048d1a719c07d9bc1c9e5]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20251023 08:00:00.538004 21252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a27543620a6846028a73e83fb89458d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:00.538249 21406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a27543620a6846028a73e83fb89458d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:00.538632 21250 tablet_service.cc:1505] Processing CreateTablet for tablet 7b0fab70cb35481eb8681415447f0763 (DEFAULT_TABLE table=soft_deleted_table [id=ff4befe1408048d1a719c07d9bc1c9e5]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20251023 08:00:00.539994 21250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b0fab70cb35481eb8681415447f0763. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:00.542835 21327 tablet_service.cc:1505] Processing CreateTablet for tablet a27543620a6846028a73e83fb89458d5 (DEFAULT_TABLE table=soft_deleted_table [id=ff4befe1408048d1a719c07d9bc1c9e5]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20251023 08:00:00.544170 21327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a27543620a6846028a73e83fb89458d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:00.555135 21328 tablet_service.cc:1505] Processing CreateTablet for tablet 7b0fab70cb35481eb8681415447f0763 (DEFAULT_TABLE table=soft_deleted_table [id=ff4befe1408048d1a719c07d9bc1c9e5]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20251023 08:00:00.558203 21557 tablet_bootstrap.cc:492] T dbc2b9be96eb4372849d84bf61f9dc9a P 462a37ed579b46e78a75add632eabf23: Bootstrap starting.
I20251023 08:00:00.558732 21328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b0fab70cb35481eb8681415447f0763. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:00.559537 21403 tablet_service.cc:1505] Processing CreateTablet for tablet 7b0fab70cb35481eb8681415447f0763 (DEFAULT_TABLE table=soft_deleted_table [id=ff4befe1408048d1a719c07d9bc1c9e5]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20251023 08:00:00.560982 21403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b0fab70cb35481eb8681415447f0763. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:00.568903 21249 tablet_service.cc:1505] Processing CreateTablet for tablet a29027605e3640d3a9cf4ecd7f312192 (DEFAULT_TABLE table=soft_deleted_table [id=ff4befe1408048d1a719c07d9bc1c9e5]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20251023 08:00:00.572834 21249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a29027605e3640d3a9cf4ecd7f312192. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:00.573334 21332 tablet_service.cc:1505] Processing CreateTablet for tablet a29027605e3640d3a9cf4ecd7f312192 (DEFAULT_TABLE table=soft_deleted_table [id=ff4befe1408048d1a719c07d9bc1c9e5]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20251023 08:00:00.573690 21400 tablet_service.cc:1505] Processing CreateTablet for tablet a29027605e3640d3a9cf4ecd7f312192 (DEFAULT_TABLE table=soft_deleted_table [id=ff4befe1408048d1a719c07d9bc1c9e5]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20251023 08:00:00.574677 21332 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a29027605e3640d3a9cf4ecd7f312192. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:00.574975 21400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a29027605e3640d3a9cf4ecd7f312192. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:00.585532 21555 tablet_bootstrap.cc:492] T dbc2b9be96eb4372849d84bf61f9dc9a P abf20d53faa04ffd9e2aec95f13abb8d: No bootstrap required, opened a new log
I20251023 08:00:00.586129 21555 ts_tablet_manager.cc:1403] T dbc2b9be96eb4372849d84bf61f9dc9a P abf20d53faa04ffd9e2aec95f13abb8d: Time spent bootstrapping tablet: real 0.131s user 0.015s sys 0.009s
I20251023 08:00:00.595930 21557 tablet_bootstrap.cc:654] T dbc2b9be96eb4372849d84bf61f9dc9a P 462a37ed579b46e78a75add632eabf23: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:00.589123 21555 raft_consensus.cc:359] T dbc2b9be96eb4372849d84bf61f9dc9a P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:00.598361 21555 raft_consensus.cc:385] T dbc2b9be96eb4372849d84bf61f9dc9a P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:00.598711 21555 raft_consensus.cc:740] T dbc2b9be96eb4372849d84bf61f9dc9a P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf20d53faa04ffd9e2aec95f13abb8d, State: Initialized, Role: FOLLOWER
I20251023 08:00:00.599438 21555 consensus_queue.cc:260] T dbc2b9be96eb4372849d84bf61f9dc9a P abf20d53faa04ffd9e2aec95f13abb8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:00.607971 21555 ts_tablet_manager.cc:1434] T dbc2b9be96eb4372849d84bf61f9dc9a P abf20d53faa04ffd9e2aec95f13abb8d: Time spent starting tablet: real 0.022s user 0.007s sys 0.000s
I20251023 08:00:00.608987 21555 tablet_bootstrap.cc:492] T 7d2bc5448c3a4be6b037deea58e8e721 P abf20d53faa04ffd9e2aec95f13abb8d: Bootstrap starting.
I20251023 08:00:00.622244 21555 tablet_bootstrap.cc:654] T 7d2bc5448c3a4be6b037deea58e8e721 P abf20d53faa04ffd9e2aec95f13abb8d: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:00.631095 21556 tablet_bootstrap.cc:492] T dbc2b9be96eb4372849d84bf61f9dc9a P 189a9eeaf7ef4038aecadfbb80cf8c7b: No bootstrap required, opened a new log
I20251023 08:00:00.631808 21556 ts_tablet_manager.cc:1403] T dbc2b9be96eb4372849d84bf61f9dc9a P 189a9eeaf7ef4038aecadfbb80cf8c7b: Time spent bootstrapping tablet: real 0.168s user 0.007s sys 0.007s
I20251023 08:00:00.636622 21556 raft_consensus.cc:359] T dbc2b9be96eb4372849d84bf61f9dc9a P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:00.641409 21556 raft_consensus.cc:385] T dbc2b9be96eb4372849d84bf61f9dc9a P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:00.641754 21556 raft_consensus.cc:740] T dbc2b9be96eb4372849d84bf61f9dc9a P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 189a9eeaf7ef4038aecadfbb80cf8c7b, State: Initialized, Role: FOLLOWER
I20251023 08:00:00.642506 21556 consensus_queue.cc:260] T dbc2b9be96eb4372849d84bf61f9dc9a P 189a9eeaf7ef4038aecadfbb80cf8c7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:00.644169 21555 tablet_bootstrap.cc:492] T 7d2bc5448c3a4be6b037deea58e8e721 P abf20d53faa04ffd9e2aec95f13abb8d: No bootstrap required, opened a new log
I20251023 08:00:00.644665 21556 ts_tablet_manager.cc:1434] T dbc2b9be96eb4372849d84bf61f9dc9a P 189a9eeaf7ef4038aecadfbb80cf8c7b: Time spent starting tablet: real 0.012s user 0.008s sys 0.000s
I20251023 08:00:00.644711 21555 ts_tablet_manager.cc:1403] T 7d2bc5448c3a4be6b037deea58e8e721 P abf20d53faa04ffd9e2aec95f13abb8d: Time spent bootstrapping tablet: real 0.036s user 0.018s sys 0.003s
I20251023 08:00:00.645845 21556 tablet_bootstrap.cc:492] T 7d2bc5448c3a4be6b037deea58e8e721 P 189a9eeaf7ef4038aecadfbb80cf8c7b: Bootstrap starting.
I20251023 08:00:00.649051 21555 raft_consensus.cc:359] T 7d2bc5448c3a4be6b037deea58e8e721 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:00.650110 21555 raft_consensus.cc:385] T 7d2bc5448c3a4be6b037deea58e8e721 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:00.650435 21555 raft_consensus.cc:740] T 7d2bc5448c3a4be6b037deea58e8e721 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf20d53faa04ffd9e2aec95f13abb8d, State: Initialized, Role: FOLLOWER
I20251023 08:00:00.651154 21555 consensus_queue.cc:260] T 7d2bc5448c3a4be6b037deea58e8e721 P abf20d53faa04ffd9e2aec95f13abb8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:00.652141 21557 tablet_bootstrap.cc:492] T dbc2b9be96eb4372849d84bf61f9dc9a P 462a37ed579b46e78a75add632eabf23: No bootstrap required, opened a new log
I20251023 08:00:00.652696 21557 ts_tablet_manager.cc:1403] T dbc2b9be96eb4372849d84bf61f9dc9a P 462a37ed579b46e78a75add632eabf23: Time spent bootstrapping tablet: real 0.095s user 0.015s sys 0.000s
I20251023 08:00:00.653106 21555 ts_tablet_manager.cc:1434] T 7d2bc5448c3a4be6b037deea58e8e721 P abf20d53faa04ffd9e2aec95f13abb8d: Time spent starting tablet: real 0.008s user 0.005s sys 0.000s
I20251023 08:00:00.654171 21555 tablet_bootstrap.cc:492] T 96cc067b744f4c04b020f42d519288d7 P abf20d53faa04ffd9e2aec95f13abb8d: Bootstrap starting.
I20251023 08:00:00.656049 21557 raft_consensus.cc:359] T dbc2b9be96eb4372849d84bf61f9dc9a P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:00.656801 21557 raft_consensus.cc:385] T dbc2b9be96eb4372849d84bf61f9dc9a P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:00.657101 21557 raft_consensus.cc:740] T dbc2b9be96eb4372849d84bf61f9dc9a P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 462a37ed579b46e78a75add632eabf23, State: Initialized, Role: FOLLOWER
I20251023 08:00:00.657899 21557 consensus_queue.cc:260] T dbc2b9be96eb4372849d84bf61f9dc9a P 462a37ed579b46e78a75add632eabf23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:00.660275 21555 tablet_bootstrap.cc:654] T 96cc067b744f4c04b020f42d519288d7 P abf20d53faa04ffd9e2aec95f13abb8d: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:00.660624 21557 ts_tablet_manager.cc:1434] T dbc2b9be96eb4372849d84bf61f9dc9a P 462a37ed579b46e78a75add632eabf23: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20251023 08:00:00.665230 21557 tablet_bootstrap.cc:492] T 7d2bc5448c3a4be6b037deea58e8e721 P 462a37ed579b46e78a75add632eabf23: Bootstrap starting.
I20251023 08:00:00.666249 21555 tablet_bootstrap.cc:492] T 96cc067b744f4c04b020f42d519288d7 P abf20d53faa04ffd9e2aec95f13abb8d: No bootstrap required, opened a new log
I20251023 08:00:00.666822 21555 ts_tablet_manager.cc:1403] T 96cc067b744f4c04b020f42d519288d7 P abf20d53faa04ffd9e2aec95f13abb8d: Time spent bootstrapping tablet: real 0.013s user 0.007s sys 0.004s
I20251023 08:00:00.669826 21555 raft_consensus.cc:359] T 96cc067b744f4c04b020f42d519288d7 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:00.670583 21555 raft_consensus.cc:385] T 96cc067b744f4c04b020f42d519288d7 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:00.671898 21556 tablet_bootstrap.cc:654] T 7d2bc5448c3a4be6b037deea58e8e721 P 189a9eeaf7ef4038aecadfbb80cf8c7b: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:00.670881 21555 raft_consensus.cc:740] T 96cc067b744f4c04b020f42d519288d7 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf20d53faa04ffd9e2aec95f13abb8d, State: Initialized, Role: FOLLOWER
I20251023 08:00:00.676270 21555 consensus_queue.cc:260] T 96cc067b744f4c04b020f42d519288d7 P abf20d53faa04ffd9e2aec95f13abb8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:00.677980 21557 tablet_bootstrap.cc:654] T 7d2bc5448c3a4be6b037deea58e8e721 P 462a37ed579b46e78a75add632eabf23: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:00.678901 21555 ts_tablet_manager.cc:1434] T 96cc067b744f4c04b020f42d519288d7 P abf20d53faa04ffd9e2aec95f13abb8d: Time spent starting tablet: real 0.012s user 0.006s sys 0.002s
I20251023 08:00:00.680357 21555 tablet_bootstrap.cc:492] T a27543620a6846028a73e83fb89458d5 P abf20d53faa04ffd9e2aec95f13abb8d: Bootstrap starting.
I20251023 08:00:00.683102 21556 tablet_bootstrap.cc:492] T 7d2bc5448c3a4be6b037deea58e8e721 P 189a9eeaf7ef4038aecadfbb80cf8c7b: No bootstrap required, opened a new log
I20251023 08:00:00.683658 21556 ts_tablet_manager.cc:1403] T 7d2bc5448c3a4be6b037deea58e8e721 P 189a9eeaf7ef4038aecadfbb80cf8c7b: Time spent bootstrapping tablet: real 0.038s user 0.004s sys 0.006s
I20251023 08:00:00.686671 21556 raft_consensus.cc:359] T 7d2bc5448c3a4be6b037deea58e8e721 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:00.687614 21556 raft_consensus.cc:385] T 7d2bc5448c3a4be6b037deea58e8e721 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:00.687909 21556 raft_consensus.cc:740] T 7d2bc5448c3a4be6b037deea58e8e721 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 189a9eeaf7ef4038aecadfbb80cf8c7b, State: Initialized, Role: FOLLOWER
I20251023 08:00:00.691202 21555 tablet_bootstrap.cc:654] T a27543620a6846028a73e83fb89458d5 P abf20d53faa04ffd9e2aec95f13abb8d: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:00.688657 21556 consensus_queue.cc:260] T 7d2bc5448c3a4be6b037deea58e8e721 P 189a9eeaf7ef4038aecadfbb80cf8c7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:00.692215 21557 tablet_bootstrap.cc:492] T 7d2bc5448c3a4be6b037deea58e8e721 P 462a37ed579b46e78a75add632eabf23: No bootstrap required, opened a new log
I20251023 08:00:00.693888 21557 ts_tablet_manager.cc:1403] T 7d2bc5448c3a4be6b037deea58e8e721 P 462a37ed579b46e78a75add632eabf23: Time spent bootstrapping tablet: real 0.029s user 0.015s sys 0.004s
I20251023 08:00:00.693951 21556 ts_tablet_manager.cc:1434] T 7d2bc5448c3a4be6b037deea58e8e721 P 189a9eeaf7ef4038aecadfbb80cf8c7b: Time spent starting tablet: real 0.010s user 0.008s sys 0.001s
I20251023 08:00:00.695096 21556 tablet_bootstrap.cc:492] T 94c7110bc7d84a09886191fcf82e530f P 189a9eeaf7ef4038aecadfbb80cf8c7b: Bootstrap starting.
I20251023 08:00:00.697193 21557 raft_consensus.cc:359] T 7d2bc5448c3a4be6b037deea58e8e721 P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:00.698062 21557 raft_consensus.cc:385] T 7d2bc5448c3a4be6b037deea58e8e721 P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:00.698558 21557 raft_consensus.cc:740] T 7d2bc5448c3a4be6b037deea58e8e721 P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 462a37ed579b46e78a75add632eabf23, State: Initialized, Role: FOLLOWER
I20251023 08:00:00.699378 21557 consensus_queue.cc:260] T 7d2bc5448c3a4be6b037deea58e8e721 P 462a37ed579b46e78a75add632eabf23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:00.701710 21556 tablet_bootstrap.cc:654] T 94c7110bc7d84a09886191fcf82e530f P 189a9eeaf7ef4038aecadfbb80cf8c7b: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:00.702034 21557 ts_tablet_manager.cc:1434] T 7d2bc5448c3a4be6b037deea58e8e721 P 462a37ed579b46e78a75add632eabf23: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20251023 08:00:00.703639 21557 tablet_bootstrap.cc:492] T 94c7110bc7d84a09886191fcf82e530f P 462a37ed579b46e78a75add632eabf23: Bootstrap starting.
I20251023 08:00:00.704035 21558 raft_consensus.cc:493] T dbc2b9be96eb4372849d84bf61f9dc9a P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 08:00:00.715013 21557 tablet_bootstrap.cc:654] T 94c7110bc7d84a09886191fcf82e530f P 462a37ed579b46e78a75add632eabf23: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:00.714771 21558 raft_consensus.cc:515] T dbc2b9be96eb4372849d84bf61f9dc9a P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:00.717458 21558 leader_election.cc:290] T dbc2b9be96eb4372849d84bf61f9dc9a P 189a9eeaf7ef4038aecadfbb80cf8c7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 462a37ed579b46e78a75add632eabf23 (127.16.126.2:44879), abf20d53faa04ffd9e2aec95f13abb8d (127.16.126.3:36749)
I20251023 08:00:00.718144 21340 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dbc2b9be96eb4372849d84bf61f9dc9a" candidate_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "462a37ed579b46e78a75add632eabf23" is_pre_election: true
I20251023 08:00:00.718622 21555 tablet_bootstrap.cc:492] T a27543620a6846028a73e83fb89458d5 P abf20d53faa04ffd9e2aec95f13abb8d: No bootstrap required, opened a new log
I20251023 08:00:00.718890 21340 raft_consensus.cc:2468] T dbc2b9be96eb4372849d84bf61f9dc9a P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a9eeaf7ef4038aecadfbb80cf8c7b in term 0.
I20251023 08:00:00.719405 21555 ts_tablet_manager.cc:1403] T a27543620a6846028a73e83fb89458d5 P abf20d53faa04ffd9e2aec95f13abb8d: Time spent bootstrapping tablet: real 0.039s user 0.016s sys 0.012s
I20251023 08:00:00.718719 21414 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dbc2b9be96eb4372849d84bf61f9dc9a" candidate_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" is_pre_election: true
I20251023 08:00:00.720144 21414 raft_consensus.cc:2468] T dbc2b9be96eb4372849d84bf61f9dc9a P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a9eeaf7ef4038aecadfbb80cf8c7b in term 0.
I20251023 08:00:00.721400 21233 leader_election.cc:304] T dbc2b9be96eb4372849d84bf61f9dc9a P 189a9eeaf7ef4038aecadfbb80cf8c7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a9eeaf7ef4038aecadfbb80cf8c7b, abf20d53faa04ffd9e2aec95f13abb8d; no voters:
I20251023 08:00:00.722909 21558 raft_consensus.cc:2804] T dbc2b9be96eb4372849d84bf61f9dc9a P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 08:00:00.723420 21558 raft_consensus.cc:493] T dbc2b9be96eb4372849d84bf61f9dc9a P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 08:00:00.723006 21555 raft_consensus.cc:359] T a27543620a6846028a73e83fb89458d5 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:00.723814 21558 raft_consensus.cc:3060] T dbc2b9be96eb4372849d84bf61f9dc9a P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:00.723886 21555 raft_consensus.cc:385] T a27543620a6846028a73e83fb89458d5 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:00.724381 21555 raft_consensus.cc:740] T a27543620a6846028a73e83fb89458d5 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf20d53faa04ffd9e2aec95f13abb8d, State: Initialized, Role: FOLLOWER
I20251023 08:00:00.725327 21556 tablet_bootstrap.cc:492] T 94c7110bc7d84a09886191fcf82e530f P 189a9eeaf7ef4038aecadfbb80cf8c7b: No bootstrap required, opened a new log
I20251023 08:00:00.725395 21557 tablet_bootstrap.cc:492] T 94c7110bc7d84a09886191fcf82e530f P 462a37ed579b46e78a75add632eabf23: No bootstrap required, opened a new log
I20251023 08:00:00.725137 21555 consensus_queue.cc:260] T a27543620a6846028a73e83fb89458d5 P abf20d53faa04ffd9e2aec95f13abb8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:00.726029 21556 ts_tablet_manager.cc:1403] T 94c7110bc7d84a09886191fcf82e530f P 189a9eeaf7ef4038aecadfbb80cf8c7b: Time spent bootstrapping tablet: real 0.031s user 0.010s sys 0.003s
I20251023 08:00:00.726238 21557 ts_tablet_manager.cc:1403] T 94c7110bc7d84a09886191fcf82e530f P 462a37ed579b46e78a75add632eabf23: Time spent bootstrapping tablet: real 0.023s user 0.008s sys 0.012s
I20251023 08:00:00.728987 21556 raft_consensus.cc:359] T 94c7110bc7d84a09886191fcf82e530f P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:00.729784 21556 raft_consensus.cc:385] T 94c7110bc7d84a09886191fcf82e530f P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:00.730082 21556 raft_consensus.cc:740] T 94c7110bc7d84a09886191fcf82e530f P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 189a9eeaf7ef4038aecadfbb80cf8c7b, State: Initialized, Role: FOLLOWER
I20251023 08:00:00.730791 21556 consensus_queue.cc:260] T 94c7110bc7d84a09886191fcf82e530f P 189a9eeaf7ef4038aecadfbb80cf8c7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:00.731863 21557 raft_consensus.cc:359] T 94c7110bc7d84a09886191fcf82e530f P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:00.731969 21558 raft_consensus.cc:515] T dbc2b9be96eb4372849d84bf61f9dc9a P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:00.732831 21557 raft_consensus.cc:385] T 94c7110bc7d84a09886191fcf82e530f P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:00.727944 21555 ts_tablet_manager.cc:1434] T a27543620a6846028a73e83fb89458d5 P abf20d53faa04ffd9e2aec95f13abb8d: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s
I20251023 08:00:00.735008 21340 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dbc2b9be96eb4372849d84bf61f9dc9a" candidate_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "462a37ed579b46e78a75add632eabf23"
I20251023 08:00:00.735637 21340 raft_consensus.cc:3060] T dbc2b9be96eb4372849d84bf61f9dc9a P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:00.736073 21556 ts_tablet_manager.cc:1434] T 94c7110bc7d84a09886191fcf82e530f P 189a9eeaf7ef4038aecadfbb80cf8c7b: Time spent starting tablet: real 0.010s user 0.006s sys 0.000s
I20251023 08:00:00.737175 21556 tablet_bootstrap.cc:492] T 96cc067b744f4c04b020f42d519288d7 P 189a9eeaf7ef4038aecadfbb80cf8c7b: Bootstrap starting.
I20251023 08:00:00.733215 21557 raft_consensus.cc:740] T 94c7110bc7d84a09886191fcf82e530f P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 462a37ed579b46e78a75add632eabf23, State: Initialized, Role: FOLLOWER
I20251023 08:00:00.741715 21557 consensus_queue.cc:260] T 94c7110bc7d84a09886191fcf82e530f P 462a37ed579b46e78a75add632eabf23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:00.743791 21556 tablet_bootstrap.cc:654] T 96cc067b744f4c04b020f42d519288d7 P 189a9eeaf7ef4038aecadfbb80cf8c7b: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:00.744397 21557 ts_tablet_manager.cc:1434] T 94c7110bc7d84a09886191fcf82e530f P 462a37ed579b46e78a75add632eabf23: Time spent starting tablet: real 0.015s user 0.000s sys 0.007s
I20251023 08:00:00.745574 21557 tablet_bootstrap.cc:492] T 96cc067b744f4c04b020f42d519288d7 P 462a37ed579b46e78a75add632eabf23: Bootstrap starting.
I20251023 08:00:00.745990 21555 tablet_bootstrap.cc:492] T a29027605e3640d3a9cf4ecd7f312192 P abf20d53faa04ffd9e2aec95f13abb8d: Bootstrap starting.
W20251023 08:00:00.746960 21442 tablet.cc:2378] T 7d2bc5448c3a4be6b037deea58e8e721 P abf20d53faa04ffd9e2aec95f13abb8d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251023 08:00:00.748652 21541 raft_consensus.cc:493] T 96cc067b744f4c04b020f42d519288d7 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 08:00:00.749163 21541 raft_consensus.cc:515] T 96cc067b744f4c04b020f42d519288d7 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:00.751425 21541 leader_election.cc:290] T 96cc067b744f4c04b020f42d519288d7 P abf20d53faa04ffd9e2aec95f13abb8d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1:36379), 462a37ed579b46e78a75add632eabf23 (127.16.126.2:44879)
I20251023 08:00:00.752974 21555 tablet_bootstrap.cc:654] T a29027605e3640d3a9cf4ecd7f312192 P abf20d53faa04ffd9e2aec95f13abb8d: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:00.753822 21267 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "96cc067b744f4c04b020f42d519288d7" candidate_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" is_pre_election: true
I20251023 08:00:00.754019 21340 raft_consensus.cc:2468] T dbc2b9be96eb4372849d84bf61f9dc9a P 462a37ed579b46e78a75add632eabf23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a9eeaf7ef4038aecadfbb80cf8c7b in term 1.
I20251023 08:00:00.753945 21338 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "96cc067b744f4c04b020f42d519288d7" candidate_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "462a37ed579b46e78a75add632eabf23" is_pre_election: true
I20251023 08:00:00.755609 21558 leader_election.cc:290] T dbc2b9be96eb4372849d84bf61f9dc9a P 189a9eeaf7ef4038aecadfbb80cf8c7b [CANDIDATE]: Term 1 election: Requested vote from peers 462a37ed579b46e78a75add632eabf23 (127.16.126.2:44879), abf20d53faa04ffd9e2aec95f13abb8d (127.16.126.3:36749)
I20251023 08:00:00.756763 21230 leader_election.cc:304] T dbc2b9be96eb4372849d84bf61f9dc9a P 189a9eeaf7ef4038aecadfbb80cf8c7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a9eeaf7ef4038aecadfbb80cf8c7b, 462a37ed579b46e78a75add632eabf23; no voters:
W20251023 08:00:00.757141 21379 leader_election.cc:343] T 96cc067b744f4c04b020f42d519288d7 P abf20d53faa04ffd9e2aec95f13abb8d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 462a37ed579b46e78a75add632eabf23 (127.16.126.2:44879): Illegal state: must be running to vote when last-logged opid is not known
I20251023 08:00:00.758241 21414 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dbc2b9be96eb4372849d84bf61f9dc9a" candidate_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf20d53faa04ffd9e2aec95f13abb8d"
I20251023 08:00:00.759104 21414 raft_consensus.cc:3060] T dbc2b9be96eb4372849d84bf61f9dc9a P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Advancing to term 1
W20251023 08:00:00.764601 21379 leader_election.cc:343] T 96cc067b744f4c04b020f42d519288d7 P abf20d53faa04ffd9e2aec95f13abb8d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1:36379): Illegal state: must be running to vote when last-logged opid is not known
I20251023 08:00:00.765225 21379 leader_election.cc:304] T 96cc067b744f4c04b020f42d519288d7 P abf20d53faa04ffd9e2aec95f13abb8d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf20d53faa04ffd9e2aec95f13abb8d; no voters: 189a9eeaf7ef4038aecadfbb80cf8c7b, 462a37ed579b46e78a75add632eabf23
I20251023 08:00:00.766834 21541 raft_consensus.cc:2749] T 96cc067b744f4c04b020f42d519288d7 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 08:00:00.773658 21558 raft_consensus.cc:2804] T dbc2b9be96eb4372849d84bf61f9dc9a P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 FOLLOWER]: Leader election won for term 1
I20251023 08:00:00.775579 21558 raft_consensus.cc:697] T dbc2b9be96eb4372849d84bf61f9dc9a P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 LEADER]: Becoming Leader. State: Replica: 189a9eeaf7ef4038aecadfbb80cf8c7b, State: Running, Role: LEADER
I20251023 08:00:00.776925 21558 consensus_queue.cc:237] T dbc2b9be96eb4372849d84bf61f9dc9a P 189a9eeaf7ef4038aecadfbb80cf8c7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:00.780411 21557 tablet_bootstrap.cc:654] T 96cc067b744f4c04b020f42d519288d7 P 462a37ed579b46e78a75add632eabf23: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:00.781739 21414 raft_consensus.cc:2468] T dbc2b9be96eb4372849d84bf61f9dc9a P abf20d53faa04ffd9e2aec95f13abb8d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a9eeaf7ef4038aecadfbb80cf8c7b in term 1.
I20251023 08:00:00.793978 21556 tablet_bootstrap.cc:492] T 96cc067b744f4c04b020f42d519288d7 P 189a9eeaf7ef4038aecadfbb80cf8c7b: No bootstrap required, opened a new log
I20251023 08:00:00.794570 21556 ts_tablet_manager.cc:1403] T 96cc067b744f4c04b020f42d519288d7 P 189a9eeaf7ef4038aecadfbb80cf8c7b: Time spent bootstrapping tablet: real 0.058s user 0.021s sys 0.025s
I20251023 08:00:00.795143 21555 tablet_bootstrap.cc:492] T a29027605e3640d3a9cf4ecd7f312192 P abf20d53faa04ffd9e2aec95f13abb8d: No bootstrap required, opened a new log
I20251023 08:00:00.797586 21556 raft_consensus.cc:359] T 96cc067b744f4c04b020f42d519288d7 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:00.798333 21556 raft_consensus.cc:385] T 96cc067b744f4c04b020f42d519288d7 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:00.798615 21557 tablet_bootstrap.cc:492] T 96cc067b744f4c04b020f42d519288d7 P 462a37ed579b46e78a75add632eabf23: No bootstrap required, opened a new log
I20251023 08:00:00.798635 21556 raft_consensus.cc:740] T 96cc067b744f4c04b020f42d519288d7 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 189a9eeaf7ef4038aecadfbb80cf8c7b, State: Initialized, Role: FOLLOWER
I20251023 08:00:00.799252 21557 ts_tablet_manager.cc:1403] T 96cc067b744f4c04b020f42d519288d7 P 462a37ed579b46e78a75add632eabf23: Time spent bootstrapping tablet: real 0.054s user 0.011s sys 0.004s
I20251023 08:00:00.799587 21556 consensus_queue.cc:260] T 96cc067b744f4c04b020f42d519288d7 P 189a9eeaf7ef4038aecadfbb80cf8c7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:00.801626 21556 ts_tablet_manager.cc:1434] T 96cc067b744f4c04b020f42d519288d7 P 189a9eeaf7ef4038aecadfbb80cf8c7b: Time spent starting tablet: real 0.007s user 0.006s sys 0.002s
I20251023 08:00:00.801784 21165 catalog_manager.cc:5649] T dbc2b9be96eb4372849d84bf61f9dc9a P 189a9eeaf7ef4038aecadfbb80cf8c7b reported cstate change: term changed from 0 to 1, leader changed from <none> to 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1). New cstate: current_term: 1 leader_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } health_report { overall_health: UNKNOWN } } }
I20251023 08:00:00.802583 21556 tablet_bootstrap.cc:492] T 7b0fab70cb35481eb8681415447f0763 P 189a9eeaf7ef4038aecadfbb80cf8c7b: Bootstrap starting.
I20251023 08:00:00.802539 21557 raft_consensus.cc:359] T 96cc067b744f4c04b020f42d519288d7 P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:00.803404 21557 raft_consensus.cc:385] T 96cc067b744f4c04b020f42d519288d7 P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:00.803704 21557 raft_consensus.cc:740] T 96cc067b744f4c04b020f42d519288d7 P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 462a37ed579b46e78a75add632eabf23, State: Initialized, Role: FOLLOWER
I20251023 08:00:00.804018 21555 ts_tablet_manager.cc:1403] T a29027605e3640d3a9cf4ecd7f312192 P abf20d53faa04ffd9e2aec95f13abb8d: Time spent bootstrapping tablet: real 0.058s user 0.020s sys 0.027s
I20251023 08:00:00.804426 21557 consensus_queue.cc:260] T 96cc067b744f4c04b020f42d519288d7 P 462a37ed579b46e78a75add632eabf23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:00.807222 21557 ts_tablet_manager.cc:1434] T 96cc067b744f4c04b020f42d519288d7 P 462a37ed579b46e78a75add632eabf23: Time spent starting tablet: real 0.008s user 0.006s sys 0.002s
I20251023 08:00:00.809705 21556 tablet_bootstrap.cc:654] T 7b0fab70cb35481eb8681415447f0763 P 189a9eeaf7ef4038aecadfbb80cf8c7b: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:00.809942 21555 raft_consensus.cc:359] T a29027605e3640d3a9cf4ecd7f312192 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:00.810748 21555 raft_consensus.cc:385] T a29027605e3640d3a9cf4ecd7f312192 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:00.811008 21555 raft_consensus.cc:740] T a29027605e3640d3a9cf4ecd7f312192 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf20d53faa04ffd9e2aec95f13abb8d, State: Initialized, Role: FOLLOWER
I20251023 08:00:00.811731 21555 consensus_queue.cc:260] T a29027605e3640d3a9cf4ecd7f312192 P abf20d53faa04ffd9e2aec95f13abb8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:00.813539 21557 tablet_bootstrap.cc:492] T 660ad6de5e3c4d0a932f73640864f54b P 462a37ed579b46e78a75add632eabf23: Bootstrap starting.
I20251023 08:00:00.820806 21555 ts_tablet_manager.cc:1434] T a29027605e3640d3a9cf4ecd7f312192 P abf20d53faa04ffd9e2aec95f13abb8d: Time spent starting tablet: real 0.016s user 0.004s sys 0.002s
I20251023 08:00:00.821684 21541 raft_consensus.cc:493] T 7d2bc5448c3a4be6b037deea58e8e721 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 08:00:00.822170 21541 raft_consensus.cc:515] T 7d2bc5448c3a4be6b037deea58e8e721 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:00.822538 21557 tablet_bootstrap.cc:654] T 660ad6de5e3c4d0a932f73640864f54b P 462a37ed579b46e78a75add632eabf23: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:00.824115 21541 leader_election.cc:290] T 7d2bc5448c3a4be6b037deea58e8e721 P abf20d53faa04ffd9e2aec95f13abb8d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1:36379), 462a37ed579b46e78a75add632eabf23 (127.16.126.2:44879)
I20251023 08:00:00.824328 21555 tablet_bootstrap.cc:492] T a0e6c38393ac49009a25e9806355d2e4 P abf20d53faa04ffd9e2aec95f13abb8d: Bootstrap starting.
I20251023 08:00:00.826237 21338 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7d2bc5448c3a4be6b037deea58e8e721" candidate_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "462a37ed579b46e78a75add632eabf23" is_pre_election: true
I20251023 08:00:00.826962 21338 raft_consensus.cc:2468] T 7d2bc5448c3a4be6b037deea58e8e721 P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf20d53faa04ffd9e2aec95f13abb8d in term 0.
I20251023 08:00:00.828506 21267 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7d2bc5448c3a4be6b037deea58e8e721" candidate_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" is_pre_election: true
I20251023 08:00:00.830992 21267 raft_consensus.cc:2468] T 7d2bc5448c3a4be6b037deea58e8e721 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf20d53faa04ffd9e2aec95f13abb8d in term 0.
I20251023 08:00:00.831408 21555 tablet_bootstrap.cc:654] T a0e6c38393ac49009a25e9806355d2e4 P abf20d53faa04ffd9e2aec95f13abb8d: Neither blocks nor log segments found. Creating new log.
W20251023 08:00:00.833483 21213 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20251023 08:00:00.834705 21379 leader_election.cc:304] T 7d2bc5448c3a4be6b037deea58e8e721 P abf20d53faa04ffd9e2aec95f13abb8d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a9eeaf7ef4038aecadfbb80cf8c7b, abf20d53faa04ffd9e2aec95f13abb8d; no voters:
I20251023 08:00:00.835836 21541 raft_consensus.cc:2804] T 7d2bc5448c3a4be6b037deea58e8e721 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 08:00:00.839612 21557 tablet_bootstrap.cc:492] T 660ad6de5e3c4d0a932f73640864f54b P 462a37ed579b46e78a75add632eabf23: No bootstrap required, opened a new log
I20251023 08:00:00.840323 21541 raft_consensus.cc:493] T 7d2bc5448c3a4be6b037deea58e8e721 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 08:00:00.840497 21557 ts_tablet_manager.cc:1403] T 660ad6de5e3c4d0a932f73640864f54b P 462a37ed579b46e78a75add632eabf23: Time spent bootstrapping tablet: real 0.027s user 0.016s sys 0.004s
I20251023 08:00:00.841055 21541 raft_consensus.cc:3060] T 7d2bc5448c3a4be6b037deea58e8e721 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:00.843688 21557 raft_consensus.cc:359] T 660ad6de5e3c4d0a932f73640864f54b P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:00.844501 21557 raft_consensus.cc:385] T 660ad6de5e3c4d0a932f73640864f54b P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:00.844792 21557 raft_consensus.cc:740] T 660ad6de5e3c4d0a932f73640864f54b P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 462a37ed579b46e78a75add632eabf23, State: Initialized, Role: FOLLOWER
I20251023 08:00:00.848914 21557 consensus_queue.cc:260] T 660ad6de5e3c4d0a932f73640864f54b P 462a37ed579b46e78a75add632eabf23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:00.850752 21555 tablet_bootstrap.cc:492] T a0e6c38393ac49009a25e9806355d2e4 P abf20d53faa04ffd9e2aec95f13abb8d: No bootstrap required, opened a new log
I20251023 08:00:00.851330 21555 ts_tablet_manager.cc:1403] T a0e6c38393ac49009a25e9806355d2e4 P abf20d53faa04ffd9e2aec95f13abb8d: Time spent bootstrapping tablet: real 0.027s user 0.011s sys 0.003s
I20251023 08:00:00.852820 21558 raft_consensus.cc:493] T 96cc067b744f4c04b020f42d519288d7 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 08:00:00.854226 21558 raft_consensus.cc:515] T 96cc067b744f4c04b020f42d519288d7 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:00.854472 21555 raft_consensus.cc:359] T a0e6c38393ac49009a25e9806355d2e4 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:00.856112 21555 raft_consensus.cc:385] T a0e6c38393ac49009a25e9806355d2e4 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:00.856577 21555 raft_consensus.cc:740] T a0e6c38393ac49009a25e9806355d2e4 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf20d53faa04ffd9e2aec95f13abb8d, State: Initialized, Role: FOLLOWER
I20251023 08:00:00.857887 21555 consensus_queue.cc:260] T a0e6c38393ac49009a25e9806355d2e4 P abf20d53faa04ffd9e2aec95f13abb8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:00.859378 21338 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "96cc067b744f4c04b020f42d519288d7" candidate_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "462a37ed579b46e78a75add632eabf23" is_pre_election: true
I20251023 08:00:00.860338 21338 raft_consensus.cc:2468] T 96cc067b744f4c04b020f42d519288d7 P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a9eeaf7ef4038aecadfbb80cf8c7b in term 0.
I20251023 08:00:00.861874 21230 leader_election.cc:304] T 96cc067b744f4c04b020f42d519288d7 P 189a9eeaf7ef4038aecadfbb80cf8c7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a9eeaf7ef4038aecadfbb80cf8c7b, 462a37ed579b46e78a75add632eabf23; no voters:
I20251023 08:00:00.863013 21487 raft_consensus.cc:2804] T 96cc067b744f4c04b020f42d519288d7 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 08:00:00.863456 21487 raft_consensus.cc:493] T 96cc067b744f4c04b020f42d519288d7 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 08:00:00.863864 21487 raft_consensus.cc:3060] T 96cc067b744f4c04b020f42d519288d7 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:00.872202 21414 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "96cc067b744f4c04b020f42d519288d7" candidate_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" is_pre_election: true
I20251023 08:00:00.873466 21414 raft_consensus.cc:2468] T 96cc067b744f4c04b020f42d519288d7 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a9eeaf7ef4038aecadfbb80cf8c7b in term 0.
I20251023 08:00:00.875392 21558 leader_election.cc:290] T 96cc067b744f4c04b020f42d519288d7 P 189a9eeaf7ef4038aecadfbb80cf8c7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 462a37ed579b46e78a75add632eabf23 (127.16.126.2:44879), abf20d53faa04ffd9e2aec95f13abb8d (127.16.126.3:36749)
I20251023 08:00:00.875770 21557 ts_tablet_manager.cc:1434] T 660ad6de5e3c4d0a932f73640864f54b P 462a37ed579b46e78a75add632eabf23: Time spent starting tablet: real 0.035s user 0.000s sys 0.006s
I20251023 08:00:00.879153 21557 tablet_bootstrap.cc:492] T a27543620a6846028a73e83fb89458d5 P 462a37ed579b46e78a75add632eabf23: Bootstrap starting.
I20251023 08:00:00.895780 21557 tablet_bootstrap.cc:654] T a27543620a6846028a73e83fb89458d5 P 462a37ed579b46e78a75add632eabf23: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:00.895215 21541 raft_consensus.cc:515] T 7d2bc5448c3a4be6b037deea58e8e721 P abf20d53faa04ffd9e2aec95f13abb8d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:00.899597 21267 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7d2bc5448c3a4be6b037deea58e8e721" candidate_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b"
I20251023 08:00:00.900475 21267 raft_consensus.cc:3060] T 7d2bc5448c3a4be6b037deea58e8e721 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:00.920473 21556 tablet_bootstrap.cc:492] T 7b0fab70cb35481eb8681415447f0763 P 189a9eeaf7ef4038aecadfbb80cf8c7b: No bootstrap required, opened a new log
I20251023 08:00:00.930608 21556 ts_tablet_manager.cc:1403] T 7b0fab70cb35481eb8681415447f0763 P 189a9eeaf7ef4038aecadfbb80cf8c7b: Time spent bootstrapping tablet: real 0.128s user 0.034s sys 0.078s
I20251023 08:00:00.931325 21338 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7d2bc5448c3a4be6b037deea58e8e721" candidate_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "462a37ed579b46e78a75add632eabf23"
I20251023 08:00:00.932271 21338 raft_consensus.cc:3060] T 7d2bc5448c3a4be6b037deea58e8e721 P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:00.935880 21579 raft_consensus.cc:493] T a29027605e3640d3a9cf4ecd7f312192 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 08:00:00.940447 21579 raft_consensus.cc:515] T a29027605e3640d3a9cf4ecd7f312192 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:00.890347 21487 raft_consensus.cc:515] T 96cc067b744f4c04b020f42d519288d7 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:00.943435 21338 raft_consensus.cc:2468] T 7d2bc5448c3a4be6b037deea58e8e721 P 462a37ed579b46e78a75add632eabf23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf20d53faa04ffd9e2aec95f13abb8d in term 1.
I20251023 08:00:00.922050 21541 leader_election.cc:290] T 7d2bc5448c3a4be6b037deea58e8e721 P abf20d53faa04ffd9e2aec95f13abb8d [CANDIDATE]: Term 1 election: Requested vote from peers 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1:36379), 462a37ed579b46e78a75add632eabf23 (127.16.126.2:44879)
I20251023 08:00:00.925899 21267 raft_consensus.cc:2468] T 7d2bc5448c3a4be6b037deea58e8e721 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf20d53faa04ffd9e2aec95f13abb8d in term 1.
I20251023 08:00:00.945206 21414 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "96cc067b744f4c04b020f42d519288d7" candidate_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf20d53faa04ffd9e2aec95f13abb8d"
I20251023 08:00:00.945998 21414 raft_consensus.cc:3060] T 96cc067b744f4c04b020f42d519288d7 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:00.945178 21379 leader_election.cc:304] T 7d2bc5448c3a4be6b037deea58e8e721 P abf20d53faa04ffd9e2aec95f13abb8d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 462a37ed579b46e78a75add632eabf23, abf20d53faa04ffd9e2aec95f13abb8d; no voters:
I20251023 08:00:00.950611 21541 raft_consensus.cc:2804] T 7d2bc5448c3a4be6b037deea58e8e721 P abf20d53faa04ffd9e2aec95f13abb8d [term 1 FOLLOWER]: Leader election won for term 1
I20251023 08:00:00.951212 21541 raft_consensus.cc:697] T 7d2bc5448c3a4be6b037deea58e8e721 P abf20d53faa04ffd9e2aec95f13abb8d [term 1 LEADER]: Becoming Leader. State: Replica: abf20d53faa04ffd9e2aec95f13abb8d, State: Running, Role: LEADER
I20251023 08:00:00.952231 21338 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "96cc067b744f4c04b020f42d519288d7" candidate_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "462a37ed579b46e78a75add632eabf23"
I20251023 08:00:00.956810 21338 raft_consensus.cc:3060] T 96cc067b744f4c04b020f42d519288d7 P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:00.945942 21487 leader_election.cc:290] T 96cc067b744f4c04b020f42d519288d7 P 189a9eeaf7ef4038aecadfbb80cf8c7b [CANDIDATE]: Term 1 election: Requested vote from peers 462a37ed579b46e78a75add632eabf23 (127.16.126.2:44879), abf20d53faa04ffd9e2aec95f13abb8d (127.16.126.3:36749)
I20251023 08:00:00.952299 21541 consensus_queue.cc:237] T 7d2bc5448c3a4be6b037deea58e8e721 P abf20d53faa04ffd9e2aec95f13abb8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:00.966197 21555 ts_tablet_manager.cc:1434] T a0e6c38393ac49009a25e9806355d2e4 P abf20d53faa04ffd9e2aec95f13abb8d: Time spent starting tablet: real 0.115s user 0.041s sys 0.055s
I20251023 08:00:00.967051 21267 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a29027605e3640d3a9cf4ecd7f312192" candidate_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" is_pre_election: true
I20251023 08:00:00.967393 21555 tablet_bootstrap.cc:492] T 660ad6de5e3c4d0a932f73640864f54b P abf20d53faa04ffd9e2aec95f13abb8d: Bootstrap starting.
W20251023 08:00:00.968966 21379 leader_election.cc:343] T a29027605e3640d3a9cf4ecd7f312192 P abf20d53faa04ffd9e2aec95f13abb8d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1:36379): Illegal state: must be running to vote when last-logged opid is not known
I20251023 08:00:00.970433 21556 raft_consensus.cc:359] T 7b0fab70cb35481eb8681415447f0763 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:00.976670 21556 raft_consensus.cc:385] T 7b0fab70cb35481eb8681415447f0763 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:00.974071 21338 raft_consensus.cc:2468] T 96cc067b744f4c04b020f42d519288d7 P 462a37ed579b46e78a75add632eabf23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a9eeaf7ef4038aecadfbb80cf8c7b in term 1.
I20251023 08:00:00.976897 21340 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a29027605e3640d3a9cf4ecd7f312192" candidate_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "462a37ed579b46e78a75add632eabf23" is_pre_election: true
I20251023 08:00:00.974169 21414 raft_consensus.cc:2468] T 96cc067b744f4c04b020f42d519288d7 P abf20d53faa04ffd9e2aec95f13abb8d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a9eeaf7ef4038aecadfbb80cf8c7b in term 1.
I20251023 08:00:00.977196 21556 raft_consensus.cc:740] T 7b0fab70cb35481eb8681415447f0763 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 189a9eeaf7ef4038aecadfbb80cf8c7b, State: Initialized, Role: FOLLOWER
I20251023 08:00:00.978495 21233 leader_election.cc:304] T 96cc067b744f4c04b020f42d519288d7 P 189a9eeaf7ef4038aecadfbb80cf8c7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a9eeaf7ef4038aecadfbb80cf8c7b, abf20d53faa04ffd9e2aec95f13abb8d; no voters:
W20251023 08:00:00.978546 21379 leader_election.cc:343] T a29027605e3640d3a9cf4ecd7f312192 P abf20d53faa04ffd9e2aec95f13abb8d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 462a37ed579b46e78a75add632eabf23 (127.16.126.2:44879): Illegal state: must be running to vote when last-logged opid is not known
I20251023 08:00:00.975922 21579 leader_election.cc:290] T a29027605e3640d3a9cf4ecd7f312192 P abf20d53faa04ffd9e2aec95f13abb8d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1:36379), 462a37ed579b46e78a75add632eabf23 (127.16.126.2:44879)
I20251023 08:00:00.979223 21379 leader_election.cc:304] T a29027605e3640d3a9cf4ecd7f312192 P abf20d53faa04ffd9e2aec95f13abb8d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf20d53faa04ffd9e2aec95f13abb8d; no voters: 189a9eeaf7ef4038aecadfbb80cf8c7b, 462a37ed579b46e78a75add632eabf23
I20251023 08:00:00.979504 21580 raft_consensus.cc:2804] T 96cc067b744f4c04b020f42d519288d7 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 FOLLOWER]: Leader election won for term 1
I20251023 08:00:00.979110 21556 consensus_queue.cc:260] T 7b0fab70cb35481eb8681415447f0763 P 189a9eeaf7ef4038aecadfbb80cf8c7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:00.980077 21580 raft_consensus.cc:697] T 96cc067b744f4c04b020f42d519288d7 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 LEADER]: Becoming Leader. State: Replica: 189a9eeaf7ef4038aecadfbb80cf8c7b, State: Running, Role: LEADER
I20251023 08:00:00.980477 21579 raft_consensus.cc:2749] T a29027605e3640d3a9cf4ecd7f312192 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 08:00:00.980962 21580 consensus_queue.cc:237] T 96cc067b744f4c04b020f42d519288d7 P 189a9eeaf7ef4038aecadfbb80cf8c7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:00.982182 21556 ts_tablet_manager.cc:1434] T 7b0fab70cb35481eb8681415447f0763 P 189a9eeaf7ef4038aecadfbb80cf8c7b: Time spent starting tablet: real 0.051s user 0.006s sys 0.004s
I20251023 08:00:00.983309 21556 tablet_bootstrap.cc:492] T 660ad6de5e3c4d0a932f73640864f54b P 189a9eeaf7ef4038aecadfbb80cf8c7b: Bootstrap starting.
I20251023 08:00:00.975589 21555 tablet_bootstrap.cc:654] T 660ad6de5e3c4d0a932f73640864f54b P abf20d53faa04ffd9e2aec95f13abb8d: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:00.983618 21557 tablet_bootstrap.cc:492] T a27543620a6846028a73e83fb89458d5 P 462a37ed579b46e78a75add632eabf23: No bootstrap required, opened a new log
I20251023 08:00:00.984261 21557 ts_tablet_manager.cc:1403] T a27543620a6846028a73e83fb89458d5 P 462a37ed579b46e78a75add632eabf23: Time spent bootstrapping tablet: real 0.105s user 0.016s sys 0.072s
I20251023 08:00:00.987711 21557 raft_consensus.cc:359] T a27543620a6846028a73e83fb89458d5 P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:00.988517 21557 raft_consensus.cc:385] T a27543620a6846028a73e83fb89458d5 P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:00.988860 21557 raft_consensus.cc:740] T a27543620a6846028a73e83fb89458d5 P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 462a37ed579b46e78a75add632eabf23, State: Initialized, Role: FOLLOWER
I20251023 08:00:00.989662 21557 consensus_queue.cc:260] T a27543620a6846028a73e83fb89458d5 P 462a37ed579b46e78a75add632eabf23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:00.990626 21556 tablet_bootstrap.cc:654] T 660ad6de5e3c4d0a932f73640864f54b P 189a9eeaf7ef4038aecadfbb80cf8c7b: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:00.992522 21557 ts_tablet_manager.cc:1434] T a27543620a6846028a73e83fb89458d5 P 462a37ed579b46e78a75add632eabf23: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20251023 08:00:00.992336 21165 catalog_manager.cc:5649] T 7d2bc5448c3a4be6b037deea58e8e721 P abf20d53faa04ffd9e2aec95f13abb8d reported cstate change: term changed from 0 to 1, leader changed from <none> to abf20d53faa04ffd9e2aec95f13abb8d (127.16.126.3). New cstate: current_term: 1 leader_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } health_report { overall_health: HEALTHY } } }
I20251023 08:00:00.993840 21557 tablet_bootstrap.cc:492] T a29027605e3640d3a9cf4ecd7f312192 P 462a37ed579b46e78a75add632eabf23: Bootstrap starting.
I20251023 08:00:01.001945 21557 tablet_bootstrap.cc:654] T a29027605e3640d3a9cf4ecd7f312192 P 462a37ed579b46e78a75add632eabf23: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:01.002588 21556 tablet_bootstrap.cc:492] T 660ad6de5e3c4d0a932f73640864f54b P 189a9eeaf7ef4038aecadfbb80cf8c7b: No bootstrap required, opened a new log
I20251023 08:00:01.005820 21556 ts_tablet_manager.cc:1403] T 660ad6de5e3c4d0a932f73640864f54b P 189a9eeaf7ef4038aecadfbb80cf8c7b: Time spent bootstrapping tablet: real 0.023s user 0.013s sys 0.003s
I20251023 08:00:01.005852 21571 raft_consensus.cc:493] T 660ad6de5e3c4d0a932f73640864f54b P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 08:00:01.006503 21571 raft_consensus.cc:515] T 660ad6de5e3c4d0a932f73640864f54b P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:01.008595 21571 leader_election.cc:290] T 660ad6de5e3c4d0a932f73640864f54b P 462a37ed579b46e78a75add632eabf23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1:36379), abf20d53faa04ffd9e2aec95f13abb8d (127.16.126.3:36749)
I20251023 08:00:01.008961 21556 raft_consensus.cc:359] T 660ad6de5e3c4d0a932f73640864f54b P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:01.009909 21556 raft_consensus.cc:385] T 660ad6de5e3c4d0a932f73640864f54b P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:01.010246 21556 raft_consensus.cc:740] T 660ad6de5e3c4d0a932f73640864f54b P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 189a9eeaf7ef4038aecadfbb80cf8c7b, State: Initialized, Role: FOLLOWER
I20251023 08:00:01.010556 21416 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "660ad6de5e3c4d0a932f73640864f54b" candidate_uuid: "462a37ed579b46e78a75add632eabf23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" is_pre_election: true
I20251023 08:00:01.011188 21556 consensus_queue.cc:260] T 660ad6de5e3c4d0a932f73640864f54b P 189a9eeaf7ef4038aecadfbb80cf8c7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
W20251023 08:00:01.012090 21308 leader_election.cc:343] T 660ad6de5e3c4d0a932f73640864f54b P 462a37ed579b46e78a75add632eabf23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abf20d53faa04ffd9e2aec95f13abb8d (127.16.126.3:36749): Illegal state: must be running to vote when last-logged opid is not known
I20251023 08:00:01.013702 21267 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "660ad6de5e3c4d0a932f73640864f54b" candidate_uuid: "462a37ed579b46e78a75add632eabf23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" is_pre_election: true
I20251023 08:00:01.014426 21556 ts_tablet_manager.cc:1434] T 660ad6de5e3c4d0a932f73640864f54b P 189a9eeaf7ef4038aecadfbb80cf8c7b: Time spent starting tablet: real 0.008s user 0.006s sys 0.002s
I20251023 08:00:01.014396 21267 raft_consensus.cc:2468] T 660ad6de5e3c4d0a932f73640864f54b P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 462a37ed579b46e78a75add632eabf23 in term 0.
I20251023 08:00:01.015522 21556 tablet_bootstrap.cc:492] T a27543620a6846028a73e83fb89458d5 P 189a9eeaf7ef4038aecadfbb80cf8c7b: Bootstrap starting.
I20251023 08:00:01.015771 21305 leader_election.cc:304] T 660ad6de5e3c4d0a932f73640864f54b P 462a37ed579b46e78a75add632eabf23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a9eeaf7ef4038aecadfbb80cf8c7b, 462a37ed579b46e78a75add632eabf23; no voters: abf20d53faa04ffd9e2aec95f13abb8d
I20251023 08:00:01.016259 21555 tablet_bootstrap.cc:492] T 660ad6de5e3c4d0a932f73640864f54b P abf20d53faa04ffd9e2aec95f13abb8d: No bootstrap required, opened a new log
I20251023 08:00:01.016754 21555 ts_tablet_manager.cc:1403] T 660ad6de5e3c4d0a932f73640864f54b P abf20d53faa04ffd9e2aec95f13abb8d: Time spent bootstrapping tablet: real 0.050s user 0.015s sys 0.001s
I20251023 08:00:01.017087 21571 raft_consensus.cc:2804] T 660ad6de5e3c4d0a932f73640864f54b P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 08:00:01.017591 21571 raft_consensus.cc:493] T 660ad6de5e3c4d0a932f73640864f54b P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 08:00:01.017992 21571 raft_consensus.cc:3060] T 660ad6de5e3c4d0a932f73640864f54b P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:01.019591 21555 raft_consensus.cc:359] T 660ad6de5e3c4d0a932f73640864f54b P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:01.020354 21555 raft_consensus.cc:385] T 660ad6de5e3c4d0a932f73640864f54b P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:01.020659 21555 raft_consensus.cc:740] T 660ad6de5e3c4d0a932f73640864f54b P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf20d53faa04ffd9e2aec95f13abb8d, State: Initialized, Role: FOLLOWER
I20251023 08:00:01.022029 21556 tablet_bootstrap.cc:654] T a27543620a6846028a73e83fb89458d5 P 189a9eeaf7ef4038aecadfbb80cf8c7b: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:01.021668 21555 consensus_queue.cc:260] T 660ad6de5e3c4d0a932f73640864f54b P abf20d53faa04ffd9e2aec95f13abb8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:01.024210 21555 ts_tablet_manager.cc:1434] T 660ad6de5e3c4d0a932f73640864f54b P abf20d53faa04ffd9e2aec95f13abb8d: Time spent starting tablet: real 0.007s user 0.004s sys 0.004s
I20251023 08:00:01.025175 21555 tablet_bootstrap.cc:492] T 94c7110bc7d84a09886191fcf82e530f P abf20d53faa04ffd9e2aec95f13abb8d: Bootstrap starting.
I20251023 08:00:01.026597 21571 raft_consensus.cc:515] T 660ad6de5e3c4d0a932f73640864f54b P 462a37ed579b46e78a75add632eabf23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:01.029829 21164 catalog_manager.cc:5649] T 96cc067b744f4c04b020f42d519288d7 P 189a9eeaf7ef4038aecadfbb80cf8c7b reported cstate change: term changed from 0 to 1, leader changed from <none> to 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1). New cstate: current_term: 1 leader_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } health_report { overall_health: UNKNOWN } } }
I20251023 08:00:01.031726 21555 tablet_bootstrap.cc:654] T 94c7110bc7d84a09886191fcf82e530f P abf20d53faa04ffd9e2aec95f13abb8d: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:01.032064 21267 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "660ad6de5e3c4d0a932f73640864f54b" candidate_uuid: "462a37ed579b46e78a75add632eabf23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b"
I20251023 08:00:01.032904 21267 raft_consensus.cc:3060] T 660ad6de5e3c4d0a932f73640864f54b P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:01.043190 21555 tablet_bootstrap.cc:492] T 94c7110bc7d84a09886191fcf82e530f P abf20d53faa04ffd9e2aec95f13abb8d: No bootstrap required, opened a new log
I20251023 08:00:01.043759 21555 ts_tablet_manager.cc:1403] T 94c7110bc7d84a09886191fcf82e530f P abf20d53faa04ffd9e2aec95f13abb8d: Time spent bootstrapping tablet: real 0.019s user 0.016s sys 0.000s
I20251023 08:00:01.044543 21267 raft_consensus.cc:2468] T 660ad6de5e3c4d0a932f73640864f54b P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 462a37ed579b46e78a75add632eabf23 in term 1.
I20251023 08:00:01.046339 21555 raft_consensus.cc:359] T 94c7110bc7d84a09886191fcf82e530f P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:01.047364 21555 raft_consensus.cc:385] T 94c7110bc7d84a09886191fcf82e530f P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:01.047153 21305 leader_election.cc:304] T 660ad6de5e3c4d0a932f73640864f54b P 462a37ed579b46e78a75add632eabf23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a9eeaf7ef4038aecadfbb80cf8c7b, 462a37ed579b46e78a75add632eabf23; no voters:
I20251023 08:00:01.047704 21555 raft_consensus.cc:740] T 94c7110bc7d84a09886191fcf82e530f P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf20d53faa04ffd9e2aec95f13abb8d, State: Initialized, Role: FOLLOWER
I20251023 08:00:01.048477 21538 raft_consensus.cc:2804] T 660ad6de5e3c4d0a932f73640864f54b P 462a37ed579b46e78a75add632eabf23 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 08:00:01.048393 21555 consensus_queue.cc:260] T 94c7110bc7d84a09886191fcf82e530f P abf20d53faa04ffd9e2aec95f13abb8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:01.050613 21555 ts_tablet_manager.cc:1434] T 94c7110bc7d84a09886191fcf82e530f P abf20d53faa04ffd9e2aec95f13abb8d: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20251023 08:00:01.051537 21555 tablet_bootstrap.cc:492] T 7b0fab70cb35481eb8681415447f0763 P abf20d53faa04ffd9e2aec95f13abb8d: Bootstrap starting.
I20251023 08:00:01.059196 21538 raft_consensus.cc:697] T 660ad6de5e3c4d0a932f73640864f54b P 462a37ed579b46e78a75add632eabf23 [term 1 LEADER]: Becoming Leader. State: Replica: 462a37ed579b46e78a75add632eabf23, State: Running, Role: LEADER
I20251023 08:00:01.060734 21538 consensus_queue.cc:237] T 660ad6de5e3c4d0a932f73640864f54b P 462a37ed579b46e78a75add632eabf23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:01.063236 21541 raft_consensus.cc:493] T a0e6c38393ac49009a25e9806355d2e4 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 08:00:01.064270 21541 raft_consensus.cc:515] T a0e6c38393ac49009a25e9806355d2e4 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:01.066323 21414 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "660ad6de5e3c4d0a932f73640864f54b" candidate_uuid: "462a37ed579b46e78a75add632eabf23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf20d53faa04ffd9e2aec95f13abb8d"
I20251023 08:00:01.067340 21414 raft_consensus.cc:3060] T 660ad6de5e3c4d0a932f73640864f54b P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:01.067600 21265 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a0e6c38393ac49009a25e9806355d2e4" candidate_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" is_pre_election: true
W20251023 08:00:01.069016 21379 leader_election.cc:343] T a0e6c38393ac49009a25e9806355d2e4 P abf20d53faa04ffd9e2aec95f13abb8d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1:36379): Illegal state: must be running to vote when last-logged opid is not known
I20251023 08:00:01.069723 21571 leader_election.cc:290] T 660ad6de5e3c4d0a932f73640864f54b P 462a37ed579b46e78a75add632eabf23 [CANDIDATE]: Term 1 election: Requested vote from peers 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1:36379), abf20d53faa04ffd9e2aec95f13abb8d (127.16.126.3:36749)
I20251023 08:00:01.074625 21555 tablet_bootstrap.cc:654] T 7b0fab70cb35481eb8681415447f0763 P abf20d53faa04ffd9e2aec95f13abb8d: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:01.079787 21338 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a0e6c38393ac49009a25e9806355d2e4" candidate_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "462a37ed579b46e78a75add632eabf23" is_pre_election: true
I20251023 08:00:01.080708 21541 leader_election.cc:290] T a0e6c38393ac49009a25e9806355d2e4 P abf20d53faa04ffd9e2aec95f13abb8d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1:36379), 462a37ed579b46e78a75add632eabf23 (127.16.126.2:44879)
I20251023 08:00:01.089780 21163 catalog_manager.cc:5649] T 660ad6de5e3c4d0a932f73640864f54b P 462a37ed579b46e78a75add632eabf23 reported cstate change: term changed from 0 to 1, leader changed from <none> to 462a37ed579b46e78a75add632eabf23 (127.16.126.2). New cstate: current_term: 1 leader_uuid: "462a37ed579b46e78a75add632eabf23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } health_report { overall_health: UNKNOWN } } }
I20251023 08:00:01.095324 21541 raft_consensus.cc:493] T a27543620a6846028a73e83fb89458d5 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 08:00:01.101281 21541 raft_consensus.cc:515] T a27543620a6846028a73e83fb89458d5 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:01.106640 21555 tablet_bootstrap.cc:492] T 7b0fab70cb35481eb8681415447f0763 P abf20d53faa04ffd9e2aec95f13abb8d: No bootstrap required, opened a new log
I20251023 08:00:01.107203 21555 ts_tablet_manager.cc:1403] T 7b0fab70cb35481eb8681415447f0763 P abf20d53faa04ffd9e2aec95f13abb8d: Time spent bootstrapping tablet: real 0.056s user 0.007s sys 0.003s
I20251023 08:00:01.108255 21267 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a27543620a6846028a73e83fb89458d5" candidate_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" is_pre_election: true
W20251023 08:00:01.112130 21379 leader_election.cc:343] T a27543620a6846028a73e83fb89458d5 P abf20d53faa04ffd9e2aec95f13abb8d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1:36379): Illegal state: must be running to vote when last-logged opid is not known
I20251023 08:00:01.115908 21580 raft_consensus.cc:493] T 94c7110bc7d84a09886191fcf82e530f P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 08:00:01.110085 21555 raft_consensus.cc:359] T 7b0fab70cb35481eb8681415447f0763 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:01.116742 21555 raft_consensus.cc:385] T 7b0fab70cb35481eb8681415447f0763 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:01.116518 21580 raft_consensus.cc:515] T 94c7110bc7d84a09886191fcf82e530f P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:01.117035 21555 raft_consensus.cc:740] T 7b0fab70cb35481eb8681415447f0763 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf20d53faa04ffd9e2aec95f13abb8d, State: Initialized, Role: FOLLOWER
I20251023 08:00:01.118793 21555 consensus_queue.cc:260] T 7b0fab70cb35481eb8681415447f0763 P abf20d53faa04ffd9e2aec95f13abb8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:01.119740 21414 raft_consensus.cc:2468] T 660ad6de5e3c4d0a932f73640864f54b P abf20d53faa04ffd9e2aec95f13abb8d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 462a37ed579b46e78a75add632eabf23 in term 1.
I20251023 08:00:01.120033 21340 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "94c7110bc7d84a09886191fcf82e530f" candidate_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "462a37ed579b46e78a75add632eabf23" is_pre_election: true
I20251023 08:00:01.120724 21340 raft_consensus.cc:2468] T 94c7110bc7d84a09886191fcf82e530f P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a9eeaf7ef4038aecadfbb80cf8c7b in term 0.
I20251023 08:00:01.121089 21555 ts_tablet_manager.cc:1434] T 7b0fab70cb35481eb8681415447f0763 P abf20d53faa04ffd9e2aec95f13abb8d: Time spent starting tablet: real 0.014s user 0.005s sys 0.000s
I20251023 08:00:01.121906 21541 leader_election.cc:290] T a27543620a6846028a73e83fb89458d5 P abf20d53faa04ffd9e2aec95f13abb8d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1:36379), 462a37ed579b46e78a75add632eabf23 (127.16.126.2:44879)
I20251023 08:00:01.122155 21230 leader_election.cc:304] T 94c7110bc7d84a09886191fcf82e530f P 189a9eeaf7ef4038aecadfbb80cf8c7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a9eeaf7ef4038aecadfbb80cf8c7b, 462a37ed579b46e78a75add632eabf23; no voters:
I20251023 08:00:01.123211 21558 raft_consensus.cc:2804] T 94c7110bc7d84a09886191fcf82e530f P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 08:00:01.123569 21558 raft_consensus.cc:493] T 94c7110bc7d84a09886191fcf82e530f P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 08:00:01.123934 21558 raft_consensus.cc:3060] T 94c7110bc7d84a09886191fcf82e530f P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:01.126562 21556 tablet_bootstrap.cc:492] T a27543620a6846028a73e83fb89458d5 P 189a9eeaf7ef4038aecadfbb80cf8c7b: No bootstrap required, opened a new log
I20251023 08:00:01.128460 21556 ts_tablet_manager.cc:1403] T a27543620a6846028a73e83fb89458d5 P 189a9eeaf7ef4038aecadfbb80cf8c7b: Time spent bootstrapping tablet: real 0.113s user 0.045s sys 0.064s
I20251023 08:00:01.130756 21557 tablet_bootstrap.cc:492] T a29027605e3640d3a9cf4ecd7f312192 P 462a37ed579b46e78a75add632eabf23: No bootstrap required, opened a new log
I20251023 08:00:01.131307 21557 ts_tablet_manager.cc:1403] T a29027605e3640d3a9cf4ecd7f312192 P 462a37ed579b46e78a75add632eabf23: Time spent bootstrapping tablet: real 0.138s user 0.026s sys 0.010s
I20251023 08:00:01.131325 21556 raft_consensus.cc:359] T a27543620a6846028a73e83fb89458d5 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:01.132212 21556 raft_consensus.cc:385] T a27543620a6846028a73e83fb89458d5 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:01.132515 21556 raft_consensus.cc:740] T a27543620a6846028a73e83fb89458d5 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 189a9eeaf7ef4038aecadfbb80cf8c7b, State: Initialized, Role: FOLLOWER
I20251023 08:00:01.133076 21580 leader_election.cc:290] T 94c7110bc7d84a09886191fcf82e530f P 189a9eeaf7ef4038aecadfbb80cf8c7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 462a37ed579b46e78a75add632eabf23 (127.16.126.2:44879), abf20d53faa04ffd9e2aec95f13abb8d (127.16.126.3:36749)
I20251023 08:00:01.133226 21556 consensus_queue.cc:260] T a27543620a6846028a73e83fb89458d5 P 189a9eeaf7ef4038aecadfbb80cf8c7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
W20251023 08:00:01.134735 21379 leader_election.cc:343] T a0e6c38393ac49009a25e9806355d2e4 P abf20d53faa04ffd9e2aec95f13abb8d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 462a37ed579b46e78a75add632eabf23 (127.16.126.2:44879): Illegal state: must be running to vote when last-logged opid is not known
I20251023 08:00:01.135257 21379 leader_election.cc:304] T a0e6c38393ac49009a25e9806355d2e4 P abf20d53faa04ffd9e2aec95f13abb8d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf20d53faa04ffd9e2aec95f13abb8d; no voters: 189a9eeaf7ef4038aecadfbb80cf8c7b, 462a37ed579b46e78a75add632eabf23
I20251023 08:00:01.136566 21579 raft_consensus.cc:2749] T a0e6c38393ac49009a25e9806355d2e4 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 08:00:01.136897 21556 ts_tablet_manager.cc:1434] T a27543620a6846028a73e83fb89458d5 P 189a9eeaf7ef4038aecadfbb80cf8c7b: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20251023 08:00:01.134428 21557 raft_consensus.cc:359] T a29027605e3640d3a9cf4ecd7f312192 P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:01.133795 21415 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "94c7110bc7d84a09886191fcf82e530f" candidate_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" is_pre_election: true
I20251023 08:00:01.138746 21557 raft_consensus.cc:385] T a29027605e3640d3a9cf4ecd7f312192 P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:01.138955 21415 raft_consensus.cc:2468] T 94c7110bc7d84a09886191fcf82e530f P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a9eeaf7ef4038aecadfbb80cf8c7b in term 0.
I20251023 08:00:01.139084 21557 raft_consensus.cc:740] T a29027605e3640d3a9cf4ecd7f312192 P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 462a37ed579b46e78a75add632eabf23, State: Initialized, Role: FOLLOWER
I20251023 08:00:01.138218 21338 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a27543620a6846028a73e83fb89458d5" candidate_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "462a37ed579b46e78a75add632eabf23" is_pre_election: true
I20251023 08:00:01.139792 21558 raft_consensus.cc:515] T 94c7110bc7d84a09886191fcf82e530f P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:01.140288 21557 consensus_queue.cc:260] T a29027605e3640d3a9cf4ecd7f312192 P 462a37ed579b46e78a75add632eabf23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:01.141746 21556 tablet_bootstrap.cc:492] T a0e6c38393ac49009a25e9806355d2e4 P 189a9eeaf7ef4038aecadfbb80cf8c7b: Bootstrap starting.
I20251023 08:00:01.140281 21338 raft_consensus.cc:2468] T a27543620a6846028a73e83fb89458d5 P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf20d53faa04ffd9e2aec95f13abb8d in term 0.
I20251023 08:00:01.143594 21340 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "94c7110bc7d84a09886191fcf82e530f" candidate_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "462a37ed579b46e78a75add632eabf23"
I20251023 08:00:01.143059 21557 ts_tablet_manager.cc:1434] T a29027605e3640d3a9cf4ecd7f312192 P 462a37ed579b46e78a75add632eabf23: Time spent starting tablet: real 0.011s user 0.008s sys 0.000s
I20251023 08:00:01.144210 21340 raft_consensus.cc:3060] T 94c7110bc7d84a09886191fcf82e530f P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:01.145319 21557 tablet_bootstrap.cc:492] T 7b0fab70cb35481eb8681415447f0763 P 462a37ed579b46e78a75add632eabf23: Bootstrap starting.
I20251023 08:00:01.148696 21558 leader_election.cc:290] T 94c7110bc7d84a09886191fcf82e530f P 189a9eeaf7ef4038aecadfbb80cf8c7b [CANDIDATE]: Term 1 election: Requested vote from peers 462a37ed579b46e78a75add632eabf23 (127.16.126.2:44879), abf20d53faa04ffd9e2aec95f13abb8d (127.16.126.3:36749)
I20251023 08:00:01.149801 21415 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "94c7110bc7d84a09886191fcf82e530f" candidate_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf20d53faa04ffd9e2aec95f13abb8d"
I20251023 08:00:01.150447 21415 raft_consensus.cc:3060] T 94c7110bc7d84a09886191fcf82e530f P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:01.152470 21557 tablet_bootstrap.cc:654] T 7b0fab70cb35481eb8681415447f0763 P 462a37ed579b46e78a75add632eabf23: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:01.156925 21556 tablet_bootstrap.cc:654] T a0e6c38393ac49009a25e9806355d2e4 P 189a9eeaf7ef4038aecadfbb80cf8c7b: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:01.159862 21340 raft_consensus.cc:2468] T 94c7110bc7d84a09886191fcf82e530f P 462a37ed579b46e78a75add632eabf23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a9eeaf7ef4038aecadfbb80cf8c7b in term 1.
I20251023 08:00:01.163071 21230 leader_election.cc:304] T 94c7110bc7d84a09886191fcf82e530f P 189a9eeaf7ef4038aecadfbb80cf8c7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a9eeaf7ef4038aecadfbb80cf8c7b, 462a37ed579b46e78a75add632eabf23; no voters:
I20251023 08:00:01.164039 21558 raft_consensus.cc:2804] T 94c7110bc7d84a09886191fcf82e530f P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 FOLLOWER]: Leader election won for term 1
I20251023 08:00:01.164544 21558 raft_consensus.cc:697] T 94c7110bc7d84a09886191fcf82e530f P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 LEADER]: Becoming Leader. State: Replica: 189a9eeaf7ef4038aecadfbb80cf8c7b, State: Running, Role: LEADER
I20251023 08:00:01.165364 21558 consensus_queue.cc:237] T 94c7110bc7d84a09886191fcf82e530f P 189a9eeaf7ef4038aecadfbb80cf8c7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:01.170353 21556 tablet_bootstrap.cc:492] T a0e6c38393ac49009a25e9806355d2e4 P 189a9eeaf7ef4038aecadfbb80cf8c7b: No bootstrap required, opened a new log
I20251023 08:00:01.171123 21556 ts_tablet_manager.cc:1403] T a0e6c38393ac49009a25e9806355d2e4 P 189a9eeaf7ef4038aecadfbb80cf8c7b: Time spent bootstrapping tablet: real 0.030s user 0.009s sys 0.011s
I20251023 08:00:01.174767 21556 raft_consensus.cc:359] T a0e6c38393ac49009a25e9806355d2e4 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:01.175690 21556 raft_consensus.cc:385] T a0e6c38393ac49009a25e9806355d2e4 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:01.176033 21556 raft_consensus.cc:740] T a0e6c38393ac49009a25e9806355d2e4 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 189a9eeaf7ef4038aecadfbb80cf8c7b, State: Initialized, Role: FOLLOWER
I20251023 08:00:01.176872 21556 consensus_queue.cc:260] T a0e6c38393ac49009a25e9806355d2e4 P 189a9eeaf7ef4038aecadfbb80cf8c7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:01.178015 21379 leader_election.cc:304] T a27543620a6846028a73e83fb89458d5 P abf20d53faa04ffd9e2aec95f13abb8d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 462a37ed579b46e78a75add632eabf23, abf20d53faa04ffd9e2aec95f13abb8d; no voters: 189a9eeaf7ef4038aecadfbb80cf8c7b
I20251023 08:00:01.178954 21541 raft_consensus.cc:2804] T a27543620a6846028a73e83fb89458d5 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 08:00:01.179464 21541 raft_consensus.cc:493] T a27543620a6846028a73e83fb89458d5 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 08:00:01.179891 21541 raft_consensus.cc:3060] T a27543620a6846028a73e83fb89458d5 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:01.189219 21163 catalog_manager.cc:5649] T 94c7110bc7d84a09886191fcf82e530f P 189a9eeaf7ef4038aecadfbb80cf8c7b reported cstate change: term changed from 0 to 1, leader changed from <none> to 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1). New cstate: current_term: 1 leader_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } health_report { overall_health: UNKNOWN } } }
I20251023 08:00:01.191004 21415 raft_consensus.cc:2468] T 94c7110bc7d84a09886191fcf82e530f P abf20d53faa04ffd9e2aec95f13abb8d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a9eeaf7ef4038aecadfbb80cf8c7b in term 1.
I20251023 08:00:01.190690 21541 raft_consensus.cc:515] T a27543620a6846028a73e83fb89458d5 P abf20d53faa04ffd9e2aec95f13abb8d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:01.193125 21556 ts_tablet_manager.cc:1434] T a0e6c38393ac49009a25e9806355d2e4 P 189a9eeaf7ef4038aecadfbb80cf8c7b: Time spent starting tablet: real 0.022s user 0.009s sys 0.000s
I20251023 08:00:01.196832 21556 tablet_bootstrap.cc:492] T a29027605e3640d3a9cf4ecd7f312192 P 189a9eeaf7ef4038aecadfbb80cf8c7b: Bootstrap starting.
I20251023 08:00:01.197350 21541 leader_election.cc:290] T a27543620a6846028a73e83fb89458d5 P abf20d53faa04ffd9e2aec95f13abb8d [CANDIDATE]: Term 1 election: Requested vote from peers 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1:36379), 462a37ed579b46e78a75add632eabf23 (127.16.126.2:44879)
I20251023 08:00:01.199847 21557 tablet_bootstrap.cc:492] T 7b0fab70cb35481eb8681415447f0763 P 462a37ed579b46e78a75add632eabf23: No bootstrap required, opened a new log
I20251023 08:00:01.200440 21557 ts_tablet_manager.cc:1403] T 7b0fab70cb35481eb8681415447f0763 P 462a37ed579b46e78a75add632eabf23: Time spent bootstrapping tablet: real 0.055s user 0.023s sys 0.027s
I20251023 08:00:01.200714 21267 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a27543620a6846028a73e83fb89458d5" candidate_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b"
I20251023 08:00:01.201388 21267 raft_consensus.cc:3060] T a27543620a6846028a73e83fb89458d5 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:01.202508 21556 tablet_bootstrap.cc:654] T a29027605e3640d3a9cf4ecd7f312192 P 189a9eeaf7ef4038aecadfbb80cf8c7b: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:01.203088 21557 raft_consensus.cc:359] T 7b0fab70cb35481eb8681415447f0763 P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:01.203830 21557 raft_consensus.cc:385] T 7b0fab70cb35481eb8681415447f0763 P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:01.204077 21557 raft_consensus.cc:740] T 7b0fab70cb35481eb8681415447f0763 P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 462a37ed579b46e78a75add632eabf23, State: Initialized, Role: FOLLOWER
I20251023 08:00:01.204721 21557 consensus_queue.cc:260] T 7b0fab70cb35481eb8681415447f0763 P 462a37ed579b46e78a75add632eabf23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:01.206918 21340 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a27543620a6846028a73e83fb89458d5" candidate_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "462a37ed579b46e78a75add632eabf23"
I20251023 08:00:01.207598 21340 raft_consensus.cc:3060] T a27543620a6846028a73e83fb89458d5 P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:01.207692 21557 ts_tablet_manager.cc:1434] T 7b0fab70cb35481eb8681415447f0763 P 462a37ed579b46e78a75add632eabf23: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20251023 08:00:01.209101 21557 tablet_bootstrap.cc:492] T a0e6c38393ac49009a25e9806355d2e4 P 462a37ed579b46e78a75add632eabf23: Bootstrap starting.
I20251023 08:00:01.216205 21557 tablet_bootstrap.cc:654] T a0e6c38393ac49009a25e9806355d2e4 P 462a37ed579b46e78a75add632eabf23: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:01.217796 21340 raft_consensus.cc:2468] T a27543620a6846028a73e83fb89458d5 P 462a37ed579b46e78a75add632eabf23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf20d53faa04ffd9e2aec95f13abb8d in term 1.
I20251023 08:00:01.220193 21379 leader_election.cc:304] T a27543620a6846028a73e83fb89458d5 P abf20d53faa04ffd9e2aec95f13abb8d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 462a37ed579b46e78a75add632eabf23, abf20d53faa04ffd9e2aec95f13abb8d; no voters:
I20251023 08:00:01.221580 21541 raft_consensus.cc:2804] T a27543620a6846028a73e83fb89458d5 P abf20d53faa04ffd9e2aec95f13abb8d [term 1 FOLLOWER]: Leader election won for term 1
I20251023 08:00:01.222162 21541 raft_consensus.cc:697] T a27543620a6846028a73e83fb89458d5 P abf20d53faa04ffd9e2aec95f13abb8d [term 1 LEADER]: Becoming Leader. State: Replica: abf20d53faa04ffd9e2aec95f13abb8d, State: Running, Role: LEADER
I20251023 08:00:01.223276 21556 tablet_bootstrap.cc:492] T a29027605e3640d3a9cf4ecd7f312192 P 189a9eeaf7ef4038aecadfbb80cf8c7b: No bootstrap required, opened a new log
I20251023 08:00:01.223806 21556 ts_tablet_manager.cc:1403] T a29027605e3640d3a9cf4ecd7f312192 P 189a9eeaf7ef4038aecadfbb80cf8c7b: Time spent bootstrapping tablet: real 0.027s user 0.006s sys 0.011s
I20251023 08:00:01.223007 21267 raft_consensus.cc:2468] T a27543620a6846028a73e83fb89458d5 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf20d53faa04ffd9e2aec95f13abb8d in term 1.
I20251023 08:00:01.224483 21557 tablet_bootstrap.cc:492] T a0e6c38393ac49009a25e9806355d2e4 P 462a37ed579b46e78a75add632eabf23: No bootstrap required, opened a new log
I20251023 08:00:01.224967 21557 ts_tablet_manager.cc:1403] T a0e6c38393ac49009a25e9806355d2e4 P 462a37ed579b46e78a75add632eabf23: Time spent bootstrapping tablet: real 0.016s user 0.011s sys 0.003s
I20251023 08:00:01.223007 21541 consensus_queue.cc:237] T a27543620a6846028a73e83fb89458d5 P abf20d53faa04ffd9e2aec95f13abb8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:01.226512 21556 raft_consensus.cc:359] T a29027605e3640d3a9cf4ecd7f312192 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:01.227200 21556 raft_consensus.cc:385] T a29027605e3640d3a9cf4ecd7f312192 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:01.227478 21556 raft_consensus.cc:740] T a29027605e3640d3a9cf4ecd7f312192 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 189a9eeaf7ef4038aecadfbb80cf8c7b, State: Initialized, Role: FOLLOWER
I20251023 08:00:01.227428 21557 raft_consensus.cc:359] T a0e6c38393ac49009a25e9806355d2e4 P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:01.228235 21557 raft_consensus.cc:385] T a0e6c38393ac49009a25e9806355d2e4 P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:01.228577 21557 raft_consensus.cc:740] T a0e6c38393ac49009a25e9806355d2e4 P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 462a37ed579b46e78a75add632eabf23, State: Initialized, Role: FOLLOWER
I20251023 08:00:01.228298 21556 consensus_queue.cc:260] T a29027605e3640d3a9cf4ecd7f312192 P 189a9eeaf7ef4038aecadfbb80cf8c7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:01.229254 21557 consensus_queue.cc:260] T a0e6c38393ac49009a25e9806355d2e4 P 462a37ed579b46e78a75add632eabf23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:01.231494 21557 ts_tablet_manager.cc:1434] T a0e6c38393ac49009a25e9806355d2e4 P 462a37ed579b46e78a75add632eabf23: Time spent starting tablet: real 0.006s user 0.002s sys 0.003s
I20251023 08:00:01.233186 21556 ts_tablet_manager.cc:1434] T a29027605e3640d3a9cf4ecd7f312192 P 189a9eeaf7ef4038aecadfbb80cf8c7b: Time spent starting tablet: real 0.009s user 0.005s sys 0.001s
I20251023 08:00:01.237628 21163 catalog_manager.cc:5649] T a27543620a6846028a73e83fb89458d5 P abf20d53faa04ffd9e2aec95f13abb8d reported cstate change: term changed from 0 to 1, leader changed from <none> to abf20d53faa04ffd9e2aec95f13abb8d (127.16.126.3). New cstate: current_term: 1 leader_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } health_report { overall_health: HEALTHY } } }
I20251023 08:00:01.242709 21541 raft_consensus.cc:493] T 7b0fab70cb35481eb8681415447f0763 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 08:00:01.243317 21541 raft_consensus.cc:515] T 7b0fab70cb35481eb8681415447f0763 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:01.244628 21589 raft_consensus.cc:493] T a29027605e3640d3a9cf4ecd7f312192 P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 08:00:01.245165 21589 raft_consensus.cc:515] T a29027605e3640d3a9cf4ecd7f312192 P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:01.246917 21267 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b0fab70cb35481eb8681415447f0763" candidate_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" is_pre_election: true
I20251023 08:00:01.247148 21589 leader_election.cc:290] T a29027605e3640d3a9cf4ecd7f312192 P 462a37ed579b46e78a75add632eabf23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1:36379), abf20d53faa04ffd9e2aec95f13abb8d (127.16.126.3:36749)
I20251023 08:00:01.247359 21541 leader_election.cc:290] T 7b0fab70cb35481eb8681415447f0763 P abf20d53faa04ffd9e2aec95f13abb8d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1:36379), 462a37ed579b46e78a75add632eabf23 (127.16.126.2:44879)
I20251023 08:00:01.247818 21267 raft_consensus.cc:2468] T 7b0fab70cb35481eb8681415447f0763 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf20d53faa04ffd9e2aec95f13abb8d in term 0.
I20251023 08:00:01.248873 21379 leader_election.cc:304] T 7b0fab70cb35481eb8681415447f0763 P abf20d53faa04ffd9e2aec95f13abb8d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a9eeaf7ef4038aecadfbb80cf8c7b, abf20d53faa04ffd9e2aec95f13abb8d; no voters:
I20251023 08:00:01.249140 21265 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a29027605e3640d3a9cf4ecd7f312192" candidate_uuid: "462a37ed579b46e78a75add632eabf23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" is_pre_election: true
I20251023 08:00:01.249744 21541 raft_consensus.cc:2804] T 7b0fab70cb35481eb8681415447f0763 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 08:00:01.249823 21415 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a29027605e3640d3a9cf4ecd7f312192" candidate_uuid: "462a37ed579b46e78a75add632eabf23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" is_pre_election: true
I20251023 08:00:01.249833 21265 raft_consensus.cc:2468] T a29027605e3640d3a9cf4ecd7f312192 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 462a37ed579b46e78a75add632eabf23 in term 0.
I20251023 08:00:01.250141 21541 raft_consensus.cc:493] T 7b0fab70cb35481eb8681415447f0763 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 08:00:01.250624 21541 raft_consensus.cc:3060] T 7b0fab70cb35481eb8681415447f0763 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:01.250597 21415 raft_consensus.cc:2468] T a29027605e3640d3a9cf4ecd7f312192 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 462a37ed579b46e78a75add632eabf23 in term 0.
I20251023 08:00:01.251343 21305 leader_election.cc:304] T a29027605e3640d3a9cf4ecd7f312192 P 462a37ed579b46e78a75add632eabf23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a9eeaf7ef4038aecadfbb80cf8c7b, 462a37ed579b46e78a75add632eabf23; no voters:
I20251023 08:00:01.251888 21340 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b0fab70cb35481eb8681415447f0763" candidate_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "462a37ed579b46e78a75add632eabf23" is_pre_election: true
I20251023 08:00:01.252373 21589 raft_consensus.cc:2804] T a29027605e3640d3a9cf4ecd7f312192 P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 08:00:01.252554 21340 raft_consensus.cc:2468] T 7b0fab70cb35481eb8681415447f0763 P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf20d53faa04ffd9e2aec95f13abb8d in term 0.
I20251023 08:00:01.252866 21589 raft_consensus.cc:493] T a29027605e3640d3a9cf4ecd7f312192 P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 08:00:01.253423 21589 raft_consensus.cc:3060] T a29027605e3640d3a9cf4ecd7f312192 P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:01.257627 21541 raft_consensus.cc:515] T 7b0fab70cb35481eb8681415447f0763 P abf20d53faa04ffd9e2aec95f13abb8d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:01.259261 21541 leader_election.cc:290] T 7b0fab70cb35481eb8681415447f0763 P abf20d53faa04ffd9e2aec95f13abb8d [CANDIDATE]: Term 1 election: Requested vote from peers 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1:36379), 462a37ed579b46e78a75add632eabf23 (127.16.126.2:44879)
I20251023 08:00:01.259793 21589 raft_consensus.cc:515] T a29027605e3640d3a9cf4ecd7f312192 P 462a37ed579b46e78a75add632eabf23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:01.260310 21265 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b0fab70cb35481eb8681415447f0763" candidate_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b"
I20251023 08:00:01.260778 21340 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b0fab70cb35481eb8681415447f0763" candidate_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "462a37ed579b46e78a75add632eabf23"
I20251023 08:00:01.260957 21265 raft_consensus.cc:3060] T 7b0fab70cb35481eb8681415447f0763 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:01.261359 21340 raft_consensus.cc:3060] T 7b0fab70cb35481eb8681415447f0763 P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:01.262539 21589 leader_election.cc:290] T a29027605e3640d3a9cf4ecd7f312192 P 462a37ed579b46e78a75add632eabf23 [CANDIDATE]: Term 1 election: Requested vote from peers 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1:36379), abf20d53faa04ffd9e2aec95f13abb8d (127.16.126.3:36749)
I20251023 08:00:01.263366 21267 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a29027605e3640d3a9cf4ecd7f312192" candidate_uuid: "462a37ed579b46e78a75add632eabf23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b"
I20251023 08:00:01.263995 21267 raft_consensus.cc:3060] T a29027605e3640d3a9cf4ecd7f312192 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:01.268263 21265 raft_consensus.cc:2468] T 7b0fab70cb35481eb8681415447f0763 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf20d53faa04ffd9e2aec95f13abb8d in term 1.
I20251023 08:00:01.268725 21340 raft_consensus.cc:2468] T 7b0fab70cb35481eb8681415447f0763 P 462a37ed579b46e78a75add632eabf23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf20d53faa04ffd9e2aec95f13abb8d in term 1.
I20251023 08:00:01.269547 21379 leader_election.cc:304] T 7b0fab70cb35481eb8681415447f0763 P abf20d53faa04ffd9e2aec95f13abb8d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a9eeaf7ef4038aecadfbb80cf8c7b, abf20d53faa04ffd9e2aec95f13abb8d; no voters:
I20251023 08:00:01.270025 21267 raft_consensus.cc:2468] T a29027605e3640d3a9cf4ecd7f312192 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 462a37ed579b46e78a75add632eabf23 in term 1.
I20251023 08:00:01.270263 21541 raft_consensus.cc:2804] T 7b0fab70cb35481eb8681415447f0763 P abf20d53faa04ffd9e2aec95f13abb8d [term 1 FOLLOWER]: Leader election won for term 1
I20251023 08:00:01.270812 21541 raft_consensus.cc:697] T 7b0fab70cb35481eb8681415447f0763 P abf20d53faa04ffd9e2aec95f13abb8d [term 1 LEADER]: Becoming Leader. State: Replica: abf20d53faa04ffd9e2aec95f13abb8d, State: Running, Role: LEADER
I20251023 08:00:01.271029 21305 leader_election.cc:304] T a29027605e3640d3a9cf4ecd7f312192 P 462a37ed579b46e78a75add632eabf23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a9eeaf7ef4038aecadfbb80cf8c7b, 462a37ed579b46e78a75add632eabf23; no voters:
I20251023 08:00:01.271437 21415 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a29027605e3640d3a9cf4ecd7f312192" candidate_uuid: "462a37ed579b46e78a75add632eabf23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf20d53faa04ffd9e2aec95f13abb8d"
I20251023 08:00:01.271940 21589 raft_consensus.cc:2804] T a29027605e3640d3a9cf4ecd7f312192 P 462a37ed579b46e78a75add632eabf23 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 08:00:01.271690 21541 consensus_queue.cc:237] T 7b0fab70cb35481eb8681415447f0763 P abf20d53faa04ffd9e2aec95f13abb8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:01.272078 21415 raft_consensus.cc:3060] T a29027605e3640d3a9cf4ecd7f312192 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:01.272444 21589 raft_consensus.cc:697] T a29027605e3640d3a9cf4ecd7f312192 P 462a37ed579b46e78a75add632eabf23 [term 1 LEADER]: Becoming Leader. State: Replica: 462a37ed579b46e78a75add632eabf23, State: Running, Role: LEADER
I20251023 08:00:01.273331 21589 consensus_queue.cc:237] T a29027605e3640d3a9cf4ecd7f312192 P 462a37ed579b46e78a75add632eabf23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:01.279506 21415 raft_consensus.cc:2468] T a29027605e3640d3a9cf4ecd7f312192 P abf20d53faa04ffd9e2aec95f13abb8d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 462a37ed579b46e78a75add632eabf23 in term 1.
I20251023 08:00:01.281056 21163 catalog_manager.cc:5649] T 7b0fab70cb35481eb8681415447f0763 P abf20d53faa04ffd9e2aec95f13abb8d reported cstate change: term changed from 0 to 1, leader changed from <none> to abf20d53faa04ffd9e2aec95f13abb8d (127.16.126.3). New cstate: current_term: 1 leader_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } health_report { overall_health: HEALTHY } } }
I20251023 08:00:01.281795 21164 catalog_manager.cc:5649] T a29027605e3640d3a9cf4ecd7f312192 P 462a37ed579b46e78a75add632eabf23 reported cstate change: term changed from 0 to 1, leader changed from <none> to 462a37ed579b46e78a75add632eabf23 (127.16.126.2). New cstate: current_term: 1 leader_uuid: "462a37ed579b46e78a75add632eabf23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } health_report { overall_health: UNKNOWN } } }
I20251023 08:00:01.301329 21558 consensus_queue.cc:1048] T dbc2b9be96eb4372849d84bf61f9dc9a P 189a9eeaf7ef4038aecadfbb80cf8c7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 08:00:01.315157 21558 consensus_queue.cc:1048] T dbc2b9be96eb4372849d84bf61f9dc9a P 189a9eeaf7ef4038aecadfbb80cf8c7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 08:00:01.408576 21541 consensus_queue.cc:1048] T 7d2bc5448c3a4be6b037deea58e8e721 P abf20d53faa04ffd9e2aec95f13abb8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 08:00:01.419385 21579 consensus_queue.cc:1048] T 7d2bc5448c3a4be6b037deea58e8e721 P abf20d53faa04ffd9e2aec95f13abb8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 08:00:01.504184 21589 consensus_queue.cc:1048] T 660ad6de5e3c4d0a932f73640864f54b P 462a37ed579b46e78a75add632eabf23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 08:00:01.514372 21538 consensus_queue.cc:1048] T 660ad6de5e3c4d0a932f73640864f54b P 462a37ed579b46e78a75add632eabf23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 08:00:01.554828 21558 raft_consensus.cc:493] T a0e6c38393ac49009a25e9806355d2e4 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 08:00:01.555501 21558 raft_consensus.cc:515] T a0e6c38393ac49009a25e9806355d2e4 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:01.557372 21558 leader_election.cc:290] T a0e6c38393ac49009a25e9806355d2e4 P 189a9eeaf7ef4038aecadfbb80cf8c7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 462a37ed579b46e78a75add632eabf23 (127.16.126.2:44879), abf20d53faa04ffd9e2aec95f13abb8d (127.16.126.3:36749)
I20251023 08:00:01.558244 21338 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a0e6c38393ac49009a25e9806355d2e4" candidate_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "462a37ed579b46e78a75add632eabf23" is_pre_election: true
I20251023 08:00:01.558590 21414 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a0e6c38393ac49009a25e9806355d2e4" candidate_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" is_pre_election: true
I20251023 08:00:01.558960 21338 raft_consensus.cc:2468] T a0e6c38393ac49009a25e9806355d2e4 P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a9eeaf7ef4038aecadfbb80cf8c7b in term 0.
I20251023 08:00:01.559194 21414 raft_consensus.cc:2468] T a0e6c38393ac49009a25e9806355d2e4 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a9eeaf7ef4038aecadfbb80cf8c7b in term 0.
I20251023 08:00:01.559947 21230 leader_election.cc:304] T a0e6c38393ac49009a25e9806355d2e4 P 189a9eeaf7ef4038aecadfbb80cf8c7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a9eeaf7ef4038aecadfbb80cf8c7b, 462a37ed579b46e78a75add632eabf23; no voters:
I20251023 08:00:01.560683 21558 raft_consensus.cc:2804] T a0e6c38393ac49009a25e9806355d2e4 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 08:00:01.561017 21558 raft_consensus.cc:493] T a0e6c38393ac49009a25e9806355d2e4 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 08:00:01.561254 21558 raft_consensus.cc:3060] T a0e6c38393ac49009a25e9806355d2e4 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:01.566740 21558 raft_consensus.cc:515] T a0e6c38393ac49009a25e9806355d2e4 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:01.568567 21558 leader_election.cc:290] T a0e6c38393ac49009a25e9806355d2e4 P 189a9eeaf7ef4038aecadfbb80cf8c7b [CANDIDATE]: Term 1 election: Requested vote from peers 462a37ed579b46e78a75add632eabf23 (127.16.126.2:44879), abf20d53faa04ffd9e2aec95f13abb8d (127.16.126.3:36749)
I20251023 08:00:01.569414 21338 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a0e6c38393ac49009a25e9806355d2e4" candidate_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "462a37ed579b46e78a75add632eabf23"
I20251023 08:00:01.569849 21414 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a0e6c38393ac49009a25e9806355d2e4" candidate_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf20d53faa04ffd9e2aec95f13abb8d"
I20251023 08:00:01.570001 21338 raft_consensus.cc:3060] T a0e6c38393ac49009a25e9806355d2e4 P 462a37ed579b46e78a75add632eabf23 [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:01.570398 21414 raft_consensus.cc:3060] T a0e6c38393ac49009a25e9806355d2e4 P abf20d53faa04ffd9e2aec95f13abb8d [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:01.572012 21580 consensus_queue.cc:1048] T 96cc067b744f4c04b020f42d519288d7 P 189a9eeaf7ef4038aecadfbb80cf8c7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 08:00:01.578421 21338 raft_consensus.cc:2468] T a0e6c38393ac49009a25e9806355d2e4 P 462a37ed579b46e78a75add632eabf23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a9eeaf7ef4038aecadfbb80cf8c7b in term 1.
I20251023 08:00:01.579694 21230 leader_election.cc:304] T a0e6c38393ac49009a25e9806355d2e4 P 189a9eeaf7ef4038aecadfbb80cf8c7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a9eeaf7ef4038aecadfbb80cf8c7b, 462a37ed579b46e78a75add632eabf23; no voters:
I20251023 08:00:01.580106 21414 raft_consensus.cc:2468] T a0e6c38393ac49009a25e9806355d2e4 P abf20d53faa04ffd9e2aec95f13abb8d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a9eeaf7ef4038aecadfbb80cf8c7b in term 1.
I20251023 08:00:01.581492 21580 raft_consensus.cc:2804] T a0e6c38393ac49009a25e9806355d2e4 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 FOLLOWER]: Leader election won for term 1
I20251023 08:00:01.588804 21580 raft_consensus.cc:697] T a0e6c38393ac49009a25e9806355d2e4 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 LEADER]: Becoming Leader. State: Replica: 189a9eeaf7ef4038aecadfbb80cf8c7b, State: Running, Role: LEADER
I20251023 08:00:01.589807 21580 consensus_queue.cc:237] T a0e6c38393ac49009a25e9806355d2e4 P 189a9eeaf7ef4038aecadfbb80cf8c7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:01.597285 21558 consensus_queue.cc:1048] T 94c7110bc7d84a09886191fcf82e530f P 189a9eeaf7ef4038aecadfbb80cf8c7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20251023 08:00:01.600962 21558 consensus_queue.cc:1048] T 96cc067b744f4c04b020f42d519288d7 P 189a9eeaf7ef4038aecadfbb80cf8c7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 08:00:01.605808 21163 catalog_manager.cc:5649] T a0e6c38393ac49009a25e9806355d2e4 P 189a9eeaf7ef4038aecadfbb80cf8c7b reported cstate change: term changed from 0 to 1, leader changed from <none> to 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1). New cstate: current_term: 1 leader_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } health_report { overall_health: UNKNOWN } } }
I20251023 08:00:01.614459 21558 consensus_queue.cc:1048] T 94c7110bc7d84a09886191fcf82e530f P 189a9eeaf7ef4038aecadfbb80cf8c7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 08:00:01.646273 21606 consensus_queue.cc:1048] T a27543620a6846028a73e83fb89458d5 P abf20d53faa04ffd9e2aec95f13abb8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 08:00:01.653311 21579 consensus_queue.cc:1048] T 7b0fab70cb35481eb8681415447f0763 P abf20d53faa04ffd9e2aec95f13abb8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 08:00:01.658211 21606 consensus_queue.cc:1048] T a27543620a6846028a73e83fb89458d5 P abf20d53faa04ffd9e2aec95f13abb8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 08:00:01.666577 21571 consensus_queue.cc:1048] T a29027605e3640d3a9cf4ecd7f312192 P 462a37ed579b46e78a75add632eabf23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 08:00:01.679198 21577 consensus_queue.cc:1048] T 7b0fab70cb35481eb8681415447f0763 P abf20d53faa04ffd9e2aec95f13abb8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 08:00:01.703472 21538 consensus_queue.cc:1048] T a29027605e3640d3a9cf4ecd7f312192 P 462a37ed579b46e78a75add632eabf23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 08:00:01.847048 21414 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "7d2bc5448c3a4be6b037deea58e8e721"
dest_uuid: "abf20d53faa04ffd9e2aec95f13abb8d"
mode: GRACEFUL
new_leader_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b"
from {username='slave'} at 127.0.0.1:56814
I20251023 08:00:01.847549 21414 raft_consensus.cc:606] T 7d2bc5448c3a4be6b037deea58e8e721 P abf20d53faa04ffd9e2aec95f13abb8d [term 1 LEADER]: Received request to transfer leadership to TS 189a9eeaf7ef4038aecadfbb80cf8c7b
I20251023 08:00:01.855011 21340 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "660ad6de5e3c4d0a932f73640864f54b"
dest_uuid: "462a37ed579b46e78a75add632eabf23"
mode: GRACEFUL
new_leader_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b"
from {username='slave'} at 127.0.0.1:38566
I20251023 08:00:01.855664 21340 raft_consensus.cc:606] T 660ad6de5e3c4d0a932f73640864f54b P 462a37ed579b46e78a75add632eabf23 [term 1 LEADER]: Received request to transfer leadership to TS 189a9eeaf7ef4038aecadfbb80cf8c7b
I20251023 08:00:01.861022 21267 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "96cc067b744f4c04b020f42d519288d7"
dest_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b"
mode: GRACEFUL
new_leader_uuid: "462a37ed579b46e78a75add632eabf23"
from {username='slave'} at 127.0.0.1:34202
I20251023 08:00:01.861722 21267 raft_consensus.cc:606] T 96cc067b744f4c04b020f42d519288d7 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 LEADER]: Received request to transfer leadership to TS 462a37ed579b46e78a75add632eabf23
I20251023 08:00:01.866752 21267 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "a0e6c38393ac49009a25e9806355d2e4"
dest_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b"
mode: GRACEFUL
new_leader_uuid: "462a37ed579b46e78a75add632eabf23"
from {username='slave'} at 127.0.0.1:34202
I20251023 08:00:01.867220 21267 raft_consensus.cc:606] T a0e6c38393ac49009a25e9806355d2e4 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 LEADER]: Received request to transfer leadership to TS 462a37ed579b46e78a75add632eabf23
I20251023 08:00:01.871438 21414 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "a27543620a6846028a73e83fb89458d5"
dest_uuid: "abf20d53faa04ffd9e2aec95f13abb8d"
mode: GRACEFUL
new_leader_uuid: "462a37ed579b46e78a75add632eabf23"
from {username='slave'} at 127.0.0.1:56814
I20251023 08:00:01.871892 21414 raft_consensus.cc:606] T a27543620a6846028a73e83fb89458d5 P abf20d53faa04ffd9e2aec95f13abb8d [term 1 LEADER]: Received request to transfer leadership to TS 462a37ed579b46e78a75add632eabf23
I20251023 08:00:01.876187 21414 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "7b0fab70cb35481eb8681415447f0763"
dest_uuid: "abf20d53faa04ffd9e2aec95f13abb8d"
mode: GRACEFUL
new_leader_uuid: "462a37ed579b46e78a75add632eabf23"
from {username='slave'} at 127.0.0.1:56814
I20251023 08:00:01.876709 21414 raft_consensus.cc:606] T 7b0fab70cb35481eb8681415447f0763 P abf20d53faa04ffd9e2aec95f13abb8d [term 1 LEADER]: Received request to transfer leadership to TS 462a37ed579b46e78a75add632eabf23
I20251023 08:00:01.881418 21340 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "a29027605e3640d3a9cf4ecd7f312192"
dest_uuid: "462a37ed579b46e78a75add632eabf23"
mode: GRACEFUL
new_leader_uuid: "abf20d53faa04ffd9e2aec95f13abb8d"
from {username='slave'} at 127.0.0.1:38566
I20251023 08:00:01.882036 21340 raft_consensus.cc:606] T a29027605e3640d3a9cf4ecd7f312192 P 462a37ed579b46e78a75add632eabf23 [term 1 LEADER]: Received request to transfer leadership to TS abf20d53faa04ffd9e2aec95f13abb8d
I20251023 08:00:01.954191 21588 raft_consensus.cc:993] T 660ad6de5e3c4d0a932f73640864f54b P 462a37ed579b46e78a75add632eabf23: : Instructing follower 189a9eeaf7ef4038aecadfbb80cf8c7b to start an election
I20251023 08:00:01.954655 21538 raft_consensus.cc:1081] T 660ad6de5e3c4d0a932f73640864f54b P 462a37ed579b46e78a75add632eabf23 [term 1 LEADER]: Signalling peer 189a9eeaf7ef4038aecadfbb80cf8c7b to start an election
I20251023 08:00:01.955948 21267 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "660ad6de5e3c4d0a932f73640864f54b"
dest_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b"
from {username='slave'} at 127.0.0.1:34198
I20251023 08:00:01.956380 21267 raft_consensus.cc:493] T 660ad6de5e3c4d0a932f73640864f54b P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 08:00:01.956619 21267 raft_consensus.cc:3060] T 660ad6de5e3c4d0a932f73640864f54b P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 FOLLOWER]: Advancing to term 2
I20251023 08:00:01.961688 21267 raft_consensus.cc:515] T 660ad6de5e3c4d0a932f73640864f54b P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:01.963096 21267 leader_election.cc:290] T 660ad6de5e3c4d0a932f73640864f54b P 189a9eeaf7ef4038aecadfbb80cf8c7b [CANDIDATE]: Term 2 election: Requested vote from peers 462a37ed579b46e78a75add632eabf23 (127.16.126.2:44879), abf20d53faa04ffd9e2aec95f13abb8d (127.16.126.3:36749)
I20251023 08:00:01.963928 21340 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "660ad6de5e3c4d0a932f73640864f54b" candidate_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "462a37ed579b46e78a75add632eabf23"
I20251023 08:00:01.964061 21414 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "660ad6de5e3c4d0a932f73640864f54b" candidate_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "abf20d53faa04ffd9e2aec95f13abb8d"
I20251023 08:00:01.964520 21340 raft_consensus.cc:3055] T 660ad6de5e3c4d0a932f73640864f54b P 462a37ed579b46e78a75add632eabf23 [term 1 LEADER]: Stepping down as leader of term 1
I20251023 08:00:01.964661 21414 raft_consensus.cc:3060] T 660ad6de5e3c4d0a932f73640864f54b P abf20d53faa04ffd9e2aec95f13abb8d [term 1 FOLLOWER]: Advancing to term 2
I20251023 08:00:01.964815 21340 raft_consensus.cc:740] T 660ad6de5e3c4d0a932f73640864f54b P 462a37ed579b46e78a75add632eabf23 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 462a37ed579b46e78a75add632eabf23, State: Running, Role: LEADER
I20251023 08:00:01.965574 21340 consensus_queue.cc:260] T 660ad6de5e3c4d0a932f73640864f54b P 462a37ed579b46e78a75add632eabf23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:01.966601 21340 raft_consensus.cc:3060] T 660ad6de5e3c4d0a932f73640864f54b P 462a37ed579b46e78a75add632eabf23 [term 1 FOLLOWER]: Advancing to term 2
I20251023 08:00:01.969537 21414 raft_consensus.cc:2468] T 660ad6de5e3c4d0a932f73640864f54b P abf20d53faa04ffd9e2aec95f13abb8d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a9eeaf7ef4038aecadfbb80cf8c7b in term 2.
I20251023 08:00:01.970592 21233 leader_election.cc:304] T 660ad6de5e3c4d0a932f73640864f54b P 189a9eeaf7ef4038aecadfbb80cf8c7b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a9eeaf7ef4038aecadfbb80cf8c7b, abf20d53faa04ffd9e2aec95f13abb8d; no voters:
I20251023 08:00:01.971352 21558 raft_consensus.cc:2804] T 660ad6de5e3c4d0a932f73640864f54b P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 2 FOLLOWER]: Leader election won for term 2
I20251023 08:00:01.971761 21558 raft_consensus.cc:697] T 660ad6de5e3c4d0a932f73640864f54b P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 2 LEADER]: Becoming Leader. State: Replica: 189a9eeaf7ef4038aecadfbb80cf8c7b, State: Running, Role: LEADER
I20251023 08:00:01.972129 21340 raft_consensus.cc:2468] T 660ad6de5e3c4d0a932f73640864f54b P 462a37ed579b46e78a75add632eabf23 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a9eeaf7ef4038aecadfbb80cf8c7b in term 2.
I20251023 08:00:01.972529 21558 consensus_queue.cc:237] T 660ad6de5e3c4d0a932f73640864f54b P 189a9eeaf7ef4038aecadfbb80cf8c7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:01.978947 21165 catalog_manager.cc:5649] T 660ad6de5e3c4d0a932f73640864f54b P 189a9eeaf7ef4038aecadfbb80cf8c7b reported cstate change: term changed from 1 to 2, leader changed from 462a37ed579b46e78a75add632eabf23 (127.16.126.2) to 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1). New cstate: current_term: 2 leader_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } health_report { overall_health: UNKNOWN } } }
I20251023 08:00:02.036926 21558 consensus_queue.cc:1048] T a0e6c38393ac49009a25e9806355d2e4 P 189a9eeaf7ef4038aecadfbb80cf8c7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 08:00:02.043884 21487 raft_consensus.cc:993] T a0e6c38393ac49009a25e9806355d2e4 P 189a9eeaf7ef4038aecadfbb80cf8c7b: : Instructing follower 462a37ed579b46e78a75add632eabf23 to start an election
I20251023 08:00:02.044382 21487 raft_consensus.cc:1081] T a0e6c38393ac49009a25e9806355d2e4 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 LEADER]: Signalling peer 462a37ed579b46e78a75add632eabf23 to start an election
I20251023 08:00:02.046432 21338 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "a0e6c38393ac49009a25e9806355d2e4"
dest_uuid: "462a37ed579b46e78a75add632eabf23"
from {username='slave'} at 127.0.0.1:38550
I20251023 08:00:02.047022 21338 raft_consensus.cc:493] T a0e6c38393ac49009a25e9806355d2e4 P 462a37ed579b46e78a75add632eabf23 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 08:00:02.047425 21338 raft_consensus.cc:3060] T a0e6c38393ac49009a25e9806355d2e4 P 462a37ed579b46e78a75add632eabf23 [term 1 FOLLOWER]: Advancing to term 2
I20251023 08:00:02.048776 21558 consensus_queue.cc:1048] T a0e6c38393ac49009a25e9806355d2e4 P 189a9eeaf7ef4038aecadfbb80cf8c7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 08:00:02.055428 21338 raft_consensus.cc:515] T a0e6c38393ac49009a25e9806355d2e4 P 462a37ed579b46e78a75add632eabf23 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:02.056562 21340 raft_consensus.cc:1240] T a0e6c38393ac49009a25e9806355d2e4 P 462a37ed579b46e78a75add632eabf23 [term 2 FOLLOWER]: Rejecting Update request from peer 189a9eeaf7ef4038aecadfbb80cf8c7b for earlier term 1. Current term is 2. Ops: []
I20251023 08:00:02.058351 21338 leader_election.cc:290] T a0e6c38393ac49009a25e9806355d2e4 P 462a37ed579b46e78a75add632eabf23 [CANDIDATE]: Term 2 election: Requested vote from peers 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1:36379), abf20d53faa04ffd9e2aec95f13abb8d (127.16.126.3:36749)
I20251023 08:00:02.058418 21267 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a0e6c38393ac49009a25e9806355d2e4" candidate_uuid: "462a37ed579b46e78a75add632eabf23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b"
I20251023 08:00:02.059278 21267 raft_consensus.cc:3055] T a0e6c38393ac49009a25e9806355d2e4 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 LEADER]: Stepping down as leader of term 1
I20251023 08:00:02.059581 21267 raft_consensus.cc:740] T a0e6c38393ac49009a25e9806355d2e4 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 189a9eeaf7ef4038aecadfbb80cf8c7b, State: Running, Role: LEADER
I20251023 08:00:02.060290 21267 consensus_queue.cc:260] T a0e6c38393ac49009a25e9806355d2e4 P 189a9eeaf7ef4038aecadfbb80cf8c7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:02.060580 21414 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a0e6c38393ac49009a25e9806355d2e4" candidate_uuid: "462a37ed579b46e78a75add632eabf23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "abf20d53faa04ffd9e2aec95f13abb8d"
I20251023 08:00:02.061395 21267 raft_consensus.cc:3060] T a0e6c38393ac49009a25e9806355d2e4 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 FOLLOWER]: Advancing to term 2
I20251023 08:00:02.061793 21414 raft_consensus.cc:3060] T a0e6c38393ac49009a25e9806355d2e4 P abf20d53faa04ffd9e2aec95f13abb8d [term 1 FOLLOWER]: Advancing to term 2
I20251023 08:00:02.068089 21414 raft_consensus.cc:2468] T a0e6c38393ac49009a25e9806355d2e4 P abf20d53faa04ffd9e2aec95f13abb8d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 462a37ed579b46e78a75add632eabf23 in term 2.
I20251023 08:00:02.068089 21267 raft_consensus.cc:2468] T a0e6c38393ac49009a25e9806355d2e4 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 462a37ed579b46e78a75add632eabf23 in term 2.
I20251023 08:00:02.069670 21308 leader_election.cc:304] T a0e6c38393ac49009a25e9806355d2e4 P 462a37ed579b46e78a75add632eabf23 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 462a37ed579b46e78a75add632eabf23, abf20d53faa04ffd9e2aec95f13abb8d; no voters:
I20251023 08:00:02.070541 21538 raft_consensus.cc:2804] T a0e6c38393ac49009a25e9806355d2e4 P 462a37ed579b46e78a75add632eabf23 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 08:00:02.071023 21538 raft_consensus.cc:697] T a0e6c38393ac49009a25e9806355d2e4 P 462a37ed579b46e78a75add632eabf23 [term 2 LEADER]: Becoming Leader. State: Replica: 462a37ed579b46e78a75add632eabf23, State: Running, Role: LEADER
I20251023 08:00:02.071834 21538 consensus_queue.cc:237] T a0e6c38393ac49009a25e9806355d2e4 P 462a37ed579b46e78a75add632eabf23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:02.080621 21164 catalog_manager.cc:5649] T a0e6c38393ac49009a25e9806355d2e4 P 462a37ed579b46e78a75add632eabf23 reported cstate change: term changed from 1 to 2, leader changed from 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1) to 462a37ed579b46e78a75add632eabf23 (127.16.126.2). New cstate: current_term: 2 leader_uuid: "462a37ed579b46e78a75add632eabf23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } health_report { overall_health: UNKNOWN } } }
I20251023 08:00:02.131651 21541 raft_consensus.cc:993] T 7b0fab70cb35481eb8681415447f0763 P abf20d53faa04ffd9e2aec95f13abb8d: : Instructing follower 462a37ed579b46e78a75add632eabf23 to start an election
I20251023 08:00:02.132073 21606 raft_consensus.cc:1081] T 7b0fab70cb35481eb8681415447f0763 P abf20d53faa04ffd9e2aec95f13abb8d [term 1 LEADER]: Signalling peer 462a37ed579b46e78a75add632eabf23 to start an election
I20251023 08:00:02.133464 21340 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "7b0fab70cb35481eb8681415447f0763"
dest_uuid: "462a37ed579b46e78a75add632eabf23"
from {username='slave'} at 127.0.0.1:38548
I20251023 08:00:02.133905 21340 raft_consensus.cc:493] T 7b0fab70cb35481eb8681415447f0763 P 462a37ed579b46e78a75add632eabf23 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 08:00:02.134171 21340 raft_consensus.cc:3060] T 7b0fab70cb35481eb8681415447f0763 P 462a37ed579b46e78a75add632eabf23 [term 1 FOLLOWER]: Advancing to term 2
I20251023 08:00:02.138893 21340 raft_consensus.cc:515] T 7b0fab70cb35481eb8681415447f0763 P 462a37ed579b46e78a75add632eabf23 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:02.140326 21340 leader_election.cc:290] T 7b0fab70cb35481eb8681415447f0763 P 462a37ed579b46e78a75add632eabf23 [CANDIDATE]: Term 2 election: Requested vote from peers 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1:36379), abf20d53faa04ffd9e2aec95f13abb8d (127.16.126.3:36749)
I20251023 08:00:02.141147 21267 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b0fab70cb35481eb8681415447f0763" candidate_uuid: "462a37ed579b46e78a75add632eabf23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b"
I20251023 08:00:02.141367 21415 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b0fab70cb35481eb8681415447f0763" candidate_uuid: "462a37ed579b46e78a75add632eabf23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "abf20d53faa04ffd9e2aec95f13abb8d"
I20251023 08:00:02.141819 21267 raft_consensus.cc:3060] T 7b0fab70cb35481eb8681415447f0763 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 FOLLOWER]: Advancing to term 2
I20251023 08:00:02.141935 21415 raft_consensus.cc:3055] T 7b0fab70cb35481eb8681415447f0763 P abf20d53faa04ffd9e2aec95f13abb8d [term 1 LEADER]: Stepping down as leader of term 1
I20251023 08:00:02.142343 21415 raft_consensus.cc:740] T 7b0fab70cb35481eb8681415447f0763 P abf20d53faa04ffd9e2aec95f13abb8d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: abf20d53faa04ffd9e2aec95f13abb8d, State: Running, Role: LEADER
I20251023 08:00:02.143150 21415 consensus_queue.cc:260] T 7b0fab70cb35481eb8681415447f0763 P abf20d53faa04ffd9e2aec95f13abb8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:02.144399 21415 raft_consensus.cc:3060] T 7b0fab70cb35481eb8681415447f0763 P abf20d53faa04ffd9e2aec95f13abb8d [term 1 FOLLOWER]: Advancing to term 2
I20251023 08:00:02.148806 21267 raft_consensus.cc:2468] T 7b0fab70cb35481eb8681415447f0763 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 462a37ed579b46e78a75add632eabf23 in term 2.
I20251023 08:00:02.150024 21305 leader_election.cc:304] T 7b0fab70cb35481eb8681415447f0763 P 462a37ed579b46e78a75add632eabf23 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a9eeaf7ef4038aecadfbb80cf8c7b, 462a37ed579b46e78a75add632eabf23; no voters:
I20251023 08:00:02.150703 21538 raft_consensus.cc:2804] T 7b0fab70cb35481eb8681415447f0763 P 462a37ed579b46e78a75add632eabf23 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 08:00:02.151093 21415 raft_consensus.cc:2468] T 7b0fab70cb35481eb8681415447f0763 P abf20d53faa04ffd9e2aec95f13abb8d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 462a37ed579b46e78a75add632eabf23 in term 2.
I20251023 08:00:02.151221 21538 raft_consensus.cc:697] T 7b0fab70cb35481eb8681415447f0763 P 462a37ed579b46e78a75add632eabf23 [term 2 LEADER]: Becoming Leader. State: Replica: 462a37ed579b46e78a75add632eabf23, State: Running, Role: LEADER
I20251023 08:00:02.152071 21538 consensus_queue.cc:237] T 7b0fab70cb35481eb8681415447f0763 P 462a37ed579b46e78a75add632eabf23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:02.158277 21164 catalog_manager.cc:5649] T 7b0fab70cb35481eb8681415447f0763 P 462a37ed579b46e78a75add632eabf23 reported cstate change: term changed from 1 to 2, leader changed from abf20d53faa04ffd9e2aec95f13abb8d (127.16.126.3) to 462a37ed579b46e78a75add632eabf23 (127.16.126.2). New cstate: current_term: 2 leader_uuid: "462a37ed579b46e78a75add632eabf23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } health_report { overall_health: UNKNOWN } } }
I20251023 08:00:02.164402 21588 raft_consensus.cc:993] T a29027605e3640d3a9cf4ecd7f312192 P 462a37ed579b46e78a75add632eabf23: : Instructing follower abf20d53faa04ffd9e2aec95f13abb8d to start an election
I20251023 08:00:02.164951 21538 raft_consensus.cc:1081] T a29027605e3640d3a9cf4ecd7f312192 P 462a37ed579b46e78a75add632eabf23 [term 1 LEADER]: Signalling peer abf20d53faa04ffd9e2aec95f13abb8d to start an election
I20251023 08:00:02.166599 21415 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "a29027605e3640d3a9cf4ecd7f312192"
dest_uuid: "abf20d53faa04ffd9e2aec95f13abb8d"
from {username='slave'} at 127.0.0.1:56790
I20251023 08:00:02.167032 21415 raft_consensus.cc:493] T a29027605e3640d3a9cf4ecd7f312192 P abf20d53faa04ffd9e2aec95f13abb8d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 08:00:02.167290 21415 raft_consensus.cc:3060] T a29027605e3640d3a9cf4ecd7f312192 P abf20d53faa04ffd9e2aec95f13abb8d [term 1 FOLLOWER]: Advancing to term 2
I20251023 08:00:02.172405 21415 raft_consensus.cc:515] T a29027605e3640d3a9cf4ecd7f312192 P abf20d53faa04ffd9e2aec95f13abb8d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:02.173902 21415 leader_election.cc:290] T a29027605e3640d3a9cf4ecd7f312192 P abf20d53faa04ffd9e2aec95f13abb8d [CANDIDATE]: Term 2 election: Requested vote from peers 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1:36379), 462a37ed579b46e78a75add632eabf23 (127.16.126.2:44879)
I20251023 08:00:02.174984 21340 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a29027605e3640d3a9cf4ecd7f312192" candidate_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "462a37ed579b46e78a75add632eabf23"
I20251023 08:00:02.174875 21267 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a29027605e3640d3a9cf4ecd7f312192" candidate_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b"
I20251023 08:00:02.175678 21340 raft_consensus.cc:3055] T a29027605e3640d3a9cf4ecd7f312192 P 462a37ed579b46e78a75add632eabf23 [term 1 LEADER]: Stepping down as leader of term 1
I20251023 08:00:02.175760 21267 raft_consensus.cc:3060] T a29027605e3640d3a9cf4ecd7f312192 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 FOLLOWER]: Advancing to term 2
I20251023 08:00:02.175930 21340 raft_consensus.cc:740] T a29027605e3640d3a9cf4ecd7f312192 P 462a37ed579b46e78a75add632eabf23 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 462a37ed579b46e78a75add632eabf23, State: Running, Role: LEADER
I20251023 08:00:02.176578 21340 consensus_queue.cc:260] T a29027605e3640d3a9cf4ecd7f312192 P 462a37ed579b46e78a75add632eabf23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:02.177531 21340 raft_consensus.cc:3060] T a29027605e3640d3a9cf4ecd7f312192 P 462a37ed579b46e78a75add632eabf23 [term 1 FOLLOWER]: Advancing to term 2
I20251023 08:00:02.180694 21267 raft_consensus.cc:2468] T a29027605e3640d3a9cf4ecd7f312192 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf20d53faa04ffd9e2aec95f13abb8d in term 2.
I20251023 08:00:02.181759 21379 leader_election.cc:304] T a29027605e3640d3a9cf4ecd7f312192 P abf20d53faa04ffd9e2aec95f13abb8d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a9eeaf7ef4038aecadfbb80cf8c7b, abf20d53faa04ffd9e2aec95f13abb8d; no voters:
I20251023 08:00:02.182050 21340 raft_consensus.cc:2468] T a29027605e3640d3a9cf4ecd7f312192 P 462a37ed579b46e78a75add632eabf23 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf20d53faa04ffd9e2aec95f13abb8d in term 2.
I20251023 08:00:02.182435 21606 raft_consensus.cc:2804] T a29027605e3640d3a9cf4ecd7f312192 P abf20d53faa04ffd9e2aec95f13abb8d [term 2 FOLLOWER]: Leader election won for term 2
I20251023 08:00:02.182940 21606 raft_consensus.cc:697] T a29027605e3640d3a9cf4ecd7f312192 P abf20d53faa04ffd9e2aec95f13abb8d [term 2 LEADER]: Becoming Leader. State: Replica: abf20d53faa04ffd9e2aec95f13abb8d, State: Running, Role: LEADER
I20251023 08:00:02.183670 21606 consensus_queue.cc:237] T a29027605e3640d3a9cf4ecd7f312192 P abf20d53faa04ffd9e2aec95f13abb8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:02.190217 21164 catalog_manager.cc:5649] T a29027605e3640d3a9cf4ecd7f312192 P abf20d53faa04ffd9e2aec95f13abb8d reported cstate change: term changed from 1 to 2, leader changed from 462a37ed579b46e78a75add632eabf23 (127.16.126.2) to abf20d53faa04ffd9e2aec95f13abb8d (127.16.126.3). New cstate: current_term: 2 leader_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } health_report { overall_health: HEALTHY } } }
I20251023 08:00:02.219646 21558 raft_consensus.cc:993] T 96cc067b744f4c04b020f42d519288d7 P 189a9eeaf7ef4038aecadfbb80cf8c7b: : Instructing follower 462a37ed579b46e78a75add632eabf23 to start an election
I20251023 08:00:02.220166 21487 raft_consensus.cc:1081] T 96cc067b744f4c04b020f42d519288d7 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 LEADER]: Signalling peer 462a37ed579b46e78a75add632eabf23 to start an election
I20251023 08:00:02.221571 21340 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "96cc067b744f4c04b020f42d519288d7"
dest_uuid: "462a37ed579b46e78a75add632eabf23"
from {username='slave'} at 127.0.0.1:38550
I20251023 08:00:02.221987 21340 raft_consensus.cc:493] T 96cc067b744f4c04b020f42d519288d7 P 462a37ed579b46e78a75add632eabf23 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 08:00:02.222270 21340 raft_consensus.cc:3060] T 96cc067b744f4c04b020f42d519288d7 P 462a37ed579b46e78a75add632eabf23 [term 1 FOLLOWER]: Advancing to term 2
I20251023 08:00:02.227991 21340 raft_consensus.cc:515] T 96cc067b744f4c04b020f42d519288d7 P 462a37ed579b46e78a75add632eabf23 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:02.229373 21340 leader_election.cc:290] T 96cc067b744f4c04b020f42d519288d7 P 462a37ed579b46e78a75add632eabf23 [CANDIDATE]: Term 2 election: Requested vote from peers 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1:36379), abf20d53faa04ffd9e2aec95f13abb8d (127.16.126.3:36749)
I20251023 08:00:02.230418 21415 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "96cc067b744f4c04b020f42d519288d7" candidate_uuid: "462a37ed579b46e78a75add632eabf23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "abf20d53faa04ffd9e2aec95f13abb8d"
I20251023 08:00:02.230436 21267 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "96cc067b744f4c04b020f42d519288d7" candidate_uuid: "462a37ed579b46e78a75add632eabf23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b"
I20251023 08:00:02.230980 21415 raft_consensus.cc:3060] T 96cc067b744f4c04b020f42d519288d7 P abf20d53faa04ffd9e2aec95f13abb8d [term 1 FOLLOWER]: Advancing to term 2
I20251023 08:00:02.231050 21267 raft_consensus.cc:3055] T 96cc067b744f4c04b020f42d519288d7 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 LEADER]: Stepping down as leader of term 1
I20251023 08:00:02.231396 21267 raft_consensus.cc:740] T 96cc067b744f4c04b020f42d519288d7 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 189a9eeaf7ef4038aecadfbb80cf8c7b, State: Running, Role: LEADER
I20251023 08:00:02.231943 21267 consensus_queue.cc:260] T 96cc067b744f4c04b020f42d519288d7 P 189a9eeaf7ef4038aecadfbb80cf8c7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:02.232781 21267 raft_consensus.cc:3060] T 96cc067b744f4c04b020f42d519288d7 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 FOLLOWER]: Advancing to term 2
I20251023 08:00:02.236186 21415 raft_consensus.cc:2468] T 96cc067b744f4c04b020f42d519288d7 P abf20d53faa04ffd9e2aec95f13abb8d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 462a37ed579b46e78a75add632eabf23 in term 2.
I20251023 08:00:02.237314 21267 raft_consensus.cc:2468] T 96cc067b744f4c04b020f42d519288d7 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 462a37ed579b46e78a75add632eabf23 in term 2.
I20251023 08:00:02.237321 21308 leader_election.cc:304] T 96cc067b744f4c04b020f42d519288d7 P 462a37ed579b46e78a75add632eabf23 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 462a37ed579b46e78a75add632eabf23, abf20d53faa04ffd9e2aec95f13abb8d; no voters:
I20251023 08:00:02.238371 21538 raft_consensus.cc:2804] T 96cc067b744f4c04b020f42d519288d7 P 462a37ed579b46e78a75add632eabf23 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 08:00:02.238803 21538 raft_consensus.cc:697] T 96cc067b744f4c04b020f42d519288d7 P 462a37ed579b46e78a75add632eabf23 [term 2 LEADER]: Becoming Leader. State: Replica: 462a37ed579b46e78a75add632eabf23, State: Running, Role: LEADER
I20251023 08:00:02.239562 21538 consensus_queue.cc:237] T 96cc067b744f4c04b020f42d519288d7 P 462a37ed579b46e78a75add632eabf23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:02.246827 21164 catalog_manager.cc:5649] T 96cc067b744f4c04b020f42d519288d7 P 462a37ed579b46e78a75add632eabf23 reported cstate change: term changed from 1 to 2, leader changed from 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1) to 462a37ed579b46e78a75add632eabf23 (127.16.126.2). New cstate: current_term: 2 leader_uuid: "462a37ed579b46e78a75add632eabf23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } health_report { overall_health: UNKNOWN } } }
I20251023 08:00:02.253074 21541 raft_consensus.cc:993] T a27543620a6846028a73e83fb89458d5 P abf20d53faa04ffd9e2aec95f13abb8d: : Instructing follower 462a37ed579b46e78a75add632eabf23 to start an election
I20251023 08:00:02.253548 21541 raft_consensus.cc:1081] T a27543620a6846028a73e83fb89458d5 P abf20d53faa04ffd9e2aec95f13abb8d [term 1 LEADER]: Signalling peer 462a37ed579b46e78a75add632eabf23 to start an election
I20251023 08:00:02.255029 21340 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "a27543620a6846028a73e83fb89458d5"
dest_uuid: "462a37ed579b46e78a75add632eabf23"
from {username='slave'} at 127.0.0.1:38548
I20251023 08:00:02.255527 21340 raft_consensus.cc:493] T a27543620a6846028a73e83fb89458d5 P 462a37ed579b46e78a75add632eabf23 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 08:00:02.255785 21340 raft_consensus.cc:3060] T a27543620a6846028a73e83fb89458d5 P 462a37ed579b46e78a75add632eabf23 [term 1 FOLLOWER]: Advancing to term 2
I20251023 08:00:02.260610 21340 raft_consensus.cc:515] T a27543620a6846028a73e83fb89458d5 P 462a37ed579b46e78a75add632eabf23 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:02.262085 21340 leader_election.cc:290] T a27543620a6846028a73e83fb89458d5 P 462a37ed579b46e78a75add632eabf23 [CANDIDATE]: Term 2 election: Requested vote from peers 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1:36379), abf20d53faa04ffd9e2aec95f13abb8d (127.16.126.3:36749)
I20251023 08:00:02.263182 21415 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a27543620a6846028a73e83fb89458d5" candidate_uuid: "462a37ed579b46e78a75add632eabf23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "abf20d53faa04ffd9e2aec95f13abb8d"
I20251023 08:00:02.263484 21267 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a27543620a6846028a73e83fb89458d5" candidate_uuid: "462a37ed579b46e78a75add632eabf23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b"
I20251023 08:00:02.263945 21415 raft_consensus.cc:3055] T a27543620a6846028a73e83fb89458d5 P abf20d53faa04ffd9e2aec95f13abb8d [term 1 LEADER]: Stepping down as leader of term 1
I20251023 08:00:02.264055 21267 raft_consensus.cc:3060] T a27543620a6846028a73e83fb89458d5 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 FOLLOWER]: Advancing to term 2
I20251023 08:00:02.264300 21415 raft_consensus.cc:740] T a27543620a6846028a73e83fb89458d5 P abf20d53faa04ffd9e2aec95f13abb8d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: abf20d53faa04ffd9e2aec95f13abb8d, State: Running, Role: LEADER
I20251023 08:00:02.265192 21415 consensus_queue.cc:260] T a27543620a6846028a73e83fb89458d5 P abf20d53faa04ffd9e2aec95f13abb8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:02.266178 21415 raft_consensus.cc:3060] T a27543620a6846028a73e83fb89458d5 P abf20d53faa04ffd9e2aec95f13abb8d [term 1 FOLLOWER]: Advancing to term 2
I20251023 08:00:02.268990 21267 raft_consensus.cc:2468] T a27543620a6846028a73e83fb89458d5 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 462a37ed579b46e78a75add632eabf23 in term 2.
I20251023 08:00:02.269966 21305 leader_election.cc:304] T a27543620a6846028a73e83fb89458d5 P 462a37ed579b46e78a75add632eabf23 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a9eeaf7ef4038aecadfbb80cf8c7b, 462a37ed579b46e78a75add632eabf23; no voters:
I20251023 08:00:02.270622 21538 raft_consensus.cc:2804] T a27543620a6846028a73e83fb89458d5 P 462a37ed579b46e78a75add632eabf23 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 08:00:02.271008 21538 raft_consensus.cc:697] T a27543620a6846028a73e83fb89458d5 P 462a37ed579b46e78a75add632eabf23 [term 2 LEADER]: Becoming Leader. State: Replica: 462a37ed579b46e78a75add632eabf23, State: Running, Role: LEADER
I20251023 08:00:02.271178 21415 raft_consensus.cc:2468] T a27543620a6846028a73e83fb89458d5 P abf20d53faa04ffd9e2aec95f13abb8d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 462a37ed579b46e78a75add632eabf23 in term 2.
I20251023 08:00:02.271752 21538 consensus_queue.cc:237] T a27543620a6846028a73e83fb89458d5 P 462a37ed579b46e78a75add632eabf23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:02.278301 21164 catalog_manager.cc:5649] T a27543620a6846028a73e83fb89458d5 P 462a37ed579b46e78a75add632eabf23 reported cstate change: term changed from 1 to 2, leader changed from abf20d53faa04ffd9e2aec95f13abb8d (127.16.126.3) to 462a37ed579b46e78a75add632eabf23 (127.16.126.2). New cstate: current_term: 2 leader_uuid: "462a37ed579b46e78a75add632eabf23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } health_report { overall_health: UNKNOWN } } }
I20251023 08:00:02.304759 21606 raft_consensus.cc:993] T 7d2bc5448c3a4be6b037deea58e8e721 P abf20d53faa04ffd9e2aec95f13abb8d: : Instructing follower 189a9eeaf7ef4038aecadfbb80cf8c7b to start an election
I20251023 08:00:02.305157 21541 raft_consensus.cc:1081] T 7d2bc5448c3a4be6b037deea58e8e721 P abf20d53faa04ffd9e2aec95f13abb8d [term 1 LEADER]: Signalling peer 189a9eeaf7ef4038aecadfbb80cf8c7b to start an election
I20251023 08:00:02.306499 21267 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "7d2bc5448c3a4be6b037deea58e8e721"
dest_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b"
from {username='slave'} at 127.0.0.1:34182
I20251023 08:00:02.306914 21267 raft_consensus.cc:493] T 7d2bc5448c3a4be6b037deea58e8e721 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 08:00:02.307193 21267 raft_consensus.cc:3060] T 7d2bc5448c3a4be6b037deea58e8e721 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 FOLLOWER]: Advancing to term 2
I20251023 08:00:02.311836 21267 raft_consensus.cc:515] T 7d2bc5448c3a4be6b037deea58e8e721 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:02.313278 21267 leader_election.cc:290] T 7d2bc5448c3a4be6b037deea58e8e721 P 189a9eeaf7ef4038aecadfbb80cf8c7b [CANDIDATE]: Term 2 election: Requested vote from peers 462a37ed579b46e78a75add632eabf23 (127.16.126.2:44879), abf20d53faa04ffd9e2aec95f13abb8d (127.16.126.3:36749)
I20251023 08:00:02.314136 21340 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7d2bc5448c3a4be6b037deea58e8e721" candidate_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "462a37ed579b46e78a75add632eabf23"
I20251023 08:00:02.314296 21415 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7d2bc5448c3a4be6b037deea58e8e721" candidate_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "abf20d53faa04ffd9e2aec95f13abb8d"
I20251023 08:00:02.314666 21340 raft_consensus.cc:3060] T 7d2bc5448c3a4be6b037deea58e8e721 P 462a37ed579b46e78a75add632eabf23 [term 1 FOLLOWER]: Advancing to term 2
I20251023 08:00:02.314857 21415 raft_consensus.cc:3055] T 7d2bc5448c3a4be6b037deea58e8e721 P abf20d53faa04ffd9e2aec95f13abb8d [term 1 LEADER]: Stepping down as leader of term 1
I20251023 08:00:02.315169 21415 raft_consensus.cc:740] T 7d2bc5448c3a4be6b037deea58e8e721 P abf20d53faa04ffd9e2aec95f13abb8d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: abf20d53faa04ffd9e2aec95f13abb8d, State: Running, Role: LEADER
I20251023 08:00:02.315806 21415 consensus_queue.cc:260] T 7d2bc5448c3a4be6b037deea58e8e721 P abf20d53faa04ffd9e2aec95f13abb8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:02.316743 21415 raft_consensus.cc:3060] T 7d2bc5448c3a4be6b037deea58e8e721 P abf20d53faa04ffd9e2aec95f13abb8d [term 1 FOLLOWER]: Advancing to term 2
I20251023 08:00:02.319370 21340 raft_consensus.cc:2468] T 7d2bc5448c3a4be6b037deea58e8e721 P 462a37ed579b46e78a75add632eabf23 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a9eeaf7ef4038aecadfbb80cf8c7b in term 2.
I20251023 08:00:02.320353 21230 leader_election.cc:304] T 7d2bc5448c3a4be6b037deea58e8e721 P 189a9eeaf7ef4038aecadfbb80cf8c7b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a9eeaf7ef4038aecadfbb80cf8c7b, 462a37ed579b46e78a75add632eabf23; no voters:
I20251023 08:00:02.321010 21487 raft_consensus.cc:2804] T 7d2bc5448c3a4be6b037deea58e8e721 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 2 FOLLOWER]: Leader election won for term 2
I20251023 08:00:02.321383 21487 raft_consensus.cc:697] T 7d2bc5448c3a4be6b037deea58e8e721 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 2 LEADER]: Becoming Leader. State: Replica: 189a9eeaf7ef4038aecadfbb80cf8c7b, State: Running, Role: LEADER
I20251023 08:00:02.322160 21415 raft_consensus.cc:2468] T 7d2bc5448c3a4be6b037deea58e8e721 P abf20d53faa04ffd9e2aec95f13abb8d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a9eeaf7ef4038aecadfbb80cf8c7b in term 2.
I20251023 08:00:02.322157 21487 consensus_queue.cc:237] T 7d2bc5448c3a4be6b037deea58e8e721 P 189a9eeaf7ef4038aecadfbb80cf8c7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:02.329583 21164 catalog_manager.cc:5649] T 7d2bc5448c3a4be6b037deea58e8e721 P 189a9eeaf7ef4038aecadfbb80cf8c7b reported cstate change: term changed from 1 to 2, leader changed from abf20d53faa04ffd9e2aec95f13abb8d (127.16.126.3) to 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1). New cstate: current_term: 2 leader_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } health_report { overall_health: UNKNOWN } } }
I20251023 08:00:02.385041 21340 raft_consensus.cc:1275] T 660ad6de5e3c4d0a932f73640864f54b P 462a37ed579b46e78a75add632eabf23 [term 2 FOLLOWER]: Refusing update from remote peer 189a9eeaf7ef4038aecadfbb80cf8c7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 08:00:02.386173 21487 consensus_queue.cc:1048] T 660ad6de5e3c4d0a932f73640864f54b P 189a9eeaf7ef4038aecadfbb80cf8c7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 08:00:02.393184 21415 raft_consensus.cc:1275] T 660ad6de5e3c4d0a932f73640864f54b P abf20d53faa04ffd9e2aec95f13abb8d [term 2 FOLLOWER]: Refusing update from remote peer 189a9eeaf7ef4038aecadfbb80cf8c7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 08:00:02.394829 21558 consensus_queue.cc:1048] T 660ad6de5e3c4d0a932f73640864f54b P 189a9eeaf7ef4038aecadfbb80cf8c7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 08:00:02.450311 21267 raft_consensus.cc:1275] T a0e6c38393ac49009a25e9806355d2e4 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 2 FOLLOWER]: Refusing update from remote peer 462a37ed579b46e78a75add632eabf23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 08:00:02.451520 21538 consensus_queue.cc:1048] T a0e6c38393ac49009a25e9806355d2e4 P 462a37ed579b46e78a75add632eabf23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 08:00:02.460665 21415 raft_consensus.cc:1275] T a0e6c38393ac49009a25e9806355d2e4 P abf20d53faa04ffd9e2aec95f13abb8d [term 2 FOLLOWER]: Refusing update from remote peer 462a37ed579b46e78a75add632eabf23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 08:00:02.462080 21626 consensus_queue.cc:1048] T a0e6c38393ac49009a25e9806355d2e4 P 462a37ed579b46e78a75add632eabf23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 08:00:02.599205 21414 raft_consensus.cc:1275] T 7b0fab70cb35481eb8681415447f0763 P abf20d53faa04ffd9e2aec95f13abb8d [term 2 FOLLOWER]: Refusing update from remote peer 462a37ed579b46e78a75add632eabf23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 08:00:02.600340 21538 consensus_queue.cc:1048] T 7b0fab70cb35481eb8681415447f0763 P 462a37ed579b46e78a75add632eabf23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 08:00:02.607347 21267 raft_consensus.cc:1275] T 7b0fab70cb35481eb8681415447f0763 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 2 FOLLOWER]: Refusing update from remote peer 462a37ed579b46e78a75add632eabf23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 08:00:02.608770 21588 consensus_queue.cc:1048] T 7b0fab70cb35481eb8681415447f0763 P 462a37ed579b46e78a75add632eabf23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 08:00:02.654379 21414 raft_consensus.cc:1275] T 96cc067b744f4c04b020f42d519288d7 P abf20d53faa04ffd9e2aec95f13abb8d [term 2 FOLLOWER]: Refusing update from remote peer 462a37ed579b46e78a75add632eabf23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 08:00:02.655571 21588 consensus_queue.cc:1048] T 96cc067b744f4c04b020f42d519288d7 P 462a37ed579b46e78a75add632eabf23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 08:00:02.665922 21267 raft_consensus.cc:1275] T 96cc067b744f4c04b020f42d519288d7 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 2 FOLLOWER]: Refusing update from remote peer 462a37ed579b46e78a75add632eabf23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 08:00:02.667315 21626 consensus_queue.cc:1048] T 96cc067b744f4c04b020f42d519288d7 P 462a37ed579b46e78a75add632eabf23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 08:00:02.672875 21414 raft_consensus.cc:1275] T a27543620a6846028a73e83fb89458d5 P abf20d53faa04ffd9e2aec95f13abb8d [term 2 FOLLOWER]: Refusing update from remote peer 462a37ed579b46e78a75add632eabf23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 08:00:02.674480 21538 consensus_queue.cc:1048] T a27543620a6846028a73e83fb89458d5 P 462a37ed579b46e78a75add632eabf23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 08:00:02.690521 21267 raft_consensus.cc:1275] T a27543620a6846028a73e83fb89458d5 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 2 FOLLOWER]: Refusing update from remote peer 462a37ed579b46e78a75add632eabf23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 08:00:02.691816 21538 consensus_queue.cc:1048] T a27543620a6846028a73e83fb89458d5 P 462a37ed579b46e78a75add632eabf23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 08:00:02.703567 21414 raft_consensus.cc:1275] T 7d2bc5448c3a4be6b037deea58e8e721 P abf20d53faa04ffd9e2aec95f13abb8d [term 2 FOLLOWER]: Refusing update from remote peer 189a9eeaf7ef4038aecadfbb80cf8c7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 08:00:02.704797 21558 consensus_queue.cc:1048] T 7d2bc5448c3a4be6b037deea58e8e721 P 189a9eeaf7ef4038aecadfbb80cf8c7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 08:00:02.713498 21340 raft_consensus.cc:1275] T 7d2bc5448c3a4be6b037deea58e8e721 P 462a37ed579b46e78a75add632eabf23 [term 2 FOLLOWER]: Refusing update from remote peer 189a9eeaf7ef4038aecadfbb80cf8c7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 08:00:02.715977 21612 consensus_queue.cc:1048] T 7d2bc5448c3a4be6b037deea58e8e721 P 189a9eeaf7ef4038aecadfbb80cf8c7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 08:00:02.716791 21265 raft_consensus.cc:1275] T a29027605e3640d3a9cf4ecd7f312192 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 2 FOLLOWER]: Refusing update from remote peer abf20d53faa04ffd9e2aec95f13abb8d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 08:00:02.719355 21541 consensus_queue.cc:1048] T a29027605e3640d3a9cf4ecd7f312192 P abf20d53faa04ffd9e2aec95f13abb8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 08:00:02.729915 21340 raft_consensus.cc:1275] T a29027605e3640d3a9cf4ecd7f312192 P 462a37ed579b46e78a75add632eabf23 [term 2 FOLLOWER]: Refusing update from remote peer abf20d53faa04ffd9e2aec95f13abb8d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 08:00:02.731343 21541 consensus_queue.cc:1048] T a29027605e3640d3a9cf4ecd7f312192 P abf20d53faa04ffd9e2aec95f13abb8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 08:00:04.886123 21165 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:43258:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20251023 08:00:04.915221 21165 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:43258:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
W20251023 08:00:04.927799 21165 catalog_manager.cc:5101] could not convert tablet's dbc2b9be96eb4372849d84bf61f9dc9a schema from PB: OK
I20251023 08:00:04.953682 16888 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
W20251023 08:00:05.053915 21308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.3:36749, user_credentials={real_user=slave}} blocked reactor thread for 66648.1us
I20251023 08:00:05.141616 21667 tablet.cc:1722] T dbc2b9be96eb4372849d84bf61f9dc9a P 189a9eeaf7ef4038aecadfbb80cf8c7b: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251023 08:00:05.102615 21670 tablet.cc:1722] T dbc2b9be96eb4372849d84bf61f9dc9a P abf20d53faa04ffd9e2aec95f13abb8d: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251023 08:00:05.215267 21687 tablet.cc:1722] T a29027605e3640d3a9cf4ecd7f312192 P abf20d53faa04ffd9e2aec95f13abb8d: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
W20251023 08:00:05.226763 21308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.3:36749, user_credentials={real_user=slave}} blocked reactor thread for 134982us
I20251023 08:00:05.190976 21688 tablet.cc:1722] T a29027605e3640d3a9cf4ecd7f312192 P 189a9eeaf7ef4038aecadfbb80cf8c7b: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
W20251023 08:00:05.283105 21679 log.cc:927] Time spent T a0e6c38393ac49009a25e9806355d2e4 P 189a9eeaf7ef4038aecadfbb80cf8c7b: Append to log took a long time: real 0.100s user 0.004s sys 0.000s
W20251023 08:00:05.307047 21685 log.cc:927] Time spent T a27543620a6846028a73e83fb89458d5 P 462a37ed579b46e78a75add632eabf23: Append to log took a long time: real 0.106s user 0.000s sys 0.001s
W20251023 08:00:05.316599 21681 log.cc:927] Time spent T 96cc067b744f4c04b020f42d519288d7 P 189a9eeaf7ef4038aecadfbb80cf8c7b: Append to log took a long time: real 0.122s user 0.001s sys 0.001s
W20251023 08:00:05.324481 21691 log.cc:927] Time spent T 7d2bc5448c3a4be6b037deea58e8e721 P 462a37ed579b46e78a75add632eabf23: Append to log took a long time: real 0.104s user 0.001s sys 0.000s
I20251023 08:00:05.347720 21699 tablet.cc:1722] T 660ad6de5e3c4d0a932f73640864f54b P 189a9eeaf7ef4038aecadfbb80cf8c7b: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251023 08:00:05.361526 21667 tablet.cc:1722] T a0e6c38393ac49009a25e9806355d2e4 P 189a9eeaf7ef4038aecadfbb80cf8c7b: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251023 08:00:05.334702 21697 tablet.cc:1722] T 7d2bc5448c3a4be6b037deea58e8e721 P 189a9eeaf7ef4038aecadfbb80cf8c7b: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
W20251023 08:00:05.374271 21689 log.cc:927] Time spent T 660ad6de5e3c4d0a932f73640864f54b P 462a37ed579b46e78a75add632eabf23: Append to log took a long time: real 0.156s user 0.000s sys 0.004s
I20251023 08:00:05.381665 21690 tablet.cc:1722] T 7d2bc5448c3a4be6b037deea58e8e721 P abf20d53faa04ffd9e2aec95f13abb8d: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251023 08:00:05.388505 21337 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "a0e6c38393ac49009a25e9806355d2e4"
dest_uuid: "462a37ed579b46e78a75add632eabf23"
mode: GRACEFUL
new_leader_uuid: "abf20d53faa04ffd9e2aec95f13abb8d"
from {username='slave'} at 127.0.0.1:38574
I20251023 08:00:05.414278 21707 tablet.cc:1722] T 7b0fab70cb35481eb8681415447f0763 P 462a37ed579b46e78a75add632eabf23: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251023 08:00:05.421032 21337 raft_consensus.cc:606] T a0e6c38393ac49009a25e9806355d2e4 P 462a37ed579b46e78a75add632eabf23 [term 2 LEADER]: Received request to transfer leadership to TS abf20d53faa04ffd9e2aec95f13abb8d
I20251023 08:00:05.430825 21703 tablet.cc:1722] T dbc2b9be96eb4372849d84bf61f9dc9a P 462a37ed579b46e78a75add632eabf23: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251023 08:00:05.441213 21704 tablet.cc:1722] T a0e6c38393ac49009a25e9806355d2e4 P 462a37ed579b46e78a75add632eabf23: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251023 08:00:05.433313 21705 tablet.cc:1722] T 7b0fab70cb35481eb8681415447f0763 P abf20d53faa04ffd9e2aec95f13abb8d: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251023 08:00:05.419145 21690 tablet.cc:1722] T 660ad6de5e3c4d0a932f73640864f54b P abf20d53faa04ffd9e2aec95f13abb8d: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251023 08:00:05.453094 21667 tablet.cc:1722] T 96cc067b744f4c04b020f42d519288d7 P 189a9eeaf7ef4038aecadfbb80cf8c7b: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251023 08:00:05.455951 21653 raft_consensus.cc:993] T a0e6c38393ac49009a25e9806355d2e4 P 462a37ed579b46e78a75add632eabf23: : Instructing follower abf20d53faa04ffd9e2aec95f13abb8d to start an election
I20251023 08:00:05.456746 21651 raft_consensus.cc:1081] T a0e6c38393ac49009a25e9806355d2e4 P 462a37ed579b46e78a75add632eabf23 [term 2 LEADER]: Signalling peer abf20d53faa04ffd9e2aec95f13abb8d to start an election
I20251023 08:00:05.468163 21702 tablet.cc:1722] T 96cc067b744f4c04b020f42d519288d7 P 462a37ed579b46e78a75add632eabf23: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251023 08:00:05.476054 21687 tablet.cc:1722] T 94c7110bc7d84a09886191fcf82e530f P abf20d53faa04ffd9e2aec95f13abb8d: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251023 08:00:05.469296 21670 tablet.cc:1722] T 96cc067b744f4c04b020f42d519288d7 P abf20d53faa04ffd9e2aec95f13abb8d: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251023 08:00:05.481958 21699 tablet.cc:1722] T 94c7110bc7d84a09886191fcf82e530f P 189a9eeaf7ef4038aecadfbb80cf8c7b: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251023 08:00:05.483412 21411 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "a0e6c38393ac49009a25e9806355d2e4"
dest_uuid: "abf20d53faa04ffd9e2aec95f13abb8d"
from {username='slave'} at 127.0.0.1:56790
I20251023 08:00:05.488469 21411 raft_consensus.cc:493] T a0e6c38393ac49009a25e9806355d2e4 P abf20d53faa04ffd9e2aec95f13abb8d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 08:00:05.489032 21411 raft_consensus.cc:3060] T a0e6c38393ac49009a25e9806355d2e4 P abf20d53faa04ffd9e2aec95f13abb8d [term 2 FOLLOWER]: Advancing to term 3
I20251023 08:00:05.496515 21688 tablet.cc:1722] T 7b0fab70cb35481eb8681415447f0763 P 189a9eeaf7ef4038aecadfbb80cf8c7b: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251023 08:00:05.512465 21697 tablet.cc:1722] T a27543620a6846028a73e83fb89458d5 P 189a9eeaf7ef4038aecadfbb80cf8c7b: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251023 08:00:05.517403 21704 tablet.cc:1722] T 660ad6de5e3c4d0a932f73640864f54b P 462a37ed579b46e78a75add632eabf23: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251023 08:00:05.535960 21411 raft_consensus.cc:515] T a0e6c38393ac49009a25e9806355d2e4 P abf20d53faa04ffd9e2aec95f13abb8d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:05.521193 21703 tablet.cc:1722] T a29027605e3640d3a9cf4ecd7f312192 P 462a37ed579b46e78a75add632eabf23: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251023 08:00:05.523561 21687 tablet.cc:1722] T a0e6c38393ac49009a25e9806355d2e4 P abf20d53faa04ffd9e2aec95f13abb8d: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251023 08:00:05.543510 21267 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a0e6c38393ac49009a25e9806355d2e4" candidate_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b"
I20251023 08:00:05.546005 21267 raft_consensus.cc:3060] T a0e6c38393ac49009a25e9806355d2e4 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 2 FOLLOWER]: Advancing to term 3
I20251023 08:00:05.546633 21265 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "dbc2b9be96eb4372849d84bf61f9dc9a"
dest_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b"
mode: GRACEFUL
new_leader_uuid: "abf20d53faa04ffd9e2aec95f13abb8d"
from {username='slave'} at 127.0.0.1:56238
I20251023 08:00:05.547274 21265 raft_consensus.cc:606] T dbc2b9be96eb4372849d84bf61f9dc9a P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 LEADER]: Received request to transfer leadership to TS abf20d53faa04ffd9e2aec95f13abb8d
I20251023 08:00:05.524209 21690 tablet.cc:1722] T a27543620a6846028a73e83fb89458d5 P abf20d53faa04ffd9e2aec95f13abb8d: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251023 08:00:05.549775 16888 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20251023 08:00:05.550454 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 08:00:05.538486 21707 tablet.cc:1722] T a27543620a6846028a73e83fb89458d5 P 462a37ed579b46e78a75add632eabf23: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251023 08:00:05.559793 21265 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "0f6a4f63262e476193a5ed5fbb47bcdf"
dest_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b"
mode: GRACEFUL
new_leader_uuid: "abf20d53faa04ffd9e2aec95f13abb8d"
from {username='slave'} at 127.0.0.1:56238
I20251023 08:00:05.560534 21265 raft_consensus.cc:606] T 0f6a4f63262e476193a5ed5fbb47bcdf P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 2 LEADER]: Received request to transfer leadership to TS abf20d53faa04ffd9e2aec95f13abb8d
I20251023 08:00:05.560712 21267 raft_consensus.cc:2468] T a0e6c38393ac49009a25e9806355d2e4 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf20d53faa04ffd9e2aec95f13abb8d in term 3.
I20251023 08:00:05.562280 21379 leader_election.cc:304] T a0e6c38393ac49009a25e9806355d2e4 P abf20d53faa04ffd9e2aec95f13abb8d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a9eeaf7ef4038aecadfbb80cf8c7b, abf20d53faa04ffd9e2aec95f13abb8d; no voters:
I20251023 08:00:05.563313 21541 raft_consensus.cc:2804] T a0e6c38393ac49009a25e9806355d2e4 P abf20d53faa04ffd9e2aec95f13abb8d [term 3 FOLLOWER]: Leader election won for term 3
I20251023 08:00:05.563838 21541 raft_consensus.cc:697] T a0e6c38393ac49009a25e9806355d2e4 P abf20d53faa04ffd9e2aec95f13abb8d [term 3 LEADER]: Becoming Leader. State: Replica: abf20d53faa04ffd9e2aec95f13abb8d, State: Running, Role: LEADER
I20251023 08:00:05.564787 21541 consensus_queue.cc:237] T a0e6c38393ac49009a25e9806355d2e4 P abf20d53faa04ffd9e2aec95f13abb8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:05.568482 21342 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "7341661a4a144d58a6f2f78391143c89"
dest_uuid: "462a37ed579b46e78a75add632eabf23"
mode: GRACEFUL
new_leader_uuid: "abf20d53faa04ffd9e2aec95f13abb8d"
from {username='slave'} at 127.0.0.1:38574
I20251023 08:00:05.569456 21342 raft_consensus.cc:606] T 7341661a4a144d58a6f2f78391143c89 P 462a37ed579b46e78a75add632eabf23 [term 1 LEADER]: Received request to transfer leadership to TS abf20d53faa04ffd9e2aec95f13abb8d
I20251023 08:00:05.571099 21411 leader_election.cc:290] T a0e6c38393ac49009a25e9806355d2e4 P abf20d53faa04ffd9e2aec95f13abb8d [CANDIDATE]: Term 3 election: Requested vote from peers 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1:36379), 462a37ed579b46e78a75add632eabf23 (127.16.126.2:44879)
I20251023 08:00:05.573395 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20251023 08:00:05.574005 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 08:00:05.574659 21342 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a0e6c38393ac49009a25e9806355d2e4" candidate_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "462a37ed579b46e78a75add632eabf23"
I20251023 08:00:05.577733 21342 raft_consensus.cc:3055] T a0e6c38393ac49009a25e9806355d2e4 P 462a37ed579b46e78a75add632eabf23 [term 2 LEADER]: Stepping down as leader of term 2
I20251023 08:00:05.585110 21342 raft_consensus.cc:740] T a0e6c38393ac49009a25e9806355d2e4 P 462a37ed579b46e78a75add632eabf23 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 462a37ed579b46e78a75add632eabf23, State: Running, Role: LEADER
I20251023 08:00:05.586043 21342 consensus_queue.cc:260] T a0e6c38393ac49009a25e9806355d2e4 P 462a37ed579b46e78a75add632eabf23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:05.587445 21342 raft_consensus.cc:3060] T a0e6c38393ac49009a25e9806355d2e4 P 462a37ed579b46e78a75add632eabf23 [term 2 FOLLOWER]: Advancing to term 3
I20251023 08:00:05.580473 21702 tablet.cc:1722] T 7d2bc5448c3a4be6b037deea58e8e721 P 462a37ed579b46e78a75add632eabf23: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251023 08:00:05.582507 21707 tablet.cc:1722] T 94c7110bc7d84a09886191fcf82e530f P 462a37ed579b46e78a75add632eabf23: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251023 08:00:05.605960 21165 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 7b7e99cce269401ea04f24281106b86e: soft_deleted_table [id=ff4befe1408048d1a719c07d9bc1c9e5] alter complete (version 1)
I20251023 08:00:05.609252 21342 raft_consensus.cc:2468] T a0e6c38393ac49009a25e9806355d2e4 P 462a37ed579b46e78a75add632eabf23 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf20d53faa04ffd9e2aec95f13abb8d in term 3.
I20251023 08:00:05.620323 21164 catalog_manager.cc:5649] T a0e6c38393ac49009a25e9806355d2e4 P abf20d53faa04ffd9e2aec95f13abb8d reported cstate change: term changed from 2 to 3, leader changed from 462a37ed579b46e78a75add632eabf23 (127.16.126.2) to abf20d53faa04ffd9e2aec95f13abb8d (127.16.126.3). New cstate: current_term: 3 leader_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } health_report { overall_health: HEALTHY } } }
I20251023 08:00:05.714063 21538 raft_consensus.cc:993] T 7341661a4a144d58a6f2f78391143c89 P 462a37ed579b46e78a75add632eabf23: : Instructing follower abf20d53faa04ffd9e2aec95f13abb8d to start an election
I20251023 08:00:05.714470 21651 raft_consensus.cc:1081] T 7341661a4a144d58a6f2f78391143c89 P 462a37ed579b46e78a75add632eabf23 [term 1 LEADER]: Signalling peer abf20d53faa04ffd9e2aec95f13abb8d to start an election
I20251023 08:00:05.715828 21411 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "7341661a4a144d58a6f2f78391143c89"
dest_uuid: "abf20d53faa04ffd9e2aec95f13abb8d"
from {username='slave'} at 127.0.0.1:56790
I20251023 08:00:05.716286 21411 raft_consensus.cc:493] T 7341661a4a144d58a6f2f78391143c89 P abf20d53faa04ffd9e2aec95f13abb8d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 08:00:05.716555 21411 raft_consensus.cc:3060] T 7341661a4a144d58a6f2f78391143c89 P abf20d53faa04ffd9e2aec95f13abb8d [term 1 FOLLOWER]: Advancing to term 2
I20251023 08:00:05.722721 21411 raft_consensus.cc:515] T 7341661a4a144d58a6f2f78391143c89 P abf20d53faa04ffd9e2aec95f13abb8d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:05.724241 21411 leader_election.cc:290] T 7341661a4a144d58a6f2f78391143c89 P abf20d53faa04ffd9e2aec95f13abb8d [CANDIDATE]: Term 2 election: Requested vote from peers 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1:36379), 462a37ed579b46e78a75add632eabf23 (127.16.126.2:44879)
I20251023 08:00:05.725039 21267 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7341661a4a144d58a6f2f78391143c89" candidate_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b"
I20251023 08:00:05.725742 21267 raft_consensus.cc:3060] T 7341661a4a144d58a6f2f78391143c89 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 FOLLOWER]: Advancing to term 2
I20251023 08:00:05.725967 21342 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7341661a4a144d58a6f2f78391143c89" candidate_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "462a37ed579b46e78a75add632eabf23"
I20251023 08:00:05.726604 21342 raft_consensus.cc:3055] T 7341661a4a144d58a6f2f78391143c89 P 462a37ed579b46e78a75add632eabf23 [term 1 LEADER]: Stepping down as leader of term 1
I20251023 08:00:05.726913 21342 raft_consensus.cc:740] T 7341661a4a144d58a6f2f78391143c89 P 462a37ed579b46e78a75add632eabf23 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 462a37ed579b46e78a75add632eabf23, State: Running, Role: LEADER
I20251023 08:00:05.727759 21342 consensus_queue.cc:260] T 7341661a4a144d58a6f2f78391143c89 P 462a37ed579b46e78a75add632eabf23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:05.729163 21342 raft_consensus.cc:3060] T 7341661a4a144d58a6f2f78391143c89 P 462a37ed579b46e78a75add632eabf23 [term 1 FOLLOWER]: Advancing to term 2
I20251023 08:00:05.733271 21267 raft_consensus.cc:2468] T 7341661a4a144d58a6f2f78391143c89 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf20d53faa04ffd9e2aec95f13abb8d in term 2.
I20251023 08:00:05.734619 21379 leader_election.cc:304] T 7341661a4a144d58a6f2f78391143c89 P abf20d53faa04ffd9e2aec95f13abb8d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a9eeaf7ef4038aecadfbb80cf8c7b, abf20d53faa04ffd9e2aec95f13abb8d; no voters:
I20251023 08:00:05.735443 21541 raft_consensus.cc:2804] T 7341661a4a144d58a6f2f78391143c89 P abf20d53faa04ffd9e2aec95f13abb8d [term 2 FOLLOWER]: Leader election won for term 2
I20251023 08:00:05.735913 21541 raft_consensus.cc:697] T 7341661a4a144d58a6f2f78391143c89 P abf20d53faa04ffd9e2aec95f13abb8d [term 2 LEADER]: Becoming Leader. State: Replica: abf20d53faa04ffd9e2aec95f13abb8d, State: Running, Role: LEADER
I20251023 08:00:05.736629 21342 raft_consensus.cc:2468] T 7341661a4a144d58a6f2f78391143c89 P 462a37ed579b46e78a75add632eabf23 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf20d53faa04ffd9e2aec95f13abb8d in term 2.
I20251023 08:00:05.736838 21541 consensus_queue.cc:237] T 7341661a4a144d58a6f2f78391143c89 P abf20d53faa04ffd9e2aec95f13abb8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:05.746098 21164 catalog_manager.cc:5649] T 7341661a4a144d58a6f2f78391143c89 P abf20d53faa04ffd9e2aec95f13abb8d reported cstate change: term changed from 1 to 2, leader changed from 462a37ed579b46e78a75add632eabf23 (127.16.126.2) to abf20d53faa04ffd9e2aec95f13abb8d (127.16.126.3). New cstate: current_term: 2 leader_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } health_report { overall_health: HEALTHY } } }
I20251023 08:00:05.844805 21671 raft_consensus.cc:993] T dbc2b9be96eb4372849d84bf61f9dc9a P 189a9eeaf7ef4038aecadfbb80cf8c7b: : Instructing follower abf20d53faa04ffd9e2aec95f13abb8d to start an election
I20251023 08:00:05.845355 21673 raft_consensus.cc:1081] T dbc2b9be96eb4372849d84bf61f9dc9a P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 LEADER]: Signalling peer abf20d53faa04ffd9e2aec95f13abb8d to start an election
I20251023 08:00:05.846724 21411 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "dbc2b9be96eb4372849d84bf61f9dc9a"
dest_uuid: "abf20d53faa04ffd9e2aec95f13abb8d"
from {username='slave'} at 127.0.0.1:56798
I20251023 08:00:05.847225 21411 raft_consensus.cc:493] T dbc2b9be96eb4372849d84bf61f9dc9a P abf20d53faa04ffd9e2aec95f13abb8d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 08:00:05.847513 21411 raft_consensus.cc:3060] T dbc2b9be96eb4372849d84bf61f9dc9a P abf20d53faa04ffd9e2aec95f13abb8d [term 1 FOLLOWER]: Advancing to term 2
I20251023 08:00:05.853209 21411 raft_consensus.cc:515] T dbc2b9be96eb4372849d84bf61f9dc9a P abf20d53faa04ffd9e2aec95f13abb8d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:05.854875 21411 leader_election.cc:290] T dbc2b9be96eb4372849d84bf61f9dc9a P abf20d53faa04ffd9e2aec95f13abb8d [CANDIDATE]: Term 2 election: Requested vote from peers 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1:36379), 462a37ed579b46e78a75add632eabf23 (127.16.126.2:44879)
I20251023 08:00:05.855476 21267 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dbc2b9be96eb4372849d84bf61f9dc9a" candidate_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b"
I20251023 08:00:05.855918 21342 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dbc2b9be96eb4372849d84bf61f9dc9a" candidate_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "462a37ed579b46e78a75add632eabf23"
I20251023 08:00:05.856097 21267 raft_consensus.cc:3055] T dbc2b9be96eb4372849d84bf61f9dc9a P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 LEADER]: Stepping down as leader of term 1
I20251023 08:00:05.856456 21342 raft_consensus.cc:3060] T dbc2b9be96eb4372849d84bf61f9dc9a P 462a37ed579b46e78a75add632eabf23 [term 1 FOLLOWER]: Advancing to term 2
I20251023 08:00:05.856441 21267 raft_consensus.cc:740] T dbc2b9be96eb4372849d84bf61f9dc9a P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 189a9eeaf7ef4038aecadfbb80cf8c7b, State: Running, Role: LEADER
I20251023 08:00:05.857372 21267 consensus_queue.cc:260] T dbc2b9be96eb4372849d84bf61f9dc9a P 189a9eeaf7ef4038aecadfbb80cf8c7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:05.858306 21267 raft_consensus.cc:3060] T dbc2b9be96eb4372849d84bf61f9dc9a P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 FOLLOWER]: Advancing to term 2
I20251023 08:00:05.863091 21342 raft_consensus.cc:2468] T dbc2b9be96eb4372849d84bf61f9dc9a P 462a37ed579b46e78a75add632eabf23 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf20d53faa04ffd9e2aec95f13abb8d in term 2.
I20251023 08:00:05.864243 21379 leader_election.cc:304] T dbc2b9be96eb4372849d84bf61f9dc9a P abf20d53faa04ffd9e2aec95f13abb8d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 462a37ed579b46e78a75add632eabf23, abf20d53faa04ffd9e2aec95f13abb8d; no voters:
I20251023 08:00:05.864290 21267 raft_consensus.cc:2468] T dbc2b9be96eb4372849d84bf61f9dc9a P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf20d53faa04ffd9e2aec95f13abb8d in term 2.
I20251023 08:00:05.865092 21541 raft_consensus.cc:2804] T dbc2b9be96eb4372849d84bf61f9dc9a P abf20d53faa04ffd9e2aec95f13abb8d [term 2 FOLLOWER]: Leader election won for term 2
I20251023 08:00:05.865535 21541 raft_consensus.cc:697] T dbc2b9be96eb4372849d84bf61f9dc9a P abf20d53faa04ffd9e2aec95f13abb8d [term 2 LEADER]: Becoming Leader. State: Replica: abf20d53faa04ffd9e2aec95f13abb8d, State: Running, Role: LEADER
I20251023 08:00:05.866370 21541 consensus_queue.cc:237] T dbc2b9be96eb4372849d84bf61f9dc9a P abf20d53faa04ffd9e2aec95f13abb8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:05.873231 21164 catalog_manager.cc:5649] T dbc2b9be96eb4372849d84bf61f9dc9a P abf20d53faa04ffd9e2aec95f13abb8d reported cstate change: term changed from 1 to 2, leader changed from 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1) to abf20d53faa04ffd9e2aec95f13abb8d (127.16.126.3). New cstate: current_term: 2 leader_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } health_report { overall_health: HEALTHY } } }
I20251023 08:00:05.989161 21671 raft_consensus.cc:993] T 0f6a4f63262e476193a5ed5fbb47bcdf P 189a9eeaf7ef4038aecadfbb80cf8c7b: : Instructing follower abf20d53faa04ffd9e2aec95f13abb8d to start an election
I20251023 08:00:05.989638 21673 raft_consensus.cc:1081] T 0f6a4f63262e476193a5ed5fbb47bcdf P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 2 LEADER]: Signalling peer abf20d53faa04ffd9e2aec95f13abb8d to start an election
I20251023 08:00:05.990901 21411 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "0f6a4f63262e476193a5ed5fbb47bcdf"
dest_uuid: "abf20d53faa04ffd9e2aec95f13abb8d"
from {username='slave'} at 127.0.0.1:56798
I20251023 08:00:05.991371 21411 raft_consensus.cc:493] T 0f6a4f63262e476193a5ed5fbb47bcdf P abf20d53faa04ffd9e2aec95f13abb8d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 08:00:05.991740 21411 raft_consensus.cc:3060] T 0f6a4f63262e476193a5ed5fbb47bcdf P abf20d53faa04ffd9e2aec95f13abb8d [term 2 FOLLOWER]: Advancing to term 3
I20251023 08:00:05.997249 21411 raft_consensus.cc:515] T 0f6a4f63262e476193a5ed5fbb47bcdf P abf20d53faa04ffd9e2aec95f13abb8d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:05.998790 21411 leader_election.cc:290] T 0f6a4f63262e476193a5ed5fbb47bcdf P abf20d53faa04ffd9e2aec95f13abb8d [CANDIDATE]: Term 3 election: Requested vote from peers 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1:36379), 462a37ed579b46e78a75add632eabf23 (127.16.126.2:44879)
I20251023 08:00:05.999589 21265 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0f6a4f63262e476193a5ed5fbb47bcdf" candidate_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b"
I20251023 08:00:05.999779 21342 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0f6a4f63262e476193a5ed5fbb47bcdf" candidate_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "462a37ed579b46e78a75add632eabf23"
I20251023 08:00:06.000218 21265 raft_consensus.cc:3055] T 0f6a4f63262e476193a5ed5fbb47bcdf P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 2 LEADER]: Stepping down as leader of term 2
I20251023 08:00:06.000533 21265 raft_consensus.cc:740] T 0f6a4f63262e476193a5ed5fbb47bcdf P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 189a9eeaf7ef4038aecadfbb80cf8c7b, State: Running, Role: LEADER
I20251023 08:00:06.000403 21342 raft_consensus.cc:3060] T 0f6a4f63262e476193a5ed5fbb47bcdf P 462a37ed579b46e78a75add632eabf23 [term 2 FOLLOWER]: Advancing to term 3
I20251023 08:00:06.001363 21265 consensus_queue.cc:260] T 0f6a4f63262e476193a5ed5fbb47bcdf P 189a9eeaf7ef4038aecadfbb80cf8c7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:06.002393 21265 raft_consensus.cc:3060] T 0f6a4f63262e476193a5ed5fbb47bcdf P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 2 FOLLOWER]: Advancing to term 3
I20251023 08:00:06.008091 21265 raft_consensus.cc:2468] T 0f6a4f63262e476193a5ed5fbb47bcdf P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf20d53faa04ffd9e2aec95f13abb8d in term 3.
I20251023 08:00:06.008145 21342 raft_consensus.cc:2468] T 0f6a4f63262e476193a5ed5fbb47bcdf P 462a37ed579b46e78a75add632eabf23 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf20d53faa04ffd9e2aec95f13abb8d in term 3.
I20251023 08:00:06.009019 21379 leader_election.cc:304] T 0f6a4f63262e476193a5ed5fbb47bcdf P abf20d53faa04ffd9e2aec95f13abb8d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a9eeaf7ef4038aecadfbb80cf8c7b, abf20d53faa04ffd9e2aec95f13abb8d; no voters:
I20251023 08:00:06.009672 21541 raft_consensus.cc:2804] T 0f6a4f63262e476193a5ed5fbb47bcdf P abf20d53faa04ffd9e2aec95f13abb8d [term 3 FOLLOWER]: Leader election won for term 3
I20251023 08:00:06.010032 21541 raft_consensus.cc:697] T 0f6a4f63262e476193a5ed5fbb47bcdf P abf20d53faa04ffd9e2aec95f13abb8d [term 3 LEADER]: Becoming Leader. State: Replica: abf20d53faa04ffd9e2aec95f13abb8d, State: Running, Role: LEADER
I20251023 08:00:06.010917 21541 consensus_queue.cc:237] T 0f6a4f63262e476193a5ed5fbb47bcdf P abf20d53faa04ffd9e2aec95f13abb8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } }
I20251023 08:00:06.018007 21164 catalog_manager.cc:5649] T 0f6a4f63262e476193a5ed5fbb47bcdf P abf20d53faa04ffd9e2aec95f13abb8d reported cstate change: term changed from 2 to 3, leader changed from 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1) to abf20d53faa04ffd9e2aec95f13abb8d (127.16.126.3). New cstate: current_term: 3 leader_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf20d53faa04ffd9e2aec95f13abb8d" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36749 } health_report { overall_health: HEALTHY } } }
I20251023 08:00:06.053683 21265 raft_consensus.cc:1275] T a0e6c38393ac49009a25e9806355d2e4 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 3 FOLLOWER]: Refusing update from remote peer abf20d53faa04ffd9e2aec95f13abb8d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20251023 08:00:06.054736 21541 consensus_queue.cc:1048] T a0e6c38393ac49009a25e9806355d2e4 P abf20d53faa04ffd9e2aec95f13abb8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 08:00:06.062752 21342 raft_consensus.cc:1275] T a0e6c38393ac49009a25e9806355d2e4 P 462a37ed579b46e78a75add632eabf23 [term 3 FOLLOWER]: Refusing update from remote peer abf20d53faa04ffd9e2aec95f13abb8d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20251023 08:00:06.064448 21716 consensus_queue.cc:1048] T a0e6c38393ac49009a25e9806355d2e4 P abf20d53faa04ffd9e2aec95f13abb8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251023 08:00:06.227217 21342 raft_consensus.cc:1275] T 7341661a4a144d58a6f2f78391143c89 P 462a37ed579b46e78a75add632eabf23 [term 2 FOLLOWER]: Refusing update from remote peer abf20d53faa04ffd9e2aec95f13abb8d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 08:00:06.228471 21716 consensus_queue.cc:1048] T 7341661a4a144d58a6f2f78391143c89 P abf20d53faa04ffd9e2aec95f13abb8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 08:00:06.238978 21265 raft_consensus.cc:1275] T 7341661a4a144d58a6f2f78391143c89 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 2 FOLLOWER]: Refusing update from remote peer abf20d53faa04ffd9e2aec95f13abb8d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 08:00:06.240459 21541 consensus_queue.cc:1048] T 7341661a4a144d58a6f2f78391143c89 P abf20d53faa04ffd9e2aec95f13abb8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 08:00:06.246246 21267 raft_consensus.cc:1275] T dbc2b9be96eb4372849d84bf61f9dc9a P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 2 FOLLOWER]: Refusing update from remote peer abf20d53faa04ffd9e2aec95f13abb8d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20251023 08:00:06.249601 21716 consensus_queue.cc:1048] T dbc2b9be96eb4372849d84bf61f9dc9a P abf20d53faa04ffd9e2aec95f13abb8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 08:00:06.264187 21342 raft_consensus.cc:1275] T dbc2b9be96eb4372849d84bf61f9dc9a P 462a37ed579b46e78a75add632eabf23 [term 2 FOLLOWER]: Refusing update from remote peer abf20d53faa04ffd9e2aec95f13abb8d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20251023 08:00:06.265581 21661 consensus_queue.cc:1048] T dbc2b9be96eb4372849d84bf61f9dc9a P abf20d53faa04ffd9e2aec95f13abb8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 08:00:06.428402 21342 raft_consensus.cc:1275] T 0f6a4f63262e476193a5ed5fbb47bcdf P 462a37ed579b46e78a75add632eabf23 [term 3 FOLLOWER]: Refusing update from remote peer abf20d53faa04ffd9e2aec95f13abb8d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251023 08:00:06.429615 21267 raft_consensus.cc:1275] T 0f6a4f63262e476193a5ed5fbb47bcdf P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 3 FOLLOWER]: Refusing update from remote peer abf20d53faa04ffd9e2aec95f13abb8d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251023 08:00:06.429695 21661 consensus_queue.cc:1048] T 0f6a4f63262e476193a5ed5fbb47bcdf P abf20d53faa04ffd9e2aec95f13abb8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "462a37ed579b46e78a75add632eabf23" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 44879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20251023 08:00:06.431078 21716 consensus_queue.cc:1048] T 0f6a4f63262e476193a5ed5fbb47bcdf P abf20d53faa04ffd9e2aec95f13abb8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a9eeaf7ef4038aecadfbb80cf8c7b" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 36379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 08:00:06.575084 16888 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20251023 08:00:06.580224 16888 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20251023 08:00:06.580655 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 08:00:06.585940 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251023 08:00:06.586377 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 08:00:07.587450 16888 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20251023 08:00:07.592458 16888 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20251023 08:00:07.592924 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 08:00:07.597882 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251023 08:00:07.598268 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 08:00:08.599260 16888 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20251023 08:00:08.605379 16888 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20251023 08:00:08.605841 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 08:00:08.610347 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251023 08:00:08.610719 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 08:00:09.611620 16888 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20251023 08:00:09.616779 16888 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20251023 08:00:09.617244 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 08:00:09.622558 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251023 08:00:09.622992 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 08:00:10.623996 16888 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20251023 08:00:10.628911 16888 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20251023 08:00:10.629346 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 08:00:10.634935 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251023 08:00:10.635430 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 08:00:11.636499 16888 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20251023 08:00:11.642836 16888 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20251023 08:00:11.643388 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 08:00:11.647981 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251023 08:00:11.648365 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 08:00:12.649314 16888 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20251023 08:00:12.654212 16888 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20251023 08:00:12.654624 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 08:00:12.660089 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251023 08:00:12.660432 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 08:00:13.661667 16888 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20251023 08:00:13.668744 16888 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20251023 08:00:13.669174 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 08:00:13.675089 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251023 08:00:13.675577 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 08:00:14.676746 16888 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20251023 08:00:14.681968 16888 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20251023 08:00:14.682469 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 08:00:14.687836 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251023 08:00:14.688160 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 08:00:15.742036 16888 tablet_server.cc:178] TabletServer@127.16.126.1:0 shutting down...
I20251023 08:00:15.777257 16888 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251023 08:00:15.778016 16888 tablet_replica.cc:333] T a29027605e3640d3a9cf4ecd7f312192 P 189a9eeaf7ef4038aecadfbb80cf8c7b: stopping tablet replica
I20251023 08:00:15.779011 16888 raft_consensus.cc:2243] T a29027605e3640d3a9cf4ecd7f312192 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:15.779780 16888 raft_consensus.cc:2272] T a29027605e3640d3a9cf4ecd7f312192 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:15.782586 16888 tablet_replica.cc:333] T a0e6c38393ac49009a25e9806355d2e4 P 189a9eeaf7ef4038aecadfbb80cf8c7b: stopping tablet replica
I20251023 08:00:15.783327 16888 raft_consensus.cc:2243] T a0e6c38393ac49009a25e9806355d2e4 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 3 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:15.784148 16888 raft_consensus.cc:2272] T a0e6c38393ac49009a25e9806355d2e4 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 3 FOLLOWER]: Raft consensus is shut down!
W20251023 08:00:15.787407 21379 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 93 similar messages]
I20251023 08:00:15.787904 16888 tablet_replica.cc:333] T 7b0fab70cb35481eb8681415447f0763 P 189a9eeaf7ef4038aecadfbb80cf8c7b: stopping tablet replica
I20251023 08:00:15.788781 16888 raft_consensus.cc:2243] T 7b0fab70cb35481eb8681415447f0763 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:15.789605 16888 raft_consensus.cc:2272] T 7b0fab70cb35481eb8681415447f0763 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 2 FOLLOWER]: Raft consensus is shut down!
W20251023 08:00:15.790722 21379 consensus_peers.cc:597] T 0f6a4f63262e476193a5ed5fbb47bcdf P abf20d53faa04ffd9e2aec95f13abb8d -> Peer 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1:36379): Couldn't send request to peer 189a9eeaf7ef4038aecadfbb80cf8c7b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251023 08:00:15.792271 16888 tablet_replica.cc:333] T 30795d2458e943b5923542028d5c85a6 P 189a9eeaf7ef4038aecadfbb80cf8c7b: stopping tablet replica
I20251023 08:00:15.792944 16888 raft_consensus.cc:2243] T 30795d2458e943b5923542028d5c85a6 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 2 LEADER]: Raft consensus shutting down.
I20251023 08:00:15.793803 16888 raft_consensus.cc:2272] T 30795d2458e943b5923542028d5c85a6 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:15.795903 16888 tablet_replica.cc:333] T 7d2bc5448c3a4be6b037deea58e8e721 P 189a9eeaf7ef4038aecadfbb80cf8c7b: stopping tablet replica
I20251023 08:00:15.796520 16888 raft_consensus.cc:2243] T 7d2bc5448c3a4be6b037deea58e8e721 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 2 LEADER]: Raft consensus shutting down.
I20251023 08:00:15.797365 16888 raft_consensus.cc:2272] T 7d2bc5448c3a4be6b037deea58e8e721 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:15.799706 16888 tablet_replica.cc:333] T 0f6a4f63262e476193a5ed5fbb47bcdf P 189a9eeaf7ef4038aecadfbb80cf8c7b: stopping tablet replica
I20251023 08:00:15.800341 16888 raft_consensus.cc:2243] T 0f6a4f63262e476193a5ed5fbb47bcdf P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 3 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:15.800835 16888 raft_consensus.cc:2272] T 0f6a4f63262e476193a5ed5fbb47bcdf P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 3 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:15.803216 16888 tablet_replica.cc:333] T 3db5b343d92742c9a0fea1cfc7cc457e P 189a9eeaf7ef4038aecadfbb80cf8c7b: stopping tablet replica
I20251023 08:00:15.803776 16888 raft_consensus.cc:2243] T 3db5b343d92742c9a0fea1cfc7cc457e P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:15.804240 16888 raft_consensus.cc:2272] T 3db5b343d92742c9a0fea1cfc7cc457e P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:15.806504 16888 tablet_replica.cc:333] T 96cc067b744f4c04b020f42d519288d7 P 189a9eeaf7ef4038aecadfbb80cf8c7b: stopping tablet replica
I20251023 08:00:15.807147 16888 raft_consensus.cc:2243] T 96cc067b744f4c04b020f42d519288d7 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:15.807679 16888 raft_consensus.cc:2272] T 96cc067b744f4c04b020f42d519288d7 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:15.810039 16888 tablet_replica.cc:333] T 40eac800e4b24372ab2d12224be9bee4 P 189a9eeaf7ef4038aecadfbb80cf8c7b: stopping tablet replica
I20251023 08:00:15.810652 16888 raft_consensus.cc:2243] T 40eac800e4b24372ab2d12224be9bee4 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:15.811139 16888 raft_consensus.cc:2272] T 40eac800e4b24372ab2d12224be9bee4 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:15.813372 16888 tablet_replica.cc:333] T 660ad6de5e3c4d0a932f73640864f54b P 189a9eeaf7ef4038aecadfbb80cf8c7b: stopping tablet replica
I20251023 08:00:15.813988 16888 raft_consensus.cc:2243] T 660ad6de5e3c4d0a932f73640864f54b P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 2 LEADER]: Raft consensus shutting down.
I20251023 08:00:15.814874 16888 raft_consensus.cc:2272] T 660ad6de5e3c4d0a932f73640864f54b P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:15.817234 16888 tablet_replica.cc:333] T 927d27447e7e463c836f015eb15cc307 P 189a9eeaf7ef4038aecadfbb80cf8c7b: stopping tablet replica
I20251023 08:00:15.817812 16888 raft_consensus.cc:2243] T 927d27447e7e463c836f015eb15cc307 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:15.818373 16888 raft_consensus.cc:2272] T 927d27447e7e463c836f015eb15cc307 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:15.820613 16888 tablet_replica.cc:333] T 94c7110bc7d84a09886191fcf82e530f P 189a9eeaf7ef4038aecadfbb80cf8c7b: stopping tablet replica
I20251023 08:00:15.821177 16888 raft_consensus.cc:2243] T 94c7110bc7d84a09886191fcf82e530f P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 LEADER]: Raft consensus shutting down.
I20251023 08:00:15.822032 16888 raft_consensus.cc:2272] T 94c7110bc7d84a09886191fcf82e530f P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:15.824584 16888 tablet_replica.cc:333] T dbc2b9be96eb4372849d84bf61f9dc9a P 189a9eeaf7ef4038aecadfbb80cf8c7b: stopping tablet replica
I20251023 08:00:15.825218 16888 raft_consensus.cc:2243] T dbc2b9be96eb4372849d84bf61f9dc9a P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:15.825801 16888 raft_consensus.cc:2272] T dbc2b9be96eb4372849d84bf61f9dc9a P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 2 FOLLOWER]: Raft consensus is shut down!
W20251023 08:00:15.826372 21379 consensus_peers.cc:597] T 3db5b343d92742c9a0fea1cfc7cc457e P abf20d53faa04ffd9e2aec95f13abb8d -> Peer 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1:36379): Couldn't send request to peer 189a9eeaf7ef4038aecadfbb80cf8c7b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251023 08:00:15.828253 16888 tablet_replica.cc:333] T 0f4050c875ff487e89b8a8170c0b9125 P 189a9eeaf7ef4038aecadfbb80cf8c7b: stopping tablet replica
I20251023 08:00:15.828881 16888 raft_consensus.cc:2243] T 0f4050c875ff487e89b8a8170c0b9125 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 2 LEADER]: Raft consensus shutting down.
I20251023 08:00:15.829905 16888 raft_consensus.cc:2272] T 0f4050c875ff487e89b8a8170c0b9125 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:15.832163 16888 tablet_replica.cc:333] T a27543620a6846028a73e83fb89458d5 P 189a9eeaf7ef4038aecadfbb80cf8c7b: stopping tablet replica
I20251023 08:00:15.832674 16888 raft_consensus.cc:2243] T a27543620a6846028a73e83fb89458d5 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:15.833227 16888 raft_consensus.cc:2272] T a27543620a6846028a73e83fb89458d5 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:15.835549 16888 tablet_replica.cc:333] T a9ac30e967a44ca38d29e93d1cca6fb7 P 189a9eeaf7ef4038aecadfbb80cf8c7b: stopping tablet replica
I20251023 08:00:15.836061 16888 raft_consensus.cc:2243] T a9ac30e967a44ca38d29e93d1cca6fb7 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:15.836571 16888 raft_consensus.cc:2272] T a9ac30e967a44ca38d29e93d1cca6fb7 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:15.838681 16888 tablet_replica.cc:333] T 7341661a4a144d58a6f2f78391143c89 P 189a9eeaf7ef4038aecadfbb80cf8c7b: stopping tablet replica
I20251023 08:00:15.839216 16888 raft_consensus.cc:2243] T 7341661a4a144d58a6f2f78391143c89 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:15.839644 16888 raft_consensus.cc:2272] T 7341661a4a144d58a6f2f78391143c89 P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:15.841825 16888 tablet_replica.cc:333] T 07bbde512054431eb0f36c0fc3ce25cf P 189a9eeaf7ef4038aecadfbb80cf8c7b: stopping tablet replica
I20251023 08:00:15.842303 16888 raft_consensus.cc:2243] T 07bbde512054431eb0f36c0fc3ce25cf P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 LEADER]: Raft consensus shutting down.
I20251023 08:00:15.843351 16888 raft_consensus.cc:2272] T 07bbde512054431eb0f36c0fc3ce25cf P 189a9eeaf7ef4038aecadfbb80cf8c7b [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:15.887145 16888 tablet_server.cc:195] TabletServer@127.16.126.1:0 shutdown complete.
I20251023 08:00:15.939702 16888 tablet_server.cc:178] TabletServer@127.16.126.2:0 shutting down...
W20251023 08:00:15.939395 21305 consensus_peers.cc:597] T a27543620a6846028a73e83fb89458d5 P 462a37ed579b46e78a75add632eabf23 -> Peer 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1:36379): Couldn't send request to peer 189a9eeaf7ef4038aecadfbb80cf8c7b. Status: Network error: Client connection negotiation failed: client connection to 127.16.126.1:36379: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251023 08:00:15.974413 16888 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251023 08:00:15.975353 16888 tablet_replica.cc:333] T a0e6c38393ac49009a25e9806355d2e4 P 462a37ed579b46e78a75add632eabf23: stopping tablet replica
I20251023 08:00:15.976615 16888 raft_consensus.cc:2243] T a0e6c38393ac49009a25e9806355d2e4 P 462a37ed579b46e78a75add632eabf23 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:15.977394 16888 raft_consensus.cc:2272] T a0e6c38393ac49009a25e9806355d2e4 P 462a37ed579b46e78a75add632eabf23 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:15.979593 16888 tablet_replica.cc:333] T 7b0fab70cb35481eb8681415447f0763 P 462a37ed579b46e78a75add632eabf23: stopping tablet replica
I20251023 08:00:15.980175 16888 raft_consensus.cc:2243] T 7b0fab70cb35481eb8681415447f0763 P 462a37ed579b46e78a75add632eabf23 [term 2 LEADER]: Raft consensus shutting down.
I20251023 08:00:15.981011 16888 raft_consensus.cc:2272] T 7b0fab70cb35481eb8681415447f0763 P 462a37ed579b46e78a75add632eabf23 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:15.983171 16888 tablet_replica.cc:333] T a29027605e3640d3a9cf4ecd7f312192 P 462a37ed579b46e78a75add632eabf23: stopping tablet replica
I20251023 08:00:15.983705 16888 raft_consensus.cc:2243] T a29027605e3640d3a9cf4ecd7f312192 P 462a37ed579b46e78a75add632eabf23 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:15.984179 16888 raft_consensus.cc:2272] T a29027605e3640d3a9cf4ecd7f312192 P 462a37ed579b46e78a75add632eabf23 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:15.986390 16888 tablet_replica.cc:333] T 7341661a4a144d58a6f2f78391143c89 P 462a37ed579b46e78a75add632eabf23: stopping tablet replica
I20251023 08:00:15.986927 16888 raft_consensus.cc:2243] T 7341661a4a144d58a6f2f78391143c89 P 462a37ed579b46e78a75add632eabf23 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:15.987413 16888 raft_consensus.cc:2272] T 7341661a4a144d58a6f2f78391143c89 P 462a37ed579b46e78a75add632eabf23 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:15.989416 16888 tablet_replica.cc:333] T a27543620a6846028a73e83fb89458d5 P 462a37ed579b46e78a75add632eabf23: stopping tablet replica
I20251023 08:00:15.989979 16888 raft_consensus.cc:2243] T a27543620a6846028a73e83fb89458d5 P 462a37ed579b46e78a75add632eabf23 [term 2 LEADER]: Raft consensus shutting down.
I20251023 08:00:15.990796 16888 raft_consensus.cc:2272] T a27543620a6846028a73e83fb89458d5 P 462a37ed579b46e78a75add632eabf23 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:15.992916 16888 tablet_replica.cc:333] T a9ac30e967a44ca38d29e93d1cca6fb7 P 462a37ed579b46e78a75add632eabf23: stopping tablet replica
I20251023 08:00:15.993425 16888 raft_consensus.cc:2243] T a9ac30e967a44ca38d29e93d1cca6fb7 P 462a37ed579b46e78a75add632eabf23 [term 2 LEADER]: Raft consensus shutting down.
I20251023 08:00:15.994210 16888 raft_consensus.cc:2272] T a9ac30e967a44ca38d29e93d1cca6fb7 P 462a37ed579b46e78a75add632eabf23 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:15.996012 16888 tablet_replica.cc:333] T 94c7110bc7d84a09886191fcf82e530f P 462a37ed579b46e78a75add632eabf23: stopping tablet replica
I20251023 08:00:15.996570 16888 raft_consensus.cc:2243] T 94c7110bc7d84a09886191fcf82e530f P 462a37ed579b46e78a75add632eabf23 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:15.997022 16888 raft_consensus.cc:2272] T 94c7110bc7d84a09886191fcf82e530f P 462a37ed579b46e78a75add632eabf23 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:15.999116 16888 tablet_replica.cc:333] T dbc2b9be96eb4372849d84bf61f9dc9a P 462a37ed579b46e78a75add632eabf23: stopping tablet replica
I20251023 08:00:15.999663 16888 raft_consensus.cc:2243] T dbc2b9be96eb4372849d84bf61f9dc9a P 462a37ed579b46e78a75add632eabf23 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:16.000042 16888 raft_consensus.cc:2272] T dbc2b9be96eb4372849d84bf61f9dc9a P 462a37ed579b46e78a75add632eabf23 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:16.002039 16888 tablet_replica.cc:333] T 0f4050c875ff487e89b8a8170c0b9125 P 462a37ed579b46e78a75add632eabf23: stopping tablet replica
I20251023 08:00:16.002568 16888 raft_consensus.cc:2243] T 0f4050c875ff487e89b8a8170c0b9125 P 462a37ed579b46e78a75add632eabf23 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:16.003011 16888 raft_consensus.cc:2272] T 0f4050c875ff487e89b8a8170c0b9125 P 462a37ed579b46e78a75add632eabf23 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:16.005890 16888 tablet_replica.cc:333] T 660ad6de5e3c4d0a932f73640864f54b P 462a37ed579b46e78a75add632eabf23: stopping tablet replica
I20251023 08:00:16.006618 16888 raft_consensus.cc:2243] T 660ad6de5e3c4d0a932f73640864f54b P 462a37ed579b46e78a75add632eabf23 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:16.007349 16888 raft_consensus.cc:2272] T 660ad6de5e3c4d0a932f73640864f54b P 462a37ed579b46e78a75add632eabf23 [term 2 FOLLOWER]: Raft consensus is shut down!
W20251023 08:00:16.007882 21305 consensus_peers.cc:597] T 927d27447e7e463c836f015eb15cc307 P 462a37ed579b46e78a75add632eabf23 -> Peer 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1:36379): Couldn't send request to peer 189a9eeaf7ef4038aecadfbb80cf8c7b. Status: Network error: Client connection negotiation failed: client connection to 127.16.126.1:36379: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251023 08:00:16.009776 16888 tablet_replica.cc:333] T 927d27447e7e463c836f015eb15cc307 P 462a37ed579b46e78a75add632eabf23: stopping tablet replica
I20251023 08:00:16.010380 16888 raft_consensus.cc:2243] T 927d27447e7e463c836f015eb15cc307 P 462a37ed579b46e78a75add632eabf23 [term 2 LEADER]: Raft consensus shutting down.
I20251023 08:00:16.011194 16888 raft_consensus.cc:2272] T 927d27447e7e463c836f015eb15cc307 P 462a37ed579b46e78a75add632eabf23 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:16.013353 16888 tablet_replica.cc:333] T 96cc067b744f4c04b020f42d519288d7 P 462a37ed579b46e78a75add632eabf23: stopping tablet replica
I20251023 08:00:16.013886 16888 raft_consensus.cc:2243] T 96cc067b744f4c04b020f42d519288d7 P 462a37ed579b46e78a75add632eabf23 [term 2 LEADER]: Raft consensus shutting down.
I20251023 08:00:16.014706 16888 raft_consensus.cc:2272] T 96cc067b744f4c04b020f42d519288d7 P 462a37ed579b46e78a75add632eabf23 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:16.016752 16888 tablet_replica.cc:333] T 40eac800e4b24372ab2d12224be9bee4 P 462a37ed579b46e78a75add632eabf23: stopping tablet replica
I20251023 08:00:16.017277 16888 raft_consensus.cc:2243] T 40eac800e4b24372ab2d12224be9bee4 P 462a37ed579b46e78a75add632eabf23 [term 2 LEADER]: Raft consensus shutting down.
I20251023 08:00:16.018134 16888 raft_consensus.cc:2272] T 40eac800e4b24372ab2d12224be9bee4 P 462a37ed579b46e78a75add632eabf23 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:16.020183 16888 tablet_replica.cc:333] T 7d2bc5448c3a4be6b037deea58e8e721 P 462a37ed579b46e78a75add632eabf23: stopping tablet replica
I20251023 08:00:16.020660 16888 raft_consensus.cc:2243] T 7d2bc5448c3a4be6b037deea58e8e721 P 462a37ed579b46e78a75add632eabf23 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:16.021123 16888 raft_consensus.cc:2272] T 7d2bc5448c3a4be6b037deea58e8e721 P 462a37ed579b46e78a75add632eabf23 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:16.023236 16888 tablet_replica.cc:333] T 0f6a4f63262e476193a5ed5fbb47bcdf P 462a37ed579b46e78a75add632eabf23: stopping tablet replica
I20251023 08:00:16.023720 16888 raft_consensus.cc:2243] T 0f6a4f63262e476193a5ed5fbb47bcdf P 462a37ed579b46e78a75add632eabf23 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:16.024156 16888 raft_consensus.cc:2272] T 0f6a4f63262e476193a5ed5fbb47bcdf P 462a37ed579b46e78a75add632eabf23 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:16.026218 16888 tablet_replica.cc:333] T 3db5b343d92742c9a0fea1cfc7cc457e P 462a37ed579b46e78a75add632eabf23: stopping tablet replica
I20251023 08:00:16.026691 16888 raft_consensus.cc:2243] T 3db5b343d92742c9a0fea1cfc7cc457e P 462a37ed579b46e78a75add632eabf23 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:16.027122 16888 raft_consensus.cc:2272] T 3db5b343d92742c9a0fea1cfc7cc457e P 462a37ed579b46e78a75add632eabf23 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:16.029106 16888 tablet_replica.cc:333] T 30795d2458e943b5923542028d5c85a6 P 462a37ed579b46e78a75add632eabf23: stopping tablet replica
I20251023 08:00:16.029601 16888 raft_consensus.cc:2243] T 30795d2458e943b5923542028d5c85a6 P 462a37ed579b46e78a75add632eabf23 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:16.030074 16888 raft_consensus.cc:2272] T 30795d2458e943b5923542028d5c85a6 P 462a37ed579b46e78a75add632eabf23 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:16.031952 16888 tablet_replica.cc:333] T 07bbde512054431eb0f36c0fc3ce25cf P 462a37ed579b46e78a75add632eabf23: stopping tablet replica
I20251023 08:00:16.032411 16888 raft_consensus.cc:2243] T 07bbde512054431eb0f36c0fc3ce25cf P 462a37ed579b46e78a75add632eabf23 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:16.032825 16888 raft_consensus.cc:2272] T 07bbde512054431eb0f36c0fc3ce25cf P 462a37ed579b46e78a75add632eabf23 [term 1 FOLLOWER]: Raft consensus is shut down!
W20251023 08:00:16.047691 21379 consensus_peers.cc:597] T dbc2b9be96eb4372849d84bf61f9dc9a P abf20d53faa04ffd9e2aec95f13abb8d -> Peer 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1:36379): Couldn't send request to peer 189a9eeaf7ef4038aecadfbb80cf8c7b. Status: Network error: Client connection negotiation failed: client connection to 127.16.126.1:36379: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251023 08:00:16.074945 16888 tablet_server.cc:195] TabletServer@127.16.126.2:0 shutdown complete.
W20251023 08:00:16.093510 21379 consensus_peers.cc:597] T a0e6c38393ac49009a25e9806355d2e4 P abf20d53faa04ffd9e2aec95f13abb8d -> Peer 189a9eeaf7ef4038aecadfbb80cf8c7b (127.16.126.1:36379): Couldn't send request to peer 189a9eeaf7ef4038aecadfbb80cf8c7b. Status: Network error: Client connection negotiation failed: client connection to 127.16.126.1:36379: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251023 08:00:16.123381 16888 tablet_server.cc:178] TabletServer@127.16.126.3:0 shutting down...
W20251023 08:00:16.142760 21379 consensus_peers.cc:597] T 3db5b343d92742c9a0fea1cfc7cc457e P abf20d53faa04ffd9e2aec95f13abb8d -> Peer 462a37ed579b46e78a75add632eabf23 (127.16.126.2:44879): Couldn't send request to peer 462a37ed579b46e78a75add632eabf23. Status: Network error: Client connection negotiation failed: client connection to 127.16.126.2:44879: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251023 08:00:16.153861 16888 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251023 08:00:16.154562 16888 tablet_replica.cc:333] T 7b0fab70cb35481eb8681415447f0763 P abf20d53faa04ffd9e2aec95f13abb8d: stopping tablet replica
I20251023 08:00:16.155370 16888 raft_consensus.cc:2243] T 7b0fab70cb35481eb8681415447f0763 P abf20d53faa04ffd9e2aec95f13abb8d [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:16.156179 16888 raft_consensus.cc:2272] T 7b0fab70cb35481eb8681415447f0763 P abf20d53faa04ffd9e2aec95f13abb8d [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:16.158496 16888 tablet_replica.cc:333] T a0e6c38393ac49009a25e9806355d2e4 P abf20d53faa04ffd9e2aec95f13abb8d: stopping tablet replica
I20251023 08:00:16.159080 16888 raft_consensus.cc:2243] T a0e6c38393ac49009a25e9806355d2e4 P abf20d53faa04ffd9e2aec95f13abb8d [term 3 LEADER]: Raft consensus shutting down.
I20251023 08:00:16.160017 16888 raft_consensus.cc:2272] T a0e6c38393ac49009a25e9806355d2e4 P abf20d53faa04ffd9e2aec95f13abb8d [term 3 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:16.162015 16888 tablet_replica.cc:333] T a29027605e3640d3a9cf4ecd7f312192 P abf20d53faa04ffd9e2aec95f13abb8d: stopping tablet replica
I20251023 08:00:16.162509 16888 raft_consensus.cc:2243] T a29027605e3640d3a9cf4ecd7f312192 P abf20d53faa04ffd9e2aec95f13abb8d [term 2 LEADER]: Raft consensus shutting down.
I20251023 08:00:16.163476 16888 raft_consensus.cc:2272] T a29027605e3640d3a9cf4ecd7f312192 P abf20d53faa04ffd9e2aec95f13abb8d [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:16.165313 16888 tablet_replica.cc:333] T 7d2bc5448c3a4be6b037deea58e8e721 P abf20d53faa04ffd9e2aec95f13abb8d: stopping tablet replica
I20251023 08:00:16.165856 16888 raft_consensus.cc:2243] T 7d2bc5448c3a4be6b037deea58e8e721 P abf20d53faa04ffd9e2aec95f13abb8d [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:16.166314 16888 raft_consensus.cc:2272] T 7d2bc5448c3a4be6b037deea58e8e721 P abf20d53faa04ffd9e2aec95f13abb8d [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:16.168283 16888 tablet_replica.cc:333] T 0f6a4f63262e476193a5ed5fbb47bcdf P abf20d53faa04ffd9e2aec95f13abb8d: stopping tablet replica
I20251023 08:00:16.169157 16888 raft_consensus.cc:2243] T 0f6a4f63262e476193a5ed5fbb47bcdf P abf20d53faa04ffd9e2aec95f13abb8d [term 3 LEADER]: Raft consensus shutting down.
I20251023 08:00:16.170778 16888 raft_consensus.cc:2272] T 0f6a4f63262e476193a5ed5fbb47bcdf P abf20d53faa04ffd9e2aec95f13abb8d [term 3 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:16.173328 16888 tablet_replica.cc:333] T 3db5b343d92742c9a0fea1cfc7cc457e P abf20d53faa04ffd9e2aec95f13abb8d: stopping tablet replica
I20251023 08:00:16.173882 16888 raft_consensus.cc:2243] T 3db5b343d92742c9a0fea1cfc7cc457e P abf20d53faa04ffd9e2aec95f13abb8d [term 2 LEADER]: Raft consensus shutting down.
I20251023 08:00:16.174733 16888 raft_consensus.cc:2272] T 3db5b343d92742c9a0fea1cfc7cc457e P abf20d53faa04ffd9e2aec95f13abb8d [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:16.176757 16888 tablet_replica.cc:333] T 07bbde512054431eb0f36c0fc3ce25cf P abf20d53faa04ffd9e2aec95f13abb8d: stopping tablet replica
I20251023 08:00:16.177335 16888 raft_consensus.cc:2243] T 07bbde512054431eb0f36c0fc3ce25cf P abf20d53faa04ffd9e2aec95f13abb8d [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:16.177798 16888 raft_consensus.cc:2272] T 07bbde512054431eb0f36c0fc3ce25cf P abf20d53faa04ffd9e2aec95f13abb8d [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:16.179710 16888 tablet_replica.cc:333] T 7341661a4a144d58a6f2f78391143c89 P abf20d53faa04ffd9e2aec95f13abb8d: stopping tablet replica
I20251023 08:00:16.180251 16888 raft_consensus.cc:2243] T 7341661a4a144d58a6f2f78391143c89 P abf20d53faa04ffd9e2aec95f13abb8d [term 2 LEADER]: Raft consensus shutting down.
I20251023 08:00:16.181017 16888 raft_consensus.cc:2272] T 7341661a4a144d58a6f2f78391143c89 P abf20d53faa04ffd9e2aec95f13abb8d [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:16.182998 16888 tablet_replica.cc:333] T 660ad6de5e3c4d0a932f73640864f54b P abf20d53faa04ffd9e2aec95f13abb8d: stopping tablet replica
I20251023 08:00:16.183512 16888 raft_consensus.cc:2243] T 660ad6de5e3c4d0a932f73640864f54b P abf20d53faa04ffd9e2aec95f13abb8d [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:16.183951 16888 raft_consensus.cc:2272] T 660ad6de5e3c4d0a932f73640864f54b P abf20d53faa04ffd9e2aec95f13abb8d [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:16.185807 16888 tablet_replica.cc:333] T 927d27447e7e463c836f015eb15cc307 P abf20d53faa04ffd9e2aec95f13abb8d: stopping tablet replica
I20251023 08:00:16.186436 16888 raft_consensus.cc:2243] T 927d27447e7e463c836f015eb15cc307 P abf20d53faa04ffd9e2aec95f13abb8d [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:16.186909 16888 raft_consensus.cc:2272] T 927d27447e7e463c836f015eb15cc307 P abf20d53faa04ffd9e2aec95f13abb8d [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:16.188751 16888 tablet_replica.cc:333] T 96cc067b744f4c04b020f42d519288d7 P abf20d53faa04ffd9e2aec95f13abb8d: stopping tablet replica
I20251023 08:00:16.189254 16888 raft_consensus.cc:2243] T 96cc067b744f4c04b020f42d519288d7 P abf20d53faa04ffd9e2aec95f13abb8d [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:16.189747 16888 raft_consensus.cc:2272] T 96cc067b744f4c04b020f42d519288d7 P abf20d53faa04ffd9e2aec95f13abb8d [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:16.191738 16888 tablet_replica.cc:333] T 40eac800e4b24372ab2d12224be9bee4 P abf20d53faa04ffd9e2aec95f13abb8d: stopping tablet replica
I20251023 08:00:16.192224 16888 raft_consensus.cc:2243] T 40eac800e4b24372ab2d12224be9bee4 P abf20d53faa04ffd9e2aec95f13abb8d [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:16.192698 16888 raft_consensus.cc:2272] T 40eac800e4b24372ab2d12224be9bee4 P abf20d53faa04ffd9e2aec95f13abb8d [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:16.194689 16888 tablet_replica.cc:333] T a27543620a6846028a73e83fb89458d5 P abf20d53faa04ffd9e2aec95f13abb8d: stopping tablet replica
I20251023 08:00:16.195222 16888 raft_consensus.cc:2243] T a27543620a6846028a73e83fb89458d5 P abf20d53faa04ffd9e2aec95f13abb8d [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:16.195674 16888 raft_consensus.cc:2272] T a27543620a6846028a73e83fb89458d5 P abf20d53faa04ffd9e2aec95f13abb8d [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:16.197465 16888 tablet_replica.cc:333] T a9ac30e967a44ca38d29e93d1cca6fb7 P abf20d53faa04ffd9e2aec95f13abb8d: stopping tablet replica
I20251023 08:00:16.197937 16888 raft_consensus.cc:2243] T a9ac30e967a44ca38d29e93d1cca6fb7 P abf20d53faa04ffd9e2aec95f13abb8d [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:16.198398 16888 raft_consensus.cc:2272] T a9ac30e967a44ca38d29e93d1cca6fb7 P abf20d53faa04ffd9e2aec95f13abb8d [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:16.200258 16888 tablet_replica.cc:333] T 94c7110bc7d84a09886191fcf82e530f P abf20d53faa04ffd9e2aec95f13abb8d: stopping tablet replica
I20251023 08:00:16.200731 16888 raft_consensus.cc:2243] T 94c7110bc7d84a09886191fcf82e530f P abf20d53faa04ffd9e2aec95f13abb8d [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:16.201189 16888 raft_consensus.cc:2272] T 94c7110bc7d84a09886191fcf82e530f P abf20d53faa04ffd9e2aec95f13abb8d [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:16.203086 16888 tablet_replica.cc:333] T dbc2b9be96eb4372849d84bf61f9dc9a P abf20d53faa04ffd9e2aec95f13abb8d: stopping tablet replica
I20251023 08:00:16.203526 16888 raft_consensus.cc:2243] T dbc2b9be96eb4372849d84bf61f9dc9a P abf20d53faa04ffd9e2aec95f13abb8d [term 2 LEADER]: Raft consensus shutting down.
I20251023 08:00:16.204301 16888 raft_consensus.cc:2272] T dbc2b9be96eb4372849d84bf61f9dc9a P abf20d53faa04ffd9e2aec95f13abb8d [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:16.206252 16888 tablet_replica.cc:333] T 0f4050c875ff487e89b8a8170c0b9125 P abf20d53faa04ffd9e2aec95f13abb8d: stopping tablet replica
I20251023 08:00:16.206717 16888 raft_consensus.cc:2243] T 0f4050c875ff487e89b8a8170c0b9125 P abf20d53faa04ffd9e2aec95f13abb8d [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:16.207150 16888 raft_consensus.cc:2272] T 0f4050c875ff487e89b8a8170c0b9125 P abf20d53faa04ffd9e2aec95f13abb8d [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:16.209069 16888 tablet_replica.cc:333] T 30795d2458e943b5923542028d5c85a6 P abf20d53faa04ffd9e2aec95f13abb8d: stopping tablet replica
I20251023 08:00:16.209535 16888 raft_consensus.cc:2243] T 30795d2458e943b5923542028d5c85a6 P abf20d53faa04ffd9e2aec95f13abb8d [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:16.209973 16888 raft_consensus.cc:2272] T 30795d2458e943b5923542028d5c85a6 P abf20d53faa04ffd9e2aec95f13abb8d [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:16.249351 16888 tablet_server.cc:195] TabletServer@127.16.126.3:0 shutdown complete.
I20251023 08:00:16.286752 16888 master.cc:561] Master@127.16.126.62:34345 shutting down...
I20251023 08:00:16.310642 16888 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 7b7e99cce269401ea04f24281106b86e [term 1 LEADER]: Raft consensus shutting down.
I20251023 08:00:16.311255 16888 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 7b7e99cce269401ea04f24281106b86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:16.311573 16888 tablet_replica.cc:333] T 00000000000000000000000000000000 P 7b7e99cce269401ea04f24281106b86e: stopping tablet replica
I20251023 08:00:16.331461 16888 master.cc:583] Master@127.16.126.62:34345 shutdown complete.
[ OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (20747 ms)
[ RUN ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20251023 08:00:16.384225 16888 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.16.126.62:45855
I20251023 08:00:16.385324 16888 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251023 08:00:16.391407 21753 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251023 08:00:16.391491 21754 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251023 08:00:16.392369 21756 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251023 08:00:16.393715 16888 server_base.cc:1047] running on GCE node
I20251023 08:00:16.394656 16888 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251023 08:00:16.394840 16888 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251023 08:00:16.394953 16888 hybrid_clock.cc:648] HybridClock initialized: now 1761206416394941 us; error 0 us; skew 500 ppm
I20251023 08:00:16.395408 16888 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20251023 08:00:16.397774 16888 webserver.cc:492] Webserver started at http://127.16.126.62:45065/ using document root <none> and password file <none>
I20251023 08:00:16.398257 16888 fs_manager.cc:362] Metadata directory not provided
I20251023 08:00:16.398435 16888 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251023 08:00:16.398634 16888 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251023 08:00:16.399705 16888 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1761206251627710-16888-0/minicluster-data/master-0-root/instance:
uuid: "d62703c4b8174795af160c14e69d5120"
format_stamp: "Formatted at 2025-10-23 08:00:16 on dist-test-slave-m488"
I20251023 08:00:16.404191 16888 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20251023 08:00:16.407578 21761 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251023 08:00:16.408306 16888 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20251023 08:00:16.408569 16888 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1761206251627710-16888-0/minicluster-data/master-0-root
uuid: "d62703c4b8174795af160c14e69d5120"
format_stamp: "Formatted at 2025-10-23 08:00:16 on dist-test-slave-m488"
I20251023 08:00:16.408838 16888 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1761206251627710-16888-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1761206251627710-16888-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1761206251627710-16888-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251023 08:00:16.430595 16888 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251023 08:00:16.431823 16888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251023 08:00:16.469203 16888 rpc_server.cc:307] RPC server started. Bound to: 127.16.126.62:45855
I20251023 08:00:16.469311 21812 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.126.62:45855 every 8 connection(s)
I20251023 08:00:16.473084 21813 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:16.484411 21813 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d62703c4b8174795af160c14e69d5120: Bootstrap starting.
I20251023 08:00:16.489410 21813 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d62703c4b8174795af160c14e69d5120: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:16.493700 21813 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d62703c4b8174795af160c14e69d5120: No bootstrap required, opened a new log
I20251023 08:00:16.495886 21813 raft_consensus.cc:359] T 00000000000000000000000000000000 P d62703c4b8174795af160c14e69d5120 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d62703c4b8174795af160c14e69d5120" member_type: VOTER }
I20251023 08:00:16.496320 21813 raft_consensus.cc:385] T 00000000000000000000000000000000 P d62703c4b8174795af160c14e69d5120 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:16.496517 21813 raft_consensus.cc:740] T 00000000000000000000000000000000 P d62703c4b8174795af160c14e69d5120 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d62703c4b8174795af160c14e69d5120, State: Initialized, Role: FOLLOWER
I20251023 08:00:16.496999 21813 consensus_queue.cc:260] T 00000000000000000000000000000000 P d62703c4b8174795af160c14e69d5120 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d62703c4b8174795af160c14e69d5120" member_type: VOTER }
I20251023 08:00:16.497448 21813 raft_consensus.cc:399] T 00000000000000000000000000000000 P d62703c4b8174795af160c14e69d5120 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251023 08:00:16.497633 21813 raft_consensus.cc:493] T 00000000000000000000000000000000 P d62703c4b8174795af160c14e69d5120 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251023 08:00:16.497841 21813 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d62703c4b8174795af160c14e69d5120 [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:16.502764 21813 raft_consensus.cc:515] T 00000000000000000000000000000000 P d62703c4b8174795af160c14e69d5120 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d62703c4b8174795af160c14e69d5120" member_type: VOTER }
I20251023 08:00:16.503258 21813 leader_election.cc:304] T 00000000000000000000000000000000 P d62703c4b8174795af160c14e69d5120 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d62703c4b8174795af160c14e69d5120; no voters:
I20251023 08:00:16.504370 21813 leader_election.cc:290] T 00000000000000000000000000000000 P d62703c4b8174795af160c14e69d5120 [CANDIDATE]: Term 1 election: Requested vote from peers
I20251023 08:00:16.504798 21816 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d62703c4b8174795af160c14e69d5120 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 08:00:16.506211 21816 raft_consensus.cc:697] T 00000000000000000000000000000000 P d62703c4b8174795af160c14e69d5120 [term 1 LEADER]: Becoming Leader. State: Replica: d62703c4b8174795af160c14e69d5120, State: Running, Role: LEADER
I20251023 08:00:16.506901 21816 consensus_queue.cc:237] T 00000000000000000000000000000000 P d62703c4b8174795af160c14e69d5120 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d62703c4b8174795af160c14e69d5120" member_type: VOTER }
I20251023 08:00:16.507476 21813 sys_catalog.cc:565] T 00000000000000000000000000000000 P d62703c4b8174795af160c14e69d5120 [sys.catalog]: configured and running, proceeding with master startup.
I20251023 08:00:16.514086 21817 sys_catalog.cc:455] T 00000000000000000000000000000000 P d62703c4b8174795af160c14e69d5120 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d62703c4b8174795af160c14e69d5120" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d62703c4b8174795af160c14e69d5120" member_type: VOTER } }
I20251023 08:00:16.514076 21818 sys_catalog.cc:455] T 00000000000000000000000000000000 P d62703c4b8174795af160c14e69d5120 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d62703c4b8174795af160c14e69d5120. Latest consensus state: current_term: 1 leader_uuid: "d62703c4b8174795af160c14e69d5120" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d62703c4b8174795af160c14e69d5120" member_type: VOTER } }
I20251023 08:00:16.514972 21817 sys_catalog.cc:458] T 00000000000000000000000000000000 P d62703c4b8174795af160c14e69d5120 [sys.catalog]: This master's current role is: LEADER
I20251023 08:00:16.515080 21818 sys_catalog.cc:458] T 00000000000000000000000000000000 P d62703c4b8174795af160c14e69d5120 [sys.catalog]: This master's current role is: LEADER
I20251023 08:00:16.516855 21825 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251023 08:00:16.521749 21825 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251023 08:00:16.524384 16888 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20251023 08:00:16.531033 21825 catalog_manager.cc:1357] Generated new cluster ID: 50fb8ef6a1464c2085e9af864a412fe4
I20251023 08:00:16.531518 21825 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251023 08:00:16.545400 21825 catalog_manager.cc:1380] Generated new certificate authority record
I20251023 08:00:16.546777 21825 catalog_manager.cc:1514] Loading token signing keys...
I20251023 08:00:16.559856 21825 catalog_manager.cc:6022] T 00000000000000000000000000000000 P d62703c4b8174795af160c14e69d5120: Generated new TSK 0
I20251023 08:00:16.560529 21825 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251023 08:00:16.594259 16888 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251023 08:00:16.600322 21834 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251023 08:00:16.601533 21835 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251023 08:00:16.603259 21837 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251023 08:00:16.603446 16888 server_base.cc:1047] running on GCE node
I20251023 08:00:16.604523 16888 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251023 08:00:16.604707 16888 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251023 08:00:16.604830 16888 hybrid_clock.cc:648] HybridClock initialized: now 1761206416604819 us; error 0 us; skew 500 ppm
I20251023 08:00:16.605294 16888 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20251023 08:00:16.607571 16888 webserver.cc:492] Webserver started at http://127.16.126.1:44813/ using document root <none> and password file <none>
I20251023 08:00:16.608011 16888 fs_manager.cc:362] Metadata directory not provided
I20251023 08:00:16.608162 16888 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251023 08:00:16.608381 16888 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251023 08:00:16.609570 16888 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1761206251627710-16888-0/minicluster-data/ts-0-root/instance:
uuid: "9927a56797194391a4c98a02c10f6f58"
format_stamp: "Formatted at 2025-10-23 08:00:16 on dist-test-slave-m488"
I20251023 08:00:16.613982 16888 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20251023 08:00:16.617415 21842 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251023 08:00:16.618405 16888 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20251023 08:00:16.618671 16888 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1761206251627710-16888-0/minicluster-data/ts-0-root
uuid: "9927a56797194391a4c98a02c10f6f58"
format_stamp: "Formatted at 2025-10-23 08:00:16 on dist-test-slave-m488"
I20251023 08:00:16.618919 16888 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1761206251627710-16888-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1761206251627710-16888-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1761206251627710-16888-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251023 08:00:16.647883 16888 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251023 08:00:16.649096 16888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251023 08:00:16.650610 16888 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251023 08:00:16.652864 16888 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251023 08:00:16.653034 16888 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251023 08:00:16.653250 16888 ts_tablet_manager.cc:616] Registered 0 tablets
I20251023 08:00:16.653414 16888 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251023 08:00:16.694916 16888 rpc_server.cc:307] RPC server started. Bound to: 127.16.126.1:43563
I20251023 08:00:16.695015 21904 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.126.1:43563 every 8 connection(s)
I20251023 08:00:16.699816 16888 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251023 08:00:16.708554 21910 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251023 08:00:16.709256 21909 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251023 08:00:16.712433 21905 heartbeater.cc:344] Connected to a master server at 127.16.126.62:45855
I20251023 08:00:16.712664 16888 server_base.cc:1047] running on GCE node
I20251023 08:00:16.712965 21905 heartbeater.cc:461] Registering TS with master...
W20251023 08:00:16.713071 21912 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251023 08:00:16.714031 21905 heartbeater.cc:507] Master 127.16.126.62:45855 requested a full tablet report, sending...
I20251023 08:00:16.714388 16888 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251023 08:00:16.714694 16888 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251023 08:00:16.714900 16888 hybrid_clock.cc:648] HybridClock initialized: now 1761206416714880 us; error 0 us; skew 500 ppm
I20251023 08:00:16.715632 16888 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20251023 08:00:16.716372 21778 ts_manager.cc:194] Registered new tserver with Master: 9927a56797194391a4c98a02c10f6f58 (127.16.126.1:43563)
I20251023 08:00:16.718394 16888 webserver.cc:492] Webserver started at http://127.16.126.2:43705/ using document root <none> and password file <none>
I20251023 08:00:16.718575 21778 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54898
I20251023 08:00:16.718947 16888 fs_manager.cc:362] Metadata directory not provided
I20251023 08:00:16.719211 16888 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251023 08:00:16.719492 16888 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251023 08:00:16.721155 16888 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1761206251627710-16888-0/minicluster-data/ts-1-root/instance:
uuid: "49d13a11243a439581313cbf2389dea7"
format_stamp: "Formatted at 2025-10-23 08:00:16 on dist-test-slave-m488"
I20251023 08:00:16.726578 16888 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20251023 08:00:16.729859 21917 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251023 08:00:16.730626 16888 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20251023 08:00:16.730918 16888 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1761206251627710-16888-0/minicluster-data/ts-1-root
uuid: "49d13a11243a439581313cbf2389dea7"
format_stamp: "Formatted at 2025-10-23 08:00:16 on dist-test-slave-m488"
I20251023 08:00:16.731195 16888 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1761206251627710-16888-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1761206251627710-16888-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1761206251627710-16888-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251023 08:00:16.757728 16888 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251023 08:00:16.758949 16888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251023 08:00:16.760416 16888 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251023 08:00:16.762605 16888 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251023 08:00:16.762799 16888 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251023 08:00:16.763031 16888 ts_tablet_manager.cc:616] Registered 0 tablets
I20251023 08:00:16.763186 16888 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251023 08:00:16.803305 16888 rpc_server.cc:307] RPC server started. Bound to: 127.16.126.2:36187
I20251023 08:00:16.803424 21979 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.126.2:36187 every 8 connection(s)
I20251023 08:00:16.807963 16888 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251023 08:00:16.815188 21983 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251023 08:00:16.815325 21984 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251023 08:00:16.818305 21986 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251023 08:00:16.818677 16888 server_base.cc:1047] running on GCE node
I20251023 08:00:16.819959 16888 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20251023 08:00:16.820127 21980 heartbeater.cc:344] Connected to a master server at 127.16.126.62:45855
W20251023 08:00:16.820206 16888 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251023 08:00:16.820654 21980 heartbeater.cc:461] Registering TS with master...
I20251023 08:00:16.820695 16888 hybrid_clock.cc:648] HybridClock initialized: now 1761206416820602 us; error 0 us; skew 500 ppm
I20251023 08:00:16.821465 16888 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20251023 08:00:16.821475 21980 heartbeater.cc:507] Master 127.16.126.62:45855 requested a full tablet report, sending...
I20251023 08:00:16.823729 21778 ts_manager.cc:194] Registered new tserver with Master: 49d13a11243a439581313cbf2389dea7 (127.16.126.2:36187)
I20251023 08:00:16.824116 16888 webserver.cc:492] Webserver started at http://127.16.126.3:38235/ using document root <none> and password file <none>
I20251023 08:00:16.824636 16888 fs_manager.cc:362] Metadata directory not provided
I20251023 08:00:16.824816 16888 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251023 08:00:16.825053 16888 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251023 08:00:16.825168 21778 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54904
I20251023 08:00:16.826460 16888 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1761206251627710-16888-0/minicluster-data/ts-2-root/instance:
uuid: "c51023bde9f346c1af16edaf4c858f98"
format_stamp: "Formatted at 2025-10-23 08:00:16 on dist-test-slave-m488"
I20251023 08:00:16.830910 16888 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20251023 08:00:16.834115 21991 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251023 08:00:16.834841 16888 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20251023 08:00:16.835131 16888 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1761206251627710-16888-0/minicluster-data/ts-2-root
uuid: "c51023bde9f346c1af16edaf4c858f98"
format_stamp: "Formatted at 2025-10-23 08:00:16 on dist-test-slave-m488"
I20251023 08:00:16.835400 16888 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1761206251627710-16888-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1761206251627710-16888-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1761206251627710-16888-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251023 08:00:16.848872 16888 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251023 08:00:16.850181 16888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251023 08:00:16.851655 16888 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251023 08:00:16.853929 16888 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251023 08:00:16.854151 16888 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251023 08:00:16.854388 16888 ts_tablet_manager.cc:616] Registered 0 tablets
I20251023 08:00:16.854547 16888 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251023 08:00:16.895757 16888 rpc_server.cc:307] RPC server started. Bound to: 127.16.126.3:36947
I20251023 08:00:16.895890 22053 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.126.3:36947 every 8 connection(s)
I20251023 08:00:16.910261 22054 heartbeater.cc:344] Connected to a master server at 127.16.126.62:45855
I20251023 08:00:16.910697 22054 heartbeater.cc:461] Registering TS with master...
I20251023 08:00:16.911444 22054 heartbeater.cc:507] Master 127.16.126.62:45855 requested a full tablet report, sending...
I20251023 08:00:16.913357 21778 ts_manager.cc:194] Registered new tserver with Master: c51023bde9f346c1af16edaf4c858f98 (127.16.126.3:36947)
I20251023 08:00:16.913761 16888 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014707668s
I20251023 08:00:16.914736 21778 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54916
I20251023 08:00:16.915982 16888 test_util.cc:276] Using random seed: -757383690
I20251023 08:00:16.938894 21778 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54928:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251023 08:00:16.941896 21778 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251023 08:00:17.008519 21945 tablet_service.cc:1505] Processing CreateTablet for tablet 7456ec78bb664a40a6dde0929ea12d8f (DEFAULT_TABLE table=test-workload [id=cf90d04bf3d643f3a033236cdc4e457f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20251023 08:00:17.010193 21945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7456ec78bb664a40a6dde0929ea12d8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:17.013796 21944 tablet_service.cc:1505] Processing CreateTablet for tablet a773cc2cdf5045c09ec36f401421de47 (DEFAULT_TABLE table=test-workload [id=cf90d04bf3d643f3a033236cdc4e457f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20251023 08:00:17.015833 21944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a773cc2cdf5045c09ec36f401421de47. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:17.021159 21943 tablet_service.cc:1505] Processing CreateTablet for tablet 47b52375a02b4d348c0d45f6aab2dd8c (DEFAULT_TABLE table=test-workload [id=cf90d04bf3d643f3a033236cdc4e457f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20251023 08:00:17.022671 21943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47b52375a02b4d348c0d45f6aab2dd8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:17.025132 21942 tablet_service.cc:1505] Processing CreateTablet for tablet b555f281b922436fa19baf6f373d0aac (DEFAULT_TABLE table=test-workload [id=cf90d04bf3d643f3a033236cdc4e457f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20251023 08:00:17.026574 21942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b555f281b922436fa19baf6f373d0aac. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:17.031471 21941 tablet_service.cc:1505] Processing CreateTablet for tablet 2fa24c01f1114e93976301027c9d0a76 (DEFAULT_TABLE table=test-workload [id=cf90d04bf3d643f3a033236cdc4e457f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20251023 08:00:17.032968 21941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fa24c01f1114e93976301027c9d0a76. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:17.034580 21940 tablet_service.cc:1505] Processing CreateTablet for tablet 2d3590750a9e499a9d0b125ab1c2d8bc (DEFAULT_TABLE table=test-workload [id=cf90d04bf3d643f3a033236cdc4e457f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20251023 08:00:17.035969 21940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d3590750a9e499a9d0b125ab1c2d8bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:17.038254 21939 tablet_service.cc:1505] Processing CreateTablet for tablet e446af5509c84a799ff7fa3d89cdbc8f (DEFAULT_TABLE table=test-workload [id=cf90d04bf3d643f3a033236cdc4e457f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20251023 08:00:17.041934 21938 tablet_service.cc:1505] Processing CreateTablet for tablet eda010f13927475e9cb3af93eed06d3e (DEFAULT_TABLE table=test-workload [id=cf90d04bf3d643f3a033236cdc4e457f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20251023 08:00:17.043279 21939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e446af5509c84a799ff7fa3d89cdbc8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:17.046242 21937 tablet_service.cc:1505] Processing CreateTablet for tablet e84b3c7d7db24d86800d4a76767db682 (DEFAULT_TABLE table=test-workload [id=cf90d04bf3d643f3a033236cdc4e457f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20251023 08:00:17.048200 21937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e84b3c7d7db24d86800d4a76767db682. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:17.049749 21938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eda010f13927475e9cb3af93eed06d3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:17.070653 22019 tablet_service.cc:1505] Processing CreateTablet for tablet 7456ec78bb664a40a6dde0929ea12d8f (DEFAULT_TABLE table=test-workload [id=cf90d04bf3d643f3a033236cdc4e457f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20251023 08:00:17.072572 22019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7456ec78bb664a40a6dde0929ea12d8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:17.074697 22017 tablet_service.cc:1505] Processing CreateTablet for tablet 47b52375a02b4d348c0d45f6aab2dd8c (DEFAULT_TABLE table=test-workload [id=cf90d04bf3d643f3a033236cdc4e457f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20251023 08:00:17.076144 22017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47b52375a02b4d348c0d45f6aab2dd8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:17.077366 21864 tablet_service.cc:1505] Processing CreateTablet for tablet e446af5509c84a799ff7fa3d89cdbc8f (DEFAULT_TABLE table=test-workload [id=cf90d04bf3d643f3a033236cdc4e457f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20251023 08:00:17.078831 21864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e446af5509c84a799ff7fa3d89cdbc8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:17.078634 22016 tablet_service.cc:1505] Processing CreateTablet for tablet b555f281b922436fa19baf6f373d0aac (DEFAULT_TABLE table=test-workload [id=cf90d04bf3d643f3a033236cdc4e457f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20251023 08:00:17.080037 22016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b555f281b922436fa19baf6f373d0aac. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:17.082698 21869 tablet_service.cc:1505] Processing CreateTablet for tablet a773cc2cdf5045c09ec36f401421de47 (DEFAULT_TABLE table=test-workload [id=cf90d04bf3d643f3a033236cdc4e457f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20251023 08:00:17.084000 21869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a773cc2cdf5045c09ec36f401421de47. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:17.087046 21863 tablet_service.cc:1505] Processing CreateTablet for tablet eda010f13927475e9cb3af93eed06d3e (DEFAULT_TABLE table=test-workload [id=cf90d04bf3d643f3a033236cdc4e457f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20251023 08:00:17.087749 21870 tablet_service.cc:1505] Processing CreateTablet for tablet 7456ec78bb664a40a6dde0929ea12d8f (DEFAULT_TABLE table=test-workload [id=cf90d04bf3d643f3a033236cdc4e457f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20251023 08:00:17.089669 21866 tablet_service.cc:1505] Processing CreateTablet for tablet 2fa24c01f1114e93976301027c9d0a76 (DEFAULT_TABLE table=test-workload [id=cf90d04bf3d643f3a033236cdc4e457f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20251023 08:00:17.087643 22018 tablet_service.cc:1505] Processing CreateTablet for tablet a773cc2cdf5045c09ec36f401421de47 (DEFAULT_TABLE table=test-workload [id=cf90d04bf3d643f3a033236cdc4e457f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20251023 08:00:17.091198 22018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a773cc2cdf5045c09ec36f401421de47. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:17.091897 21868 tablet_service.cc:1505] Processing CreateTablet for tablet 47b52375a02b4d348c0d45f6aab2dd8c (DEFAULT_TABLE table=test-workload [id=cf90d04bf3d643f3a033236cdc4e457f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20251023 08:00:17.094363 21865 tablet_service.cc:1505] Processing CreateTablet for tablet 2d3590750a9e499a9d0b125ab1c2d8bc (DEFAULT_TABLE table=test-workload [id=cf90d04bf3d643f3a033236cdc4e457f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20251023 08:00:17.096196 21867 tablet_service.cc:1505] Processing CreateTablet for tablet b555f281b922436fa19baf6f373d0aac (DEFAULT_TABLE table=test-workload [id=cf90d04bf3d643f3a033236cdc4e457f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20251023 08:00:17.098843 22015 tablet_service.cc:1505] Processing CreateTablet for tablet 2fa24c01f1114e93976301027c9d0a76 (DEFAULT_TABLE table=test-workload [id=cf90d04bf3d643f3a033236cdc4e457f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20251023 08:00:17.100268 22015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fa24c01f1114e93976301027c9d0a76. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:17.100334 22011 tablet_service.cc:1505] Processing CreateTablet for tablet e84b3c7d7db24d86800d4a76767db682 (DEFAULT_TABLE table=test-workload [id=cf90d04bf3d643f3a033236cdc4e457f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20251023 08:00:17.101735 22011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e84b3c7d7db24d86800d4a76767db682. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:17.102633 22014 tablet_service.cc:1505] Processing CreateTablet for tablet 2d3590750a9e499a9d0b125ab1c2d8bc (DEFAULT_TABLE table=test-workload [id=cf90d04bf3d643f3a033236cdc4e457f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20251023 08:00:17.103933 22014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d3590750a9e499a9d0b125ab1c2d8bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:17.106581 22013 tablet_service.cc:1505] Processing CreateTablet for tablet e446af5509c84a799ff7fa3d89cdbc8f (DEFAULT_TABLE table=test-workload [id=cf90d04bf3d643f3a033236cdc4e457f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20251023 08:00:17.107919 22013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e446af5509c84a799ff7fa3d89cdbc8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:17.088464 21863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eda010f13927475e9cb3af93eed06d3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:17.109370 21862 tablet_service.cc:1505] Processing CreateTablet for tablet e84b3c7d7db24d86800d4a76767db682 (DEFAULT_TABLE table=test-workload [id=cf90d04bf3d643f3a033236cdc4e457f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20251023 08:00:17.109723 22012 tablet_service.cc:1505] Processing CreateTablet for tablet eda010f13927475e9cb3af93eed06d3e (DEFAULT_TABLE table=test-workload [id=cf90d04bf3d643f3a033236cdc4e457f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20251023 08:00:17.111508 21862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e84b3c7d7db24d86800d4a76767db682. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:17.112895 22012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eda010f13927475e9cb3af93eed06d3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:17.113090 21867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b555f281b922436fa19baf6f373d0aac. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:17.113870 21868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47b52375a02b4d348c0d45f6aab2dd8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:17.129629 21865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d3590750a9e499a9d0b125ab1c2d8bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:17.130380 21866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fa24c01f1114e93976301027c9d0a76. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:17.133852 21870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7456ec78bb664a40a6dde0929ea12d8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:17.142742 22069 tablet_bootstrap.cc:492] T 7456ec78bb664a40a6dde0929ea12d8f P 49d13a11243a439581313cbf2389dea7: Bootstrap starting.
I20251023 08:00:17.183043 22069 tablet_bootstrap.cc:654] T 7456ec78bb664a40a6dde0929ea12d8f P 49d13a11243a439581313cbf2389dea7: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:17.196956 22070 tablet_bootstrap.cc:492] T e446af5509c84a799ff7fa3d89cdbc8f P 9927a56797194391a4c98a02c10f6f58: Bootstrap starting.
I20251023 08:00:17.204396 22071 tablet_bootstrap.cc:492] T e446af5509c84a799ff7fa3d89cdbc8f P c51023bde9f346c1af16edaf4c858f98: Bootstrap starting.
I20251023 08:00:17.218194 22070 tablet_bootstrap.cc:654] T e446af5509c84a799ff7fa3d89cdbc8f P 9927a56797194391a4c98a02c10f6f58: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:17.228057 22069 tablet_bootstrap.cc:492] T 7456ec78bb664a40a6dde0929ea12d8f P 49d13a11243a439581313cbf2389dea7: No bootstrap required, opened a new log
I20251023 08:00:17.228506 22069 ts_tablet_manager.cc:1403] T 7456ec78bb664a40a6dde0929ea12d8f P 49d13a11243a439581313cbf2389dea7: Time spent bootstrapping tablet: real 0.086s user 0.011s sys 0.012s
I20251023 08:00:17.231350 22071 tablet_bootstrap.cc:654] T e446af5509c84a799ff7fa3d89cdbc8f P c51023bde9f346c1af16edaf4c858f98: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:17.237143 22069 raft_consensus.cc:359] T 7456ec78bb664a40a6dde0929ea12d8f P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } } peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } }
I20251023 08:00:17.238597 22069 raft_consensus.cc:385] T 7456ec78bb664a40a6dde0929ea12d8f P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:17.238996 22069 raft_consensus.cc:740] T 7456ec78bb664a40a6dde0929ea12d8f P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49d13a11243a439581313cbf2389dea7, State: Initialized, Role: FOLLOWER
I20251023 08:00:17.240034 22069 consensus_queue.cc:260] T 7456ec78bb664a40a6dde0929ea12d8f P 49d13a11243a439581313cbf2389dea7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } } peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } }
I20251023 08:00:17.241580 22071 tablet_bootstrap.cc:492] T e446af5509c84a799ff7fa3d89cdbc8f P c51023bde9f346c1af16edaf4c858f98: No bootstrap required, opened a new log
I20251023 08:00:17.242789 22071 ts_tablet_manager.cc:1403] T e446af5509c84a799ff7fa3d89cdbc8f P c51023bde9f346c1af16edaf4c858f98: Time spent bootstrapping tablet: real 0.075s user 0.016s sys 0.000s
I20251023 08:00:17.245744 22070 tablet_bootstrap.cc:492] T e446af5509c84a799ff7fa3d89cdbc8f P 9927a56797194391a4c98a02c10f6f58: No bootstrap required, opened a new log
I20251023 08:00:17.246260 22070 ts_tablet_manager.cc:1403] T e446af5509c84a799ff7fa3d89cdbc8f P 9927a56797194391a4c98a02c10f6f58: Time spent bootstrapping tablet: real 0.050s user 0.021s sys 0.013s
I20251023 08:00:17.245883 22071 raft_consensus.cc:359] T e446af5509c84a799ff7fa3d89cdbc8f P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.246966 22071 raft_consensus.cc:385] T e446af5509c84a799ff7fa3d89cdbc8f P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:17.247368 22071 raft_consensus.cc:740] T e446af5509c84a799ff7fa3d89cdbc8f P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51023bde9f346c1af16edaf4c858f98, State: Initialized, Role: FOLLOWER
I20251023 08:00:17.248397 22070 raft_consensus.cc:359] T e446af5509c84a799ff7fa3d89cdbc8f P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.249087 22070 raft_consensus.cc:385] T e446af5509c84a799ff7fa3d89cdbc8f P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:17.248314 22071 consensus_queue.cc:260] T e446af5509c84a799ff7fa3d89cdbc8f P c51023bde9f346c1af16edaf4c858f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.249308 22070 raft_consensus.cc:740] T e446af5509c84a799ff7fa3d89cdbc8f P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9927a56797194391a4c98a02c10f6f58, State: Initialized, Role: FOLLOWER
I20251023 08:00:17.250274 22070 consensus_queue.cc:260] T e446af5509c84a799ff7fa3d89cdbc8f P 9927a56797194391a4c98a02c10f6f58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.250758 21980 heartbeater.cc:499] Master 127.16.126.62:45855 was elected leader, sending a full tablet report...
I20251023 08:00:17.251834 22069 ts_tablet_manager.cc:1434] T 7456ec78bb664a40a6dde0929ea12d8f P 49d13a11243a439581313cbf2389dea7: Time spent starting tablet: real 0.023s user 0.008s sys 0.004s
I20251023 08:00:17.253242 22069 tablet_bootstrap.cc:492] T b555f281b922436fa19baf6f373d0aac P 49d13a11243a439581313cbf2389dea7: Bootstrap starting.
I20251023 08:00:17.262365 22069 tablet_bootstrap.cc:654] T b555f281b922436fa19baf6f373d0aac P 49d13a11243a439581313cbf2389dea7: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:17.276062 22069 tablet_bootstrap.cc:492] T b555f281b922436fa19baf6f373d0aac P 49d13a11243a439581313cbf2389dea7: No bootstrap required, opened a new log
I20251023 08:00:17.276806 22069 ts_tablet_manager.cc:1403] T b555f281b922436fa19baf6f373d0aac P 49d13a11243a439581313cbf2389dea7: Time spent bootstrapping tablet: real 0.024s user 0.016s sys 0.004s
I20251023 08:00:17.278332 22071 ts_tablet_manager.cc:1434] T e446af5509c84a799ff7fa3d89cdbc8f P c51023bde9f346c1af16edaf4c858f98: Time spent starting tablet: real 0.035s user 0.009s sys 0.026s
I20251023 08:00:17.279103 22054 heartbeater.cc:499] Master 127.16.126.62:45855 was elected leader, sending a full tablet report...
I20251023 08:00:17.279428 22071 tablet_bootstrap.cc:492] T 7456ec78bb664a40a6dde0929ea12d8f P c51023bde9f346c1af16edaf4c858f98: Bootstrap starting.
I20251023 08:00:17.284994 22071 tablet_bootstrap.cc:654] T 7456ec78bb664a40a6dde0929ea12d8f P c51023bde9f346c1af16edaf4c858f98: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:17.291154 22069 raft_consensus.cc:359] T b555f281b922436fa19baf6f373d0aac P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.292333 22069 raft_consensus.cc:385] T b555f281b922436fa19baf6f373d0aac P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:17.292737 22069 raft_consensus.cc:740] T b555f281b922436fa19baf6f373d0aac P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49d13a11243a439581313cbf2389dea7, State: Initialized, Role: FOLLOWER
I20251023 08:00:17.293722 22069 consensus_queue.cc:260] T b555f281b922436fa19baf6f373d0aac P 49d13a11243a439581313cbf2389dea7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.296206 21905 heartbeater.cc:499] Master 127.16.126.62:45855 was elected leader, sending a full tablet report...
I20251023 08:00:17.297859 22069 ts_tablet_manager.cc:1434] T b555f281b922436fa19baf6f373d0aac P 49d13a11243a439581313cbf2389dea7: Time spent starting tablet: real 0.021s user 0.012s sys 0.000s
I20251023 08:00:17.299058 22069 tablet_bootstrap.cc:492] T e84b3c7d7db24d86800d4a76767db682 P 49d13a11243a439581313cbf2389dea7: Bootstrap starting.
I20251023 08:00:17.306852 22069 tablet_bootstrap.cc:654] T e84b3c7d7db24d86800d4a76767db682 P 49d13a11243a439581313cbf2389dea7: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:17.307962 22070 ts_tablet_manager.cc:1434] T e446af5509c84a799ff7fa3d89cdbc8f P 9927a56797194391a4c98a02c10f6f58: Time spent starting tablet: real 0.061s user 0.024s sys 0.026s
I20251023 08:00:17.309489 22070 tablet_bootstrap.cc:492] T 2d3590750a9e499a9d0b125ab1c2d8bc P 9927a56797194391a4c98a02c10f6f58: Bootstrap starting.
I20251023 08:00:17.318509 22070 tablet_bootstrap.cc:654] T 2d3590750a9e499a9d0b125ab1c2d8bc P 9927a56797194391a4c98a02c10f6f58: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:17.326495 22069 tablet_bootstrap.cc:492] T e84b3c7d7db24d86800d4a76767db682 P 49d13a11243a439581313cbf2389dea7: No bootstrap required, opened a new log
I20251023 08:00:17.327056 22069 ts_tablet_manager.cc:1403] T e84b3c7d7db24d86800d4a76767db682 P 49d13a11243a439581313cbf2389dea7: Time spent bootstrapping tablet: real 0.028s user 0.015s sys 0.007s
I20251023 08:00:17.327757 22070 tablet_bootstrap.cc:492] T 2d3590750a9e499a9d0b125ab1c2d8bc P 9927a56797194391a4c98a02c10f6f58: No bootstrap required, opened a new log
I20251023 08:00:17.328326 22070 ts_tablet_manager.cc:1403] T 2d3590750a9e499a9d0b125ab1c2d8bc P 9927a56797194391a4c98a02c10f6f58: Time spent bootstrapping tablet: real 0.019s user 0.011s sys 0.003s
I20251023 08:00:17.330085 22069 raft_consensus.cc:359] T e84b3c7d7db24d86800d4a76767db682 P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.330960 22069 raft_consensus.cc:385] T e84b3c7d7db24d86800d4a76767db682 P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:17.331286 22069 raft_consensus.cc:740] T e84b3c7d7db24d86800d4a76767db682 P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49d13a11243a439581313cbf2389dea7, State: Initialized, Role: FOLLOWER
I20251023 08:00:17.331264 22070 raft_consensus.cc:359] T 2d3590750a9e499a9d0b125ab1c2d8bc P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.332140 22070 raft_consensus.cc:385] T 2d3590750a9e499a9d0b125ab1c2d8bc P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:17.332456 22070 raft_consensus.cc:740] T 2d3590750a9e499a9d0b125ab1c2d8bc P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9927a56797194391a4c98a02c10f6f58, State: Initialized, Role: FOLLOWER
I20251023 08:00:17.332381 22069 consensus_queue.cc:260] T e84b3c7d7db24d86800d4a76767db682 P 49d13a11243a439581313cbf2389dea7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.333693 22070 consensus_queue.cc:260] T 2d3590750a9e499a9d0b125ab1c2d8bc P 9927a56797194391a4c98a02c10f6f58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.336071 22070 ts_tablet_manager.cc:1434] T 2d3590750a9e499a9d0b125ab1c2d8bc P 9927a56797194391a4c98a02c10f6f58: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20251023 08:00:17.336979 22070 tablet_bootstrap.cc:492] T eda010f13927475e9cb3af93eed06d3e P 9927a56797194391a4c98a02c10f6f58: Bootstrap starting.
I20251023 08:00:17.337955 22071 tablet_bootstrap.cc:492] T 7456ec78bb664a40a6dde0929ea12d8f P c51023bde9f346c1af16edaf4c858f98: No bootstrap required, opened a new log
I20251023 08:00:17.338510 22071 ts_tablet_manager.cc:1403] T 7456ec78bb664a40a6dde0929ea12d8f P c51023bde9f346c1af16edaf4c858f98: Time spent bootstrapping tablet: real 0.059s user 0.017s sys 0.038s
I20251023 08:00:17.340297 22069 ts_tablet_manager.cc:1434] T e84b3c7d7db24d86800d4a76767db682 P 49d13a11243a439581313cbf2389dea7: Time spent starting tablet: real 0.013s user 0.008s sys 0.000s
I20251023 08:00:17.341391 22071 raft_consensus.cc:359] T 7456ec78bb664a40a6dde0929ea12d8f P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } } peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } }
I20251023 08:00:17.342202 22071 raft_consensus.cc:385] T 7456ec78bb664a40a6dde0929ea12d8f P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:17.342475 22071 raft_consensus.cc:740] T 7456ec78bb664a40a6dde0929ea12d8f P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51023bde9f346c1af16edaf4c858f98, State: Initialized, Role: FOLLOWER
I20251023 08:00:17.341401 22069 tablet_bootstrap.cc:492] T eda010f13927475e9cb3af93eed06d3e P 49d13a11243a439581313cbf2389dea7: Bootstrap starting.
I20251023 08:00:17.343565 22070 tablet_bootstrap.cc:654] T eda010f13927475e9cb3af93eed06d3e P 9927a56797194391a4c98a02c10f6f58: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:17.344985 22071 consensus_queue.cc:260] T 7456ec78bb664a40a6dde0929ea12d8f P c51023bde9f346c1af16edaf4c858f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } } peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } }
I20251023 08:00:17.350178 22069 tablet_bootstrap.cc:654] T eda010f13927475e9cb3af93eed06d3e P 49d13a11243a439581313cbf2389dea7: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:17.352056 22071 ts_tablet_manager.cc:1434] T 7456ec78bb664a40a6dde0929ea12d8f P c51023bde9f346c1af16edaf4c858f98: Time spent starting tablet: real 0.013s user 0.007s sys 0.000s
I20251023 08:00:17.353263 22071 tablet_bootstrap.cc:492] T b555f281b922436fa19baf6f373d0aac P c51023bde9f346c1af16edaf4c858f98: Bootstrap starting.
I20251023 08:00:17.355145 22070 tablet_bootstrap.cc:492] T eda010f13927475e9cb3af93eed06d3e P 9927a56797194391a4c98a02c10f6f58: No bootstrap required, opened a new log
I20251023 08:00:17.356367 22070 ts_tablet_manager.cc:1403] T eda010f13927475e9cb3af93eed06d3e P 9927a56797194391a4c98a02c10f6f58: Time spent bootstrapping tablet: real 0.020s user 0.009s sys 0.009s
I20251023 08:00:17.359776 22070 raft_consensus.cc:359] T eda010f13927475e9cb3af93eed06d3e P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.360527 22070 raft_consensus.cc:385] T eda010f13927475e9cb3af93eed06d3e P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:17.360826 22070 raft_consensus.cc:740] T eda010f13927475e9cb3af93eed06d3e P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9927a56797194391a4c98a02c10f6f58, State: Initialized, Role: FOLLOWER
I20251023 08:00:17.361653 22070 consensus_queue.cc:260] T eda010f13927475e9cb3af93eed06d3e P 9927a56797194391a4c98a02c10f6f58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.364331 22070 ts_tablet_manager.cc:1434] T eda010f13927475e9cb3af93eed06d3e P 9927a56797194391a4c98a02c10f6f58: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20251023 08:00:17.368170 22069 tablet_bootstrap.cc:492] T eda010f13927475e9cb3af93eed06d3e P 49d13a11243a439581313cbf2389dea7: No bootstrap required, opened a new log
I20251023 08:00:17.368692 22069 ts_tablet_manager.cc:1403] T eda010f13927475e9cb3af93eed06d3e P 49d13a11243a439581313cbf2389dea7: Time spent bootstrapping tablet: real 0.028s user 0.012s sys 0.012s
I20251023 08:00:17.369630 22071 tablet_bootstrap.cc:654] T b555f281b922436fa19baf6f373d0aac P c51023bde9f346c1af16edaf4c858f98: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:17.365370 22070 tablet_bootstrap.cc:492] T 47b52375a02b4d348c0d45f6aab2dd8c P 9927a56797194391a4c98a02c10f6f58: Bootstrap starting.
I20251023 08:00:17.370958 22069 raft_consensus.cc:359] T eda010f13927475e9cb3af93eed06d3e P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.371716 22069 raft_consensus.cc:385] T eda010f13927475e9cb3af93eed06d3e P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:17.371964 22069 raft_consensus.cc:740] T eda010f13927475e9cb3af93eed06d3e P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49d13a11243a439581313cbf2389dea7, State: Initialized, Role: FOLLOWER
I20251023 08:00:17.372550 22069 consensus_queue.cc:260] T eda010f13927475e9cb3af93eed06d3e P 49d13a11243a439581313cbf2389dea7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.374781 22069 ts_tablet_manager.cc:1434] T eda010f13927475e9cb3af93eed06d3e P 49d13a11243a439581313cbf2389dea7: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20251023 08:00:17.375820 22069 tablet_bootstrap.cc:492] T 2d3590750a9e499a9d0b125ab1c2d8bc P 49d13a11243a439581313cbf2389dea7: Bootstrap starting.
I20251023 08:00:17.379601 22070 tablet_bootstrap.cc:654] T 47b52375a02b4d348c0d45f6aab2dd8c P 9927a56797194391a4c98a02c10f6f58: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:17.381390 22071 tablet_bootstrap.cc:492] T b555f281b922436fa19baf6f373d0aac P c51023bde9f346c1af16edaf4c858f98: No bootstrap required, opened a new log
I20251023 08:00:17.382014 22071 ts_tablet_manager.cc:1403] T b555f281b922436fa19baf6f373d0aac P c51023bde9f346c1af16edaf4c858f98: Time spent bootstrapping tablet: real 0.029s user 0.010s sys 0.010s
I20251023 08:00:17.383147 22069 tablet_bootstrap.cc:654] T 2d3590750a9e499a9d0b125ab1c2d8bc P 49d13a11243a439581313cbf2389dea7: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:17.385329 22071 raft_consensus.cc:359] T b555f281b922436fa19baf6f373d0aac P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.386564 22076 raft_consensus.cc:493] T 7456ec78bb664a40a6dde0929ea12d8f P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 08:00:17.387230 22076 raft_consensus.cc:515] T 7456ec78bb664a40a6dde0929ea12d8f P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } } peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } }
I20251023 08:00:17.399207 22076 leader_election.cc:290] T 7456ec78bb664a40a6dde0929ea12d8f P c51023bde9f346c1af16edaf4c858f98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 49d13a11243a439581313cbf2389dea7 (127.16.126.2:36187), 9927a56797194391a4c98a02c10f6f58 (127.16.126.1:43563)
I20251023 08:00:17.408830 21955 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7456ec78bb664a40a6dde0929ea12d8f" candidate_uuid: "c51023bde9f346c1af16edaf4c858f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49d13a11243a439581313cbf2389dea7" is_pre_election: true
I20251023 08:00:17.410270 21955 raft_consensus.cc:2468] T 7456ec78bb664a40a6dde0929ea12d8f P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c51023bde9f346c1af16edaf4c858f98 in term 0.
I20251023 08:00:17.412629 21992 leader_election.cc:304] T 7456ec78bb664a40a6dde0929ea12d8f P c51023bde9f346c1af16edaf4c858f98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49d13a11243a439581313cbf2389dea7, c51023bde9f346c1af16edaf4c858f98; no voters:
I20251023 08:00:17.413869 22076 raft_consensus.cc:2804] T 7456ec78bb664a40a6dde0929ea12d8f P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 08:00:17.414388 22076 raft_consensus.cc:493] T 7456ec78bb664a40a6dde0929ea12d8f P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 08:00:17.414825 22076 raft_consensus.cc:3060] T 7456ec78bb664a40a6dde0929ea12d8f P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:17.416114 22071 raft_consensus.cc:385] T b555f281b922436fa19baf6f373d0aac P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:17.417475 22071 raft_consensus.cc:740] T b555f281b922436fa19baf6f373d0aac P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51023bde9f346c1af16edaf4c858f98, State: Initialized, Role: FOLLOWER
I20251023 08:00:17.418838 22071 consensus_queue.cc:260] T b555f281b922436fa19baf6f373d0aac P c51023bde9f346c1af16edaf4c858f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.424393 22069 tablet_bootstrap.cc:492] T 2d3590750a9e499a9d0b125ab1c2d8bc P 49d13a11243a439581313cbf2389dea7: No bootstrap required, opened a new log
I20251023 08:00:17.424906 22070 tablet_bootstrap.cc:492] T 47b52375a02b4d348c0d45f6aab2dd8c P 9927a56797194391a4c98a02c10f6f58: No bootstrap required, opened a new log
I20251023 08:00:17.425000 22069 ts_tablet_manager.cc:1403] T 2d3590750a9e499a9d0b125ab1c2d8bc P 49d13a11243a439581313cbf2389dea7: Time spent bootstrapping tablet: real 0.049s user 0.021s sys 0.023s
I20251023 08:00:17.425594 22070 ts_tablet_manager.cc:1403] T 47b52375a02b4d348c0d45f6aab2dd8c P 9927a56797194391a4c98a02c10f6f58: Time spent bootstrapping tablet: real 0.060s user 0.041s sys 0.010s
I20251023 08:00:17.426272 22076 raft_consensus.cc:515] T 7456ec78bb664a40a6dde0929ea12d8f P c51023bde9f346c1af16edaf4c858f98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } } peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } }
I20251023 08:00:17.426995 21880 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7456ec78bb664a40a6dde0929ea12d8f" candidate_uuid: "c51023bde9f346c1af16edaf4c858f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9927a56797194391a4c98a02c10f6f58" is_pre_election: true
W20251023 08:00:17.428570 21994 leader_election.cc:343] T 7456ec78bb664a40a6dde0929ea12d8f P c51023bde9f346c1af16edaf4c858f98 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9927a56797194391a4c98a02c10f6f58 (127.16.126.1:43563): Illegal state: must be running to vote when last-logged opid is not known
I20251023 08:00:17.428640 22070 raft_consensus.cc:359] T 47b52375a02b4d348c0d45f6aab2dd8c P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.429450 22070 raft_consensus.cc:385] T 47b52375a02b4d348c0d45f6aab2dd8c P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:17.429497 21955 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7456ec78bb664a40a6dde0929ea12d8f" candidate_uuid: "c51023bde9f346c1af16edaf4c858f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49d13a11243a439581313cbf2389dea7"
I20251023 08:00:17.429729 22071 ts_tablet_manager.cc:1434] T b555f281b922436fa19baf6f373d0aac P c51023bde9f346c1af16edaf4c858f98: Time spent starting tablet: real 0.047s user 0.008s sys 0.002s
I20251023 08:00:17.429802 22070 raft_consensus.cc:740] T 47b52375a02b4d348c0d45f6aab2dd8c P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9927a56797194391a4c98a02c10f6f58, State: Initialized, Role: FOLLOWER
I20251023 08:00:17.430182 21955 raft_consensus.cc:3060] T 7456ec78bb664a40a6dde0929ea12d8f P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:17.430758 22070 consensus_queue.cc:260] T 47b52375a02b4d348c0d45f6aab2dd8c P 9927a56797194391a4c98a02c10f6f58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.431527 22076 leader_election.cc:290] T 7456ec78bb664a40a6dde0929ea12d8f P c51023bde9f346c1af16edaf4c858f98 [CANDIDATE]: Term 1 election: Requested vote from peers 49d13a11243a439581313cbf2389dea7 (127.16.126.2:36187), 9927a56797194391a4c98a02c10f6f58 (127.16.126.1:43563)
I20251023 08:00:17.433612 21880 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7456ec78bb664a40a6dde0929ea12d8f" candidate_uuid: "c51023bde9f346c1af16edaf4c858f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9927a56797194391a4c98a02c10f6f58"
W20251023 08:00:17.434960 21994 leader_election.cc:343] T 7456ec78bb664a40a6dde0929ea12d8f P c51023bde9f346c1af16edaf4c858f98 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9927a56797194391a4c98a02c10f6f58 (127.16.126.1:43563): Illegal state: must be running to vote when last-logged opid is not known
I20251023 08:00:17.435680 22070 ts_tablet_manager.cc:1434] T 47b52375a02b4d348c0d45f6aab2dd8c P 9927a56797194391a4c98a02c10f6f58: Time spent starting tablet: real 0.010s user 0.006s sys 0.000s
I20251023 08:00:17.436026 22071 tablet_bootstrap.cc:492] T eda010f13927475e9cb3af93eed06d3e P c51023bde9f346c1af16edaf4c858f98: Bootstrap starting.
I20251023 08:00:17.436822 22070 tablet_bootstrap.cc:492] T a773cc2cdf5045c09ec36f401421de47 P 9927a56797194391a4c98a02c10f6f58: Bootstrap starting.
I20251023 08:00:17.439724 21955 raft_consensus.cc:2468] T 7456ec78bb664a40a6dde0929ea12d8f P 49d13a11243a439581313cbf2389dea7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c51023bde9f346c1af16edaf4c858f98 in term 1.
I20251023 08:00:17.441015 21992 leader_election.cc:304] T 7456ec78bb664a40a6dde0929ea12d8f P c51023bde9f346c1af16edaf4c858f98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 49d13a11243a439581313cbf2389dea7, c51023bde9f346c1af16edaf4c858f98; no voters: 9927a56797194391a4c98a02c10f6f58
I20251023 08:00:17.430169 22069 raft_consensus.cc:359] T 2d3590750a9e499a9d0b125ab1c2d8bc P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.442750 22069 raft_consensus.cc:385] T 2d3590750a9e499a9d0b125ab1c2d8bc P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:17.443017 22071 tablet_bootstrap.cc:654] T eda010f13927475e9cb3af93eed06d3e P c51023bde9f346c1af16edaf4c858f98: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:17.443053 22069 raft_consensus.cc:740] T 2d3590750a9e499a9d0b125ab1c2d8bc P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49d13a11243a439581313cbf2389dea7, State: Initialized, Role: FOLLOWER
I20251023 08:00:17.443557 22070 tablet_bootstrap.cc:654] T a773cc2cdf5045c09ec36f401421de47 P 9927a56797194391a4c98a02c10f6f58: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:17.446482 22088 raft_consensus.cc:2804] T 7456ec78bb664a40a6dde0929ea12d8f P c51023bde9f346c1af16edaf4c858f98 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 08:00:17.447000 22088 raft_consensus.cc:697] T 7456ec78bb664a40a6dde0929ea12d8f P c51023bde9f346c1af16edaf4c858f98 [term 1 LEADER]: Becoming Leader. State: Replica: c51023bde9f346c1af16edaf4c858f98, State: Running, Role: LEADER
I20251023 08:00:17.447923 22088 consensus_queue.cc:237] T 7456ec78bb664a40a6dde0929ea12d8f P c51023bde9f346c1af16edaf4c858f98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } } peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } }
I20251023 08:00:17.451695 22069 consensus_queue.cc:260] T 2d3590750a9e499a9d0b125ab1c2d8bc P 49d13a11243a439581313cbf2389dea7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.455579 22071 tablet_bootstrap.cc:492] T eda010f13927475e9cb3af93eed06d3e P c51023bde9f346c1af16edaf4c858f98: No bootstrap required, opened a new log
I20251023 08:00:17.456254 22071 ts_tablet_manager.cc:1403] T eda010f13927475e9cb3af93eed06d3e P c51023bde9f346c1af16edaf4c858f98: Time spent bootstrapping tablet: real 0.020s user 0.012s sys 0.004s
I20251023 08:00:17.459412 22071 raft_consensus.cc:359] T eda010f13927475e9cb3af93eed06d3e P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.460268 22071 raft_consensus.cc:385] T eda010f13927475e9cb3af93eed06d3e P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:17.460608 22071 raft_consensus.cc:740] T eda010f13927475e9cb3af93eed06d3e P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51023bde9f346c1af16edaf4c858f98, State: Initialized, Role: FOLLOWER
I20251023 08:00:17.460786 22069 ts_tablet_manager.cc:1434] T 2d3590750a9e499a9d0b125ab1c2d8bc P 49d13a11243a439581313cbf2389dea7: Time spent starting tablet: real 0.035s user 0.006s sys 0.000s
I20251023 08:00:17.461478 22070 tablet_bootstrap.cc:492] T a773cc2cdf5045c09ec36f401421de47 P 9927a56797194391a4c98a02c10f6f58: No bootstrap required, opened a new log
I20251023 08:00:17.462090 22070 ts_tablet_manager.cc:1403] T a773cc2cdf5045c09ec36f401421de47 P 9927a56797194391a4c98a02c10f6f58: Time spent bootstrapping tablet: real 0.025s user 0.010s sys 0.008s
I20251023 08:00:17.461607 22071 consensus_queue.cc:260] T eda010f13927475e9cb3af93eed06d3e P c51023bde9f346c1af16edaf4c858f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.464635 22071 ts_tablet_manager.cc:1434] T eda010f13927475e9cb3af93eed06d3e P c51023bde9f346c1af16edaf4c858f98: Time spent starting tablet: real 0.008s user 0.008s sys 0.001s
I20251023 08:00:17.465765 22071 tablet_bootstrap.cc:492] T 2fa24c01f1114e93976301027c9d0a76 P c51023bde9f346c1af16edaf4c858f98: Bootstrap starting.
I20251023 08:00:17.464664 22069 tablet_bootstrap.cc:492] T 47b52375a02b4d348c0d45f6aab2dd8c P 49d13a11243a439581313cbf2389dea7: Bootstrap starting.
I20251023 08:00:17.468680 22075 raft_consensus.cc:493] T e84b3c7d7db24d86800d4a76767db682 P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 08:00:17.469210 22075 raft_consensus.cc:515] T e84b3c7d7db24d86800d4a76767db682 P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.466435 22070 raft_consensus.cc:359] T a773cc2cdf5045c09ec36f401421de47 P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.470271 22070 raft_consensus.cc:385] T a773cc2cdf5045c09ec36f401421de47 P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:17.470599 22070 raft_consensus.cc:740] T a773cc2cdf5045c09ec36f401421de47 P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9927a56797194391a4c98a02c10f6f58, State: Initialized, Role: FOLLOWER
I20251023 08:00:17.471413 22070 consensus_queue.cc:260] T a773cc2cdf5045c09ec36f401421de47 P 9927a56797194391a4c98a02c10f6f58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.474362 21778 catalog_manager.cc:5649] T 7456ec78bb664a40a6dde0929ea12d8f P c51023bde9f346c1af16edaf4c858f98 reported cstate change: term changed from 0 to 1, leader changed from <none> to c51023bde9f346c1af16edaf4c858f98 (127.16.126.3). New cstate: current_term: 1 leader_uuid: "c51023bde9f346c1af16edaf4c858f98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } health_report { overall_health: UNKNOWN } } }
I20251023 08:00:17.476322 22069 tablet_bootstrap.cc:654] T 47b52375a02b4d348c0d45f6aab2dd8c P 49d13a11243a439581313cbf2389dea7: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:17.477695 22071 tablet_bootstrap.cc:654] T 2fa24c01f1114e93976301027c9d0a76 P c51023bde9f346c1af16edaf4c858f98: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:17.481333 22075 leader_election.cc:290] T e84b3c7d7db24d86800d4a76767db682 P 49d13a11243a439581313cbf2389dea7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9927a56797194391a4c98a02c10f6f58 (127.16.126.1:43563), c51023bde9f346c1af16edaf4c858f98 (127.16.126.3:36947)
I20251023 08:00:17.481912 22070 ts_tablet_manager.cc:1434] T a773cc2cdf5045c09ec36f401421de47 P 9927a56797194391a4c98a02c10f6f58: Time spent starting tablet: real 0.019s user 0.006s sys 0.002s
I20251023 08:00:17.483368 22070 tablet_bootstrap.cc:492] T 7456ec78bb664a40a6dde0929ea12d8f P 9927a56797194391a4c98a02c10f6f58: Bootstrap starting.
I20251023 08:00:17.492072 22070 tablet_bootstrap.cc:654] T 7456ec78bb664a40a6dde0929ea12d8f P 9927a56797194391a4c98a02c10f6f58: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:17.513305 22075 raft_consensus.cc:493] T eda010f13927475e9cb3af93eed06d3e P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 08:00:17.514021 22075 raft_consensus.cc:515] T eda010f13927475e9cb3af93eed06d3e P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.516269 22075 leader_election.cc:290] T eda010f13927475e9cb3af93eed06d3e P 49d13a11243a439581313cbf2389dea7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9927a56797194391a4c98a02c10f6f58 (127.16.126.1:43563), c51023bde9f346c1af16edaf4c858f98 (127.16.126.3:36947)
W20251023 08:00:17.520309 21826 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20251023 08:00:17.523658 22075 raft_consensus.cc:493] T 2d3590750a9e499a9d0b125ab1c2d8bc P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 08:00:17.524258 22075 raft_consensus.cc:515] T 2d3590750a9e499a9d0b125ab1c2d8bc P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.526378 22075 leader_election.cc:290] T 2d3590750a9e499a9d0b125ab1c2d8bc P 49d13a11243a439581313cbf2389dea7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9927a56797194391a4c98a02c10f6f58 (127.16.126.1:43563), c51023bde9f346c1af16edaf4c858f98 (127.16.126.3:36947)
I20251023 08:00:17.539783 22029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e84b3c7d7db24d86800d4a76767db682" candidate_uuid: "49d13a11243a439581313cbf2389dea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51023bde9f346c1af16edaf4c858f98" is_pre_election: true
I20251023 08:00:17.541358 22070 tablet_bootstrap.cc:492] T 7456ec78bb664a40a6dde0929ea12d8f P 9927a56797194391a4c98a02c10f6f58: No bootstrap required, opened a new log
I20251023 08:00:17.541939 22027 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2d3590750a9e499a9d0b125ab1c2d8bc" candidate_uuid: "49d13a11243a439581313cbf2389dea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51023bde9f346c1af16edaf4c858f98" is_pre_election: true
I20251023 08:00:17.542011 22070 ts_tablet_manager.cc:1403] T 7456ec78bb664a40a6dde0929ea12d8f P 9927a56797194391a4c98a02c10f6f58: Time spent bootstrapping tablet: real 0.059s user 0.005s sys 0.028s
I20251023 08:00:17.541477 22028 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eda010f13927475e9cb3af93eed06d3e" candidate_uuid: "49d13a11243a439581313cbf2389dea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51023bde9f346c1af16edaf4c858f98" is_pre_election: true
I20251023 08:00:17.543889 22028 raft_consensus.cc:2468] T eda010f13927475e9cb3af93eed06d3e P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49d13a11243a439581313cbf2389dea7 in term 0.
I20251023 08:00:17.543905 21879 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eda010f13927475e9cb3af93eed06d3e" candidate_uuid: "49d13a11243a439581313cbf2389dea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9927a56797194391a4c98a02c10f6f58" is_pre_election: true
I20251023 08:00:17.542098 21880 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e84b3c7d7db24d86800d4a76767db682" candidate_uuid: "49d13a11243a439581313cbf2389dea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9927a56797194391a4c98a02c10f6f58" is_pre_election: true
I20251023 08:00:17.545233 21878 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2d3590750a9e499a9d0b125ab1c2d8bc" candidate_uuid: "49d13a11243a439581313cbf2389dea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9927a56797194391a4c98a02c10f6f58" is_pre_election: true
I20251023 08:00:17.546502 21878 raft_consensus.cc:2468] T 2d3590750a9e499a9d0b125ab1c2d8bc P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49d13a11243a439581313cbf2389dea7 in term 0.
W20251023 08:00:17.546814 21921 leader_election.cc:343] T e84b3c7d7db24d86800d4a76767db682 P 49d13a11243a439581313cbf2389dea7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c51023bde9f346c1af16edaf4c858f98 (127.16.126.3:36947): Illegal state: must be running to vote when last-logged opid is not known
I20251023 08:00:17.545269 21879 raft_consensus.cc:2468] T eda010f13927475e9cb3af93eed06d3e P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49d13a11243a439581313cbf2389dea7 in term 0.
I20251023 08:00:17.547765 22070 raft_consensus.cc:359] T 7456ec78bb664a40a6dde0929ea12d8f P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } } peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } }
I20251023 08:00:17.548746 22070 raft_consensus.cc:385] T 7456ec78bb664a40a6dde0929ea12d8f P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:17.545172 22071 tablet_bootstrap.cc:492] T 2fa24c01f1114e93976301027c9d0a76 P c51023bde9f346c1af16edaf4c858f98: No bootstrap required, opened a new log
W20251023 08:00:17.549852 21920 leader_election.cc:343] T e84b3c7d7db24d86800d4a76767db682 P 49d13a11243a439581313cbf2389dea7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9927a56797194391a4c98a02c10f6f58 (127.16.126.1:43563): Illegal state: must be running to vote when last-logged opid is not known
I20251023 08:00:17.549099 22070 raft_consensus.cc:740] T 7456ec78bb664a40a6dde0929ea12d8f P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9927a56797194391a4c98a02c10f6f58, State: Initialized, Role: FOLLOWER
I20251023 08:00:17.550083 22071 ts_tablet_manager.cc:1403] T 2fa24c01f1114e93976301027c9d0a76 P c51023bde9f346c1af16edaf4c858f98: Time spent bootstrapping tablet: real 0.085s user 0.020s sys 0.018s
I20251023 08:00:17.550729 21920 leader_election.cc:304] T e84b3c7d7db24d86800d4a76767db682 P 49d13a11243a439581313cbf2389dea7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 49d13a11243a439581313cbf2389dea7; no voters: 9927a56797194391a4c98a02c10f6f58, c51023bde9f346c1af16edaf4c858f98
I20251023 08:00:17.551844 22075 raft_consensus.cc:2749] T e84b3c7d7db24d86800d4a76767db682 P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251023 08:00:17.547564 21921 leader_election.cc:343] T 2d3590750a9e499a9d0b125ab1c2d8bc P 49d13a11243a439581313cbf2389dea7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c51023bde9f346c1af16edaf4c858f98 (127.16.126.3:36947): Illegal state: must be running to vote when last-logged opid is not known
I20251023 08:00:17.552711 21921 leader_election.cc:304] T eda010f13927475e9cb3af93eed06d3e P 49d13a11243a439581313cbf2389dea7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49d13a11243a439581313cbf2389dea7, c51023bde9f346c1af16edaf4c858f98; no voters:
I20251023 08:00:17.556123 22075 raft_consensus.cc:2804] T eda010f13927475e9cb3af93eed06d3e P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 08:00:17.555794 22070 consensus_queue.cc:260] T 7456ec78bb664a40a6dde0929ea12d8f P 9927a56797194391a4c98a02c10f6f58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } } peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } }
I20251023 08:00:17.556258 21920 leader_election.cc:304] T 2d3590750a9e499a9d0b125ab1c2d8bc P 49d13a11243a439581313cbf2389dea7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 49d13a11243a439581313cbf2389dea7, 9927a56797194391a4c98a02c10f6f58; no voters: c51023bde9f346c1af16edaf4c858f98
I20251023 08:00:17.556684 22075 raft_consensus.cc:493] T eda010f13927475e9cb3af93eed06d3e P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 08:00:17.554137 22071 raft_consensus.cc:359] T 2fa24c01f1114e93976301027c9d0a76 P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.557226 22075 raft_consensus.cc:3060] T eda010f13927475e9cb3af93eed06d3e P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:17.557587 22071 raft_consensus.cc:385] T 2fa24c01f1114e93976301027c9d0a76 P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:17.557906 22071 raft_consensus.cc:740] T 2fa24c01f1114e93976301027c9d0a76 P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51023bde9f346c1af16edaf4c858f98, State: Initialized, Role: FOLLOWER
I20251023 08:00:17.558653 22071 consensus_queue.cc:260] T 2fa24c01f1114e93976301027c9d0a76 P c51023bde9f346c1af16edaf4c858f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.561017 22071 ts_tablet_manager.cc:1434] T 2fa24c01f1114e93976301027c9d0a76 P c51023bde9f346c1af16edaf4c858f98: Time spent starting tablet: real 0.010s user 0.004s sys 0.000s
I20251023 08:00:17.562036 22071 tablet_bootstrap.cc:492] T 2d3590750a9e499a9d0b125ab1c2d8bc P c51023bde9f346c1af16edaf4c858f98: Bootstrap starting.
I20251023 08:00:17.565771 22075 raft_consensus.cc:515] T eda010f13927475e9cb3af93eed06d3e P 49d13a11243a439581313cbf2389dea7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.567348 22099 raft_consensus.cc:2804] T 2d3590750a9e499a9d0b125ab1c2d8bc P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 08:00:17.567842 22099 raft_consensus.cc:493] T 2d3590750a9e499a9d0b125ab1c2d8bc P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 08:00:17.567938 22075 leader_election.cc:290] T eda010f13927475e9cb3af93eed06d3e P 49d13a11243a439581313cbf2389dea7 [CANDIDATE]: Term 1 election: Requested vote from peers 9927a56797194391a4c98a02c10f6f58 (127.16.126.1:43563), c51023bde9f346c1af16edaf4c858f98 (127.16.126.3:36947)
I20251023 08:00:17.568226 22099 raft_consensus.cc:3060] T 2d3590750a9e499a9d0b125ab1c2d8bc P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:17.569065 22070 ts_tablet_manager.cc:1434] T 7456ec78bb664a40a6dde0929ea12d8f P 9927a56797194391a4c98a02c10f6f58: Time spent starting tablet: real 0.026s user 0.007s sys 0.000s
I20251023 08:00:17.572588 22070 tablet_bootstrap.cc:492] T b555f281b922436fa19baf6f373d0aac P 9927a56797194391a4c98a02c10f6f58: Bootstrap starting.
I20251023 08:00:17.573277 22028 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eda010f13927475e9cb3af93eed06d3e" candidate_uuid: "49d13a11243a439581313cbf2389dea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51023bde9f346c1af16edaf4c858f98"
I20251023 08:00:17.574074 22028 raft_consensus.cc:3060] T eda010f13927475e9cb3af93eed06d3e P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:17.578413 22071 tablet_bootstrap.cc:654] T 2d3590750a9e499a9d0b125ab1c2d8bc P c51023bde9f346c1af16edaf4c858f98: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:17.578951 22099 raft_consensus.cc:515] T 2d3590750a9e499a9d0b125ab1c2d8bc P 49d13a11243a439581313cbf2389dea7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.581815 22028 raft_consensus.cc:2468] T eda010f13927475e9cb3af93eed06d3e P c51023bde9f346c1af16edaf4c858f98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49d13a11243a439581313cbf2389dea7 in term 1.
I20251023 08:00:17.583683 21879 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eda010f13927475e9cb3af93eed06d3e" candidate_uuid: "49d13a11243a439581313cbf2389dea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9927a56797194391a4c98a02c10f6f58"
I20251023 08:00:17.584017 22099 leader_election.cc:290] T 2d3590750a9e499a9d0b125ab1c2d8bc P 49d13a11243a439581313cbf2389dea7 [CANDIDATE]: Term 1 election: Requested vote from peers 9927a56797194391a4c98a02c10f6f58 (127.16.126.1:43563), c51023bde9f346c1af16edaf4c858f98 (127.16.126.3:36947)
I20251023 08:00:17.584421 22070 tablet_bootstrap.cc:654] T b555f281b922436fa19baf6f373d0aac P 9927a56797194391a4c98a02c10f6f58: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:17.584327 21879 raft_consensus.cc:3060] T eda010f13927475e9cb3af93eed06d3e P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:17.588012 22069 tablet_bootstrap.cc:492] T 47b52375a02b4d348c0d45f6aab2dd8c P 49d13a11243a439581313cbf2389dea7: No bootstrap required, opened a new log
I20251023 08:00:17.588603 22069 ts_tablet_manager.cc:1403] T 47b52375a02b4d348c0d45f6aab2dd8c P 49d13a11243a439581313cbf2389dea7: Time spent bootstrapping tablet: real 0.124s user 0.041s sys 0.041s
I20251023 08:00:17.589377 21878 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2d3590750a9e499a9d0b125ab1c2d8bc" candidate_uuid: "49d13a11243a439581313cbf2389dea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9927a56797194391a4c98a02c10f6f58"
I20251023 08:00:17.590060 21878 raft_consensus.cc:3060] T 2d3590750a9e499a9d0b125ab1c2d8bc P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:17.590564 22071 tablet_bootstrap.cc:492] T 2d3590750a9e499a9d0b125ab1c2d8bc P c51023bde9f346c1af16edaf4c858f98: No bootstrap required, opened a new log
I20251023 08:00:17.591131 22071 ts_tablet_manager.cc:1403] T 2d3590750a9e499a9d0b125ab1c2d8bc P c51023bde9f346c1af16edaf4c858f98: Time spent bootstrapping tablet: real 0.029s user 0.010s sys 0.006s
I20251023 08:00:17.583129 21921 leader_election.cc:304] T eda010f13927475e9cb3af93eed06d3e P 49d13a11243a439581313cbf2389dea7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49d13a11243a439581313cbf2389dea7, c51023bde9f346c1af16edaf4c858f98; no voters:
I20251023 08:00:17.594146 22071 raft_consensus.cc:359] T 2d3590750a9e499a9d0b125ab1c2d8bc P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.596141 22069 raft_consensus.cc:359] T 47b52375a02b4d348c0d45f6aab2dd8c P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.596598 22071 raft_consensus.cc:385] T 2d3590750a9e499a9d0b125ab1c2d8bc P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:17.596851 22069 raft_consensus.cc:385] T 47b52375a02b4d348c0d45f6aab2dd8c P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:17.596935 22071 raft_consensus.cc:740] T 2d3590750a9e499a9d0b125ab1c2d8bc P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51023bde9f346c1af16edaf4c858f98, State: Initialized, Role: FOLLOWER
I20251023 08:00:17.597245 22069 raft_consensus.cc:740] T 47b52375a02b4d348c0d45f6aab2dd8c P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49d13a11243a439581313cbf2389dea7, State: Initialized, Role: FOLLOWER
I20251023 08:00:17.597016 22099 raft_consensus.cc:2804] T eda010f13927475e9cb3af93eed06d3e P 49d13a11243a439581313cbf2389dea7 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 08:00:17.597676 22070 tablet_bootstrap.cc:492] T b555f281b922436fa19baf6f373d0aac P 9927a56797194391a4c98a02c10f6f58: No bootstrap required, opened a new log
I20251023 08:00:17.598759 22088 raft_consensus.cc:493] T 2fa24c01f1114e93976301027c9d0a76 P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 08:00:17.597931 22071 consensus_queue.cc:260] T 2d3590750a9e499a9d0b125ab1c2d8bc P c51023bde9f346c1af16edaf4c858f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.600576 22070 ts_tablet_manager.cc:1403] T b555f281b922436fa19baf6f373d0aac P 9927a56797194391a4c98a02c10f6f58: Time spent bootstrapping tablet: real 0.028s user 0.010s sys 0.011s
I20251023 08:00:17.600507 22088 raft_consensus.cc:515] T 2fa24c01f1114e93976301027c9d0a76 P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.601264 22099 raft_consensus.cc:697] T eda010f13927475e9cb3af93eed06d3e P 49d13a11243a439581313cbf2389dea7 [term 1 LEADER]: Becoming Leader. State: Replica: 49d13a11243a439581313cbf2389dea7, State: Running, Role: LEADER
I20251023 08:00:17.599695 22028 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2d3590750a9e499a9d0b125ab1c2d8bc" candidate_uuid: "49d13a11243a439581313cbf2389dea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51023bde9f346c1af16edaf4c858f98"
I20251023 08:00:17.602422 22028 raft_consensus.cc:3060] T 2d3590750a9e499a9d0b125ab1c2d8bc P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:17.603559 21880 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2fa24c01f1114e93976301027c9d0a76" candidate_uuid: "c51023bde9f346c1af16edaf4c858f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9927a56797194391a4c98a02c10f6f58" is_pre_election: true
I20251023 08:00:17.603706 22070 raft_consensus.cc:359] T b555f281b922436fa19baf6f373d0aac P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.595902 21879 raft_consensus.cc:2468] T eda010f13927475e9cb3af93eed06d3e P 9927a56797194391a4c98a02c10f6f58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49d13a11243a439581313cbf2389dea7 in term 1.
I20251023 08:00:17.604455 22070 raft_consensus.cc:385] T b555f281b922436fa19baf6f373d0aac P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:17.604753 22070 raft_consensus.cc:740] T b555f281b922436fa19baf6f373d0aac P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9927a56797194391a4c98a02c10f6f58, State: Initialized, Role: FOLLOWER
W20251023 08:00:17.604945 21994 leader_election.cc:343] T 2fa24c01f1114e93976301027c9d0a76 P c51023bde9f346c1af16edaf4c858f98 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9927a56797194391a4c98a02c10f6f58 (127.16.126.1:43563): Illegal state: must be running to vote when last-logged opid is not known
I20251023 08:00:17.605533 22070 consensus_queue.cc:260] T b555f281b922436fa19baf6f373d0aac P 9927a56797194391a4c98a02c10f6f58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.607971 22070 ts_tablet_manager.cc:1434] T b555f281b922436fa19baf6f373d0aac P 9927a56797194391a4c98a02c10f6f58: Time spent starting tablet: real 0.007s user 0.002s sys 0.003s
I20251023 08:00:17.609063 22070 tablet_bootstrap.cc:492] T 2fa24c01f1114e93976301027c9d0a76 P 9927a56797194391a4c98a02c10f6f58: Bootstrap starting.
I20251023 08:00:17.609561 22071 ts_tablet_manager.cc:1434] T 2d3590750a9e499a9d0b125ab1c2d8bc P c51023bde9f346c1af16edaf4c858f98: Time spent starting tablet: real 0.018s user 0.009s sys 0.003s
I20251023 08:00:17.608731 22099 consensus_queue.cc:237] T eda010f13927475e9cb3af93eed06d3e P 49d13a11243a439581313cbf2389dea7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.611263 22071 tablet_bootstrap.cc:492] T 47b52375a02b4d348c0d45f6aab2dd8c P c51023bde9f346c1af16edaf4c858f98: Bootstrap starting.
I20251023 08:00:17.616091 22070 tablet_bootstrap.cc:654] T 2fa24c01f1114e93976301027c9d0a76 P 9927a56797194391a4c98a02c10f6f58: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:17.618255 22071 tablet_bootstrap.cc:654] T 47b52375a02b4d348c0d45f6aab2dd8c P c51023bde9f346c1af16edaf4c858f98: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:17.618938 22028 raft_consensus.cc:2468] T 2d3590750a9e499a9d0b125ab1c2d8bc P c51023bde9f346c1af16edaf4c858f98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49d13a11243a439581313cbf2389dea7 in term 1.
I20251023 08:00:17.620471 22088 leader_election.cc:290] T 2fa24c01f1114e93976301027c9d0a76 P c51023bde9f346c1af16edaf4c858f98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9927a56797194391a4c98a02c10f6f58 (127.16.126.1:43563), 49d13a11243a439581313cbf2389dea7 (127.16.126.2:36187)
I20251023 08:00:17.624529 21921 leader_election.cc:304] T 2d3590750a9e499a9d0b125ab1c2d8bc P 49d13a11243a439581313cbf2389dea7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49d13a11243a439581313cbf2389dea7, c51023bde9f346c1af16edaf4c858f98; no voters:
I20251023 08:00:17.626050 22075 raft_consensus.cc:2804] T 2d3590750a9e499a9d0b125ab1c2d8bc P 49d13a11243a439581313cbf2389dea7 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 08:00:17.630406 22069 consensus_queue.cc:260] T 47b52375a02b4d348c0d45f6aab2dd8c P 49d13a11243a439581313cbf2389dea7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.632244 22077 raft_consensus.cc:493] T e446af5509c84a799ff7fa3d89cdbc8f P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 08:00:17.632799 22077 raft_consensus.cc:515] T e446af5509c84a799ff7fa3d89cdbc8f P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.633970 22071 tablet_bootstrap.cc:492] T 47b52375a02b4d348c0d45f6aab2dd8c P c51023bde9f346c1af16edaf4c858f98: No bootstrap required, opened a new log
I20251023 08:00:17.634537 22071 ts_tablet_manager.cc:1403] T 47b52375a02b4d348c0d45f6aab2dd8c P c51023bde9f346c1af16edaf4c858f98: Time spent bootstrapping tablet: real 0.023s user 0.006s sys 0.011s
I20251023 08:00:17.636662 22077 leader_election.cc:290] T e446af5509c84a799ff7fa3d89cdbc8f P 9927a56797194391a4c98a02c10f6f58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 49d13a11243a439581313cbf2389dea7 (127.16.126.2:36187), c51023bde9f346c1af16edaf4c858f98 (127.16.126.3:36947)
I20251023 08:00:17.637651 22071 raft_consensus.cc:359] T 47b52375a02b4d348c0d45f6aab2dd8c P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.638414 22071 raft_consensus.cc:385] T 47b52375a02b4d348c0d45f6aab2dd8c P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:17.638706 22071 raft_consensus.cc:740] T 47b52375a02b4d348c0d45f6aab2dd8c P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51023bde9f346c1af16edaf4c858f98, State: Initialized, Role: FOLLOWER
I20251023 08:00:17.639513 22071 consensus_queue.cc:260] T 47b52375a02b4d348c0d45f6aab2dd8c P c51023bde9f346c1af16edaf4c858f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.642309 22071 ts_tablet_manager.cc:1434] T 47b52375a02b4d348c0d45f6aab2dd8c P c51023bde9f346c1af16edaf4c858f98: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20251023 08:00:17.643392 22071 tablet_bootstrap.cc:492] T a773cc2cdf5045c09ec36f401421de47 P c51023bde9f346c1af16edaf4c858f98: Bootstrap starting.
I20251023 08:00:17.643990 22088 raft_consensus.cc:493] T e446af5509c84a799ff7fa3d89cdbc8f P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 08:00:17.644804 22088 raft_consensus.cc:515] T e446af5509c84a799ff7fa3d89cdbc8f P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.648648 22088 leader_election.cc:290] T e446af5509c84a799ff7fa3d89cdbc8f P c51023bde9f346c1af16edaf4c858f98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9927a56797194391a4c98a02c10f6f58 (127.16.126.1:43563), 49d13a11243a439581313cbf2389dea7 (127.16.126.2:36187)
I20251023 08:00:17.650010 22071 tablet_bootstrap.cc:654] T a773cc2cdf5045c09ec36f401421de47 P c51023bde9f346c1af16edaf4c858f98: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:17.662031 22071 tablet_bootstrap.cc:492] T a773cc2cdf5045c09ec36f401421de47 P c51023bde9f346c1af16edaf4c858f98: No bootstrap required, opened a new log
I20251023 08:00:17.662650 22071 ts_tablet_manager.cc:1403] T a773cc2cdf5045c09ec36f401421de47 P c51023bde9f346c1af16edaf4c858f98: Time spent bootstrapping tablet: real 0.019s user 0.006s sys 0.011s
I20251023 08:00:17.665522 22071 raft_consensus.cc:359] T a773cc2cdf5045c09ec36f401421de47 P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.666371 22071 raft_consensus.cc:385] T a773cc2cdf5045c09ec36f401421de47 P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:17.666626 22071 raft_consensus.cc:740] T a773cc2cdf5045c09ec36f401421de47 P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51023bde9f346c1af16edaf4c858f98, State: Initialized, Role: FOLLOWER
I20251023 08:00:17.667447 22071 consensus_queue.cc:260] T a773cc2cdf5045c09ec36f401421de47 P c51023bde9f346c1af16edaf4c858f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.668015 21955 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2fa24c01f1114e93976301027c9d0a76" candidate_uuid: "c51023bde9f346c1af16edaf4c858f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49d13a11243a439581313cbf2389dea7" is_pre_election: true
I20251023 08:00:17.669806 21878 raft_consensus.cc:2468] T 2d3590750a9e499a9d0b125ab1c2d8bc P 9927a56797194391a4c98a02c10f6f58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49d13a11243a439581313cbf2389dea7 in term 1.
I20251023 08:00:17.671838 22071 ts_tablet_manager.cc:1434] T a773cc2cdf5045c09ec36f401421de47 P c51023bde9f346c1af16edaf4c858f98: Time spent starting tablet: real 0.009s user 0.007s sys 0.000s
I20251023 08:00:17.672840 22071 tablet_bootstrap.cc:492] T e84b3c7d7db24d86800d4a76767db682 P c51023bde9f346c1af16edaf4c858f98: Bootstrap starting.
I20251023 08:00:17.678347 22071 tablet_bootstrap.cc:654] T e84b3c7d7db24d86800d4a76767db682 P c51023bde9f346c1af16edaf4c858f98: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:17.685810 22069 ts_tablet_manager.cc:1434] T 47b52375a02b4d348c0d45f6aab2dd8c P 49d13a11243a439581313cbf2389dea7: Time spent starting tablet: real 0.092s user 0.006s sys 0.003s
I20251023 08:00:17.687311 22069 tablet_bootstrap.cc:492] T 2fa24c01f1114e93976301027c9d0a76 P 49d13a11243a439581313cbf2389dea7: Bootstrap starting.
I20251023 08:00:17.691423 21954 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e446af5509c84a799ff7fa3d89cdbc8f" candidate_uuid: "c51023bde9f346c1af16edaf4c858f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49d13a11243a439581313cbf2389dea7" is_pre_election: true
W20251023 08:00:17.693250 21992 leader_election.cc:343] T 2fa24c01f1114e93976301027c9d0a76 P c51023bde9f346c1af16edaf4c858f98 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 49d13a11243a439581313cbf2389dea7 (127.16.126.2:36187): Illegal state: must be running to vote when last-logged opid is not known
I20251023 08:00:17.693899 21992 leader_election.cc:304] T 2fa24c01f1114e93976301027c9d0a76 P c51023bde9f346c1af16edaf4c858f98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c51023bde9f346c1af16edaf4c858f98; no voters: 49d13a11243a439581313cbf2389dea7, 9927a56797194391a4c98a02c10f6f58
I20251023 08:00:17.694919 22088 raft_consensus.cc:2749] T 2fa24c01f1114e93976301027c9d0a76 P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251023 08:00:17.697108 21992 leader_election.cc:343] T e446af5509c84a799ff7fa3d89cdbc8f P c51023bde9f346c1af16edaf4c858f98 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 49d13a11243a439581313cbf2389dea7 (127.16.126.2:36187): Illegal state: must be running to vote when last-logged opid is not known
I20251023 08:00:17.699414 22071 tablet_bootstrap.cc:492] T e84b3c7d7db24d86800d4a76767db682 P c51023bde9f346c1af16edaf4c858f98: No bootstrap required, opened a new log
I20251023 08:00:17.700098 22071 ts_tablet_manager.cc:1403] T e84b3c7d7db24d86800d4a76767db682 P c51023bde9f346c1af16edaf4c858f98: Time spent bootstrapping tablet: real 0.027s user 0.017s sys 0.009s
I20251023 08:00:17.702776 22071 raft_consensus.cc:359] T e84b3c7d7db24d86800d4a76767db682 P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.703429 22071 raft_consensus.cc:385] T e84b3c7d7db24d86800d4a76767db682 P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:17.703692 22071 raft_consensus.cc:740] T e84b3c7d7db24d86800d4a76767db682 P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51023bde9f346c1af16edaf4c858f98, State: Initialized, Role: FOLLOWER
I20251023 08:00:17.704428 22071 consensus_queue.cc:260] T e84b3c7d7db24d86800d4a76767db682 P c51023bde9f346c1af16edaf4c858f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.705868 22077 raft_consensus.cc:493] T 47b52375a02b4d348c0d45f6aab2dd8c P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 08:00:17.706398 22077 raft_consensus.cc:515] T 47b52375a02b4d348c0d45f6aab2dd8c P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.706820 22071 ts_tablet_manager.cc:1434] T e84b3c7d7db24d86800d4a76767db682 P c51023bde9f346c1af16edaf4c858f98: Time spent starting tablet: real 0.006s user 0.005s sys 0.001s
I20251023 08:00:17.708338 22077 leader_election.cc:290] T 47b52375a02b4d348c0d45f6aab2dd8c P 9927a56797194391a4c98a02c10f6f58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 49d13a11243a439581313cbf2389dea7 (127.16.126.2:36187), c51023bde9f346c1af16edaf4c858f98 (127.16.126.3:36947)
I20251023 08:00:17.710279 22110 raft_consensus.cc:493] T b555f281b922436fa19baf6f373d0aac P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 08:00:17.710949 22110 raft_consensus.cc:515] T b555f281b922436fa19baf6f373d0aac P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.715754 22028 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b555f281b922436fa19baf6f373d0aac" candidate_uuid: "49d13a11243a439581313cbf2389dea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51023bde9f346c1af16edaf4c858f98" is_pre_election: true
I20251023 08:00:17.716920 22028 raft_consensus.cc:2468] T b555f281b922436fa19baf6f373d0aac P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49d13a11243a439581313cbf2389dea7 in term 0.
I20251023 08:00:17.718344 22075 raft_consensus.cc:697] T 2d3590750a9e499a9d0b125ab1c2d8bc P 49d13a11243a439581313cbf2389dea7 [term 1 LEADER]: Becoming Leader. State: Replica: 49d13a11243a439581313cbf2389dea7, State: Running, Role: LEADER
I20251023 08:00:17.719689 21921 leader_election.cc:304] T b555f281b922436fa19baf6f373d0aac P 49d13a11243a439581313cbf2389dea7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49d13a11243a439581313cbf2389dea7, c51023bde9f346c1af16edaf4c858f98; no voters:
I20251023 08:00:17.718627 22110 leader_election.cc:290] T b555f281b922436fa19baf6f373d0aac P 49d13a11243a439581313cbf2389dea7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9927a56797194391a4c98a02c10f6f58 (127.16.126.1:43563), c51023bde9f346c1af16edaf4c858f98 (127.16.126.3:36947)
I20251023 08:00:17.721710 22110 raft_consensus.cc:2804] T b555f281b922436fa19baf6f373d0aac P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 08:00:17.721987 22110 raft_consensus.cc:493] T b555f281b922436fa19baf6f373d0aac P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 08:00:17.722257 22110 raft_consensus.cc:3060] T b555f281b922436fa19baf6f373d0aac P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:17.724054 22075 consensus_queue.cc:237] T 2d3590750a9e499a9d0b125ab1c2d8bc P 49d13a11243a439581313cbf2389dea7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.727303 21879 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b555f281b922436fa19baf6f373d0aac" candidate_uuid: "49d13a11243a439581313cbf2389dea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9927a56797194391a4c98a02c10f6f58" is_pre_election: true
I20251023 08:00:17.727558 22069 tablet_bootstrap.cc:654] T 2fa24c01f1114e93976301027c9d0a76 P 49d13a11243a439581313cbf2389dea7: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:17.728829 21879 raft_consensus.cc:2468] T b555f281b922436fa19baf6f373d0aac P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49d13a11243a439581313cbf2389dea7 in term 0.
I20251023 08:00:17.729959 21778 catalog_manager.cc:5649] T eda010f13927475e9cb3af93eed06d3e P 49d13a11243a439581313cbf2389dea7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 49d13a11243a439581313cbf2389dea7 (127.16.126.2). New cstate: current_term: 1 leader_uuid: "49d13a11243a439581313cbf2389dea7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } health_report { overall_health: UNKNOWN } } }
I20251023 08:00:17.730950 22028 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e446af5509c84a799ff7fa3d89cdbc8f" candidate_uuid: "9927a56797194391a4c98a02c10f6f58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51023bde9f346c1af16edaf4c858f98" is_pre_election: true
I20251023 08:00:17.731491 22027 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "47b52375a02b4d348c0d45f6aab2dd8c" candidate_uuid: "9927a56797194391a4c98a02c10f6f58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51023bde9f346c1af16edaf4c858f98" is_pre_election: true
I20251023 08:00:17.731617 22028 raft_consensus.cc:2468] T e446af5509c84a799ff7fa3d89cdbc8f P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9927a56797194391a4c98a02c10f6f58 in term 0.
I20251023 08:00:17.732133 22027 raft_consensus.cc:2468] T 47b52375a02b4d348c0d45f6aab2dd8c P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9927a56797194391a4c98a02c10f6f58 in term 0.
I20251023 08:00:17.729905 21878 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e446af5509c84a799ff7fa3d89cdbc8f" candidate_uuid: "c51023bde9f346c1af16edaf4c858f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9927a56797194391a4c98a02c10f6f58" is_pre_election: true
I20251023 08:00:17.733528 21846 leader_election.cc:304] T e446af5509c84a799ff7fa3d89cdbc8f P 9927a56797194391a4c98a02c10f6f58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9927a56797194391a4c98a02c10f6f58, c51023bde9f346c1af16edaf4c858f98; no voters:
I20251023 08:00:17.735689 22077 raft_consensus.cc:2804] T e446af5509c84a799ff7fa3d89cdbc8f P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 08:00:17.735777 21846 leader_election.cc:304] T 47b52375a02b4d348c0d45f6aab2dd8c P 9927a56797194391a4c98a02c10f6f58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9927a56797194391a4c98a02c10f6f58, c51023bde9f346c1af16edaf4c858f98; no voters:
I20251023 08:00:17.736238 22077 raft_consensus.cc:493] T e446af5509c84a799ff7fa3d89cdbc8f P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 08:00:17.736824 22077 raft_consensus.cc:3060] T e446af5509c84a799ff7fa3d89cdbc8f P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:17.738458 22070 tablet_bootstrap.cc:492] T 2fa24c01f1114e93976301027c9d0a76 P 9927a56797194391a4c98a02c10f6f58: No bootstrap required, opened a new log
I20251023 08:00:17.738994 22070 ts_tablet_manager.cc:1403] T 2fa24c01f1114e93976301027c9d0a76 P 9927a56797194391a4c98a02c10f6f58: Time spent bootstrapping tablet: real 0.130s user 0.032s sys 0.073s
I20251023 08:00:17.741727 22070 raft_consensus.cc:359] T 2fa24c01f1114e93976301027c9d0a76 P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.742493 22070 raft_consensus.cc:385] T 2fa24c01f1114e93976301027c9d0a76 P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:17.742842 22070 raft_consensus.cc:740] T 2fa24c01f1114e93976301027c9d0a76 P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9927a56797194391a4c98a02c10f6f58, State: Initialized, Role: FOLLOWER
I20251023 08:00:17.743616 22070 consensus_queue.cc:260] T 2fa24c01f1114e93976301027c9d0a76 P 9927a56797194391a4c98a02c10f6f58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.750692 22077 raft_consensus.cc:515] T e446af5509c84a799ff7fa3d89cdbc8f P 9927a56797194391a4c98a02c10f6f58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.760495 21878 raft_consensus.cc:2393] T e446af5509c84a799ff7fa3d89cdbc8f P 9927a56797194391a4c98a02c10f6f58 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c51023bde9f346c1af16edaf4c858f98 in current term 1: Already voted for candidate 9927a56797194391a4c98a02c10f6f58 in this term.
I20251023 08:00:17.766403 21994 leader_election.cc:304] T e446af5509c84a799ff7fa3d89cdbc8f P c51023bde9f346c1af16edaf4c858f98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c51023bde9f346c1af16edaf4c858f98; no voters: 49d13a11243a439581313cbf2389dea7, 9927a56797194391a4c98a02c10f6f58
I20251023 08:00:17.767489 22070 ts_tablet_manager.cc:1434] T 2fa24c01f1114e93976301027c9d0a76 P 9927a56797194391a4c98a02c10f6f58: Time spent starting tablet: real 0.028s user 0.020s sys 0.006s
I20251023 08:00:17.768214 22088 raft_consensus.cc:3060] T e446af5509c84a799ff7fa3d89cdbc8f P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:17.779121 22070 tablet_bootstrap.cc:492] T e84b3c7d7db24d86800d4a76767db682 P 9927a56797194391a4c98a02c10f6f58: Bootstrap starting.
W20251023 08:00:17.782729 21846 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.126.3:36947, user_credentials={real_user=slave}} blocked reactor thread for 46580.5us
I20251023 08:00:17.787401 22112 raft_consensus.cc:2804] T 47b52375a02b4d348c0d45f6aab2dd8c P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 08:00:17.787884 22112 raft_consensus.cc:493] T 47b52375a02b4d348c0d45f6aab2dd8c P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 08:00:17.788219 22112 raft_consensus.cc:3060] T 47b52375a02b4d348c0d45f6aab2dd8c P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:17.788116 21955 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "47b52375a02b4d348c0d45f6aab2dd8c" candidate_uuid: "9927a56797194391a4c98a02c10f6f58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49d13a11243a439581313cbf2389dea7" is_pre_election: true
I20251023 08:00:17.788863 21955 raft_consensus.cc:2468] T 47b52375a02b4d348c0d45f6aab2dd8c P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9927a56797194391a4c98a02c10f6f58 in term 0.
I20251023 08:00:17.789971 21953 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e446af5509c84a799ff7fa3d89cdbc8f" candidate_uuid: "9927a56797194391a4c98a02c10f6f58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49d13a11243a439581313cbf2389dea7"
I20251023 08:00:17.790922 21954 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e446af5509c84a799ff7fa3d89cdbc8f" candidate_uuid: "9927a56797194391a4c98a02c10f6f58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49d13a11243a439581313cbf2389dea7" is_pre_election: true
W20251023 08:00:17.795058 21843 leader_election.cc:343] T e446af5509c84a799ff7fa3d89cdbc8f P 9927a56797194391a4c98a02c10f6f58 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 49d13a11243a439581313cbf2389dea7 (127.16.126.2:36187): Illegal state: must be running to vote when last-logged opid is not known
W20251023 08:00:17.795710 21843 leader_election.cc:343] T e446af5509c84a799ff7fa3d89cdbc8f P 9927a56797194391a4c98a02c10f6f58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 49d13a11243a439581313cbf2389dea7 (127.16.126.2:36187): Illegal state: must be running to vote when last-logged opid is not known
I20251023 08:00:17.786073 22069 tablet_bootstrap.cc:492] T 2fa24c01f1114e93976301027c9d0a76 P 49d13a11243a439581313cbf2389dea7: No bootstrap required, opened a new log
I20251023 08:00:17.796890 22069 ts_tablet_manager.cc:1403] T 2fa24c01f1114e93976301027c9d0a76 P 49d13a11243a439581313cbf2389dea7: Time spent bootstrapping tablet: real 0.110s user 0.013s sys 0.011s
I20251023 08:00:17.796758 22110 raft_consensus.cc:515] T b555f281b922436fa19baf6f373d0aac P 49d13a11243a439581313cbf2389dea7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.800005 22069 raft_consensus.cc:359] T 2fa24c01f1114e93976301027c9d0a76 P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.800765 22069 raft_consensus.cc:385] T 2fa24c01f1114e93976301027c9d0a76 P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:17.800843 22070 tablet_bootstrap.cc:654] T e84b3c7d7db24d86800d4a76767db682 P 9927a56797194391a4c98a02c10f6f58: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:17.801088 22069 raft_consensus.cc:740] T 2fa24c01f1114e93976301027c9d0a76 P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49d13a11243a439581313cbf2389dea7, State: Initialized, Role: FOLLOWER
I20251023 08:00:17.801896 22069 consensus_queue.cc:260] T 2fa24c01f1114e93976301027c9d0a76 P 49d13a11243a439581313cbf2389dea7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.791384 22088 raft_consensus.cc:2749] T e446af5509c84a799ff7fa3d89cdbc8f P c51023bde9f346c1af16edaf4c858f98 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 08:00:17.804421 22077 leader_election.cc:290] T e446af5509c84a799ff7fa3d89cdbc8f P 9927a56797194391a4c98a02c10f6f58 [CANDIDATE]: Term 1 election: Requested vote from peers 49d13a11243a439581313cbf2389dea7 (127.16.126.2:36187), c51023bde9f346c1af16edaf4c858f98 (127.16.126.3:36947)
I20251023 08:00:17.806143 22027 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e446af5509c84a799ff7fa3d89cdbc8f" candidate_uuid: "9927a56797194391a4c98a02c10f6f58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51023bde9f346c1af16edaf4c858f98"
I20251023 08:00:17.807260 21878 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b555f281b922436fa19baf6f373d0aac" candidate_uuid: "49d13a11243a439581313cbf2389dea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9927a56797194391a4c98a02c10f6f58"
I20251023 08:00:17.807971 21878 raft_consensus.cc:3060] T b555f281b922436fa19baf6f373d0aac P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:17.809705 22110 leader_election.cc:290] T b555f281b922436fa19baf6f373d0aac P 49d13a11243a439581313cbf2389dea7 [CANDIDATE]: Term 1 election: Requested vote from peers 9927a56797194391a4c98a02c10f6f58 (127.16.126.1:43563), c51023bde9f346c1af16edaf4c858f98 (127.16.126.3:36947)
I20251023 08:00:17.809988 22028 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b555f281b922436fa19baf6f373d0aac" candidate_uuid: "49d13a11243a439581313cbf2389dea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51023bde9f346c1af16edaf4c858f98"
I20251023 08:00:17.810685 22028 raft_consensus.cc:3060] T b555f281b922436fa19baf6f373d0aac P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:17.814849 22027 raft_consensus.cc:2468] T e446af5509c84a799ff7fa3d89cdbc8f P c51023bde9f346c1af16edaf4c858f98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9927a56797194391a4c98a02c10f6f58 in term 1.
I20251023 08:00:17.816413 21846 leader_election.cc:304] T e446af5509c84a799ff7fa3d89cdbc8f P 9927a56797194391a4c98a02c10f6f58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9927a56797194391a4c98a02c10f6f58, c51023bde9f346c1af16edaf4c858f98; no voters: 49d13a11243a439581313cbf2389dea7
I20251023 08:00:17.816123 22069 ts_tablet_manager.cc:1434] T 2fa24c01f1114e93976301027c9d0a76 P 49d13a11243a439581313cbf2389dea7: Time spent starting tablet: real 0.019s user 0.008s sys 0.000s
I20251023 08:00:17.817937 22077 raft_consensus.cc:2804] T e446af5509c84a799ff7fa3d89cdbc8f P 9927a56797194391a4c98a02c10f6f58 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 08:00:17.818749 22077 raft_consensus.cc:697] T e446af5509c84a799ff7fa3d89cdbc8f P 9927a56797194391a4c98a02c10f6f58 [term 1 LEADER]: Becoming Leader. State: Replica: 9927a56797194391a4c98a02c10f6f58, State: Running, Role: LEADER
I20251023 08:00:17.819531 22069 tablet_bootstrap.cc:492] T a773cc2cdf5045c09ec36f401421de47 P 49d13a11243a439581313cbf2389dea7: Bootstrap starting.
I20251023 08:00:17.819615 22077 consensus_queue.cc:237] T e446af5509c84a799ff7fa3d89cdbc8f P 9927a56797194391a4c98a02c10f6f58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.821355 22028 raft_consensus.cc:2468] T b555f281b922436fa19baf6f373d0aac P c51023bde9f346c1af16edaf4c858f98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49d13a11243a439581313cbf2389dea7 in term 1.
I20251023 08:00:17.815863 22112 raft_consensus.cc:515] T 47b52375a02b4d348c0d45f6aab2dd8c P 9927a56797194391a4c98a02c10f6f58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.823940 21921 leader_election.cc:304] T b555f281b922436fa19baf6f373d0aac P 49d13a11243a439581313cbf2389dea7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49d13a11243a439581313cbf2389dea7, c51023bde9f346c1af16edaf4c858f98; no voters:
I20251023 08:00:17.825276 22113 raft_consensus.cc:493] T 7456ec78bb664a40a6dde0929ea12d8f P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 08:00:17.825946 22112 leader_election.cc:290] T 47b52375a02b4d348c0d45f6aab2dd8c P 9927a56797194391a4c98a02c10f6f58 [CANDIDATE]: Term 1 election: Requested vote from peers 49d13a11243a439581313cbf2389dea7 (127.16.126.2:36187), c51023bde9f346c1af16edaf4c858f98 (127.16.126.3:36947)
I20251023 08:00:17.825837 21954 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "47b52375a02b4d348c0d45f6aab2dd8c" candidate_uuid: "9927a56797194391a4c98a02c10f6f58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49d13a11243a439581313cbf2389dea7"
I20251023 08:00:17.825850 22113 raft_consensus.cc:515] T 7456ec78bb664a40a6dde0929ea12d8f P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } } peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } }
I20251023 08:00:17.821130 21778 catalog_manager.cc:5649] T 2d3590750a9e499a9d0b125ab1c2d8bc P 49d13a11243a439581313cbf2389dea7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 49d13a11243a439581313cbf2389dea7 (127.16.126.2). New cstate: current_term: 1 leader_uuid: "49d13a11243a439581313cbf2389dea7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } health_report { overall_health: UNKNOWN } } }
I20251023 08:00:17.829012 22113 leader_election.cc:290] T 7456ec78bb664a40a6dde0929ea12d8f P 9927a56797194391a4c98a02c10f6f58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 49d13a11243a439581313cbf2389dea7 (127.16.126.2:36187), c51023bde9f346c1af16edaf4c858f98 (127.16.126.3:36947)
I20251023 08:00:17.829227 22070 tablet_bootstrap.cc:492] T e84b3c7d7db24d86800d4a76767db682 P 9927a56797194391a4c98a02c10f6f58: No bootstrap required, opened a new log
I20251023 08:00:17.826783 21954 raft_consensus.cc:3060] T 47b52375a02b4d348c0d45f6aab2dd8c P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:17.829788 22070 ts_tablet_manager.cc:1403] T e84b3c7d7db24d86800d4a76767db682 P 9927a56797194391a4c98a02c10f6f58: Time spent bootstrapping tablet: real 0.051s user 0.012s sys 0.001s
I20251023 08:00:17.830483 22069 tablet_bootstrap.cc:654] T a773cc2cdf5045c09ec36f401421de47 P 49d13a11243a439581313cbf2389dea7: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:17.830719 22027 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7456ec78bb664a40a6dde0929ea12d8f" candidate_uuid: "9927a56797194391a4c98a02c10f6f58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51023bde9f346c1af16edaf4c858f98" is_pre_election: true
I20251023 08:00:17.832530 22070 raft_consensus.cc:359] T e84b3c7d7db24d86800d4a76767db682 P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.833266 22070 raft_consensus.cc:385] T e84b3c7d7db24d86800d4a76767db682 P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:17.834944 22070 raft_consensus.cc:740] T e84b3c7d7db24d86800d4a76767db682 P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9927a56797194391a4c98a02c10f6f58, State: Initialized, Role: FOLLOWER
I20251023 08:00:17.832749 22028 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "47b52375a02b4d348c0d45f6aab2dd8c" candidate_uuid: "9927a56797194391a4c98a02c10f6f58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51023bde9f346c1af16edaf4c858f98"
I20251023 08:00:17.836689 22028 raft_consensus.cc:3060] T 47b52375a02b4d348c0d45f6aab2dd8c P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:17.839300 21777 catalog_manager.cc:5649] T e446af5509c84a799ff7fa3d89cdbc8f P 9927a56797194391a4c98a02c10f6f58 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9927a56797194391a4c98a02c10f6f58 (127.16.126.1). New cstate: current_term: 1 leader_uuid: "9927a56797194391a4c98a02c10f6f58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } health_report { overall_health: UNKNOWN } } }
I20251023 08:00:17.840458 21954 raft_consensus.cc:2468] T 47b52375a02b4d348c0d45f6aab2dd8c P 49d13a11243a439581313cbf2389dea7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9927a56797194391a4c98a02c10f6f58 in term 1.
I20251023 08:00:17.833415 22075 raft_consensus.cc:2804] T b555f281b922436fa19baf6f373d0aac P 49d13a11243a439581313cbf2389dea7 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 08:00:17.841922 21843 leader_election.cc:304] T 47b52375a02b4d348c0d45f6aab2dd8c P 9927a56797194391a4c98a02c10f6f58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49d13a11243a439581313cbf2389dea7, 9927a56797194391a4c98a02c10f6f58; no voters:
I20251023 08:00:17.834635 21953 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7456ec78bb664a40a6dde0929ea12d8f" candidate_uuid: "9927a56797194391a4c98a02c10f6f58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49d13a11243a439581313cbf2389dea7" is_pre_election: true
I20251023 08:00:17.843839 21953 raft_consensus.cc:2393] T 7456ec78bb664a40a6dde0929ea12d8f P 49d13a11243a439581313cbf2389dea7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9927a56797194391a4c98a02c10f6f58 in current term 1: Already voted for candidate c51023bde9f346c1af16edaf4c858f98 in this term.
I20251023 08:00:17.844485 22028 raft_consensus.cc:2468] T 47b52375a02b4d348c0d45f6aab2dd8c P c51023bde9f346c1af16edaf4c858f98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9927a56797194391a4c98a02c10f6f58 in term 1.
I20251023 08:00:17.844594 21878 raft_consensus.cc:2468] T b555f281b922436fa19baf6f373d0aac P 9927a56797194391a4c98a02c10f6f58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49d13a11243a439581313cbf2389dea7 in term 1.
I20251023 08:00:17.843683 22075 raft_consensus.cc:697] T b555f281b922436fa19baf6f373d0aac P 49d13a11243a439581313cbf2389dea7 [term 1 LEADER]: Becoming Leader. State: Replica: 49d13a11243a439581313cbf2389dea7, State: Running, Role: LEADER
I20251023 08:00:17.847257 22077 raft_consensus.cc:2804] T 47b52375a02b4d348c0d45f6aab2dd8c P 9927a56797194391a4c98a02c10f6f58 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 08:00:17.848009 22077 raft_consensus.cc:697] T 47b52375a02b4d348c0d45f6aab2dd8c P 9927a56797194391a4c98a02c10f6f58 [term 1 LEADER]: Becoming Leader. State: Replica: 9927a56797194391a4c98a02c10f6f58, State: Running, Role: LEADER
I20251023 08:00:17.847496 22075 consensus_queue.cc:237] T b555f281b922436fa19baf6f373d0aac P 49d13a11243a439581313cbf2389dea7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.848866 22077 consensus_queue.cc:237] T 47b52375a02b4d348c0d45f6aab2dd8c P 9927a56797194391a4c98a02c10f6f58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.851127 21843 leader_election.cc:304] T 7456ec78bb664a40a6dde0929ea12d8f P 9927a56797194391a4c98a02c10f6f58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9927a56797194391a4c98a02c10f6f58; no voters: 49d13a11243a439581313cbf2389dea7, c51023bde9f346c1af16edaf4c858f98
I20251023 08:00:17.852353 22113 raft_consensus.cc:3060] T 7456ec78bb664a40a6dde0929ea12d8f P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:17.857611 22112 raft_consensus.cc:493] T a773cc2cdf5045c09ec36f401421de47 P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 08:00:17.858223 22112 raft_consensus.cc:515] T a773cc2cdf5045c09ec36f401421de47 P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.835741 22070 consensus_queue.cc:260] T e84b3c7d7db24d86800d4a76767db682 P 9927a56797194391a4c98a02c10f6f58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.869681 22070 ts_tablet_manager.cc:1434] T e84b3c7d7db24d86800d4a76767db682 P 9927a56797194391a4c98a02c10f6f58: Time spent starting tablet: real 0.040s user 0.013s sys 0.001s
I20251023 08:00:17.869621 21778 catalog_manager.cc:5649] T b555f281b922436fa19baf6f373d0aac P 49d13a11243a439581313cbf2389dea7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 49d13a11243a439581313cbf2389dea7 (127.16.126.2). New cstate: current_term: 1 leader_uuid: "49d13a11243a439581313cbf2389dea7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } health_report { overall_health: UNKNOWN } } }
I20251023 08:00:17.871626 22112 leader_election.cc:290] T a773cc2cdf5045c09ec36f401421de47 P 9927a56797194391a4c98a02c10f6f58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 49d13a11243a439581313cbf2389dea7 (127.16.126.2:36187), c51023bde9f346c1af16edaf4c858f98 (127.16.126.3:36947)
I20251023 08:00:17.872330 21954 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a773cc2cdf5045c09ec36f401421de47" candidate_uuid: "9927a56797194391a4c98a02c10f6f58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49d13a11243a439581313cbf2389dea7" is_pre_election: true
I20251023 08:00:17.872828 22113 raft_consensus.cc:2749] T 7456ec78bb664a40a6dde0929ea12d8f P 9927a56797194391a4c98a02c10f6f58 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 08:00:17.876204 22028 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a773cc2cdf5045c09ec36f401421de47" candidate_uuid: "9927a56797194391a4c98a02c10f6f58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51023bde9f346c1af16edaf4c858f98" is_pre_election: true
I20251023 08:00:17.876931 22028 raft_consensus.cc:2468] T a773cc2cdf5045c09ec36f401421de47 P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9927a56797194391a4c98a02c10f6f58 in term 0.
I20251023 08:00:17.878361 21846 leader_election.cc:304] T a773cc2cdf5045c09ec36f401421de47 P 9927a56797194391a4c98a02c10f6f58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9927a56797194391a4c98a02c10f6f58, c51023bde9f346c1af16edaf4c858f98; no voters:
I20251023 08:00:17.879269 22077 raft_consensus.cc:2804] T a773cc2cdf5045c09ec36f401421de47 P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 08:00:17.879603 22077 raft_consensus.cc:493] T a773cc2cdf5045c09ec36f401421de47 P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 08:00:17.879880 22069 tablet_bootstrap.cc:492] T a773cc2cdf5045c09ec36f401421de47 P 49d13a11243a439581313cbf2389dea7: No bootstrap required, opened a new log
I20251023 08:00:17.879953 22077 raft_consensus.cc:3060] T a773cc2cdf5045c09ec36f401421de47 P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:17.880316 22069 ts_tablet_manager.cc:1403] T a773cc2cdf5045c09ec36f401421de47 P 49d13a11243a439581313cbf2389dea7: Time spent bootstrapping tablet: real 0.062s user 0.020s sys 0.030s
W20251023 08:00:17.881803 21843 leader_election.cc:343] T a773cc2cdf5045c09ec36f401421de47 P 9927a56797194391a4c98a02c10f6f58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 49d13a11243a439581313cbf2389dea7 (127.16.126.2:36187): Illegal state: must be running to vote when last-logged opid is not known
I20251023 08:00:17.881691 21777 catalog_manager.cc:5649] T 47b52375a02b4d348c0d45f6aab2dd8c P 9927a56797194391a4c98a02c10f6f58 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9927a56797194391a4c98a02c10f6f58 (127.16.126.1). New cstate: current_term: 1 leader_uuid: "9927a56797194391a4c98a02c10f6f58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } health_report { overall_health: UNKNOWN } } }
I20251023 08:00:17.882617 22069 raft_consensus.cc:359] T a773cc2cdf5045c09ec36f401421de47 P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.883420 22069 raft_consensus.cc:385] T a773cc2cdf5045c09ec36f401421de47 P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:17.883680 22069 raft_consensus.cc:740] T a773cc2cdf5045c09ec36f401421de47 P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49d13a11243a439581313cbf2389dea7, State: Initialized, Role: FOLLOWER
I20251023 08:00:17.884380 22069 consensus_queue.cc:260] T a773cc2cdf5045c09ec36f401421de47 P 49d13a11243a439581313cbf2389dea7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.886725 22069 ts_tablet_manager.cc:1434] T a773cc2cdf5045c09ec36f401421de47 P 49d13a11243a439581313cbf2389dea7: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20251023 08:00:17.887712 22069 tablet_bootstrap.cc:492] T e446af5509c84a799ff7fa3d89cdbc8f P 49d13a11243a439581313cbf2389dea7: Bootstrap starting.
I20251023 08:00:17.887840 22077 raft_consensus.cc:515] T a773cc2cdf5045c09ec36f401421de47 P 9927a56797194391a4c98a02c10f6f58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.891043 22028 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a773cc2cdf5045c09ec36f401421de47" candidate_uuid: "9927a56797194391a4c98a02c10f6f58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51023bde9f346c1af16edaf4c858f98"
I20251023 08:00:17.891613 22028 raft_consensus.cc:3060] T a773cc2cdf5045c09ec36f401421de47 P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:17.893534 22069 tablet_bootstrap.cc:654] T e446af5509c84a799ff7fa3d89cdbc8f P 49d13a11243a439581313cbf2389dea7: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:17.894218 22077 leader_election.cc:290] T a773cc2cdf5045c09ec36f401421de47 P 9927a56797194391a4c98a02c10f6f58 [CANDIDATE]: Term 1 election: Requested vote from peers 49d13a11243a439581313cbf2389dea7 (127.16.126.2:36187), c51023bde9f346c1af16edaf4c858f98 (127.16.126.3:36947)
I20251023 08:00:17.895239 21954 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a773cc2cdf5045c09ec36f401421de47" candidate_uuid: "9927a56797194391a4c98a02c10f6f58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49d13a11243a439581313cbf2389dea7"
I20251023 08:00:17.895937 21954 raft_consensus.cc:3060] T a773cc2cdf5045c09ec36f401421de47 P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:17.898244 22077 raft_consensus.cc:493] T e84b3c7d7db24d86800d4a76767db682 P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 08:00:17.898646 22077 raft_consensus.cc:515] T e84b3c7d7db24d86800d4a76767db682 P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.900087 22077 leader_election.cc:290] T e84b3c7d7db24d86800d4a76767db682 P 9927a56797194391a4c98a02c10f6f58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 49d13a11243a439581313cbf2389dea7 (127.16.126.2:36187), c51023bde9f346c1af16edaf4c858f98 (127.16.126.3:36947)
I20251023 08:00:17.900997 21953 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e84b3c7d7db24d86800d4a76767db682" candidate_uuid: "9927a56797194391a4c98a02c10f6f58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49d13a11243a439581313cbf2389dea7" is_pre_election: true
I20251023 08:00:17.901223 22027 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e84b3c7d7db24d86800d4a76767db682" candidate_uuid: "9927a56797194391a4c98a02c10f6f58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51023bde9f346c1af16edaf4c858f98" is_pre_election: true
I20251023 08:00:17.901707 21953 raft_consensus.cc:2468] T e84b3c7d7db24d86800d4a76767db682 P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9927a56797194391a4c98a02c10f6f58 in term 0.
I20251023 08:00:17.900418 22028 raft_consensus.cc:2468] T a773cc2cdf5045c09ec36f401421de47 P c51023bde9f346c1af16edaf4c858f98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9927a56797194391a4c98a02c10f6f58 in term 1.
I20251023 08:00:17.901948 22027 raft_consensus.cc:2468] T e84b3c7d7db24d86800d4a76767db682 P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9927a56797194391a4c98a02c10f6f58 in term 0.
I20251023 08:00:17.903007 21846 leader_election.cc:304] T a773cc2cdf5045c09ec36f401421de47 P 9927a56797194391a4c98a02c10f6f58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9927a56797194391a4c98a02c10f6f58, c51023bde9f346c1af16edaf4c858f98; no voters:
I20251023 08:00:17.901962 22069 tablet_bootstrap.cc:492] T e446af5509c84a799ff7fa3d89cdbc8f P 49d13a11243a439581313cbf2389dea7: No bootstrap required, opened a new log
I20251023 08:00:17.903051 21843 leader_election.cc:304] T e84b3c7d7db24d86800d4a76767db682 P 9927a56797194391a4c98a02c10f6f58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49d13a11243a439581313cbf2389dea7, 9927a56797194391a4c98a02c10f6f58; no voters:
I20251023 08:00:17.903796 22069 ts_tablet_manager.cc:1403] T e446af5509c84a799ff7fa3d89cdbc8f P 49d13a11243a439581313cbf2389dea7: Time spent bootstrapping tablet: real 0.016s user 0.008s sys 0.003s
I20251023 08:00:17.904199 22113 raft_consensus.cc:2804] T a773cc2cdf5045c09ec36f401421de47 P 9927a56797194391a4c98a02c10f6f58 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 08:00:17.904501 22077 raft_consensus.cc:2804] T e84b3c7d7db24d86800d4a76767db682 P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 08:00:17.904757 22113 raft_consensus.cc:697] T a773cc2cdf5045c09ec36f401421de47 P 9927a56797194391a4c98a02c10f6f58 [term 1 LEADER]: Becoming Leader. State: Replica: 9927a56797194391a4c98a02c10f6f58, State: Running, Role: LEADER
I20251023 08:00:17.904958 22077 raft_consensus.cc:493] T e84b3c7d7db24d86800d4a76767db682 P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 08:00:17.905377 22077 raft_consensus.cc:3060] T e84b3c7d7db24d86800d4a76767db682 P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:17.905604 21954 raft_consensus.cc:2468] T a773cc2cdf5045c09ec36f401421de47 P 49d13a11243a439581313cbf2389dea7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9927a56797194391a4c98a02c10f6f58 in term 1.
I20251023 08:00:17.906127 22113 consensus_queue.cc:237] T a773cc2cdf5045c09ec36f401421de47 P 9927a56797194391a4c98a02c10f6f58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.911995 22069 raft_consensus.cc:359] T e446af5509c84a799ff7fa3d89cdbc8f P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.912768 22069 raft_consensus.cc:385] T e446af5509c84a799ff7fa3d89cdbc8f P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:17.912523 22077 raft_consensus.cc:515] T e84b3c7d7db24d86800d4a76767db682 P 9927a56797194391a4c98a02c10f6f58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.913007 22069 raft_consensus.cc:740] T e446af5509c84a799ff7fa3d89cdbc8f P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49d13a11243a439581313cbf2389dea7, State: Initialized, Role: FOLLOWER
I20251023 08:00:17.913756 22069 consensus_queue.cc:260] T e446af5509c84a799ff7fa3d89cdbc8f P 49d13a11243a439581313cbf2389dea7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.915058 22077 leader_election.cc:290] T e84b3c7d7db24d86800d4a76767db682 P 9927a56797194391a4c98a02c10f6f58 [CANDIDATE]: Term 1 election: Requested vote from peers 49d13a11243a439581313cbf2389dea7 (127.16.126.2:36187), c51023bde9f346c1af16edaf4c858f98 (127.16.126.3:36947)
I20251023 08:00:17.914775 21778 catalog_manager.cc:5649] T a773cc2cdf5045c09ec36f401421de47 P 9927a56797194391a4c98a02c10f6f58 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9927a56797194391a4c98a02c10f6f58 (127.16.126.1). New cstate: current_term: 1 leader_uuid: "9927a56797194391a4c98a02c10f6f58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } health_report { overall_health: UNKNOWN } } }
I20251023 08:00:17.915939 22069 ts_tablet_manager.cc:1434] T e446af5509c84a799ff7fa3d89cdbc8f P 49d13a11243a439581313cbf2389dea7: Time spent starting tablet: real 0.012s user 0.003s sys 0.002s
I20251023 08:00:17.916318 22027 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e84b3c7d7db24d86800d4a76767db682" candidate_uuid: "9927a56797194391a4c98a02c10f6f58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51023bde9f346c1af16edaf4c858f98"
I20251023 08:00:17.916450 21954 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e84b3c7d7db24d86800d4a76767db682" candidate_uuid: "9927a56797194391a4c98a02c10f6f58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49d13a11243a439581313cbf2389dea7"
I20251023 08:00:17.916953 22027 raft_consensus.cc:3060] T e84b3c7d7db24d86800d4a76767db682 P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:17.917284 21954 raft_consensus.cc:3060] T e84b3c7d7db24d86800d4a76767db682 P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:17.924916 22027 raft_consensus.cc:2468] T e84b3c7d7db24d86800d4a76767db682 P c51023bde9f346c1af16edaf4c858f98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9927a56797194391a4c98a02c10f6f58 in term 1.
I20251023 08:00:17.926128 21846 leader_election.cc:304] T e84b3c7d7db24d86800d4a76767db682 P 9927a56797194391a4c98a02c10f6f58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9927a56797194391a4c98a02c10f6f58, c51023bde9f346c1af16edaf4c858f98; no voters:
I20251023 08:00:17.926558 21954 raft_consensus.cc:2468] T e84b3c7d7db24d86800d4a76767db682 P 49d13a11243a439581313cbf2389dea7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9927a56797194391a4c98a02c10f6f58 in term 1.
I20251023 08:00:17.926843 22077 raft_consensus.cc:2804] T e84b3c7d7db24d86800d4a76767db682 P 9927a56797194391a4c98a02c10f6f58 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 08:00:17.927440 22077 raft_consensus.cc:697] T e84b3c7d7db24d86800d4a76767db682 P 9927a56797194391a4c98a02c10f6f58 [term 1 LEADER]: Becoming Leader. State: Replica: 9927a56797194391a4c98a02c10f6f58, State: Running, Role: LEADER
I20251023 08:00:17.928176 22077 consensus_queue.cc:237] T e84b3c7d7db24d86800d4a76767db682 P 9927a56797194391a4c98a02c10f6f58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.937147 21777 catalog_manager.cc:5649] T e84b3c7d7db24d86800d4a76767db682 P 9927a56797194391a4c98a02c10f6f58 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9927a56797194391a4c98a02c10f6f58 (127.16.126.1). New cstate: current_term: 1 leader_uuid: "9927a56797194391a4c98a02c10f6f58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } health_report { overall_health: UNKNOWN } } }
I20251023 08:00:17.942267 22088 consensus_queue.cc:1048] T 7456ec78bb664a40a6dde0929ea12d8f P c51023bde9f346c1af16edaf4c858f98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 08:00:17.952908 22088 consensus_queue.cc:1048] T 7456ec78bb664a40a6dde0929ea12d8f P c51023bde9f346c1af16edaf4c858f98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 08:00:17.959235 22077 raft_consensus.cc:493] T 2fa24c01f1114e93976301027c9d0a76 P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 08:00:17.959676 22077 raft_consensus.cc:515] T 2fa24c01f1114e93976301027c9d0a76 P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.961602 22077 leader_election.cc:290] T 2fa24c01f1114e93976301027c9d0a76 P 9927a56797194391a4c98a02c10f6f58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 49d13a11243a439581313cbf2389dea7 (127.16.126.2:36187), c51023bde9f346c1af16edaf4c858f98 (127.16.126.3:36947)
I20251023 08:00:17.962761 22027 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2fa24c01f1114e93976301027c9d0a76" candidate_uuid: "9927a56797194391a4c98a02c10f6f58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51023bde9f346c1af16edaf4c858f98" is_pre_election: true
I20251023 08:00:17.963505 22027 raft_consensus.cc:2468] T 2fa24c01f1114e93976301027c9d0a76 P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9927a56797194391a4c98a02c10f6f58 in term 0.
I20251023 08:00:17.964211 21954 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2fa24c01f1114e93976301027c9d0a76" candidate_uuid: "9927a56797194391a4c98a02c10f6f58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49d13a11243a439581313cbf2389dea7" is_pre_election: true
I20251023 08:00:17.964795 21954 raft_consensus.cc:2468] T 2fa24c01f1114e93976301027c9d0a76 P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9927a56797194391a4c98a02c10f6f58 in term 0.
I20251023 08:00:17.965759 21846 leader_election.cc:304] T 2fa24c01f1114e93976301027c9d0a76 P 9927a56797194391a4c98a02c10f6f58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9927a56797194391a4c98a02c10f6f58, c51023bde9f346c1af16edaf4c858f98; no voters:
I20251023 08:00:17.966480 22077 raft_consensus.cc:2804] T 2fa24c01f1114e93976301027c9d0a76 P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 08:00:17.966842 22077 raft_consensus.cc:493] T 2fa24c01f1114e93976301027c9d0a76 P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 08:00:17.967173 22077 raft_consensus.cc:3060] T 2fa24c01f1114e93976301027c9d0a76 P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:17.974176 22077 raft_consensus.cc:515] T 2fa24c01f1114e93976301027c9d0a76 P 9927a56797194391a4c98a02c10f6f58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.976009 22077 leader_election.cc:290] T 2fa24c01f1114e93976301027c9d0a76 P 9927a56797194391a4c98a02c10f6f58 [CANDIDATE]: Term 1 election: Requested vote from peers 49d13a11243a439581313cbf2389dea7 (127.16.126.2:36187), c51023bde9f346c1af16edaf4c858f98 (127.16.126.3:36947)
I20251023 08:00:17.976733 21954 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2fa24c01f1114e93976301027c9d0a76" candidate_uuid: "9927a56797194391a4c98a02c10f6f58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49d13a11243a439581313cbf2389dea7"
I20251023 08:00:17.976869 22027 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2fa24c01f1114e93976301027c9d0a76" candidate_uuid: "9927a56797194391a4c98a02c10f6f58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51023bde9f346c1af16edaf4c858f98"
I20251023 08:00:17.977277 21954 raft_consensus.cc:3060] T 2fa24c01f1114e93976301027c9d0a76 P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:17.977397 22027 raft_consensus.cc:3060] T 2fa24c01f1114e93976301027c9d0a76 P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:17.982385 21954 raft_consensus.cc:2468] T 2fa24c01f1114e93976301027c9d0a76 P 49d13a11243a439581313cbf2389dea7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9927a56797194391a4c98a02c10f6f58 in term 1.
I20251023 08:00:17.982452 22027 raft_consensus.cc:2468] T 2fa24c01f1114e93976301027c9d0a76 P c51023bde9f346c1af16edaf4c858f98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9927a56797194391a4c98a02c10f6f58 in term 1.
I20251023 08:00:17.983472 21843 leader_election.cc:304] T 2fa24c01f1114e93976301027c9d0a76 P 9927a56797194391a4c98a02c10f6f58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 49d13a11243a439581313cbf2389dea7, 9927a56797194391a4c98a02c10f6f58, c51023bde9f346c1af16edaf4c858f98; no voters:
I20251023 08:00:17.984197 22077 raft_consensus.cc:2804] T 2fa24c01f1114e93976301027c9d0a76 P 9927a56797194391a4c98a02c10f6f58 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 08:00:17.984583 22077 raft_consensus.cc:697] T 2fa24c01f1114e93976301027c9d0a76 P 9927a56797194391a4c98a02c10f6f58 [term 1 LEADER]: Becoming Leader. State: Replica: 9927a56797194391a4c98a02c10f6f58, State: Running, Role: LEADER
I20251023 08:00:17.985388 22077 consensus_queue.cc:237] T 2fa24c01f1114e93976301027c9d0a76 P 9927a56797194391a4c98a02c10f6f58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:17.992556 21778 catalog_manager.cc:5649] T 2fa24c01f1114e93976301027c9d0a76 P 9927a56797194391a4c98a02c10f6f58 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9927a56797194391a4c98a02c10f6f58 (127.16.126.1). New cstate: current_term: 1 leader_uuid: "9927a56797194391a4c98a02c10f6f58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } health_report { overall_health: UNKNOWN } } }
I20251023 08:00:18.005530 22075 consensus_queue.cc:1048] T eda010f13927475e9cb3af93eed06d3e P 49d13a11243a439581313cbf2389dea7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 08:00:18.016548 22110 consensus_queue.cc:1048] T eda010f13927475e9cb3af93eed06d3e P 49d13a11243a439581313cbf2389dea7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 08:00:18.156515 22027 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "7456ec78bb664a40a6dde0929ea12d8f"
dest_uuid: "c51023bde9f346c1af16edaf4c858f98"
mode: GRACEFUL
new_leader_uuid: "9927a56797194391a4c98a02c10f6f58"
from {username='slave'} at 127.0.0.1:40686
I20251023 08:00:18.157087 22027 raft_consensus.cc:606] T 7456ec78bb664a40a6dde0929ea12d8f P c51023bde9f346c1af16edaf4c858f98 [term 1 LEADER]: Received request to transfer leadership to TS 9927a56797194391a4c98a02c10f6f58
I20251023 08:00:18.174458 21954 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "b555f281b922436fa19baf6f373d0aac"
dest_uuid: "49d13a11243a439581313cbf2389dea7"
mode: GRACEFUL
new_leader_uuid: "9927a56797194391a4c98a02c10f6f58"
from {username='slave'} at 127.0.0.1:57012
I20251023 08:00:18.174983 21954 raft_consensus.cc:606] T b555f281b922436fa19baf6f373d0aac P 49d13a11243a439581313cbf2389dea7 [term 1 LEADER]: Received request to transfer leadership to TS 9927a56797194391a4c98a02c10f6f58
I20251023 08:00:18.187166 21878 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "2fa24c01f1114e93976301027c9d0a76"
dest_uuid: "9927a56797194391a4c98a02c10f6f58"
mode: GRACEFUL
new_leader_uuid: "49d13a11243a439581313cbf2389dea7"
from {username='slave'} at 127.0.0.1:55996
I20251023 08:00:18.187647 21878 raft_consensus.cc:606] T 2fa24c01f1114e93976301027c9d0a76 P 9927a56797194391a4c98a02c10f6f58 [term 1 LEADER]: Received request to transfer leadership to TS 49d13a11243a439581313cbf2389dea7
I20251023 08:00:18.194617 21878 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "e446af5509c84a799ff7fa3d89cdbc8f"
dest_uuid: "9927a56797194391a4c98a02c10f6f58"
mode: GRACEFUL
new_leader_uuid: "49d13a11243a439581313cbf2389dea7"
from {username='slave'} at 127.0.0.1:55996
I20251023 08:00:18.195065 21878 raft_consensus.cc:606] T e446af5509c84a799ff7fa3d89cdbc8f P 9927a56797194391a4c98a02c10f6f58 [term 1 LEADER]: Received request to transfer leadership to TS 49d13a11243a439581313cbf2389dea7
I20251023 08:00:18.202004 21878 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "e84b3c7d7db24d86800d4a76767db682"
dest_uuid: "9927a56797194391a4c98a02c10f6f58"
mode: GRACEFUL
new_leader_uuid: "c51023bde9f346c1af16edaf4c858f98"
from {username='slave'} at 127.0.0.1:55996
I20251023 08:00:18.202507 21878 raft_consensus.cc:606] T e84b3c7d7db24d86800d4a76767db682 P 9927a56797194391a4c98a02c10f6f58 [term 1 LEADER]: Received request to transfer leadership to TS c51023bde9f346c1af16edaf4c858f98
I20251023 08:00:18.216253 22110 consensus_queue.cc:1048] T 2d3590750a9e499a9d0b125ab1c2d8bc P 49d13a11243a439581313cbf2389dea7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 08:00:18.227134 22110 consensus_queue.cc:1048] T 2d3590750a9e499a9d0b125ab1c2d8bc P 49d13a11243a439581313cbf2389dea7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 08:00:18.268980 22077 consensus_queue.cc:1048] T 47b52375a02b4d348c0d45f6aab2dd8c P 9927a56797194391a4c98a02c10f6f58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 08:00:18.279047 22077 consensus_queue.cc:1048] T 47b52375a02b4d348c0d45f6aab2dd8c P 9927a56797194391a4c98a02c10f6f58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 08:00:18.294533 21954 raft_consensus.cc:3060] T e446af5509c84a799ff7fa3d89cdbc8f P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:18.301559 22077 consensus_queue.cc:1048] T e446af5509c84a799ff7fa3d89cdbc8f P 9927a56797194391a4c98a02c10f6f58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 08:00:18.308250 22113 raft_consensus.cc:993] T e446af5509c84a799ff7fa3d89cdbc8f P 9927a56797194391a4c98a02c10f6f58: : Instructing follower 49d13a11243a439581313cbf2389dea7 to start an election
I20251023 08:00:18.308738 22120 raft_consensus.cc:1081] T e446af5509c84a799ff7fa3d89cdbc8f P 9927a56797194391a4c98a02c10f6f58 [term 1 LEADER]: Signalling peer 49d13a11243a439581313cbf2389dea7 to start an election
I20251023 08:00:18.310398 21953 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "e446af5509c84a799ff7fa3d89cdbc8f"
dest_uuid: "49d13a11243a439581313cbf2389dea7"
from {username='slave'} at 127.0.0.1:57000
I20251023 08:00:18.311671 21953 raft_consensus.cc:493] T e446af5509c84a799ff7fa3d89cdbc8f P 49d13a11243a439581313cbf2389dea7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 08:00:18.312140 21953 raft_consensus.cc:3060] T e446af5509c84a799ff7fa3d89cdbc8f P 49d13a11243a439581313cbf2389dea7 [term 1 FOLLOWER]: Advancing to term 2
I20251023 08:00:18.313421 22077 consensus_queue.cc:1048] T e446af5509c84a799ff7fa3d89cdbc8f P 9927a56797194391a4c98a02c10f6f58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 08:00:18.321645 22077 consensus_queue.cc:1048] T a773cc2cdf5045c09ec36f401421de47 P 9927a56797194391a4c98a02c10f6f58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 08:00:18.322405 21953 raft_consensus.cc:515] T e446af5509c84a799ff7fa3d89cdbc8f P 49d13a11243a439581313cbf2389dea7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:18.327512 21878 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e446af5509c84a799ff7fa3d89cdbc8f" candidate_uuid: "49d13a11243a439581313cbf2389dea7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9927a56797194391a4c98a02c10f6f58"
I20251023 08:00:18.328210 21878 raft_consensus.cc:3055] T e446af5509c84a799ff7fa3d89cdbc8f P 9927a56797194391a4c98a02c10f6f58 [term 1 LEADER]: Stepping down as leader of term 1
I20251023 08:00:18.328642 21878 raft_consensus.cc:740] T e446af5509c84a799ff7fa3d89cdbc8f P 9927a56797194391a4c98a02c10f6f58 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9927a56797194391a4c98a02c10f6f58, State: Running, Role: LEADER
I20251023 08:00:18.329481 21953 leader_election.cc:290] T e446af5509c84a799ff7fa3d89cdbc8f P 49d13a11243a439581313cbf2389dea7 [CANDIDATE]: Term 2 election: Requested vote from peers 9927a56797194391a4c98a02c10f6f58 (127.16.126.1:43563), c51023bde9f346c1af16edaf4c858f98 (127.16.126.3:36947)
I20251023 08:00:18.329576 21878 consensus_queue.cc:260] T e446af5509c84a799ff7fa3d89cdbc8f P 9927a56797194391a4c98a02c10f6f58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:18.330155 22027 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e446af5509c84a799ff7fa3d89cdbc8f" candidate_uuid: "49d13a11243a439581313cbf2389dea7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c51023bde9f346c1af16edaf4c858f98"
I20251023 08:00:18.331009 22027 raft_consensus.cc:3060] T e446af5509c84a799ff7fa3d89cdbc8f P c51023bde9f346c1af16edaf4c858f98 [term 1 FOLLOWER]: Advancing to term 2
I20251023 08:00:18.331198 21878 raft_consensus.cc:3060] T e446af5509c84a799ff7fa3d89cdbc8f P 9927a56797194391a4c98a02c10f6f58 [term 1 FOLLOWER]: Advancing to term 2
I20251023 08:00:18.335063 22110 consensus_queue.cc:1048] T b555f281b922436fa19baf6f373d0aac P 49d13a11243a439581313cbf2389dea7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 08:00:18.343834 22112 consensus_queue.cc:1048] T a773cc2cdf5045c09ec36f401421de47 P 9927a56797194391a4c98a02c10f6f58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 08:00:18.348624 22027 raft_consensus.cc:2468] T e446af5509c84a799ff7fa3d89cdbc8f P c51023bde9f346c1af16edaf4c858f98 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49d13a11243a439581313cbf2389dea7 in term 2.
I20251023 08:00:18.352260 21921 leader_election.cc:304] T e446af5509c84a799ff7fa3d89cdbc8f P 49d13a11243a439581313cbf2389dea7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49d13a11243a439581313cbf2389dea7, c51023bde9f346c1af16edaf4c858f98; no voters:
I20251023 08:00:18.353475 22110 raft_consensus.cc:2804] T e446af5509c84a799ff7fa3d89cdbc8f P 49d13a11243a439581313cbf2389dea7 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 08:00:18.353943 22110 raft_consensus.cc:697] T e446af5509c84a799ff7fa3d89cdbc8f P 49d13a11243a439581313cbf2389dea7 [term 2 LEADER]: Becoming Leader. State: Replica: 49d13a11243a439581313cbf2389dea7, State: Running, Role: LEADER
I20251023 08:00:18.354732 22110 consensus_queue.cc:237] T e446af5509c84a799ff7fa3d89cdbc8f P 49d13a11243a439581313cbf2389dea7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:18.358733 22105 consensus_queue.cc:1048] T b555f281b922436fa19baf6f373d0aac P 49d13a11243a439581313cbf2389dea7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 08:00:18.356393 21878 raft_consensus.cc:2468] T e446af5509c84a799ff7fa3d89cdbc8f P 9927a56797194391a4c98a02c10f6f58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49d13a11243a439581313cbf2389dea7 in term 2.
I20251023 08:00:18.371549 21778 catalog_manager.cc:5649] T e446af5509c84a799ff7fa3d89cdbc8f P 49d13a11243a439581313cbf2389dea7 reported cstate change: term changed from 1 to 2, leader changed from 9927a56797194391a4c98a02c10f6f58 (127.16.126.1) to 49d13a11243a439581313cbf2389dea7 (127.16.126.2). New cstate: current_term: 2 leader_uuid: "49d13a11243a439581313cbf2389dea7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } health_report { overall_health: UNKNOWN } } }
I20251023 08:00:18.373759 22112 consensus_queue.cc:1048] T e84b3c7d7db24d86800d4a76767db682 P 9927a56797194391a4c98a02c10f6f58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 08:00:18.379191 22105 raft_consensus.cc:993] T b555f281b922436fa19baf6f373d0aac P 49d13a11243a439581313cbf2389dea7: : Instructing follower 9927a56797194391a4c98a02c10f6f58 to start an election
I20251023 08:00:18.379647 22105 raft_consensus.cc:1081] T b555f281b922436fa19baf6f373d0aac P 49d13a11243a439581313cbf2389dea7 [term 1 LEADER]: Signalling peer 9927a56797194391a4c98a02c10f6f58 to start an election
I20251023 08:00:18.381032 21878 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "b555f281b922436fa19baf6f373d0aac"
dest_uuid: "9927a56797194391a4c98a02c10f6f58"
from {username='slave'} at 127.0.0.1:55982
I20251023 08:00:18.381644 21878 raft_consensus.cc:493] T b555f281b922436fa19baf6f373d0aac P 9927a56797194391a4c98a02c10f6f58 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 08:00:18.382037 21878 raft_consensus.cc:3060] T b555f281b922436fa19baf6f373d0aac P 9927a56797194391a4c98a02c10f6f58 [term 1 FOLLOWER]: Advancing to term 2
I20251023 08:00:18.391599 21878 raft_consensus.cc:515] T b555f281b922436fa19baf6f373d0aac P 9927a56797194391a4c98a02c10f6f58 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:18.394160 21954 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b555f281b922436fa19baf6f373d0aac" candidate_uuid: "9927a56797194391a4c98a02c10f6f58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "49d13a11243a439581313cbf2389dea7"
I20251023 08:00:18.394153 21878 leader_election.cc:290] T b555f281b922436fa19baf6f373d0aac P 9927a56797194391a4c98a02c10f6f58 [CANDIDATE]: Term 2 election: Requested vote from peers 49d13a11243a439581313cbf2389dea7 (127.16.126.2:36187), c51023bde9f346c1af16edaf4c858f98 (127.16.126.3:36947)
I20251023 08:00:18.394424 22027 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b555f281b922436fa19baf6f373d0aac" candidate_uuid: "9927a56797194391a4c98a02c10f6f58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c51023bde9f346c1af16edaf4c858f98"
I20251023 08:00:18.394877 21954 raft_consensus.cc:3055] T b555f281b922436fa19baf6f373d0aac P 49d13a11243a439581313cbf2389dea7 [term 1 LEADER]: Stepping down as leader of term 1
I20251023 08:00:18.395022 22027 raft_consensus.cc:3060] T b555f281b922436fa19baf6f373d0aac P c51023bde9f346c1af16edaf4c858f98 [term 1 FOLLOWER]: Advancing to term 2
I20251023 08:00:18.395233 21954 raft_consensus.cc:740] T b555f281b922436fa19baf6f373d0aac P 49d13a11243a439581313cbf2389dea7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 49d13a11243a439581313cbf2389dea7, State: Running, Role: LEADER
I20251023 08:00:18.396158 21954 consensus_queue.cc:260] T b555f281b922436fa19baf6f373d0aac P 49d13a11243a439581313cbf2389dea7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:18.397569 21954 raft_consensus.cc:3060] T b555f281b922436fa19baf6f373d0aac P 49d13a11243a439581313cbf2389dea7 [term 1 FOLLOWER]: Advancing to term 2
I20251023 08:00:18.398701 22077 raft_consensus.cc:993] T e84b3c7d7db24d86800d4a76767db682 P 9927a56797194391a4c98a02c10f6f58: : Instructing follower c51023bde9f346c1af16edaf4c858f98 to start an election
I20251023 08:00:18.399187 22113 raft_consensus.cc:1081] T e84b3c7d7db24d86800d4a76767db682 P 9927a56797194391a4c98a02c10f6f58 [term 1 LEADER]: Signalling peer c51023bde9f346c1af16edaf4c858f98 to start an election
I20251023 08:00:18.402148 22029 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "e84b3c7d7db24d86800d4a76767db682"
dest_uuid: "c51023bde9f346c1af16edaf4c858f98"
from {username='slave'} at 127.0.0.1:40674
I20251023 08:00:18.402732 22027 raft_consensus.cc:2468] T b555f281b922436fa19baf6f373d0aac P c51023bde9f346c1af16edaf4c858f98 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9927a56797194391a4c98a02c10f6f58 in term 2.
I20251023 08:00:18.403724 21846 leader_election.cc:304] T b555f281b922436fa19baf6f373d0aac P 9927a56797194391a4c98a02c10f6f58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9927a56797194391a4c98a02c10f6f58, c51023bde9f346c1af16edaf4c858f98; no voters:
I20251023 08:00:18.404417 22113 raft_consensus.cc:2804] T b555f281b922436fa19baf6f373d0aac P 9927a56797194391a4c98a02c10f6f58 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 08:00:18.404873 22113 raft_consensus.cc:697] T b555f281b922436fa19baf6f373d0aac P 9927a56797194391a4c98a02c10f6f58 [term 2 LEADER]: Becoming Leader. State: Replica: 9927a56797194391a4c98a02c10f6f58, State: Running, Role: LEADER
I20251023 08:00:18.405712 22120 consensus_queue.cc:1048] T e84b3c7d7db24d86800d4a76767db682 P 9927a56797194391a4c98a02c10f6f58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 08:00:18.405679 22113 consensus_queue.cc:237] T b555f281b922436fa19baf6f373d0aac P 9927a56797194391a4c98a02c10f6f58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:18.409237 22029 raft_consensus.cc:493] T e84b3c7d7db24d86800d4a76767db682 P c51023bde9f346c1af16edaf4c858f98 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 08:00:18.409811 22029 raft_consensus.cc:3060] T e84b3c7d7db24d86800d4a76767db682 P c51023bde9f346c1af16edaf4c858f98 [term 1 FOLLOWER]: Advancing to term 2
I20251023 08:00:18.416669 21954 raft_consensus.cc:2468] T b555f281b922436fa19baf6f373d0aac P 49d13a11243a439581313cbf2389dea7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9927a56797194391a4c98a02c10f6f58 in term 2.
I20251023 08:00:18.419855 21776 catalog_manager.cc:5649] T b555f281b922436fa19baf6f373d0aac P 9927a56797194391a4c98a02c10f6f58 reported cstate change: term changed from 1 to 2, leader changed from 49d13a11243a439581313cbf2389dea7 (127.16.126.2) to 9927a56797194391a4c98a02c10f6f58 (127.16.126.1). New cstate: current_term: 2 leader_uuid: "9927a56797194391a4c98a02c10f6f58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } health_report { overall_health: UNKNOWN } } }
I20251023 08:00:18.422588 22029 raft_consensus.cc:515] T e84b3c7d7db24d86800d4a76767db682 P c51023bde9f346c1af16edaf4c858f98 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:18.429402 21878 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e84b3c7d7db24d86800d4a76767db682" candidate_uuid: "c51023bde9f346c1af16edaf4c858f98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9927a56797194391a4c98a02c10f6f58"
I20251023 08:00:18.429960 22029 leader_election.cc:290] T e84b3c7d7db24d86800d4a76767db682 P c51023bde9f346c1af16edaf4c858f98 [CANDIDATE]: Term 2 election: Requested vote from peers 9927a56797194391a4c98a02c10f6f58 (127.16.126.1:43563), 49d13a11243a439581313cbf2389dea7 (127.16.126.2:36187)
I20251023 08:00:18.430471 21878 raft_consensus.cc:3055] T e84b3c7d7db24d86800d4a76767db682 P 9927a56797194391a4c98a02c10f6f58 [term 1 LEADER]: Stepping down as leader of term 1
I20251023 08:00:18.430840 21878 raft_consensus.cc:740] T e84b3c7d7db24d86800d4a76767db682 P 9927a56797194391a4c98a02c10f6f58 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9927a56797194391a4c98a02c10f6f58, State: Running, Role: LEADER
I20251023 08:00:18.430723 21953 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e84b3c7d7db24d86800d4a76767db682" candidate_uuid: "c51023bde9f346c1af16edaf4c858f98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "49d13a11243a439581313cbf2389dea7"
I20251023 08:00:18.431427 21953 raft_consensus.cc:3060] T e84b3c7d7db24d86800d4a76767db682 P 49d13a11243a439581313cbf2389dea7 [term 1 FOLLOWER]: Advancing to term 2
I20251023 08:00:18.431721 21878 consensus_queue.cc:260] T e84b3c7d7db24d86800d4a76767db682 P 9927a56797194391a4c98a02c10f6f58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:18.433924 21878 raft_consensus.cc:3060] T e84b3c7d7db24d86800d4a76767db682 P 9927a56797194391a4c98a02c10f6f58 [term 1 FOLLOWER]: Advancing to term 2
I20251023 08:00:18.440732 21953 raft_consensus.cc:2468] T e84b3c7d7db24d86800d4a76767db682 P 49d13a11243a439581313cbf2389dea7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c51023bde9f346c1af16edaf4c858f98 in term 2.
I20251023 08:00:18.441360 21878 raft_consensus.cc:2468] T e84b3c7d7db24d86800d4a76767db682 P 9927a56797194391a4c98a02c10f6f58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c51023bde9f346c1af16edaf4c858f98 in term 2.
I20251023 08:00:18.442616 21994 leader_election.cc:304] T e84b3c7d7db24d86800d4a76767db682 P c51023bde9f346c1af16edaf4c858f98 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9927a56797194391a4c98a02c10f6f58, c51023bde9f346c1af16edaf4c858f98; no voters:
I20251023 08:00:18.443542 22088 raft_consensus.cc:2804] T e84b3c7d7db24d86800d4a76767db682 P c51023bde9f346c1af16edaf4c858f98 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 08:00:18.444041 22088 raft_consensus.cc:697] T e84b3c7d7db24d86800d4a76767db682 P c51023bde9f346c1af16edaf4c858f98 [term 2 LEADER]: Becoming Leader. State: Replica: c51023bde9f346c1af16edaf4c858f98, State: Running, Role: LEADER
I20251023 08:00:18.444852 22088 consensus_queue.cc:237] T e84b3c7d7db24d86800d4a76767db682 P c51023bde9f346c1af16edaf4c858f98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:18.452171 21776 catalog_manager.cc:5649] T e84b3c7d7db24d86800d4a76767db682 P c51023bde9f346c1af16edaf4c858f98 reported cstate change: term changed from 1 to 2, leader changed from 9927a56797194391a4c98a02c10f6f58 (127.16.126.1) to c51023bde9f346c1af16edaf4c858f98 (127.16.126.3). New cstate: current_term: 2 leader_uuid: "c51023bde9f346c1af16edaf4c858f98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } health_report { overall_health: HEALTHY } } }
I20251023 08:00:18.494966 22076 raft_consensus.cc:993] T 7456ec78bb664a40a6dde0929ea12d8f P c51023bde9f346c1af16edaf4c858f98: : Instructing follower 9927a56797194391a4c98a02c10f6f58 to start an election
I20251023 08:00:18.495432 22148 raft_consensus.cc:1081] T 7456ec78bb664a40a6dde0929ea12d8f P c51023bde9f346c1af16edaf4c858f98 [term 1 LEADER]: Signalling peer 9927a56797194391a4c98a02c10f6f58 to start an election
I20251023 08:00:18.496865 21878 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "7456ec78bb664a40a6dde0929ea12d8f"
dest_uuid: "9927a56797194391a4c98a02c10f6f58"
from {username='slave'} at 127.0.0.1:55974
I20251023 08:00:18.497361 21878 raft_consensus.cc:493] T 7456ec78bb664a40a6dde0929ea12d8f P 9927a56797194391a4c98a02c10f6f58 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 08:00:18.497785 21878 raft_consensus.cc:3060] T 7456ec78bb664a40a6dde0929ea12d8f P 9927a56797194391a4c98a02c10f6f58 [term 1 FOLLOWER]: Advancing to term 2
I20251023 08:00:18.503005 21878 raft_consensus.cc:515] T 7456ec78bb664a40a6dde0929ea12d8f P 9927a56797194391a4c98a02c10f6f58 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } } peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } }
I20251023 08:00:18.504669 21878 leader_election.cc:290] T 7456ec78bb664a40a6dde0929ea12d8f P 9927a56797194391a4c98a02c10f6f58 [CANDIDATE]: Term 2 election: Requested vote from peers 49d13a11243a439581313cbf2389dea7 (127.16.126.2:36187), c51023bde9f346c1af16edaf4c858f98 (127.16.126.3:36947)
I20251023 08:00:18.505586 21953 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7456ec78bb664a40a6dde0929ea12d8f" candidate_uuid: "9927a56797194391a4c98a02c10f6f58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "49d13a11243a439581313cbf2389dea7"
I20251023 08:00:18.505815 22029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7456ec78bb664a40a6dde0929ea12d8f" candidate_uuid: "9927a56797194391a4c98a02c10f6f58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c51023bde9f346c1af16edaf4c858f98"
I20251023 08:00:18.506197 21953 raft_consensus.cc:3060] T 7456ec78bb664a40a6dde0929ea12d8f P 49d13a11243a439581313cbf2389dea7 [term 1 FOLLOWER]: Advancing to term 2
I20251023 08:00:18.506373 22029 raft_consensus.cc:3055] T 7456ec78bb664a40a6dde0929ea12d8f P c51023bde9f346c1af16edaf4c858f98 [term 1 LEADER]: Stepping down as leader of term 1
I20251023 08:00:18.506706 22029 raft_consensus.cc:740] T 7456ec78bb664a40a6dde0929ea12d8f P c51023bde9f346c1af16edaf4c858f98 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c51023bde9f346c1af16edaf4c858f98, State: Running, Role: LEADER
I20251023 08:00:18.507337 22029 consensus_queue.cc:260] T 7456ec78bb664a40a6dde0929ea12d8f P c51023bde9f346c1af16edaf4c858f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } } peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } }
I20251023 08:00:18.508312 22029 raft_consensus.cc:3060] T 7456ec78bb664a40a6dde0929ea12d8f P c51023bde9f346c1af16edaf4c858f98 [term 1 FOLLOWER]: Advancing to term 2
I20251023 08:00:18.511740 21953 raft_consensus.cc:2468] T 7456ec78bb664a40a6dde0929ea12d8f P 49d13a11243a439581313cbf2389dea7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9927a56797194391a4c98a02c10f6f58 in term 2.
I20251023 08:00:18.512943 21843 leader_election.cc:304] T 7456ec78bb664a40a6dde0929ea12d8f P 9927a56797194391a4c98a02c10f6f58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49d13a11243a439581313cbf2389dea7, 9927a56797194391a4c98a02c10f6f58; no voters:
I20251023 08:00:18.513818 22113 raft_consensus.cc:2804] T 7456ec78bb664a40a6dde0929ea12d8f P 9927a56797194391a4c98a02c10f6f58 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 08:00:18.514005 22029 raft_consensus.cc:2468] T 7456ec78bb664a40a6dde0929ea12d8f P c51023bde9f346c1af16edaf4c858f98 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9927a56797194391a4c98a02c10f6f58 in term 2.
I20251023 08:00:18.514240 22113 raft_consensus.cc:697] T 7456ec78bb664a40a6dde0929ea12d8f P 9927a56797194391a4c98a02c10f6f58 [term 2 LEADER]: Becoming Leader. State: Replica: 9927a56797194391a4c98a02c10f6f58, State: Running, Role: LEADER
I20251023 08:00:18.515216 22113 consensus_queue.cc:237] T 7456ec78bb664a40a6dde0929ea12d8f P 9927a56797194391a4c98a02c10f6f58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } } peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } }
I20251023 08:00:18.522271 21776 catalog_manager.cc:5649] T 7456ec78bb664a40a6dde0929ea12d8f P 9927a56797194391a4c98a02c10f6f58 reported cstate change: term changed from 1 to 2, leader changed from c51023bde9f346c1af16edaf4c858f98 (127.16.126.3) to 9927a56797194391a4c98a02c10f6f58 (127.16.126.1). New cstate: current_term: 2 leader_uuid: "9927a56797194391a4c98a02c10f6f58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } health_report { overall_health: HEALTHY } } }
I20251023 08:00:18.523149 22113 consensus_queue.cc:1048] T 2fa24c01f1114e93976301027c9d0a76 P 9927a56797194391a4c98a02c10f6f58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 08:00:18.537101 22120 consensus_queue.cc:1048] T 2fa24c01f1114e93976301027c9d0a76 P 9927a56797194391a4c98a02c10f6f58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 08:00:18.545789 22112 raft_consensus.cc:993] T 2fa24c01f1114e93976301027c9d0a76 P 9927a56797194391a4c98a02c10f6f58: : Instructing follower 49d13a11243a439581313cbf2389dea7 to start an election
I20251023 08:00:18.546229 22120 raft_consensus.cc:1081] T 2fa24c01f1114e93976301027c9d0a76 P 9927a56797194391a4c98a02c10f6f58 [term 1 LEADER]: Signalling peer 49d13a11243a439581313cbf2389dea7 to start an election
I20251023 08:00:18.547848 21953 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "2fa24c01f1114e93976301027c9d0a76"
dest_uuid: "49d13a11243a439581313cbf2389dea7"
from {username='slave'} at 127.0.0.1:57000
I20251023 08:00:18.548326 21953 raft_consensus.cc:493] T 2fa24c01f1114e93976301027c9d0a76 P 49d13a11243a439581313cbf2389dea7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 08:00:18.548614 21953 raft_consensus.cc:3060] T 2fa24c01f1114e93976301027c9d0a76 P 49d13a11243a439581313cbf2389dea7 [term 1 FOLLOWER]: Advancing to term 2
I20251023 08:00:18.553687 21953 raft_consensus.cc:515] T 2fa24c01f1114e93976301027c9d0a76 P 49d13a11243a439581313cbf2389dea7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:18.555265 21953 leader_election.cc:290] T 2fa24c01f1114e93976301027c9d0a76 P 49d13a11243a439581313cbf2389dea7 [CANDIDATE]: Term 2 election: Requested vote from peers 9927a56797194391a4c98a02c10f6f58 (127.16.126.1:43563), c51023bde9f346c1af16edaf4c858f98 (127.16.126.3:36947)
I20251023 08:00:18.556284 21878 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2fa24c01f1114e93976301027c9d0a76" candidate_uuid: "49d13a11243a439581313cbf2389dea7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9927a56797194391a4c98a02c10f6f58"
I20251023 08:00:18.556458 22029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2fa24c01f1114e93976301027c9d0a76" candidate_uuid: "49d13a11243a439581313cbf2389dea7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c51023bde9f346c1af16edaf4c858f98"
I20251023 08:00:18.557030 21878 raft_consensus.cc:3055] T 2fa24c01f1114e93976301027c9d0a76 P 9927a56797194391a4c98a02c10f6f58 [term 1 LEADER]: Stepping down as leader of term 1
I20251023 08:00:18.557065 22029 raft_consensus.cc:3060] T 2fa24c01f1114e93976301027c9d0a76 P c51023bde9f346c1af16edaf4c858f98 [term 1 FOLLOWER]: Advancing to term 2
I20251023 08:00:18.557662 21878 raft_consensus.cc:740] T 2fa24c01f1114e93976301027c9d0a76 P 9927a56797194391a4c98a02c10f6f58 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9927a56797194391a4c98a02c10f6f58, State: Running, Role: LEADER
I20251023 08:00:18.558508 21878 consensus_queue.cc:260] T 2fa24c01f1114e93976301027c9d0a76 P 9927a56797194391a4c98a02c10f6f58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:18.559818 21878 raft_consensus.cc:3060] T 2fa24c01f1114e93976301027c9d0a76 P 9927a56797194391a4c98a02c10f6f58 [term 1 FOLLOWER]: Advancing to term 2
I20251023 08:00:18.565091 22029 raft_consensus.cc:2468] T 2fa24c01f1114e93976301027c9d0a76 P c51023bde9f346c1af16edaf4c858f98 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49d13a11243a439581313cbf2389dea7 in term 2.
I20251023 08:00:18.566538 21921 leader_election.cc:304] T 2fa24c01f1114e93976301027c9d0a76 P 49d13a11243a439581313cbf2389dea7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49d13a11243a439581313cbf2389dea7, c51023bde9f346c1af16edaf4c858f98; no voters:
I20251023 08:00:18.567296 21878 raft_consensus.cc:2468] T 2fa24c01f1114e93976301027c9d0a76 P 9927a56797194391a4c98a02c10f6f58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49d13a11243a439581313cbf2389dea7 in term 2.
I20251023 08:00:18.567611 22144 raft_consensus.cc:2804] T 2fa24c01f1114e93976301027c9d0a76 P 49d13a11243a439581313cbf2389dea7 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 08:00:18.568223 22144 raft_consensus.cc:697] T 2fa24c01f1114e93976301027c9d0a76 P 49d13a11243a439581313cbf2389dea7 [term 2 LEADER]: Becoming Leader. State: Replica: 49d13a11243a439581313cbf2389dea7, State: Running, Role: LEADER
I20251023 08:00:18.569075 22144 consensus_queue.cc:237] T 2fa24c01f1114e93976301027c9d0a76 P 49d13a11243a439581313cbf2389dea7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:18.575368 21776 catalog_manager.cc:5649] T 2fa24c01f1114e93976301027c9d0a76 P 49d13a11243a439581313cbf2389dea7 reported cstate change: term changed from 1 to 2, leader changed from 9927a56797194391a4c98a02c10f6f58 (127.16.126.1) to 49d13a11243a439581313cbf2389dea7 (127.16.126.2). New cstate: current_term: 2 leader_uuid: "49d13a11243a439581313cbf2389dea7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } health_report { overall_health: UNKNOWN } } }
I20251023 08:00:18.839789 21878 raft_consensus.cc:1275] T e84b3c7d7db24d86800d4a76767db682 P 9927a56797194391a4c98a02c10f6f58 [term 2 FOLLOWER]: Refusing update from remote peer c51023bde9f346c1af16edaf4c858f98: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 08:00:18.841188 22148 consensus_queue.cc:1048] T e84b3c7d7db24d86800d4a76767db682 P c51023bde9f346c1af16edaf4c858f98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 08:00:18.848685 21953 raft_consensus.cc:1275] T e84b3c7d7db24d86800d4a76767db682 P 49d13a11243a439581313cbf2389dea7 [term 2 FOLLOWER]: Refusing update from remote peer c51023bde9f346c1af16edaf4c858f98: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 08:00:18.851300 22029 raft_consensus.cc:1275] T b555f281b922436fa19baf6f373d0aac P c51023bde9f346c1af16edaf4c858f98 [term 2 FOLLOWER]: Refusing update from remote peer 9927a56797194391a4c98a02c10f6f58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 08:00:18.851541 22076 consensus_queue.cc:1048] T e84b3c7d7db24d86800d4a76767db682 P c51023bde9f346c1af16edaf4c858f98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20251023 08:00:18.852810 22120 consensus_queue.cc:1048] T b555f281b922436fa19baf6f373d0aac P 9927a56797194391a4c98a02c10f6f58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 08:00:18.863724 21953 raft_consensus.cc:1275] T b555f281b922436fa19baf6f373d0aac P 49d13a11243a439581313cbf2389dea7 [term 2 FOLLOWER]: Refusing update from remote peer 9927a56797194391a4c98a02c10f6f58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 08:00:18.865294 22120 consensus_queue.cc:1048] T b555f281b922436fa19baf6f373d0aac P 9927a56797194391a4c98a02c10f6f58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 08:00:18.902658 21878 raft_consensus.cc:1275] T e446af5509c84a799ff7fa3d89cdbc8f P 9927a56797194391a4c98a02c10f6f58 [term 2 FOLLOWER]: Refusing update from remote peer 49d13a11243a439581313cbf2389dea7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 08:00:18.903853 22144 consensus_queue.cc:1048] T e446af5509c84a799ff7fa3d89cdbc8f P 49d13a11243a439581313cbf2389dea7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 08:00:18.911605 22028 raft_consensus.cc:1275] T e446af5509c84a799ff7fa3d89cdbc8f P c51023bde9f346c1af16edaf4c858f98 [term 2 FOLLOWER]: Refusing update from remote peer 49d13a11243a439581313cbf2389dea7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 08:00:18.914331 22151 consensus_queue.cc:1048] T e446af5509c84a799ff7fa3d89cdbc8f P 49d13a11243a439581313cbf2389dea7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 08:00:19.052933 22028 raft_consensus.cc:1275] T 7456ec78bb664a40a6dde0929ea12d8f P c51023bde9f346c1af16edaf4c858f98 [term 2 FOLLOWER]: Refusing update from remote peer 9927a56797194391a4c98a02c10f6f58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 08:00:19.054286 22077 consensus_queue.cc:1048] T 7456ec78bb664a40a6dde0929ea12d8f P 9927a56797194391a4c98a02c10f6f58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 08:00:19.063329 21953 raft_consensus.cc:1275] T 7456ec78bb664a40a6dde0929ea12d8f P 49d13a11243a439581313cbf2389dea7 [term 2 FOLLOWER]: Refusing update from remote peer 9927a56797194391a4c98a02c10f6f58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 08:00:19.065043 22077 consensus_queue.cc:1048] T 7456ec78bb664a40a6dde0929ea12d8f P 9927a56797194391a4c98a02c10f6f58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 08:00:19.180171 22028 raft_consensus.cc:1275] T 2fa24c01f1114e93976301027c9d0a76 P c51023bde9f346c1af16edaf4c858f98 [term 2 FOLLOWER]: Refusing update from remote peer 49d13a11243a439581313cbf2389dea7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 08:00:19.181372 22151 consensus_queue.cc:1048] T 2fa24c01f1114e93976301027c9d0a76 P 49d13a11243a439581313cbf2389dea7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 08:00:19.188761 21878 raft_consensus.cc:1275] T 2fa24c01f1114e93976301027c9d0a76 P 9927a56797194391a4c98a02c10f6f58 [term 2 FOLLOWER]: Refusing update from remote peer 49d13a11243a439581313cbf2389dea7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 08:00:19.190697 22144 consensus_queue.cc:1048] T 2fa24c01f1114e93976301027c9d0a76 P 49d13a11243a439581313cbf2389dea7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20251023 08:00:21.203807 16888 test_util.cc:276] Using random seed: -753095875
I20251023 08:00:21.235348 21778 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54932:
name: "soft_deleted_table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251023 08:00:21.237574 21778 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251023 08:00:21.286283 21862 tablet_service.cc:1505] Processing CreateTablet for tablet 1d1e3ddac9204211924d2187d73ecd72 (DEFAULT_TABLE table=soft_deleted_table [id=f270450e4ddd4e6897fe147881a078d4]), partition=RANGE (key) PARTITION VALUES < 238609294
I20251023 08:00:21.287619 21862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d1e3ddac9204211924d2187d73ecd72. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:21.287388 21939 tablet_service.cc:1505] Processing CreateTablet for tablet 1d1e3ddac9204211924d2187d73ecd72 (DEFAULT_TABLE table=soft_deleted_table [id=f270450e4ddd4e6897fe147881a078d4]), partition=RANGE (key) PARTITION VALUES < 238609294
I20251023 08:00:21.288693 21939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d1e3ddac9204211924d2187d73ecd72. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:21.290642 21866 tablet_service.cc:1505] Processing CreateTablet for tablet 0274899ee0b94ca6ad23688cfc1ffeb5 (DEFAULT_TABLE table=soft_deleted_table [id=f270450e4ddd4e6897fe147881a078d4]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20251023 08:00:21.291977 21866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0274899ee0b94ca6ad23688cfc1ffeb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:21.293536 21867 tablet_service.cc:1505] Processing CreateTablet for tablet 9cd5e272db7a47c2b5f84af9bf661b1d (DEFAULT_TABLE table=soft_deleted_table [id=f270450e4ddd4e6897fe147881a078d4]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20251023 08:00:21.294914 21867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cd5e272db7a47c2b5f84af9bf661b1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:21.295238 22011 tablet_service.cc:1505] Processing CreateTablet for tablet 1d1e3ddac9204211924d2187d73ecd72 (DEFAULT_TABLE table=soft_deleted_table [id=f270450e4ddd4e6897fe147881a078d4]), partition=RANGE (key) PARTITION VALUES < 238609294
I20251023 08:00:21.296665 22011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d1e3ddac9204211924d2187d73ecd72. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:21.298879 21864 tablet_service.cc:1505] Processing CreateTablet for tablet cc63d5c82e054028bd3c0cfe4599d490 (DEFAULT_TABLE table=soft_deleted_table [id=f270450e4ddd4e6897fe147881a078d4]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20251023 08:00:21.300235 21864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc63d5c82e054028bd3c0cfe4599d490. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:21.306138 21870 tablet_service.cc:1505] Processing CreateTablet for tablet ec26529ef6c64b259b8428285a2ad427 (DEFAULT_TABLE table=soft_deleted_table [id=f270450e4ddd4e6897fe147881a078d4]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20251023 08:00:21.307581 21870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec26529ef6c64b259b8428285a2ad427. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:21.312218 21940 tablet_service.cc:1505] Processing CreateTablet for tablet ec26529ef6c64b259b8428285a2ad427 (DEFAULT_TABLE table=soft_deleted_table [id=f270450e4ddd4e6897fe147881a078d4]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20251023 08:00:21.313208 21944 tablet_service.cc:1505] Processing CreateTablet for tablet 0274899ee0b94ca6ad23688cfc1ffeb5 (DEFAULT_TABLE table=soft_deleted_table [id=f270450e4ddd4e6897fe147881a078d4]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20251023 08:00:21.313704 21940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec26529ef6c64b259b8428285a2ad427. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:21.314546 21944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0274899ee0b94ca6ad23688cfc1ffeb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:21.316151 21868 tablet_service.cc:1505] Processing CreateTablet for tablet 580a58e30dcb430aaf3b33473a277984 (DEFAULT_TABLE table=soft_deleted_table [id=f270450e4ddd4e6897fe147881a078d4]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20251023 08:00:21.317512 21868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 580a58e30dcb430aaf3b33473a277984. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:21.318218 21941 tablet_service.cc:1505] Processing CreateTablet for tablet 9cd5e272db7a47c2b5f84af9bf661b1d (DEFAULT_TABLE table=soft_deleted_table [id=f270450e4ddd4e6897fe147881a078d4]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20251023 08:00:21.319530 21941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cd5e272db7a47c2b5f84af9bf661b1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:21.321453 21943 tablet_service.cc:1505] Processing CreateTablet for tablet cc63d5c82e054028bd3c0cfe4599d490 (DEFAULT_TABLE table=soft_deleted_table [id=f270450e4ddd4e6897fe147881a078d4]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20251023 08:00:21.322746 21943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc63d5c82e054028bd3c0cfe4599d490. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:21.332429 22017 tablet_service.cc:1505] Processing CreateTablet for tablet 9cd5e272db7a47c2b5f84af9bf661b1d (DEFAULT_TABLE table=soft_deleted_table [id=f270450e4ddd4e6897fe147881a078d4]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20251023 08:00:21.333957 22017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cd5e272db7a47c2b5f84af9bf661b1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:21.295285 22018 tablet_service.cc:1505] Processing CreateTablet for tablet 0274899ee0b94ca6ad23688cfc1ffeb5 (DEFAULT_TABLE table=soft_deleted_table [id=f270450e4ddd4e6897fe147881a078d4]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20251023 08:00:21.334442 22015 tablet_service.cc:1505] Processing CreateTablet for tablet 68421eae3c714c6ca0dffaa6c3d5f3f1 (DEFAULT_TABLE table=soft_deleted_table [id=f270450e4ddd4e6897fe147881a078d4]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20251023 08:00:21.335465 22018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0274899ee0b94ca6ad23688cfc1ffeb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:21.333000 22014 tablet_service.cc:1505] Processing CreateTablet for tablet ec26529ef6c64b259b8428285a2ad427 (DEFAULT_TABLE table=soft_deleted_table [id=f270450e4ddd4e6897fe147881a078d4]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20251023 08:00:21.336711 22014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec26529ef6c64b259b8428285a2ad427. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:21.338413 22012 tablet_service.cc:1505] Processing CreateTablet for tablet cc63d5c82e054028bd3c0cfe4599d490 (DEFAULT_TABLE table=soft_deleted_table [id=f270450e4ddd4e6897fe147881a078d4]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20251023 08:00:21.339671 22012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc63d5c82e054028bd3c0cfe4599d490. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:21.312212 21869 tablet_service.cc:1505] Processing CreateTablet for tablet 68421eae3c714c6ca0dffaa6c3d5f3f1 (DEFAULT_TABLE table=soft_deleted_table [id=f270450e4ddd4e6897fe147881a078d4]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20251023 08:00:21.342257 21869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68421eae3c714c6ca0dffaa6c3d5f3f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:21.342531 22015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68421eae3c714c6ca0dffaa6c3d5f3f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:21.349175 22167 tablet_bootstrap.cc:492] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 9927a56797194391a4c98a02c10f6f58: Bootstrap starting.
I20251023 08:00:21.351066 21938 tablet_service.cc:1505] Processing CreateTablet for tablet 68421eae3c714c6ca0dffaa6c3d5f3f1 (DEFAULT_TABLE table=soft_deleted_table [id=f270450e4ddd4e6897fe147881a078d4]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20251023 08:00:21.352507 21938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68421eae3c714c6ca0dffaa6c3d5f3f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:21.370882 22167 tablet_bootstrap.cc:654] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 9927a56797194391a4c98a02c10f6f58: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:21.376566 21945 tablet_service.cc:1505] Processing CreateTablet for tablet 580a58e30dcb430aaf3b33473a277984 (DEFAULT_TABLE table=soft_deleted_table [id=f270450e4ddd4e6897fe147881a078d4]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20251023 08:00:21.378049 21945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 580a58e30dcb430aaf3b33473a277984. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:21.382534 22169 tablet_bootstrap.cc:492] T ec26529ef6c64b259b8428285a2ad427 P 49d13a11243a439581313cbf2389dea7: Bootstrap starting.
I20251023 08:00:21.391824 22169 tablet_bootstrap.cc:654] T ec26529ef6c64b259b8428285a2ad427 P 49d13a11243a439581313cbf2389dea7: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:21.397524 22015 tablet_service.cc:1505] Processing CreateTablet for tablet 580a58e30dcb430aaf3b33473a277984 (DEFAULT_TABLE table=soft_deleted_table [id=f270450e4ddd4e6897fe147881a078d4]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
W20251023 08:00:21.400713 21843 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.2:36187, user_credentials={real_user=slave}} blocked reactor thread for 51344us
I20251023 08:00:21.401249 21866 tablet_service.cc:1505] Processing CreateTablet for tablet 095923a5d18140f2bd7a676fc516acdc (DEFAULT_TABLE table=soft_deleted_table [id=f270450e4ddd4e6897fe147881a078d4]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20251023 08:00:21.402994 21866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 095923a5d18140f2bd7a676fc516acdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:21.399614 22015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 580a58e30dcb430aaf3b33473a277984. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:21.414136 21940 tablet_service.cc:1505] Processing CreateTablet for tablet 095923a5d18140f2bd7a676fc516acdc (DEFAULT_TABLE table=soft_deleted_table [id=f270450e4ddd4e6897fe147881a078d4]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20251023 08:00:21.415108 22016 tablet_service.cc:1505] Processing CreateTablet for tablet 095923a5d18140f2bd7a676fc516acdc (DEFAULT_TABLE table=soft_deleted_table [id=f270450e4ddd4e6897fe147881a078d4]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20251023 08:00:21.415609 21940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 095923a5d18140f2bd7a676fc516acdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:21.416517 22016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 095923a5d18140f2bd7a676fc516acdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:21.417258 21862 tablet_service.cc:1505] Processing CreateTablet for tablet 992be711bf964771a0eae249e906e021 (DEFAULT_TABLE table=soft_deleted_table [id=f270450e4ddd4e6897fe147881a078d4]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20251023 08:00:21.418622 21862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 992be711bf964771a0eae249e906e021. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:21.420554 22019 tablet_service.cc:1505] Processing CreateTablet for tablet 992be711bf964771a0eae249e906e021 (DEFAULT_TABLE table=soft_deleted_table [id=f270450e4ddd4e6897fe147881a078d4]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20251023 08:00:21.421878 22019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 992be711bf964771a0eae249e906e021. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:21.426559 21938 tablet_service.cc:1505] Processing CreateTablet for tablet 992be711bf964771a0eae249e906e021 (DEFAULT_TABLE table=soft_deleted_table [id=f270450e4ddd4e6897fe147881a078d4]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20251023 08:00:21.427953 21938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 992be711bf964771a0eae249e906e021. 1 dirs total, 0 dirs full, 0 dirs failed
I20251023 08:00:21.476047 22167 tablet_bootstrap.cc:492] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 9927a56797194391a4c98a02c10f6f58: No bootstrap required, opened a new log
I20251023 08:00:21.476679 22167 ts_tablet_manager.cc:1403] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 9927a56797194391a4c98a02c10f6f58: Time spent bootstrapping tablet: real 0.128s user 0.011s sys 0.009s
I20251023 08:00:21.484256 22167 raft_consensus.cc:359] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:21.486506 22170 tablet_bootstrap.cc:492] T ec26529ef6c64b259b8428285a2ad427 P c51023bde9f346c1af16edaf4c858f98: Bootstrap starting.
I20251023 08:00:21.489748 22169 tablet_bootstrap.cc:492] T ec26529ef6c64b259b8428285a2ad427 P 49d13a11243a439581313cbf2389dea7: No bootstrap required, opened a new log
I20251023 08:00:21.485258 22167 raft_consensus.cc:385] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:21.490751 22167 raft_consensus.cc:740] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9927a56797194391a4c98a02c10f6f58, State: Initialized, Role: FOLLOWER
I20251023 08:00:21.491899 22167 consensus_queue.cc:260] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 9927a56797194391a4c98a02c10f6f58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:21.498276 22167 ts_tablet_manager.cc:1434] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 9927a56797194391a4c98a02c10f6f58: Time spent starting tablet: real 0.021s user 0.008s sys 0.002s
I20251023 08:00:21.500152 22167 tablet_bootstrap.cc:492] T 1d1e3ddac9204211924d2187d73ecd72 P 9927a56797194391a4c98a02c10f6f58: Bootstrap starting.
I20251023 08:00:21.500672 22169 ts_tablet_manager.cc:1403] T ec26529ef6c64b259b8428285a2ad427 P 49d13a11243a439581313cbf2389dea7: Time spent bootstrapping tablet: real 0.118s user 0.016s sys 0.004s
I20251023 08:00:21.494869 22170 tablet_bootstrap.cc:654] T ec26529ef6c64b259b8428285a2ad427 P c51023bde9f346c1af16edaf4c858f98: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:21.511324 22167 tablet_bootstrap.cc:654] T 1d1e3ddac9204211924d2187d73ecd72 P 9927a56797194391a4c98a02c10f6f58: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:21.516551 22169 raft_consensus.cc:359] T ec26529ef6c64b259b8428285a2ad427 P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:21.517346 22169 raft_consensus.cc:385] T ec26529ef6c64b259b8428285a2ad427 P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:21.517683 22169 raft_consensus.cc:740] T ec26529ef6c64b259b8428285a2ad427 P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49d13a11243a439581313cbf2389dea7, State: Initialized, Role: FOLLOWER
I20251023 08:00:21.518599 22170 tablet_bootstrap.cc:492] T ec26529ef6c64b259b8428285a2ad427 P c51023bde9f346c1af16edaf4c858f98: No bootstrap required, opened a new log
I20251023 08:00:21.518453 22169 consensus_queue.cc:260] T ec26529ef6c64b259b8428285a2ad427 P 49d13a11243a439581313cbf2389dea7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:21.519073 22170 ts_tablet_manager.cc:1403] T ec26529ef6c64b259b8428285a2ad427 P c51023bde9f346c1af16edaf4c858f98: Time spent bootstrapping tablet: real 0.033s user 0.006s sys 0.006s
I20251023 08:00:21.519114 22167 tablet_bootstrap.cc:492] T 1d1e3ddac9204211924d2187d73ecd72 P 9927a56797194391a4c98a02c10f6f58: No bootstrap required, opened a new log
I20251023 08:00:21.519711 22167 ts_tablet_manager.cc:1403] T 1d1e3ddac9204211924d2187d73ecd72 P 9927a56797194391a4c98a02c10f6f58: Time spent bootstrapping tablet: real 0.020s user 0.011s sys 0.002s
I20251023 08:00:21.521054 22169 ts_tablet_manager.cc:1434] T ec26529ef6c64b259b8428285a2ad427 P 49d13a11243a439581313cbf2389dea7: Time spent starting tablet: real 0.015s user 0.004s sys 0.000s
I20251023 08:00:21.522439 22169 tablet_bootstrap.cc:492] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P 49d13a11243a439581313cbf2389dea7: Bootstrap starting.
I20251023 08:00:21.522076 22170 raft_consensus.cc:359] T ec26529ef6c64b259b8428285a2ad427 P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:21.522912 22170 raft_consensus.cc:385] T ec26529ef6c64b259b8428285a2ad427 P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:21.522893 22167 raft_consensus.cc:359] T 1d1e3ddac9204211924d2187d73ecd72 P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:21.523463 22170 raft_consensus.cc:740] T ec26529ef6c64b259b8428285a2ad427 P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51023bde9f346c1af16edaf4c858f98, State: Initialized, Role: FOLLOWER
I20251023 08:00:21.523766 22167 raft_consensus.cc:385] T 1d1e3ddac9204211924d2187d73ecd72 P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:21.524230 22167 raft_consensus.cc:740] T 1d1e3ddac9204211924d2187d73ecd72 P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9927a56797194391a4c98a02c10f6f58, State: Initialized, Role: FOLLOWER
I20251023 08:00:21.524238 22170 consensus_queue.cc:260] T ec26529ef6c64b259b8428285a2ad427 P c51023bde9f346c1af16edaf4c858f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:21.525825 22167 consensus_queue.cc:260] T 1d1e3ddac9204211924d2187d73ecd72 P 9927a56797194391a4c98a02c10f6f58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:21.526929 22170 ts_tablet_manager.cc:1434] T ec26529ef6c64b259b8428285a2ad427 P c51023bde9f346c1af16edaf4c858f98: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20251023 08:00:21.528482 22167 ts_tablet_manager.cc:1434] T 1d1e3ddac9204211924d2187d73ecd72 P 9927a56797194391a4c98a02c10f6f58: Time spent starting tablet: real 0.008s user 0.005s sys 0.000s
I20251023 08:00:21.528759 22170 tablet_bootstrap.cc:492] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P c51023bde9f346c1af16edaf4c858f98: Bootstrap starting.
I20251023 08:00:21.529656 22167 tablet_bootstrap.cc:492] T 9cd5e272db7a47c2b5f84af9bf661b1d P 9927a56797194391a4c98a02c10f6f58: Bootstrap starting.
I20251023 08:00:21.530625 22169 tablet_bootstrap.cc:654] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P 49d13a11243a439581313cbf2389dea7: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:21.535605 22170 tablet_bootstrap.cc:654] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P c51023bde9f346c1af16edaf4c858f98: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:21.544215 22167 tablet_bootstrap.cc:654] T 9cd5e272db7a47c2b5f84af9bf661b1d P 9927a56797194391a4c98a02c10f6f58: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:21.552229 22169 tablet_bootstrap.cc:492] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P 49d13a11243a439581313cbf2389dea7: No bootstrap required, opened a new log
I20251023 08:00:21.552970 22169 ts_tablet_manager.cc:1403] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P 49d13a11243a439581313cbf2389dea7: Time spent bootstrapping tablet: real 0.031s user 0.017s sys 0.009s
I20251023 08:00:21.557097 22169 raft_consensus.cc:359] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:21.558234 22169 raft_consensus.cc:385] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:21.558668 22169 raft_consensus.cc:740] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49d13a11243a439581313cbf2389dea7, State: Initialized, Role: FOLLOWER
W20251023 08:00:21.562783 21826 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20251023 08:00:21.559793 22169 consensus_queue.cc:260] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P 49d13a11243a439581313cbf2389dea7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:21.565876 22144 raft_consensus.cc:493] T ec26529ef6c64b259b8428285a2ad427 P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 08:00:21.566586 22144 raft_consensus.cc:515] T ec26529ef6c64b259b8428285a2ad427 P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:21.569864 22144 leader_election.cc:290] T ec26529ef6c64b259b8428285a2ad427 P 49d13a11243a439581313cbf2389dea7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9927a56797194391a4c98a02c10f6f58 (127.16.126.1:43563), c51023bde9f346c1af16edaf4c858f98 (127.16.126.3:36947)
I20251023 08:00:21.572125 22169 ts_tablet_manager.cc:1434] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P 49d13a11243a439581313cbf2389dea7: Time spent starting tablet: real 0.019s user 0.011s sys 0.001s
I20251023 08:00:21.571878 21878 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec26529ef6c64b259b8428285a2ad427" candidate_uuid: "49d13a11243a439581313cbf2389dea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9927a56797194391a4c98a02c10f6f58" is_pre_election: true
I20251023 08:00:21.573796 22029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec26529ef6c64b259b8428285a2ad427" candidate_uuid: "49d13a11243a439581313cbf2389dea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51023bde9f346c1af16edaf4c858f98" is_pre_election: true
W20251023 08:00:21.574247 21920 leader_election.cc:343] T ec26529ef6c64b259b8428285a2ad427 P 49d13a11243a439581313cbf2389dea7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9927a56797194391a4c98a02c10f6f58 (127.16.126.1:43563): Illegal state: must be running to vote when last-logged opid is not known
I20251023 08:00:21.574572 22029 raft_consensus.cc:2468] T ec26529ef6c64b259b8428285a2ad427 P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49d13a11243a439581313cbf2389dea7 in term 0.
I20251023 08:00:21.575865 22169 tablet_bootstrap.cc:492] T 580a58e30dcb430aaf3b33473a277984 P 49d13a11243a439581313cbf2389dea7: Bootstrap starting.
I20251023 08:00:21.575961 21921 leader_election.cc:304] T ec26529ef6c64b259b8428285a2ad427 P 49d13a11243a439581313cbf2389dea7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 49d13a11243a439581313cbf2389dea7, c51023bde9f346c1af16edaf4c858f98; no voters: 9927a56797194391a4c98a02c10f6f58
I20251023 08:00:21.578168 22144 raft_consensus.cc:2804] T ec26529ef6c64b259b8428285a2ad427 P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 08:00:21.578724 22144 raft_consensus.cc:493] T ec26529ef6c64b259b8428285a2ad427 P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 08:00:21.579175 22144 raft_consensus.cc:3060] T ec26529ef6c64b259b8428285a2ad427 P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:21.593611 22169 tablet_bootstrap.cc:654] T 580a58e30dcb430aaf3b33473a277984 P 49d13a11243a439581313cbf2389dea7: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:21.613665 22144 raft_consensus.cc:515] T ec26529ef6c64b259b8428285a2ad427 P 49d13a11243a439581313cbf2389dea7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:21.614333 22167 tablet_bootstrap.cc:492] T 9cd5e272db7a47c2b5f84af9bf661b1d P 9927a56797194391a4c98a02c10f6f58: No bootstrap required, opened a new log
I20251023 08:00:21.615142 22167 ts_tablet_manager.cc:1403] T 9cd5e272db7a47c2b5f84af9bf661b1d P 9927a56797194391a4c98a02c10f6f58: Time spent bootstrapping tablet: real 0.086s user 0.044s sys 0.027s
I20251023 08:00:21.617019 21878 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec26529ef6c64b259b8428285a2ad427" candidate_uuid: "49d13a11243a439581313cbf2389dea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9927a56797194391a4c98a02c10f6f58"
W20251023 08:00:21.618815 21920 leader_election.cc:343] T ec26529ef6c64b259b8428285a2ad427 P 49d13a11243a439581313cbf2389dea7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9927a56797194391a4c98a02c10f6f58 (127.16.126.1:43563): Illegal state: must be running to vote when last-logged opid is not known
I20251023 08:00:21.622202 22169 tablet_bootstrap.cc:492] T 580a58e30dcb430aaf3b33473a277984 P 49d13a11243a439581313cbf2389dea7: No bootstrap required, opened a new log
I20251023 08:00:21.621980 22167 raft_consensus.cc:359] T 9cd5e272db7a47c2b5f84af9bf661b1d P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:21.622888 22169 ts_tablet_manager.cc:1403] T 580a58e30dcb430aaf3b33473a277984 P 49d13a11243a439581313cbf2389dea7: Time spent bootstrapping tablet: real 0.047s user 0.018s sys 0.012s
I20251023 08:00:21.623173 22167 raft_consensus.cc:385] T 9cd5e272db7a47c2b5f84af9bf661b1d P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:21.624954 22167 raft_consensus.cc:740] T 9cd5e272db7a47c2b5f84af9bf661b1d P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9927a56797194391a4c98a02c10f6f58, State: Initialized, Role: FOLLOWER
I20251023 08:00:21.625993 22167 consensus_queue.cc:260] T 9cd5e272db7a47c2b5f84af9bf661b1d P 9927a56797194391a4c98a02c10f6f58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:21.628175 22169 raft_consensus.cc:359] T 580a58e30dcb430aaf3b33473a277984 P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:21.629138 22169 raft_consensus.cc:385] T 580a58e30dcb430aaf3b33473a277984 P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:21.629516 22169 raft_consensus.cc:740] T 580a58e30dcb430aaf3b33473a277984 P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49d13a11243a439581313cbf2389dea7, State: Initialized, Role: FOLLOWER
I20251023 08:00:21.629648 22167 ts_tablet_manager.cc:1434] T 9cd5e272db7a47c2b5f84af9bf661b1d P 9927a56797194391a4c98a02c10f6f58: Time spent starting tablet: real 0.014s user 0.012s sys 0.000s
I20251023 08:00:21.622999 22029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec26529ef6c64b259b8428285a2ad427" candidate_uuid: "49d13a11243a439581313cbf2389dea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51023bde9f346c1af16edaf4c858f98"
I20251023 08:00:21.630844 22029 raft_consensus.cc:3060] T ec26529ef6c64b259b8428285a2ad427 P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:21.631187 22167 tablet_bootstrap.cc:492] T 580a58e30dcb430aaf3b33473a277984 P 9927a56797194391a4c98a02c10f6f58: Bootstrap starting.
I20251023 08:00:21.620002 22144 leader_election.cc:290] T ec26529ef6c64b259b8428285a2ad427 P 49d13a11243a439581313cbf2389dea7 [CANDIDATE]: Term 1 election: Requested vote from peers 9927a56797194391a4c98a02c10f6f58 (127.16.126.1:43563), c51023bde9f346c1af16edaf4c858f98 (127.16.126.3:36947)
I20251023 08:00:21.636072 22169 consensus_queue.cc:260] T 580a58e30dcb430aaf3b33473a277984 P 49d13a11243a439581313cbf2389dea7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:21.639668 22169 ts_tablet_manager.cc:1434] T 580a58e30dcb430aaf3b33473a277984 P 49d13a11243a439581313cbf2389dea7: Time spent starting tablet: real 0.015s user 0.006s sys 0.000s
I20251023 08:00:21.640904 22169 tablet_bootstrap.cc:492] T cc63d5c82e054028bd3c0cfe4599d490 P 49d13a11243a439581313cbf2389dea7: Bootstrap starting.
I20251023 08:00:21.641007 22167 tablet_bootstrap.cc:654] T 580a58e30dcb430aaf3b33473a277984 P 9927a56797194391a4c98a02c10f6f58: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:21.648020 22169 tablet_bootstrap.cc:654] T cc63d5c82e054028bd3c0cfe4599d490 P 49d13a11243a439581313cbf2389dea7: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:21.654567 22167 tablet_bootstrap.cc:492] T 580a58e30dcb430aaf3b33473a277984 P 9927a56797194391a4c98a02c10f6f58: No bootstrap required, opened a new log
I20251023 08:00:21.655280 22167 ts_tablet_manager.cc:1403] T 580a58e30dcb430aaf3b33473a277984 P 9927a56797194391a4c98a02c10f6f58: Time spent bootstrapping tablet: real 0.024s user 0.019s sys 0.003s
I20251023 08:00:21.659049 22167 raft_consensus.cc:359] T 580a58e30dcb430aaf3b33473a277984 P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:21.660064 22167 raft_consensus.cc:385] T 580a58e30dcb430aaf3b33473a277984 P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:21.660468 22167 raft_consensus.cc:740] T 580a58e30dcb430aaf3b33473a277984 P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9927a56797194391a4c98a02c10f6f58, State: Initialized, Role: FOLLOWER
I20251023 08:00:21.661504 22167 consensus_queue.cc:260] T 580a58e30dcb430aaf3b33473a277984 P 9927a56797194391a4c98a02c10f6f58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:21.665081 22167 ts_tablet_manager.cc:1434] T 580a58e30dcb430aaf3b33473a277984 P 9927a56797194391a4c98a02c10f6f58: Time spent starting tablet: real 0.009s user 0.008s sys 0.000s
I20251023 08:00:21.666555 22167 tablet_bootstrap.cc:492] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P 9927a56797194391a4c98a02c10f6f58: Bootstrap starting.
I20251023 08:00:21.675736 22167 tablet_bootstrap.cc:654] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P 9927a56797194391a4c98a02c10f6f58: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:21.677810 22170 tablet_bootstrap.cc:492] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P c51023bde9f346c1af16edaf4c858f98: No bootstrap required, opened a new log
I20251023 08:00:21.681012 22170 ts_tablet_manager.cc:1403] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P c51023bde9f346c1af16edaf4c858f98: Time spent bootstrapping tablet: real 0.152s user 0.069s sys 0.077s
I20251023 08:00:21.684213 22170 raft_consensus.cc:359] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:21.685048 22170 raft_consensus.cc:385] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:21.685413 22170 raft_consensus.cc:740] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51023bde9f346c1af16edaf4c858f98, State: Initialized, Role: FOLLOWER
I20251023 08:00:21.680225 22029 raft_consensus.cc:2468] T ec26529ef6c64b259b8428285a2ad427 P c51023bde9f346c1af16edaf4c858f98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49d13a11243a439581313cbf2389dea7 in term 1.
I20251023 08:00:21.686851 21921 leader_election.cc:304] T ec26529ef6c64b259b8428285a2ad427 P 49d13a11243a439581313cbf2389dea7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 49d13a11243a439581313cbf2389dea7, c51023bde9f346c1af16edaf4c858f98; no voters: 9927a56797194391a4c98a02c10f6f58
I20251023 08:00:21.686851 22170 consensus_queue.cc:260] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P c51023bde9f346c1af16edaf4c858f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:21.688161 22144 raft_consensus.cc:2804] T ec26529ef6c64b259b8428285a2ad427 P 49d13a11243a439581313cbf2389dea7 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 08:00:21.688881 22144 raft_consensus.cc:697] T ec26529ef6c64b259b8428285a2ad427 P 49d13a11243a439581313cbf2389dea7 [term 1 LEADER]: Becoming Leader. State: Replica: 49d13a11243a439581313cbf2389dea7, State: Running, Role: LEADER
I20251023 08:00:21.690084 22169 tablet_bootstrap.cc:492] T cc63d5c82e054028bd3c0cfe4599d490 P 49d13a11243a439581313cbf2389dea7: No bootstrap required, opened a new log
I20251023 08:00:21.689821 22144 consensus_queue.cc:237] T ec26529ef6c64b259b8428285a2ad427 P 49d13a11243a439581313cbf2389dea7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:21.690802 22169 ts_tablet_manager.cc:1403] T cc63d5c82e054028bd3c0cfe4599d490 P 49d13a11243a439581313cbf2389dea7: Time spent bootstrapping tablet: real 0.050s user 0.011s sys 0.032s
I20251023 08:00:21.691116 22170 ts_tablet_manager.cc:1434] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P c51023bde9f346c1af16edaf4c858f98: Time spent starting tablet: real 0.010s user 0.007s sys 0.000s
I20251023 08:00:21.692404 22170 tablet_bootstrap.cc:492] T 9cd5e272db7a47c2b5f84af9bf661b1d P c51023bde9f346c1af16edaf4c858f98: Bootstrap starting.
I20251023 08:00:21.694116 22169 raft_consensus.cc:359] T cc63d5c82e054028bd3c0cfe4599d490 P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:21.694905 22169 raft_consensus.cc:385] T cc63d5c82e054028bd3c0cfe4599d490 P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:21.695269 22169 raft_consensus.cc:740] T cc63d5c82e054028bd3c0cfe4599d490 P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49d13a11243a439581313cbf2389dea7, State: Initialized, Role: FOLLOWER
I20251023 08:00:21.695997 22169 consensus_queue.cc:260] T cc63d5c82e054028bd3c0cfe4599d490 P 49d13a11243a439581313cbf2389dea7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:21.698648 22169 ts_tablet_manager.cc:1434] T cc63d5c82e054028bd3c0cfe4599d490 P 49d13a11243a439581313cbf2389dea7: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20251023 08:00:21.699671 22169 tablet_bootstrap.cc:492] T 9cd5e272db7a47c2b5f84af9bf661b1d P 49d13a11243a439581313cbf2389dea7: Bootstrap starting.
I20251023 08:00:21.702672 22170 tablet_bootstrap.cc:654] T 9cd5e272db7a47c2b5f84af9bf661b1d P c51023bde9f346c1af16edaf4c858f98: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:21.707095 22169 tablet_bootstrap.cc:654] T 9cd5e272db7a47c2b5f84af9bf661b1d P 49d13a11243a439581313cbf2389dea7: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:21.711253 22167 tablet_bootstrap.cc:492] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P 9927a56797194391a4c98a02c10f6f58: No bootstrap required, opened a new log
I20251023 08:00:21.712082 22167 ts_tablet_manager.cc:1403] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P 9927a56797194391a4c98a02c10f6f58: Time spent bootstrapping tablet: real 0.046s user 0.019s sys 0.014s
I20251023 08:00:21.715557 22170 tablet_bootstrap.cc:492] T 9cd5e272db7a47c2b5f84af9bf661b1d P c51023bde9f346c1af16edaf4c858f98: No bootstrap required, opened a new log
I20251023 08:00:21.716182 22170 ts_tablet_manager.cc:1403] T 9cd5e272db7a47c2b5f84af9bf661b1d P c51023bde9f346c1af16edaf4c858f98: Time spent bootstrapping tablet: real 0.024s user 0.015s sys 0.003s
I20251023 08:00:21.715430 22167 raft_consensus.cc:359] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:21.717780 22167 raft_consensus.cc:385] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:21.716651 21777 catalog_manager.cc:5649] T ec26529ef6c64b259b8428285a2ad427 P 49d13a11243a439581313cbf2389dea7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 49d13a11243a439581313cbf2389dea7 (127.16.126.2). New cstate: current_term: 1 leader_uuid: "49d13a11243a439581313cbf2389dea7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } health_report { overall_health: UNKNOWN } } }
I20251023 08:00:21.718449 22167 raft_consensus.cc:740] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9927a56797194391a4c98a02c10f6f58, State: Initialized, Role: FOLLOWER
I20251023 08:00:21.719235 22170 raft_consensus.cc:359] T 9cd5e272db7a47c2b5f84af9bf661b1d P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:21.719292 22167 consensus_queue.cc:260] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P 9927a56797194391a4c98a02c10f6f58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:21.720116 22170 raft_consensus.cc:385] T 9cd5e272db7a47c2b5f84af9bf661b1d P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:21.720546 22170 raft_consensus.cc:740] T 9cd5e272db7a47c2b5f84af9bf661b1d P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51023bde9f346c1af16edaf4c858f98, State: Initialized, Role: FOLLOWER
I20251023 08:00:21.721385 22170 consensus_queue.cc:260] T 9cd5e272db7a47c2b5f84af9bf661b1d P c51023bde9f346c1af16edaf4c858f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:21.722601 22167 ts_tablet_manager.cc:1434] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P 9927a56797194391a4c98a02c10f6f58: Time spent starting tablet: real 0.010s user 0.008s sys 0.000s
I20251023 08:00:21.723680 22167 tablet_bootstrap.cc:492] T 095923a5d18140f2bd7a676fc516acdc P 9927a56797194391a4c98a02c10f6f58: Bootstrap starting.
I20251023 08:00:21.723910 22170 ts_tablet_manager.cc:1434] T 9cd5e272db7a47c2b5f84af9bf661b1d P c51023bde9f346c1af16edaf4c858f98: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20251023 08:00:21.724957 22170 tablet_bootstrap.cc:492] T cc63d5c82e054028bd3c0cfe4599d490 P c51023bde9f346c1af16edaf4c858f98: Bootstrap starting.
I20251023 08:00:21.734689 22169 tablet_bootstrap.cc:492] T 9cd5e272db7a47c2b5f84af9bf661b1d P 49d13a11243a439581313cbf2389dea7: No bootstrap required, opened a new log
I20251023 08:00:21.735349 22169 ts_tablet_manager.cc:1403] T 9cd5e272db7a47c2b5f84af9bf661b1d P 49d13a11243a439581313cbf2389dea7: Time spent bootstrapping tablet: real 0.036s user 0.025s sys 0.006s
I20251023 08:00:21.742619 22170 tablet_bootstrap.cc:654] T cc63d5c82e054028bd3c0cfe4599d490 P c51023bde9f346c1af16edaf4c858f98: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:21.746062 22169 raft_consensus.cc:359] T 9cd5e272db7a47c2b5f84af9bf661b1d P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:21.746930 22169 raft_consensus.cc:385] T 9cd5e272db7a47c2b5f84af9bf661b1d P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:21.747246 22169 raft_consensus.cc:740] T 9cd5e272db7a47c2b5f84af9bf661b1d P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49d13a11243a439581313cbf2389dea7, State: Initialized, Role: FOLLOWER
I20251023 08:00:21.747438 22167 tablet_bootstrap.cc:654] T 095923a5d18140f2bd7a676fc516acdc P 9927a56797194391a4c98a02c10f6f58: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:21.748025 22169 consensus_queue.cc:260] T 9cd5e272db7a47c2b5f84af9bf661b1d P 49d13a11243a439581313cbf2389dea7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:21.750741 22169 ts_tablet_manager.cc:1434] T 9cd5e272db7a47c2b5f84af9bf661b1d P 49d13a11243a439581313cbf2389dea7: Time spent starting tablet: real 0.015s user 0.002s sys 0.007s
I20251023 08:00:21.758471 22170 tablet_bootstrap.cc:492] T cc63d5c82e054028bd3c0cfe4599d490 P c51023bde9f346c1af16edaf4c858f98: No bootstrap required, opened a new log
I20251023 08:00:21.759424 22170 ts_tablet_manager.cc:1403] T cc63d5c82e054028bd3c0cfe4599d490 P c51023bde9f346c1af16edaf4c858f98: Time spent bootstrapping tablet: real 0.035s user 0.017s sys 0.006s
I20251023 08:00:21.761301 22169 tablet_bootstrap.cc:492] T 1d1e3ddac9204211924d2187d73ecd72 P 49d13a11243a439581313cbf2389dea7: Bootstrap starting.
I20251023 08:00:21.764652 22167 tablet_bootstrap.cc:492] T 095923a5d18140f2bd7a676fc516acdc P 9927a56797194391a4c98a02c10f6f58: No bootstrap required, opened a new log
I20251023 08:00:21.765244 22167 ts_tablet_manager.cc:1403] T 095923a5d18140f2bd7a676fc516acdc P 9927a56797194391a4c98a02c10f6f58: Time spent bootstrapping tablet: real 0.042s user 0.017s sys 0.007s
I20251023 08:00:21.765579 22170 raft_consensus.cc:359] T cc63d5c82e054028bd3c0cfe4599d490 P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:21.766498 22170 raft_consensus.cc:385] T cc63d5c82e054028bd3c0cfe4599d490 P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:21.766842 22170 raft_consensus.cc:740] T cc63d5c82e054028bd3c0cfe4599d490 P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51023bde9f346c1af16edaf4c858f98, State: Initialized, Role: FOLLOWER
I20251023 08:00:21.767701 22170 consensus_queue.cc:260] T cc63d5c82e054028bd3c0cfe4599d490 P c51023bde9f346c1af16edaf4c858f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:21.768366 22167 raft_consensus.cc:359] T 095923a5d18140f2bd7a676fc516acdc P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:21.769178 22167 raft_consensus.cc:385] T 095923a5d18140f2bd7a676fc516acdc P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:21.769515 22167 raft_consensus.cc:740] T 095923a5d18140f2bd7a676fc516acdc P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9927a56797194391a4c98a02c10f6f58, State: Initialized, Role: FOLLOWER
I20251023 08:00:21.770678 22170 ts_tablet_manager.cc:1434] T cc63d5c82e054028bd3c0cfe4599d490 P c51023bde9f346c1af16edaf4c858f98: Time spent starting tablet: real 0.011s user 0.006s sys 0.001s
I20251023 08:00:21.770251 22167 consensus_queue.cc:260] T 095923a5d18140f2bd7a676fc516acdc P 9927a56797194391a4c98a02c10f6f58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:21.772022 22170 tablet_bootstrap.cc:492] T 580a58e30dcb430aaf3b33473a277984 P c51023bde9f346c1af16edaf4c858f98: Bootstrap starting.
I20251023 08:00:21.772723 22169 tablet_bootstrap.cc:654] T 1d1e3ddac9204211924d2187d73ecd72 P 49d13a11243a439581313cbf2389dea7: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:21.776347 22167 ts_tablet_manager.cc:1434] T 095923a5d18140f2bd7a676fc516acdc P 9927a56797194391a4c98a02c10f6f58: Time spent starting tablet: real 0.011s user 0.002s sys 0.004s
I20251023 08:00:21.777594 22167 tablet_bootstrap.cc:492] T cc63d5c82e054028bd3c0cfe4599d490 P 9927a56797194391a4c98a02c10f6f58: Bootstrap starting.
I20251023 08:00:21.778504 22153 raft_consensus.cc:493] T 1d1e3ddac9204211924d2187d73ecd72 P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 08:00:21.779563 22170 tablet_bootstrap.cc:654] T 580a58e30dcb430aaf3b33473a277984 P c51023bde9f346c1af16edaf4c858f98: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:21.779219 22153 raft_consensus.cc:515] T 1d1e3ddac9204211924d2187d73ecd72 P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:21.784118 22029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1d1e3ddac9204211924d2187d73ecd72" candidate_uuid: "9927a56797194391a4c98a02c10f6f58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51023bde9f346c1af16edaf4c858f98" is_pre_election: true
I20251023 08:00:21.784978 22167 tablet_bootstrap.cc:654] T cc63d5c82e054028bd3c0cfe4599d490 P 9927a56797194391a4c98a02c10f6f58: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:21.784955 21954 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1d1e3ddac9204211924d2187d73ecd72" candidate_uuid: "9927a56797194391a4c98a02c10f6f58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49d13a11243a439581313cbf2389dea7" is_pre_election: true
W20251023 08:00:21.785670 21846 leader_election.cc:343] T 1d1e3ddac9204211924d2187d73ecd72 P 9927a56797194391a4c98a02c10f6f58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c51023bde9f346c1af16edaf4c858f98 (127.16.126.3:36947): Illegal state: must be running to vote when last-logged opid is not known
W20251023 08:00:21.788012 21843 leader_election.cc:343] T 1d1e3ddac9204211924d2187d73ecd72 P 9927a56797194391a4c98a02c10f6f58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 49d13a11243a439581313cbf2389dea7 (127.16.126.2:36187): Illegal state: must be running to vote when last-logged opid is not known
I20251023 08:00:21.785538 22153 leader_election.cc:290] T 1d1e3ddac9204211924d2187d73ecd72 P 9927a56797194391a4c98a02c10f6f58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 49d13a11243a439581313cbf2389dea7 (127.16.126.2:36187), c51023bde9f346c1af16edaf4c858f98 (127.16.126.3:36947)
I20251023 08:00:21.791937 21843 leader_election.cc:304] T 1d1e3ddac9204211924d2187d73ecd72 P 9927a56797194391a4c98a02c10f6f58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9927a56797194391a4c98a02c10f6f58; no voters: 49d13a11243a439581313cbf2389dea7, c51023bde9f346c1af16edaf4c858f98
I20251023 08:00:21.793337 22153 raft_consensus.cc:2749] T 1d1e3ddac9204211924d2187d73ecd72 P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 08:00:21.793555 22170 tablet_bootstrap.cc:492] T 580a58e30dcb430aaf3b33473a277984 P c51023bde9f346c1af16edaf4c858f98: No bootstrap required, opened a new log
I20251023 08:00:21.794432 22170 ts_tablet_manager.cc:1403] T 580a58e30dcb430aaf3b33473a277984 P c51023bde9f346c1af16edaf4c858f98: Time spent bootstrapping tablet: real 0.023s user 0.013s sys 0.007s
I20251023 08:00:21.797785 22170 raft_consensus.cc:359] T 580a58e30dcb430aaf3b33473a277984 P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:21.798265 22167 tablet_bootstrap.cc:492] T cc63d5c82e054028bd3c0cfe4599d490 P 9927a56797194391a4c98a02c10f6f58: No bootstrap required, opened a new log
I20251023 08:00:21.798810 22170 raft_consensus.cc:385] T 580a58e30dcb430aaf3b33473a277984 P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:21.799078 22167 ts_tablet_manager.cc:1403] T cc63d5c82e054028bd3c0cfe4599d490 P 9927a56797194391a4c98a02c10f6f58: Time spent bootstrapping tablet: real 0.022s user 0.013s sys 0.007s
I20251023 08:00:21.799264 22170 raft_consensus.cc:740] T 580a58e30dcb430aaf3b33473a277984 P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51023bde9f346c1af16edaf4c858f98, State: Initialized, Role: FOLLOWER
I20251023 08:00:21.800204 22170 consensus_queue.cc:260] T 580a58e30dcb430aaf3b33473a277984 P c51023bde9f346c1af16edaf4c858f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:21.802382 22144 raft_consensus.cc:493] T cc63d5c82e054028bd3c0cfe4599d490 P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 08:00:21.802989 22170 ts_tablet_manager.cc:1434] T 580a58e30dcb430aaf3b33473a277984 P c51023bde9f346c1af16edaf4c858f98: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20251023 08:00:21.803118 22144 raft_consensus.cc:515] T cc63d5c82e054028bd3c0cfe4599d490 P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:21.804311 22170 tablet_bootstrap.cc:492] T 0274899ee0b94ca6ad23688cfc1ffeb5 P c51023bde9f346c1af16edaf4c858f98: Bootstrap starting.
I20251023 08:00:21.805794 22167 raft_consensus.cc:359] T cc63d5c82e054028bd3c0cfe4599d490 P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:21.806653 22167 raft_consensus.cc:385] T cc63d5c82e054028bd3c0cfe4599d490 P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:21.806962 22167 raft_consensus.cc:740] T cc63d5c82e054028bd3c0cfe4599d490 P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9927a56797194391a4c98a02c10f6f58, State: Initialized, Role: FOLLOWER
I20251023 08:00:21.808724 22029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cc63d5c82e054028bd3c0cfe4599d490" candidate_uuid: "49d13a11243a439581313cbf2389dea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51023bde9f346c1af16edaf4c858f98" is_pre_election: true
I20251023 08:00:21.807691 22167 consensus_queue.cc:260] T cc63d5c82e054028bd3c0cfe4599d490 P 9927a56797194391a4c98a02c10f6f58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:21.809731 22029 raft_consensus.cc:2468] T cc63d5c82e054028bd3c0cfe4599d490 P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49d13a11243a439581313cbf2389dea7 in term 0.
I20251023 08:00:21.810240 22168 raft_consensus.cc:493] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 08:00:21.810756 22168 raft_consensus.cc:515] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:21.811908 21921 leader_election.cc:304] T cc63d5c82e054028bd3c0cfe4599d490 P 49d13a11243a439581313cbf2389dea7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49d13a11243a439581313cbf2389dea7, c51023bde9f346c1af16edaf4c858f98; no voters:
I20251023 08:00:21.812342 22170 tablet_bootstrap.cc:654] T 0274899ee0b94ca6ad23688cfc1ffeb5 P c51023bde9f346c1af16edaf4c858f98: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:21.812906 22168 leader_election.cc:290] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 9927a56797194391a4c98a02c10f6f58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 49d13a11243a439581313cbf2389dea7 (127.16.126.2:36187), c51023bde9f346c1af16edaf4c858f98 (127.16.126.3:36947)
I20251023 08:00:21.813277 22173 raft_consensus.cc:2804] T cc63d5c82e054028bd3c0cfe4599d490 P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 08:00:21.813776 22173 raft_consensus.cc:493] T cc63d5c82e054028bd3c0cfe4599d490 P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 08:00:21.814180 22173 raft_consensus.cc:3060] T cc63d5c82e054028bd3c0cfe4599d490 P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:21.815578 22029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0274899ee0b94ca6ad23688cfc1ffeb5" candidate_uuid: "9927a56797194391a4c98a02c10f6f58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51023bde9f346c1af16edaf4c858f98" is_pre_election: true
I20251023 08:00:21.815997 22167 ts_tablet_manager.cc:1434] T cc63d5c82e054028bd3c0cfe4599d490 P 9927a56797194391a4c98a02c10f6f58: Time spent starting tablet: real 0.016s user 0.005s sys 0.002s
I20251023 08:00:21.817536 22144 leader_election.cc:290] T cc63d5c82e054028bd3c0cfe4599d490 P 49d13a11243a439581313cbf2389dea7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9927a56797194391a4c98a02c10f6f58 (127.16.126.1:43563), c51023bde9f346c1af16edaf4c858f98 (127.16.126.3:36947)
I20251023 08:00:21.817600 22167 tablet_bootstrap.cc:492] T ec26529ef6c64b259b8428285a2ad427 P 9927a56797194391a4c98a02c10f6f58: Bootstrap starting.
W20251023 08:00:21.818207 21846 leader_election.cc:343] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 9927a56797194391a4c98a02c10f6f58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c51023bde9f346c1af16edaf4c858f98 (127.16.126.3:36947): Illegal state: must be running to vote when last-logged opid is not known
I20251023 08:00:21.825569 22170 tablet_bootstrap.cc:492] T 0274899ee0b94ca6ad23688cfc1ffeb5 P c51023bde9f346c1af16edaf4c858f98: No bootstrap required, opened a new log
I20251023 08:00:21.826401 22170 ts_tablet_manager.cc:1403] T 0274899ee0b94ca6ad23688cfc1ffeb5 P c51023bde9f346c1af16edaf4c858f98: Time spent bootstrapping tablet: real 0.022s user 0.009s sys 0.010s
I20251023 08:00:21.826725 22167 tablet_bootstrap.cc:654] T ec26529ef6c64b259b8428285a2ad427 P 9927a56797194391a4c98a02c10f6f58: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:21.828451 22076 raft_consensus.cc:493] T 580a58e30dcb430aaf3b33473a277984 P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 08:00:21.828742 21954 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0274899ee0b94ca6ad23688cfc1ffeb5" candidate_uuid: "9927a56797194391a4c98a02c10f6f58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49d13a11243a439581313cbf2389dea7" is_pre_election: true
I20251023 08:00:21.829008 22076 raft_consensus.cc:515] T 580a58e30dcb430aaf3b33473a277984 P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:21.829701 22170 raft_consensus.cc:359] T 0274899ee0b94ca6ad23688cfc1ffeb5 P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:21.830768 22170 raft_consensus.cc:385] T 0274899ee0b94ca6ad23688cfc1ffeb5 P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:21.831143 22170 raft_consensus.cc:740] T 0274899ee0b94ca6ad23688cfc1ffeb5 P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51023bde9f346c1af16edaf4c858f98, State: Initialized, Role: FOLLOWER
I20251023 08:00:21.831369 22076 leader_election.cc:290] T 580a58e30dcb430aaf3b33473a277984 P c51023bde9f346c1af16edaf4c858f98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9927a56797194391a4c98a02c10f6f58 (127.16.126.1:43563), 49d13a11243a439581313cbf2389dea7 (127.16.126.2:36187)
I20251023 08:00:21.831691 21878 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cc63d5c82e054028bd3c0cfe4599d490" candidate_uuid: "49d13a11243a439581313cbf2389dea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9927a56797194391a4c98a02c10f6f58" is_pre_election: true
I20251023 08:00:21.832412 21878 raft_consensus.cc:2468] T cc63d5c82e054028bd3c0cfe4599d490 P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49d13a11243a439581313cbf2389dea7 in term 0.
I20251023 08:00:21.832141 22170 consensus_queue.cc:260] T 0274899ee0b94ca6ad23688cfc1ffeb5 P c51023bde9f346c1af16edaf4c858f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:21.834772 21954 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "580a58e30dcb430aaf3b33473a277984" candidate_uuid: "c51023bde9f346c1af16edaf4c858f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49d13a11243a439581313cbf2389dea7" is_pre_election: true
I20251023 08:00:21.835770 21954 raft_consensus.cc:2468] T 580a58e30dcb430aaf3b33473a277984 P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c51023bde9f346c1af16edaf4c858f98 in term 0.
I20251023 08:00:21.835963 22170 ts_tablet_manager.cc:1434] T 0274899ee0b94ca6ad23688cfc1ffeb5 P c51023bde9f346c1af16edaf4c858f98: Time spent starting tablet: real 0.009s user 0.007s sys 0.000s
I20251023 08:00:21.836781 22076 raft_consensus.cc:493] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 08:00:21.837419 21992 leader_election.cc:304] T 580a58e30dcb430aaf3b33473a277984 P c51023bde9f346c1af16edaf4c858f98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49d13a11243a439581313cbf2389dea7, c51023bde9f346c1af16edaf4c858f98; no voters:
I20251023 08:00:21.837322 22076 raft_consensus.cc:515] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:21.838770 22170 tablet_bootstrap.cc:492] T 095923a5d18140f2bd7a676fc516acdc P c51023bde9f346c1af16edaf4c858f98: Bootstrap starting.
I20251023 08:00:21.839512 22076 leader_election.cc:290] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P c51023bde9f346c1af16edaf4c858f98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9927a56797194391a4c98a02c10f6f58 (127.16.126.1:43563), 49d13a11243a439581313cbf2389dea7 (127.16.126.2:36187)
I20251023 08:00:21.840086 22167 tablet_bootstrap.cc:492] T ec26529ef6c64b259b8428285a2ad427 P 9927a56797194391a4c98a02c10f6f58: No bootstrap required, opened a new log
I20251023 08:00:21.840183 22076 raft_consensus.cc:2804] T 580a58e30dcb430aaf3b33473a277984 P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 08:00:21.840608 22167 ts_tablet_manager.cc:1403] T ec26529ef6c64b259b8428285a2ad427 P 9927a56797194391a4c98a02c10f6f58: Time spent bootstrapping tablet: real 0.023s user 0.010s sys 0.011s
I20251023 08:00:21.840692 22076 raft_consensus.cc:493] T 580a58e30dcb430aaf3b33473a277984 P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 08:00:21.841194 22076 raft_consensus.cc:3060] T 580a58e30dcb430aaf3b33473a277984 P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:21.843497 22167 raft_consensus.cc:359] T ec26529ef6c64b259b8428285a2ad427 P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:21.844215 22167 raft_consensus.cc:385] T ec26529ef6c64b259b8428285a2ad427 P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:21.844496 22167 raft_consensus.cc:740] T ec26529ef6c64b259b8428285a2ad427 P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9927a56797194391a4c98a02c10f6f58, State: Initialized, Role: FOLLOWER
I20251023 08:00:21.845224 22167 consensus_queue.cc:260] T ec26529ef6c64b259b8428285a2ad427 P 9927a56797194391a4c98a02c10f6f58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:21.845788 22170 tablet_bootstrap.cc:654] T 095923a5d18140f2bd7a676fc516acdc P c51023bde9f346c1af16edaf4c858f98: Neither blocks nor log segments found. Creating new log.
W20251023 08:00:21.847051 21843 leader_election.cc:343] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 9927a56797194391a4c98a02c10f6f58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 49d13a11243a439581313cbf2389dea7 (127.16.126.2:36187): Illegal state: must be running to vote when last-logged opid is not known
I20251023 08:00:21.847579 22167 ts_tablet_manager.cc:1434] T ec26529ef6c64b259b8428285a2ad427 P 9927a56797194391a4c98a02c10f6f58: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20251023 08:00:21.849517 22076 raft_consensus.cc:515] T 580a58e30dcb430aaf3b33473a277984 P c51023bde9f346c1af16edaf4c858f98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:21.850914 22170 tablet_bootstrap.cc:492] T 095923a5d18140f2bd7a676fc516acdc P c51023bde9f346c1af16edaf4c858f98: No bootstrap required, opened a new log
I20251023 08:00:21.852427 21843 leader_election.cc:304] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 9927a56797194391a4c98a02c10f6f58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9927a56797194391a4c98a02c10f6f58; no voters: 49d13a11243a439581313cbf2389dea7, c51023bde9f346c1af16edaf4c858f98
I20251023 08:00:21.853067 22170 ts_tablet_manager.cc:1403] T 095923a5d18140f2bd7a676fc516acdc P c51023bde9f346c1af16edaf4c858f98: Time spent bootstrapping tablet: real 0.016s user 0.007s sys 0.006s
I20251023 08:00:21.853263 22167 tablet_bootstrap.cc:492] T 992be711bf964771a0eae249e906e021 P 9927a56797194391a4c98a02c10f6f58: Bootstrap starting.
I20251023 08:00:21.853524 22153 raft_consensus.cc:2749] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251023 08:00:21.855993 21879 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "580a58e30dcb430aaf3b33473a277984" candidate_uuid: "c51023bde9f346c1af16edaf4c858f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9927a56797194391a4c98a02c10f6f58" is_pre_election: true
I20251023 08:00:21.851048 22173 raft_consensus.cc:515] T cc63d5c82e054028bd3c0cfe4599d490 P 49d13a11243a439581313cbf2389dea7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:21.856969 21879 raft_consensus.cc:2468] T 580a58e30dcb430aaf3b33473a277984 P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c51023bde9f346c1af16edaf4c858f98 in term 0.
I20251023 08:00:21.858814 22173 leader_election.cc:290] T cc63d5c82e054028bd3c0cfe4599d490 P 49d13a11243a439581313cbf2389dea7 [CANDIDATE]: Term 1 election: Requested vote from peers 9927a56797194391a4c98a02c10f6f58 (127.16.126.1:43563), c51023bde9f346c1af16edaf4c858f98 (127.16.126.3:36947)
I20251023 08:00:21.856403 22170 raft_consensus.cc:359] T 095923a5d18140f2bd7a676fc516acdc P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:21.860097 22170 raft_consensus.cc:385] T 095923a5d18140f2bd7a676fc516acdc P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:21.860083 22029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cc63d5c82e054028bd3c0cfe4599d490" candidate_uuid: "49d13a11243a439581313cbf2389dea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51023bde9f346c1af16edaf4c858f98"
I20251023 08:00:21.860766 22170 raft_consensus.cc:740] T 095923a5d18140f2bd7a676fc516acdc P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51023bde9f346c1af16edaf4c858f98, State: Initialized, Role: FOLLOWER
I20251023 08:00:21.860900 22029 raft_consensus.cc:3060] T cc63d5c82e054028bd3c0cfe4599d490 P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:21.861929 22170 consensus_queue.cc:260] T 095923a5d18140f2bd7a676fc516acdc P c51023bde9f346c1af16edaf4c858f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:21.864584 22167 tablet_bootstrap.cc:654] T 992be711bf964771a0eae249e906e021 P 9927a56797194391a4c98a02c10f6f58: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:21.864670 22170 ts_tablet_manager.cc:1434] T 095923a5d18140f2bd7a676fc516acdc P c51023bde9f346c1af16edaf4c858f98: Time spent starting tablet: real 0.011s user 0.006s sys 0.000s
I20251023 08:00:21.865767 22153 raft_consensus.cc:493] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 08:00:21.866037 22170 tablet_bootstrap.cc:492] T 1d1e3ddac9204211924d2187d73ecd72 P c51023bde9f346c1af16edaf4c858f98: Bootstrap starting.
I20251023 08:00:21.866288 22153 raft_consensus.cc:515] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:21.860127 21880 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "68421eae3c714c6ca0dffaa6c3d5f3f1" candidate_uuid: "c51023bde9f346c1af16edaf4c858f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9927a56797194391a4c98a02c10f6f58" is_pre_election: true
I20251023 08:00:21.868414 21880 raft_consensus.cc:2468] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c51023bde9f346c1af16edaf4c858f98 in term 0.
I20251023 08:00:21.869575 22153 leader_election.cc:290] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P 9927a56797194391a4c98a02c10f6f58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 49d13a11243a439581313cbf2389dea7 (127.16.126.2:36187), c51023bde9f346c1af16edaf4c858f98 (127.16.126.3:36947)
I20251023 08:00:21.873571 21880 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cc63d5c82e054028bd3c0cfe4599d490" candidate_uuid: "49d13a11243a439581313cbf2389dea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9927a56797194391a4c98a02c10f6f58"
I20251023 08:00:21.874305 21880 raft_consensus.cc:3060] T cc63d5c82e054028bd3c0cfe4599d490 P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:21.875008 22170 tablet_bootstrap.cc:654] T 1d1e3ddac9204211924d2187d73ecd72 P c51023bde9f346c1af16edaf4c858f98: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:21.874994 21954 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "68421eae3c714c6ca0dffaa6c3d5f3f1" candidate_uuid: "9927a56797194391a4c98a02c10f6f58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49d13a11243a439581313cbf2389dea7" is_pre_election: true
I20251023 08:00:21.875833 21954 raft_consensus.cc:2468] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9927a56797194391a4c98a02c10f6f58 in term 0.
I20251023 08:00:21.876895 22153 raft_consensus.cc:493] T 9cd5e272db7a47c2b5f84af9bf661b1d P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 08:00:21.877421 22153 raft_consensus.cc:515] T 9cd5e272db7a47c2b5f84af9bf661b1d P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:21.880146 22153 leader_election.cc:290] T 9cd5e272db7a47c2b5f84af9bf661b1d P 9927a56797194391a4c98a02c10f6f58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 49d13a11243a439581313cbf2389dea7 (127.16.126.2:36187), c51023bde9f346c1af16edaf4c858f98 (127.16.126.3:36947)
W20251023 08:00:21.882067 21992 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.126.2:36187, user_credentials={real_user=slave}} blocked reactor thread for 44773us
I20251023 08:00:21.883944 21954 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "68421eae3c714c6ca0dffaa6c3d5f3f1" candidate_uuid: "c51023bde9f346c1af16edaf4c858f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49d13a11243a439581313cbf2389dea7" is_pre_election: true
I20251023 08:00:21.884254 21880 raft_consensus.cc:2468] T cc63d5c82e054028bd3c0cfe4599d490 P 9927a56797194391a4c98a02c10f6f58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49d13a11243a439581313cbf2389dea7 in term 1.
I20251023 08:00:21.884619 21954 raft_consensus.cc:2468] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c51023bde9f346c1af16edaf4c858f98 in term 0.
I20251023 08:00:21.886744 22028 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "68421eae3c714c6ca0dffaa6c3d5f3f1" candidate_uuid: "9927a56797194391a4c98a02c10f6f58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51023bde9f346c1af16edaf4c858f98" is_pre_election: true
I20251023 08:00:21.887202 22027 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9cd5e272db7a47c2b5f84af9bf661b1d" candidate_uuid: "9927a56797194391a4c98a02c10f6f58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51023bde9f346c1af16edaf4c858f98" is_pre_election: true
I20251023 08:00:21.887410 22028 raft_consensus.cc:2468] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9927a56797194391a4c98a02c10f6f58 in term 0.
I20251023 08:00:21.888079 22027 raft_consensus.cc:2468] T 9cd5e272db7a47c2b5f84af9bf661b1d P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9927a56797194391a4c98a02c10f6f58 in term 0.
I20251023 08:00:21.888720 22076 leader_election.cc:290] T 580a58e30dcb430aaf3b33473a277984 P c51023bde9f346c1af16edaf4c858f98 [CANDIDATE]: Term 1 election: Requested vote from peers 9927a56797194391a4c98a02c10f6f58 (127.16.126.1:43563), 49d13a11243a439581313cbf2389dea7 (127.16.126.2:36187)
I20251023 08:00:21.890738 21846 leader_election.cc:304] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P 9927a56797194391a4c98a02c10f6f58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9927a56797194391a4c98a02c10f6f58, c51023bde9f346c1af16edaf4c858f98; no voters:
I20251023 08:00:21.891932 22153 raft_consensus.cc:2804] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 08:00:21.892426 22153 raft_consensus.cc:493] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 08:00:21.885150 22029 raft_consensus.cc:2468] T cc63d5c82e054028bd3c0cfe4599d490 P c51023bde9f346c1af16edaf4c858f98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49d13a11243a439581313cbf2389dea7 in term 1.
I20251023 08:00:21.892794 22153 raft_consensus.cc:3060] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:21.896113 21954 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9cd5e272db7a47c2b5f84af9bf661b1d" candidate_uuid: "9927a56797194391a4c98a02c10f6f58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49d13a11243a439581313cbf2389dea7" is_pre_election: true
I20251023 08:00:21.896560 22170 tablet_bootstrap.cc:492] T 1d1e3ddac9204211924d2187d73ecd72 P c51023bde9f346c1af16edaf4c858f98: No bootstrap required, opened a new log
I20251023 08:00:21.896889 21954 raft_consensus.cc:2468] T 9cd5e272db7a47c2b5f84af9bf661b1d P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9927a56797194391a4c98a02c10f6f58 in term 0.
I20251023 08:00:21.897517 22170 ts_tablet_manager.cc:1403] T 1d1e3ddac9204211924d2187d73ecd72 P c51023bde9f346c1af16edaf4c858f98: Time spent bootstrapping tablet: real 0.032s user 0.014s sys 0.013s
I20251023 08:00:21.900357 21920 leader_election.cc:304] T cc63d5c82e054028bd3c0cfe4599d490 P 49d13a11243a439581313cbf2389dea7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49d13a11243a439581313cbf2389dea7, 9927a56797194391a4c98a02c10f6f58; no voters:
I20251023 08:00:21.901319 22144 raft_consensus.cc:2804] T cc63d5c82e054028bd3c0cfe4599d490 P 49d13a11243a439581313cbf2389dea7 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 08:00:21.901844 22144 raft_consensus.cc:697] T cc63d5c82e054028bd3c0cfe4599d490 P 49d13a11243a439581313cbf2389dea7 [term 1 LEADER]: Becoming Leader. State: Replica: 49d13a11243a439581313cbf2389dea7, State: Running, Role: LEADER
I20251023 08:00:21.901708 22170 raft_consensus.cc:359] T 1d1e3ddac9204211924d2187d73ecd72 P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:21.903045 22170 raft_consensus.cc:385] T 1d1e3ddac9204211924d2187d73ecd72 P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:21.902997 22144 consensus_queue.cc:237] T cc63d5c82e054028bd3c0cfe4599d490 P 49d13a11243a439581313cbf2389dea7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:21.903592 22170 raft_consensus.cc:740] T 1d1e3ddac9204211924d2187d73ecd72 P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51023bde9f346c1af16edaf4c858f98, State: Initialized, Role: FOLLOWER
I20251023 08:00:21.904925 21954 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "580a58e30dcb430aaf3b33473a277984" candidate_uuid: "c51023bde9f346c1af16edaf4c858f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49d13a11243a439581313cbf2389dea7"
I20251023 08:00:21.905611 21954 raft_consensus.cc:3060] T 580a58e30dcb430aaf3b33473a277984 P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:21.904767 22170 consensus_queue.cc:260] T 1d1e3ddac9204211924d2187d73ecd72 P c51023bde9f346c1af16edaf4c858f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:21.908376 22170 ts_tablet_manager.cc:1434] T 1d1e3ddac9204211924d2187d73ecd72 P c51023bde9f346c1af16edaf4c858f98: Time spent starting tablet: real 0.010s user 0.006s sys 0.001s
I20251023 08:00:21.908731 21843 leader_election.cc:304] T 9cd5e272db7a47c2b5f84af9bf661b1d P 9927a56797194391a4c98a02c10f6f58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49d13a11243a439581313cbf2389dea7, 9927a56797194391a4c98a02c10f6f58; no voters:
I20251023 08:00:21.909729 22170 tablet_bootstrap.cc:492] T 992be711bf964771a0eae249e906e021 P c51023bde9f346c1af16edaf4c858f98: Bootstrap starting.
I20251023 08:00:21.914932 22153 raft_consensus.cc:515] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P 9927a56797194391a4c98a02c10f6f58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:21.915894 22168 raft_consensus.cc:2804] T 9cd5e272db7a47c2b5f84af9bf661b1d P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 08:00:21.916337 22168 raft_consensus.cc:493] T 9cd5e272db7a47c2b5f84af9bf661b1d P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 08:00:21.916684 22168 raft_consensus.cc:3060] T 9cd5e272db7a47c2b5f84af9bf661b1d P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:21.917390 22167 tablet_bootstrap.cc:492] T 992be711bf964771a0eae249e906e021 P 9927a56797194391a4c98a02c10f6f58: No bootstrap required, opened a new log
I20251023 08:00:21.917812 22153 leader_election.cc:290] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P 9927a56797194391a4c98a02c10f6f58 [CANDIDATE]: Term 1 election: Requested vote from peers 49d13a11243a439581313cbf2389dea7 (127.16.126.2:36187), c51023bde9f346c1af16edaf4c858f98 (127.16.126.3:36947)
I20251023 08:00:21.918020 22167 ts_tablet_manager.cc:1403] T 992be711bf964771a0eae249e906e021 P 9927a56797194391a4c98a02c10f6f58: Time spent bootstrapping tablet: real 0.065s user 0.028s sys 0.011s
I20251023 08:00:21.910863 21992 leader_election.cc:304] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P c51023bde9f346c1af16edaf4c858f98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49d13a11243a439581313cbf2389dea7, c51023bde9f346c1af16edaf4c858f98; no voters:
I20251023 08:00:21.921602 22196 raft_consensus.cc:2804] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 08:00:21.921383 22167 raft_consensus.cc:359] T 992be711bf964771a0eae249e906e021 P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:21.922183 22196 raft_consensus.cc:493] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 08:00:21.922303 22167 raft_consensus.cc:385] T 992be711bf964771a0eae249e906e021 P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:21.922683 22196 raft_consensus.cc:3060] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:21.922710 22167 raft_consensus.cc:740] T 992be711bf964771a0eae249e906e021 P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9927a56797194391a4c98a02c10f6f58, State: Initialized, Role: FOLLOWER
I20251023 08:00:21.923725 22167 consensus_queue.cc:260] T 992be711bf964771a0eae249e906e021 P 9927a56797194391a4c98a02c10f6f58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:21.925897 22029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "68421eae3c714c6ca0dffaa6c3d5f3f1" candidate_uuid: "9927a56797194391a4c98a02c10f6f58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51023bde9f346c1af16edaf4c858f98"
I20251023 08:00:21.924986 22168 raft_consensus.cc:515] T 9cd5e272db7a47c2b5f84af9bf661b1d P 9927a56797194391a4c98a02c10f6f58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:21.930677 21954 raft_consensus.cc:2468] T 580a58e30dcb430aaf3b33473a277984 P 49d13a11243a439581313cbf2389dea7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c51023bde9f346c1af16edaf4c858f98 in term 1.
I20251023 08:00:21.930771 22168 leader_election.cc:290] T 9cd5e272db7a47c2b5f84af9bf661b1d P 9927a56797194391a4c98a02c10f6f58 [CANDIDATE]: Term 1 election: Requested vote from peers 49d13a11243a439581313cbf2389dea7 (127.16.126.2:36187), c51023bde9f346c1af16edaf4c858f98 (127.16.126.3:36947)
I20251023 08:00:21.931584 22027 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9cd5e272db7a47c2b5f84af9bf661b1d" candidate_uuid: "9927a56797194391a4c98a02c10f6f58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51023bde9f346c1af16edaf4c858f98"
I20251023 08:00:21.936792 22027 raft_consensus.cc:3060] T 9cd5e272db7a47c2b5f84af9bf661b1d P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:21.937742 21953 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "68421eae3c714c6ca0dffaa6c3d5f3f1" candidate_uuid: "9927a56797194391a4c98a02c10f6f58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49d13a11243a439581313cbf2389dea7"
I20251023 08:00:21.938395 21953 raft_consensus.cc:3060] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Advancing to term 1
W20251023 08:00:21.931834 21994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.126.1:43563, user_credentials={real_user=slave}} blocked reactor thread for 62873.5us
I20251023 08:00:21.933077 22170 tablet_bootstrap.cc:654] T 992be711bf964771a0eae249e906e021 P c51023bde9f346c1af16edaf4c858f98: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:21.926184 22167 ts_tablet_manager.cc:1434] T 992be711bf964771a0eae249e906e021 P 9927a56797194391a4c98a02c10f6f58: Time spent starting tablet: real 0.008s user 0.003s sys 0.003s
I20251023 08:00:21.942682 21955 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9cd5e272db7a47c2b5f84af9bf661b1d" candidate_uuid: "9927a56797194391a4c98a02c10f6f58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49d13a11243a439581313cbf2389dea7"
I20251023 08:00:21.947983 21880 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "580a58e30dcb430aaf3b33473a277984" candidate_uuid: "c51023bde9f346c1af16edaf4c858f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9927a56797194391a4c98a02c10f6f58"
I20251023 08:00:21.949725 21955 raft_consensus.cc:3060] T 9cd5e272db7a47c2b5f84af9bf661b1d P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:21.948710 21880 raft_consensus.cc:3060] T 580a58e30dcb430aaf3b33473a277984 P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:21.949043 21992 leader_election.cc:304] T 580a58e30dcb430aaf3b33473a277984 P c51023bde9f346c1af16edaf4c858f98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49d13a11243a439581313cbf2389dea7, c51023bde9f346c1af16edaf4c858f98; no voters:
I20251023 08:00:21.952582 22027 raft_consensus.cc:2468] T 9cd5e272db7a47c2b5f84af9bf661b1d P c51023bde9f346c1af16edaf4c858f98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9927a56797194391a4c98a02c10f6f58 in term 1.
I20251023 08:00:21.953398 22193 raft_consensus.cc:2804] T 580a58e30dcb430aaf3b33473a277984 P c51023bde9f346c1af16edaf4c858f98 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 08:00:21.954079 22193 raft_consensus.cc:697] T 580a58e30dcb430aaf3b33473a277984 P c51023bde9f346c1af16edaf4c858f98 [term 1 LEADER]: Becoming Leader. State: Replica: c51023bde9f346c1af16edaf4c858f98, State: Running, Role: LEADER
I20251023 08:00:21.955237 22193 consensus_queue.cc:237] T 580a58e30dcb430aaf3b33473a277984 P c51023bde9f346c1af16edaf4c858f98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:21.957930 22169 tablet_bootstrap.cc:492] T 1d1e3ddac9204211924d2187d73ecd72 P 49d13a11243a439581313cbf2389dea7: No bootstrap required, opened a new log
I20251023 08:00:21.958618 22169 ts_tablet_manager.cc:1403] T 1d1e3ddac9204211924d2187d73ecd72 P 49d13a11243a439581313cbf2389dea7: Time spent bootstrapping tablet: real 0.198s user 0.021s sys 0.041s
I20251023 08:00:21.948508 22196 raft_consensus.cc:515] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P c51023bde9f346c1af16edaf4c858f98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:21.964274 22029 raft_consensus.cc:2393] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P c51023bde9f346c1af16edaf4c858f98 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9927a56797194391a4c98a02c10f6f58 in current term 1: Already voted for candidate c51023bde9f346c1af16edaf4c858f98 in this term.
I20251023 08:00:21.965258 22196 leader_election.cc:290] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P c51023bde9f346c1af16edaf4c858f98 [CANDIDATE]: Term 1 election: Requested vote from peers 9927a56797194391a4c98a02c10f6f58 (127.16.126.1:43563), 49d13a11243a439581313cbf2389dea7 (127.16.126.2:36187)
I20251023 08:00:21.966862 21877 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "68421eae3c714c6ca0dffaa6c3d5f3f1" candidate_uuid: "c51023bde9f346c1af16edaf4c858f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9927a56797194391a4c98a02c10f6f58"
I20251023 08:00:21.967717 21877 raft_consensus.cc:2393] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P 9927a56797194391a4c98a02c10f6f58 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c51023bde9f346c1af16edaf4c858f98 in current term 1: Already voted for candidate 9927a56797194391a4c98a02c10f6f58 in this term.
I20251023 08:00:21.969406 21952 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "68421eae3c714c6ca0dffaa6c3d5f3f1" candidate_uuid: "c51023bde9f346c1af16edaf4c858f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49d13a11243a439581313cbf2389dea7"
I20251023 08:00:21.970770 21992 leader_election.cc:304] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P c51023bde9f346c1af16edaf4c858f98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c51023bde9f346c1af16edaf4c858f98; no voters: 49d13a11243a439581313cbf2389dea7, 9927a56797194391a4c98a02c10f6f58
I20251023 08:00:21.971482 22196 raft_consensus.cc:2749] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P c51023bde9f346c1af16edaf4c858f98 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20251023 08:00:21.959936 21846 leader_election.cc:304] T 9cd5e272db7a47c2b5f84af9bf661b1d P 9927a56797194391a4c98a02c10f6f58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9927a56797194391a4c98a02c10f6f58, c51023bde9f346c1af16edaf4c858f98; no voters:
I20251023 08:00:21.972741 22168 raft_consensus.cc:2804] T 9cd5e272db7a47c2b5f84af9bf661b1d P 9927a56797194391a4c98a02c10f6f58 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 08:00:21.972838 21880 raft_consensus.cc:2468] T 580a58e30dcb430aaf3b33473a277984 P 9927a56797194391a4c98a02c10f6f58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c51023bde9f346c1af16edaf4c858f98 in term 1.
I20251023 08:00:21.973258 22168 raft_consensus.cc:697] T 9cd5e272db7a47c2b5f84af9bf661b1d P 9927a56797194391a4c98a02c10f6f58 [term 1 LEADER]: Becoming Leader. State: Replica: 9927a56797194391a4c98a02c10f6f58, State: Running, Role: LEADER
I20251023 08:00:21.974220 22168 consensus_queue.cc:237] T 9cd5e272db7a47c2b5f84af9bf661b1d P 9927a56797194391a4c98a02c10f6f58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:21.978320 22196 raft_consensus.cc:493] T 095923a5d18140f2bd7a676fc516acdc P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 08:00:21.978387 21953 raft_consensus.cc:2468] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P 49d13a11243a439581313cbf2389dea7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9927a56797194391a4c98a02c10f6f58 in term 1.
I20251023 08:00:21.979624 22196 raft_consensus.cc:515] T 095923a5d18140f2bd7a676fc516acdc P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:21.982137 22196 leader_election.cc:290] T 095923a5d18140f2bd7a676fc516acdc P c51023bde9f346c1af16edaf4c858f98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9927a56797194391a4c98a02c10f6f58 (127.16.126.1:43563), 49d13a11243a439581313cbf2389dea7 (127.16.126.2:36187)
I20251023 08:00:21.982293 22169 raft_consensus.cc:359] T 1d1e3ddac9204211924d2187d73ecd72 P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:21.983117 22169 raft_consensus.cc:385] T 1d1e3ddac9204211924d2187d73ecd72 P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:21.983435 22169 raft_consensus.cc:740] T 1d1e3ddac9204211924d2187d73ecd72 P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49d13a11243a439581313cbf2389dea7, State: Initialized, Role: FOLLOWER
I20251023 08:00:21.984158 22169 consensus_queue.cc:260] T 1d1e3ddac9204211924d2187d73ecd72 P 49d13a11243a439581313cbf2389dea7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:21.984539 21880 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "095923a5d18140f2bd7a676fc516acdc" candidate_uuid: "c51023bde9f346c1af16edaf4c858f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9927a56797194391a4c98a02c10f6f58" is_pre_election: true
I20251023 08:00:21.985517 21880 raft_consensus.cc:2468] T 095923a5d18140f2bd7a676fc516acdc P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c51023bde9f346c1af16edaf4c858f98 in term 0.
I20251023 08:00:21.986496 21994 leader_election.cc:304] T 095923a5d18140f2bd7a676fc516acdc P c51023bde9f346c1af16edaf4c858f98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9927a56797194391a4c98a02c10f6f58, c51023bde9f346c1af16edaf4c858f98; no voters:
I20251023 08:00:21.986668 21954 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "095923a5d18140f2bd7a676fc516acdc" candidate_uuid: "c51023bde9f346c1af16edaf4c858f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49d13a11243a439581313cbf2389dea7" is_pre_election: true
I20251023 08:00:21.987470 22196 raft_consensus.cc:2804] T 095923a5d18140f2bd7a676fc516acdc P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 08:00:21.987845 22196 raft_consensus.cc:493] T 095923a5d18140f2bd7a676fc516acdc P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 08:00:21.986693 21778 catalog_manager.cc:5649] T 9cd5e272db7a47c2b5f84af9bf661b1d P 9927a56797194391a4c98a02c10f6f58 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9927a56797194391a4c98a02c10f6f58 (127.16.126.1). New cstate: current_term: 1 leader_uuid: "9927a56797194391a4c98a02c10f6f58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } health_report { overall_health: UNKNOWN } } }
I20251023 08:00:21.988194 22196 raft_consensus.cc:3060] T 095923a5d18140f2bd7a676fc516acdc P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Advancing to term 1
W20251023 08:00:21.988448 21992 leader_election.cc:343] T 095923a5d18140f2bd7a676fc516acdc P c51023bde9f346c1af16edaf4c858f98 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 49d13a11243a439581313cbf2389dea7 (127.16.126.2:36187): Illegal state: must be running to vote when last-logged opid is not known
I20251023 08:00:21.991181 21843 leader_election.cc:304] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P 9927a56797194391a4c98a02c10f6f58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 49d13a11243a439581313cbf2389dea7, 9927a56797194391a4c98a02c10f6f58; no voters: c51023bde9f346c1af16edaf4c858f98
I20251023 08:00:21.992358 22168 raft_consensus.cc:2804] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P 9927a56797194391a4c98a02c10f6f58 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 08:00:21.992811 22168 raft_consensus.cc:697] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P 9927a56797194391a4c98a02c10f6f58 [term 1 LEADER]: Becoming Leader. State: Replica: 9927a56797194391a4c98a02c10f6f58, State: Running, Role: LEADER
I20251023 08:00:21.993691 22168 consensus_queue.cc:237] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P 9927a56797194391a4c98a02c10f6f58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:21.994505 22169 ts_tablet_manager.cc:1434] T 1d1e3ddac9204211924d2187d73ecd72 P 49d13a11243a439581313cbf2389dea7: Time spent starting tablet: real 0.034s user 0.006s sys 0.001s
I20251023 08:00:21.995589 22169 tablet_bootstrap.cc:492] T 095923a5d18140f2bd7a676fc516acdc P 49d13a11243a439581313cbf2389dea7: Bootstrap starting.
I20251023 08:00:21.996083 22170 tablet_bootstrap.cc:492] T 992be711bf964771a0eae249e906e021 P c51023bde9f346c1af16edaf4c858f98: No bootstrap required, opened a new log
I20251023 08:00:21.995435 21777 catalog_manager.cc:5649] T cc63d5c82e054028bd3c0cfe4599d490 P 49d13a11243a439581313cbf2389dea7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 49d13a11243a439581313cbf2389dea7 (127.16.126.2). New cstate: current_term: 1 leader_uuid: "49d13a11243a439581313cbf2389dea7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } health_report { overall_health: UNKNOWN } } }
I20251023 08:00:21.996564 22170 ts_tablet_manager.cc:1403] T 992be711bf964771a0eae249e906e021 P c51023bde9f346c1af16edaf4c858f98: Time spent bootstrapping tablet: real 0.087s user 0.009s sys 0.016s
I20251023 08:00:21.993290 21955 raft_consensus.cc:2468] T 9cd5e272db7a47c2b5f84af9bf661b1d P 49d13a11243a439581313cbf2389dea7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9927a56797194391a4c98a02c10f6f58 in term 1.
I20251023 08:00:22.003499 22170 raft_consensus.cc:359] T 992be711bf964771a0eae249e906e021 P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:22.004472 22170 raft_consensus.cc:385] T 992be711bf964771a0eae249e906e021 P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:22.004940 22170 raft_consensus.cc:740] T 992be711bf964771a0eae249e906e021 P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51023bde9f346c1af16edaf4c858f98, State: Initialized, Role: FOLLOWER
I20251023 08:00:22.005872 22170 consensus_queue.cc:260] T 992be711bf964771a0eae249e906e021 P c51023bde9f346c1af16edaf4c858f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:22.007859 22170 ts_tablet_manager.cc:1434] T 992be711bf964771a0eae249e906e021 P c51023bde9f346c1af16edaf4c858f98: Time spent starting tablet: real 0.011s user 0.005s sys 0.003s
I20251023 08:00:22.006870 22169 tablet_bootstrap.cc:654] T 095923a5d18140f2bd7a676fc516acdc P 49d13a11243a439581313cbf2389dea7: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:22.017535 22169 tablet_bootstrap.cc:492] T 095923a5d18140f2bd7a676fc516acdc P 49d13a11243a439581313cbf2389dea7: No bootstrap required, opened a new log
I20251023 08:00:22.018127 22169 ts_tablet_manager.cc:1403] T 095923a5d18140f2bd7a676fc516acdc P 49d13a11243a439581313cbf2389dea7: Time spent bootstrapping tablet: real 0.023s user 0.006s sys 0.008s
I20251023 08:00:22.020565 22169 raft_consensus.cc:359] T 095923a5d18140f2bd7a676fc516acdc P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:22.021205 22169 raft_consensus.cc:385] T 095923a5d18140f2bd7a676fc516acdc P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:22.021497 22169 raft_consensus.cc:740] T 095923a5d18140f2bd7a676fc516acdc P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49d13a11243a439581313cbf2389dea7, State: Initialized, Role: FOLLOWER
I20251023 08:00:22.022110 22169 consensus_queue.cc:260] T 095923a5d18140f2bd7a676fc516acdc P 49d13a11243a439581313cbf2389dea7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:22.024045 22076 raft_consensus.cc:493] T 1d1e3ddac9204211924d2187d73ecd72 P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 08:00:22.024194 22169 ts_tablet_manager.cc:1434] T 095923a5d18140f2bd7a676fc516acdc P 49d13a11243a439581313cbf2389dea7: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20251023 08:00:22.024679 22076 raft_consensus.cc:515] T 1d1e3ddac9204211924d2187d73ecd72 P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:22.025395 22169 tablet_bootstrap.cc:492] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 49d13a11243a439581313cbf2389dea7: Bootstrap starting.
I20251023 08:00:22.026968 22076 leader_election.cc:290] T 1d1e3ddac9204211924d2187d73ecd72 P c51023bde9f346c1af16edaf4c858f98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9927a56797194391a4c98a02c10f6f58 (127.16.126.1:43563), 49d13a11243a439581313cbf2389dea7 (127.16.126.2:36187)
I20251023 08:00:22.020759 21776 catalog_manager.cc:5649] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P 9927a56797194391a4c98a02c10f6f58 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9927a56797194391a4c98a02c10f6f58 (127.16.126.1). New cstate: current_term: 1 leader_uuid: "9927a56797194391a4c98a02c10f6f58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } health_report { overall_health: UNKNOWN } } }
I20251023 08:00:22.028038 21880 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1d1e3ddac9204211924d2187d73ecd72" candidate_uuid: "c51023bde9f346c1af16edaf4c858f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9927a56797194391a4c98a02c10f6f58" is_pre_election: true
I20251023 08:00:22.028731 21880 raft_consensus.cc:2468] T 1d1e3ddac9204211924d2187d73ecd72 P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c51023bde9f346c1af16edaf4c858f98 in term 0.
I20251023 08:00:22.029739 21955 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1d1e3ddac9204211924d2187d73ecd72" candidate_uuid: "c51023bde9f346c1af16edaf4c858f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49d13a11243a439581313cbf2389dea7" is_pre_election: true
I20251023 08:00:22.030037 21994 leader_election.cc:304] T 1d1e3ddac9204211924d2187d73ecd72 P c51023bde9f346c1af16edaf4c858f98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9927a56797194391a4c98a02c10f6f58, c51023bde9f346c1af16edaf4c858f98; no voters:
I20251023 08:00:22.030393 21955 raft_consensus.cc:2468] T 1d1e3ddac9204211924d2187d73ecd72 P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c51023bde9f346c1af16edaf4c858f98 in term 0.
I20251023 08:00:22.031080 22076 raft_consensus.cc:2804] T 1d1e3ddac9204211924d2187d73ecd72 P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 08:00:22.031577 22076 raft_consensus.cc:493] T 1d1e3ddac9204211924d2187d73ecd72 P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 08:00:22.031980 22076 raft_consensus.cc:3060] T 1d1e3ddac9204211924d2187d73ecd72 P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:22.033510 22169 tablet_bootstrap.cc:654] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 49d13a11243a439581313cbf2389dea7: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:22.042902 22076 raft_consensus.cc:515] T 1d1e3ddac9204211924d2187d73ecd72 P c51023bde9f346c1af16edaf4c858f98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:22.047345 21880 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1d1e3ddac9204211924d2187d73ecd72" candidate_uuid: "c51023bde9f346c1af16edaf4c858f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9927a56797194391a4c98a02c10f6f58"
I20251023 08:00:22.048193 21880 raft_consensus.cc:3060] T 1d1e3ddac9204211924d2187d73ecd72 P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:22.057911 22196 raft_consensus.cc:515] T 095923a5d18140f2bd7a676fc516acdc P c51023bde9f346c1af16edaf4c858f98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:22.061185 21955 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "095923a5d18140f2bd7a676fc516acdc" candidate_uuid: "c51023bde9f346c1af16edaf4c858f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49d13a11243a439581313cbf2389dea7"
I20251023 08:00:22.061477 22196 leader_election.cc:290] T 095923a5d18140f2bd7a676fc516acdc P c51023bde9f346c1af16edaf4c858f98 [CANDIDATE]: Term 1 election: Requested vote from peers 9927a56797194391a4c98a02c10f6f58 (127.16.126.1:43563), 49d13a11243a439581313cbf2389dea7 (127.16.126.2:36187)
I20251023 08:00:22.061882 21955 raft_consensus.cc:3060] T 095923a5d18140f2bd7a676fc516acdc P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:22.063658 21877 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "095923a5d18140f2bd7a676fc516acdc" candidate_uuid: "c51023bde9f346c1af16edaf4c858f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9927a56797194391a4c98a02c10f6f58"
I20251023 08:00:22.064378 21877 raft_consensus.cc:3060] T 095923a5d18140f2bd7a676fc516acdc P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:22.065837 21880 raft_consensus.cc:2468] T 1d1e3ddac9204211924d2187d73ecd72 P 9927a56797194391a4c98a02c10f6f58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c51023bde9f346c1af16edaf4c858f98 in term 1.
I20251023 08:00:22.067119 22076 leader_election.cc:290] T 1d1e3ddac9204211924d2187d73ecd72 P c51023bde9f346c1af16edaf4c858f98 [CANDIDATE]: Term 1 election: Requested vote from peers 9927a56797194391a4c98a02c10f6f58 (127.16.126.1:43563), 49d13a11243a439581313cbf2389dea7 (127.16.126.2:36187)
I20251023 08:00:22.066510 21777 catalog_manager.cc:5649] T 580a58e30dcb430aaf3b33473a277984 P c51023bde9f346c1af16edaf4c858f98 reported cstate change: term changed from 0 to 1, leader changed from <none> to c51023bde9f346c1af16edaf4c858f98 (127.16.126.3). New cstate: current_term: 1 leader_uuid: "c51023bde9f346c1af16edaf4c858f98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } health_report { overall_health: HEALTHY } } }
I20251023 08:00:22.069178 22169 tablet_bootstrap.cc:492] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 49d13a11243a439581313cbf2389dea7: No bootstrap required, opened a new log
I20251023 08:00:22.069723 22169 ts_tablet_manager.cc:1403] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 49d13a11243a439581313cbf2389dea7: Time spent bootstrapping tablet: real 0.045s user 0.020s sys 0.019s
I20251023 08:00:22.069980 21955 raft_consensus.cc:2468] T 095923a5d18140f2bd7a676fc516acdc P 49d13a11243a439581313cbf2389dea7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c51023bde9f346c1af16edaf4c858f98 in term 1.
I20251023 08:00:22.071246 21955 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1d1e3ddac9204211924d2187d73ecd72" candidate_uuid: "c51023bde9f346c1af16edaf4c858f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49d13a11243a439581313cbf2389dea7"
I20251023 08:00:22.071554 21994 leader_election.cc:304] T 1d1e3ddac9204211924d2187d73ecd72 P c51023bde9f346c1af16edaf4c858f98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9927a56797194391a4c98a02c10f6f58, c51023bde9f346c1af16edaf4c858f98; no voters:
I20251023 08:00:22.072448 22076 raft_consensus.cc:2804] T 1d1e3ddac9204211924d2187d73ecd72 P c51023bde9f346c1af16edaf4c858f98 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 08:00:22.072726 21992 leader_election.cc:304] T 095923a5d18140f2bd7a676fc516acdc P c51023bde9f346c1af16edaf4c858f98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49d13a11243a439581313cbf2389dea7, c51023bde9f346c1af16edaf4c858f98; no voters:
I20251023 08:00:22.072610 22169 raft_consensus.cc:359] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:22.074656 22169 raft_consensus.cc:385] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:22.073608 22196 raft_consensus.cc:2804] T 095923a5d18140f2bd7a676fc516acdc P c51023bde9f346c1af16edaf4c858f98 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 08:00:22.074949 22169 raft_consensus.cc:740] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49d13a11243a439581313cbf2389dea7, State: Initialized, Role: FOLLOWER
I20251023 08:00:22.075402 22196 raft_consensus.cc:697] T 095923a5d18140f2bd7a676fc516acdc P c51023bde9f346c1af16edaf4c858f98 [term 1 LEADER]: Becoming Leader. State: Replica: c51023bde9f346c1af16edaf4c858f98, State: Running, Role: LEADER
I20251023 08:00:22.071813 21955 raft_consensus.cc:3060] T 1d1e3ddac9204211924d2187d73ecd72 P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:22.075732 22169 consensus_queue.cc:260] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 49d13a11243a439581313cbf2389dea7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:22.076277 22196 consensus_queue.cc:237] T 095923a5d18140f2bd7a676fc516acdc P c51023bde9f346c1af16edaf4c858f98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:22.078157 22169 ts_tablet_manager.cc:1434] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 49d13a11243a439581313cbf2389dea7: Time spent starting tablet: real 0.008s user 0.006s sys 0.001s
I20251023 08:00:22.073149 22076 raft_consensus.cc:697] T 1d1e3ddac9204211924d2187d73ecd72 P c51023bde9f346c1af16edaf4c858f98 [term 1 LEADER]: Becoming Leader. State: Replica: c51023bde9f346c1af16edaf4c858f98, State: Running, Role: LEADER
I20251023 08:00:22.081228 22169 tablet_bootstrap.cc:492] T 992be711bf964771a0eae249e906e021 P 49d13a11243a439581313cbf2389dea7: Bootstrap starting.
I20251023 08:00:22.080597 22076 consensus_queue.cc:237] T 1d1e3ddac9204211924d2187d73ecd72 P c51023bde9f346c1af16edaf4c858f98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:22.084703 21877 raft_consensus.cc:2468] T 095923a5d18140f2bd7a676fc516acdc P 9927a56797194391a4c98a02c10f6f58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c51023bde9f346c1af16edaf4c858f98 in term 1.
I20251023 08:00:22.087702 22169 tablet_bootstrap.cc:654] T 992be711bf964771a0eae249e906e021 P 49d13a11243a439581313cbf2389dea7: Neither blocks nor log segments found. Creating new log.
I20251023 08:00:22.094885 21955 raft_consensus.cc:2468] T 1d1e3ddac9204211924d2187d73ecd72 P 49d13a11243a439581313cbf2389dea7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c51023bde9f346c1af16edaf4c858f98 in term 1.
I20251023 08:00:22.098258 22169 tablet_bootstrap.cc:492] T 992be711bf964771a0eae249e906e021 P 49d13a11243a439581313cbf2389dea7: No bootstrap required, opened a new log
I20251023 08:00:22.098820 22169 ts_tablet_manager.cc:1403] T 992be711bf964771a0eae249e906e021 P 49d13a11243a439581313cbf2389dea7: Time spent bootstrapping tablet: real 0.018s user 0.009s sys 0.004s
I20251023 08:00:22.099169 21777 catalog_manager.cc:5649] T 1d1e3ddac9204211924d2187d73ecd72 P c51023bde9f346c1af16edaf4c858f98 reported cstate change: term changed from 0 to 1, leader changed from <none> to c51023bde9f346c1af16edaf4c858f98 (127.16.126.3). New cstate: current_term: 1 leader_uuid: "c51023bde9f346c1af16edaf4c858f98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } health_report { overall_health: HEALTHY } } }
I20251023 08:00:22.101337 22169 raft_consensus.cc:359] T 992be711bf964771a0eae249e906e021 P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:22.100982 21777 catalog_manager.cc:5649] T 095923a5d18140f2bd7a676fc516acdc P c51023bde9f346c1af16edaf4c858f98 reported cstate change: term changed from 0 to 1, leader changed from <none> to c51023bde9f346c1af16edaf4c858f98 (127.16.126.3). New cstate: current_term: 1 leader_uuid: "c51023bde9f346c1af16edaf4c858f98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } health_report { overall_health: HEALTHY } } }
I20251023 08:00:22.102032 22169 raft_consensus.cc:385] T 992be711bf964771a0eae249e906e021 P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251023 08:00:22.102322 22169 raft_consensus.cc:740] T 992be711bf964771a0eae249e906e021 P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49d13a11243a439581313cbf2389dea7, State: Initialized, Role: FOLLOWER
I20251023 08:00:22.102981 22169 consensus_queue.cc:260] T 992be711bf964771a0eae249e906e021 P 49d13a11243a439581313cbf2389dea7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:22.105216 22169 ts_tablet_manager.cc:1434] T 992be711bf964771a0eae249e906e021 P 49d13a11243a439581313cbf2389dea7: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20251023 08:00:22.170425 22196 raft_consensus.cc:493] T 992be711bf964771a0eae249e906e021 P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 08:00:22.170928 22196 raft_consensus.cc:515] T 992be711bf964771a0eae249e906e021 P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:22.172608 22196 leader_election.cc:290] T 992be711bf964771a0eae249e906e021 P c51023bde9f346c1af16edaf4c858f98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9927a56797194391a4c98a02c10f6f58 (127.16.126.1:43563), 49d13a11243a439581313cbf2389dea7 (127.16.126.2:36187)
I20251023 08:00:22.173732 21955 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "992be711bf964771a0eae249e906e021" candidate_uuid: "c51023bde9f346c1af16edaf4c858f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49d13a11243a439581313cbf2389dea7" is_pre_election: true
I20251023 08:00:22.173609 21877 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "992be711bf964771a0eae249e906e021" candidate_uuid: "c51023bde9f346c1af16edaf4c858f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9927a56797194391a4c98a02c10f6f58" is_pre_election: true
I20251023 08:00:22.174543 21955 raft_consensus.cc:2468] T 992be711bf964771a0eae249e906e021 P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c51023bde9f346c1af16edaf4c858f98 in term 0.
I20251023 08:00:22.174551 21877 raft_consensus.cc:2468] T 992be711bf964771a0eae249e906e021 P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c51023bde9f346c1af16edaf4c858f98 in term 0.
I20251023 08:00:22.175732 21992 leader_election.cc:304] T 992be711bf964771a0eae249e906e021 P c51023bde9f346c1af16edaf4c858f98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49d13a11243a439581313cbf2389dea7, c51023bde9f346c1af16edaf4c858f98; no voters:
I20251023 08:00:22.176441 22196 raft_consensus.cc:2804] T 992be711bf964771a0eae249e906e021 P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 08:00:22.176707 22196 raft_consensus.cc:493] T 992be711bf964771a0eae249e906e021 P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 08:00:22.176918 22196 raft_consensus.cc:3060] T 992be711bf964771a0eae249e906e021 P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:22.182124 22196 raft_consensus.cc:515] T 992be711bf964771a0eae249e906e021 P c51023bde9f346c1af16edaf4c858f98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:22.183672 22196 leader_election.cc:290] T 992be711bf964771a0eae249e906e021 P c51023bde9f346c1af16edaf4c858f98 [CANDIDATE]: Term 1 election: Requested vote from peers 9927a56797194391a4c98a02c10f6f58 (127.16.126.1:43563), 49d13a11243a439581313cbf2389dea7 (127.16.126.2:36187)
I20251023 08:00:22.184736 21955 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "992be711bf964771a0eae249e906e021" candidate_uuid: "c51023bde9f346c1af16edaf4c858f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49d13a11243a439581313cbf2389dea7"
I20251023 08:00:22.184625 21877 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "992be711bf964771a0eae249e906e021" candidate_uuid: "c51023bde9f346c1af16edaf4c858f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9927a56797194391a4c98a02c10f6f58"
I20251023 08:00:22.185519 21955 raft_consensus.cc:3060] T 992be711bf964771a0eae249e906e021 P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:22.185590 21877 raft_consensus.cc:3060] T 992be711bf964771a0eae249e906e021 P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:22.190836 21955 raft_consensus.cc:2468] T 992be711bf964771a0eae249e906e021 P 49d13a11243a439581313cbf2389dea7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c51023bde9f346c1af16edaf4c858f98 in term 1.
I20251023 08:00:22.191313 21877 raft_consensus.cc:2468] T 992be711bf964771a0eae249e906e021 P 9927a56797194391a4c98a02c10f6f58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c51023bde9f346c1af16edaf4c858f98 in term 1.
I20251023 08:00:22.191911 21992 leader_election.cc:304] T 992be711bf964771a0eae249e906e021 P c51023bde9f346c1af16edaf4c858f98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49d13a11243a439581313cbf2389dea7, c51023bde9f346c1af16edaf4c858f98; no voters:
I20251023 08:00:22.192665 22196 raft_consensus.cc:2804] T 992be711bf964771a0eae249e906e021 P c51023bde9f346c1af16edaf4c858f98 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 08:00:22.193023 22196 raft_consensus.cc:697] T 992be711bf964771a0eae249e906e021 P c51023bde9f346c1af16edaf4c858f98 [term 1 LEADER]: Becoming Leader. State: Replica: c51023bde9f346c1af16edaf4c858f98, State: Running, Role: LEADER
I20251023 08:00:22.193780 22196 consensus_queue.cc:237] T 992be711bf964771a0eae249e906e021 P c51023bde9f346c1af16edaf4c858f98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:22.195376 22173 raft_consensus.cc:493] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 08:00:22.195827 22173 raft_consensus.cc:515] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:22.197820 22173 leader_election.cc:290] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 49d13a11243a439581313cbf2389dea7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9927a56797194391a4c98a02c10f6f58 (127.16.126.1:43563), c51023bde9f346c1af16edaf4c858f98 (127.16.126.3:36947)
I20251023 08:00:22.198679 21877 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0274899ee0b94ca6ad23688cfc1ffeb5" candidate_uuid: "49d13a11243a439581313cbf2389dea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9927a56797194391a4c98a02c10f6f58" is_pre_election: true
I20251023 08:00:22.199410 22029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0274899ee0b94ca6ad23688cfc1ffeb5" candidate_uuid: "49d13a11243a439581313cbf2389dea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51023bde9f346c1af16edaf4c858f98" is_pre_election: true
I20251023 08:00:22.199427 21877 raft_consensus.cc:2468] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49d13a11243a439581313cbf2389dea7 in term 0.
I20251023 08:00:22.200018 22029 raft_consensus.cc:2468] T 0274899ee0b94ca6ad23688cfc1ffeb5 P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49d13a11243a439581313cbf2389dea7 in term 0.
I20251023 08:00:22.200766 21920 leader_election.cc:304] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 49d13a11243a439581313cbf2389dea7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49d13a11243a439581313cbf2389dea7, 9927a56797194391a4c98a02c10f6f58; no voters:
I20251023 08:00:22.201622 22173 raft_consensus.cc:2804] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251023 08:00:22.201969 22173 raft_consensus.cc:493] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 08:00:22.202248 22173 raft_consensus.cc:3060] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 49d13a11243a439581313cbf2389dea7 [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:22.202867 21776 catalog_manager.cc:5649] T 992be711bf964771a0eae249e906e021 P c51023bde9f346c1af16edaf4c858f98 reported cstate change: term changed from 0 to 1, leader changed from <none> to c51023bde9f346c1af16edaf4c858f98 (127.16.126.3). New cstate: current_term: 1 leader_uuid: "c51023bde9f346c1af16edaf4c858f98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } health_report { overall_health: HEALTHY } } }
I20251023 08:00:22.206303 21877 raft_consensus.cc:3060] T ec26529ef6c64b259b8428285a2ad427 P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:22.209671 22173 raft_consensus.cc:515] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 49d13a11243a439581313cbf2389dea7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:22.212662 21880 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0274899ee0b94ca6ad23688cfc1ffeb5" candidate_uuid: "49d13a11243a439581313cbf2389dea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9927a56797194391a4c98a02c10f6f58"
I20251023 08:00:22.212805 22173 leader_election.cc:290] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 49d13a11243a439581313cbf2389dea7 [CANDIDATE]: Term 1 election: Requested vote from peers 9927a56797194391a4c98a02c10f6f58 (127.16.126.1:43563), c51023bde9f346c1af16edaf4c858f98 (127.16.126.3:36947)
I20251023 08:00:22.213354 21880 raft_consensus.cc:3060] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 9927a56797194391a4c98a02c10f6f58 [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:22.213908 22168 raft_consensus.cc:493] T ec26529ef6c64b259b8428285a2ad427 P 9927a56797194391a4c98a02c10f6f58 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 08:00:22.214445 22168 raft_consensus.cc:515] T ec26529ef6c64b259b8428285a2ad427 P 9927a56797194391a4c98a02c10f6f58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:22.214962 22029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0274899ee0b94ca6ad23688cfc1ffeb5" candidate_uuid: "49d13a11243a439581313cbf2389dea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51023bde9f346c1af16edaf4c858f98"
I20251023 08:00:22.215615 22029 raft_consensus.cc:3060] T 0274899ee0b94ca6ad23688cfc1ffeb5 P c51023bde9f346c1af16edaf4c858f98 [term 0 FOLLOWER]: Advancing to term 1
I20251023 08:00:22.216486 22173 consensus_queue.cc:1048] T ec26529ef6c64b259b8428285a2ad427 P 49d13a11243a439581313cbf2389dea7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 08:00:22.218876 22168 leader_election.cc:290] T ec26529ef6c64b259b8428285a2ad427 P 9927a56797194391a4c98a02c10f6f58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 49d13a11243a439581313cbf2389dea7 (127.16.126.2:36187), c51023bde9f346c1af16edaf4c858f98 (127.16.126.3:36947)
I20251023 08:00:22.220140 22027 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec26529ef6c64b259b8428285a2ad427" candidate_uuid: "9927a56797194391a4c98a02c10f6f58" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51023bde9f346c1af16edaf4c858f98" is_pre_election: true
I20251023 08:00:22.220889 22027 raft_consensus.cc:2468] T ec26529ef6c64b259b8428285a2ad427 P c51023bde9f346c1af16edaf4c858f98 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9927a56797194391a4c98a02c10f6f58 in term 1.
I20251023 08:00:22.218817 21955 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec26529ef6c64b259b8428285a2ad427" candidate_uuid: "9927a56797194391a4c98a02c10f6f58" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49d13a11243a439581313cbf2389dea7" is_pre_election: true
I20251023 08:00:22.221976 21880 raft_consensus.cc:2468] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 9927a56797194391a4c98a02c10f6f58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49d13a11243a439581313cbf2389dea7 in term 1.
I20251023 08:00:22.222199 21846 leader_election.cc:304] T ec26529ef6c64b259b8428285a2ad427 P 9927a56797194391a4c98a02c10f6f58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9927a56797194391a4c98a02c10f6f58, c51023bde9f346c1af16edaf4c858f98; no voters:
I20251023 08:00:22.223187 21920 leader_election.cc:304] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 49d13a11243a439581313cbf2389dea7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49d13a11243a439581313cbf2389dea7, 9927a56797194391a4c98a02c10f6f58; no voters:
I20251023 08:00:22.223690 22029 raft_consensus.cc:2468] T 0274899ee0b94ca6ad23688cfc1ffeb5 P c51023bde9f346c1af16edaf4c858f98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49d13a11243a439581313cbf2389dea7 in term 1.
I20251023 08:00:22.224169 22173 raft_consensus.cc:2804] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 49d13a11243a439581313cbf2389dea7 [term 1 FOLLOWER]: Leader election won for term 1
I20251023 08:00:22.224702 22173 raft_consensus.cc:697] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 49d13a11243a439581313cbf2389dea7 [term 1 LEADER]: Becoming Leader. State: Replica: 49d13a11243a439581313cbf2389dea7, State: Running, Role: LEADER
I20251023 08:00:22.226066 22153 raft_consensus.cc:2804] T ec26529ef6c64b259b8428285a2ad427 P 9927a56797194391a4c98a02c10f6f58 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251023 08:00:22.225620 22173 consensus_queue.cc:237] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 49d13a11243a439581313cbf2389dea7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:22.227303 22153 raft_consensus.cc:493] T ec26529ef6c64b259b8428285a2ad427 P 9927a56797194391a4c98a02c10f6f58 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 49d13a11243a439581313cbf2389dea7)
I20251023 08:00:22.227743 22153 raft_consensus.cc:3060] T ec26529ef6c64b259b8428285a2ad427 P 9927a56797194391a4c98a02c10f6f58 [term 1 FOLLOWER]: Advancing to term 2
I20251023 08:00:22.236917 22153 raft_consensus.cc:515] T ec26529ef6c64b259b8428285a2ad427 P 9927a56797194391a4c98a02c10f6f58 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:22.238143 21877 raft_consensus.cc:1240] T ec26529ef6c64b259b8428285a2ad427 P 9927a56797194391a4c98a02c10f6f58 [term 2 FOLLOWER]: Rejecting Update request from peer 49d13a11243a439581313cbf2389dea7 for earlier term 1. Current term is 2. Ops: []
I20251023 08:00:22.237958 22173 consensus_queue.cc:1048] T ec26529ef6c64b259b8428285a2ad427 P 49d13a11243a439581313cbf2389dea7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 08:00:22.240073 22153 leader_election.cc:290] T ec26529ef6c64b259b8428285a2ad427 P 9927a56797194391a4c98a02c10f6f58 [CANDIDATE]: Term 2 election: Requested vote from peers 49d13a11243a439581313cbf2389dea7 (127.16.126.2:36187), c51023bde9f346c1af16edaf4c858f98 (127.16.126.3:36947)
I20251023 08:00:22.241165 22027 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec26529ef6c64b259b8428285a2ad427" candidate_uuid: "9927a56797194391a4c98a02c10f6f58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c51023bde9f346c1af16edaf4c858f98"
I20251023 08:00:22.241384 21955 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec26529ef6c64b259b8428285a2ad427" candidate_uuid: "9927a56797194391a4c98a02c10f6f58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "49d13a11243a439581313cbf2389dea7"
I20251023 08:00:22.242919 21843 leader_election.cc:304] T ec26529ef6c64b259b8428285a2ad427 P 9927a56797194391a4c98a02c10f6f58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9927a56797194391a4c98a02c10f6f58; no voters: 49d13a11243a439581313cbf2389dea7, c51023bde9f346c1af16edaf4c858f98
I20251023 08:00:22.243739 22153 raft_consensus.cc:2749] T ec26529ef6c64b259b8428285a2ad427 P 9927a56797194391a4c98a02c10f6f58 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20251023 08:00:22.245324 21776 catalog_manager.cc:5649] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 49d13a11243a439581313cbf2389dea7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 49d13a11243a439581313cbf2389dea7 (127.16.126.2). New cstate: current_term: 1 leader_uuid: "49d13a11243a439581313cbf2389dea7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } health_report { overall_health: UNKNOWN } } }
I20251023 08:00:22.249243 22173 consensus_queue.cc:1059] T ec26529ef6c64b259b8428285a2ad427 P 49d13a11243a439581313cbf2389dea7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 08:00:22.250437 22200 raft_consensus.cc:3055] T ec26529ef6c64b259b8428285a2ad427 P 49d13a11243a439581313cbf2389dea7 [term 1 LEADER]: Stepping down as leader of term 1
I20251023 08:00:22.250782 22200 raft_consensus.cc:740] T ec26529ef6c64b259b8428285a2ad427 P 49d13a11243a439581313cbf2389dea7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 49d13a11243a439581313cbf2389dea7, State: Running, Role: LEADER
I20251023 08:00:22.251581 22200 consensus_queue.cc:260] T ec26529ef6c64b259b8428285a2ad427 P 49d13a11243a439581313cbf2389dea7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:22.252614 22200 raft_consensus.cc:3060] T ec26529ef6c64b259b8428285a2ad427 P 49d13a11243a439581313cbf2389dea7 [term 1 FOLLOWER]: Advancing to term 2
I20251023 08:00:22.370005 22153 consensus_queue.cc:1048] T 9cd5e272db7a47c2b5f84af9bf661b1d P 9927a56797194391a4c98a02c10f6f58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 08:00:22.384016 22153 consensus_queue.cc:1048] T 9cd5e272db7a47c2b5f84af9bf661b1d P 9927a56797194391a4c98a02c10f6f58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 08:00:22.391811 22200 consensus_queue.cc:1048] T cc63d5c82e054028bd3c0cfe4599d490 P 49d13a11243a439581313cbf2389dea7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 08:00:22.409540 22215 consensus_queue.cc:1048] T cc63d5c82e054028bd3c0cfe4599d490 P 49d13a11243a439581313cbf2389dea7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 08:00:22.426743 22027 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "1d1e3ddac9204211924d2187d73ecd72"
dest_uuid: "c51023bde9f346c1af16edaf4c858f98"
mode: GRACEFUL
new_leader_uuid: "9927a56797194391a4c98a02c10f6f58"
from {username='slave'} at 127.0.0.1:40686
I20251023 08:00:22.427419 22027 raft_consensus.cc:606] T 1d1e3ddac9204211924d2187d73ecd72 P c51023bde9f346c1af16edaf4c858f98 [term 1 LEADER]: Received request to transfer leadership to TS 9927a56797194391a4c98a02c10f6f58
I20251023 08:00:22.432279 21955 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "0274899ee0b94ca6ad23688cfc1ffeb5"
dest_uuid: "49d13a11243a439581313cbf2389dea7"
mode: GRACEFUL
new_leader_uuid: "9927a56797194391a4c98a02c10f6f58"
from {username='slave'} at 127.0.0.1:57012
I20251023 08:00:22.432751 21955 raft_consensus.cc:606] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 49d13a11243a439581313cbf2389dea7 [term 1 LEADER]: Received request to transfer leadership to TS 9927a56797194391a4c98a02c10f6f58
I20251023 08:00:22.439828 21955 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "cc63d5c82e054028bd3c0cfe4599d490"
dest_uuid: "49d13a11243a439581313cbf2389dea7"
mode: GRACEFUL
new_leader_uuid: "9927a56797194391a4c98a02c10f6f58"
from {username='slave'} at 127.0.0.1:57012
I20251023 08:00:22.440341 21955 raft_consensus.cc:606] T cc63d5c82e054028bd3c0cfe4599d490 P 49d13a11243a439581313cbf2389dea7 [term 1 LEADER]: Received request to transfer leadership to TS 9927a56797194391a4c98a02c10f6f58
I20251023 08:00:22.447253 21877 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "68421eae3c714c6ca0dffaa6c3d5f3f1"
dest_uuid: "9927a56797194391a4c98a02c10f6f58"
mode: GRACEFUL
new_leader_uuid: "49d13a11243a439581313cbf2389dea7"
from {username='slave'} at 127.0.0.1:55996
I20251023 08:00:22.447741 21877 raft_consensus.cc:606] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P 9927a56797194391a4c98a02c10f6f58 [term 1 LEADER]: Received request to transfer leadership to TS 49d13a11243a439581313cbf2389dea7
I20251023 08:00:22.452266 22027 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "580a58e30dcb430aaf3b33473a277984"
dest_uuid: "c51023bde9f346c1af16edaf4c858f98"
mode: GRACEFUL
new_leader_uuid: "49d13a11243a439581313cbf2389dea7"
from {username='slave'} at 127.0.0.1:40686
I20251023 08:00:22.452760 22027 raft_consensus.cc:606] T 580a58e30dcb430aaf3b33473a277984 P c51023bde9f346c1af16edaf4c858f98 [term 1 LEADER]: Received request to transfer leadership to TS 49d13a11243a439581313cbf2389dea7
I20251023 08:00:22.457408 22027 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "095923a5d18140f2bd7a676fc516acdc"
dest_uuid: "c51023bde9f346c1af16edaf4c858f98"
mode: GRACEFUL
new_leader_uuid: "49d13a11243a439581313cbf2389dea7"
from {username='slave'} at 127.0.0.1:40686
I20251023 08:00:22.457942 22027 raft_consensus.cc:606] T 095923a5d18140f2bd7a676fc516acdc P c51023bde9f346c1af16edaf4c858f98 [term 1 LEADER]: Received request to transfer leadership to TS 49d13a11243a439581313cbf2389dea7
I20251023 08:00:22.484294 22196 consensus_queue.cc:1048] T 580a58e30dcb430aaf3b33473a277984 P c51023bde9f346c1af16edaf4c858f98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 08:00:22.496035 22193 consensus_queue.cc:1048] T 580a58e30dcb430aaf3b33473a277984 P c51023bde9f346c1af16edaf4c858f98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 08:00:22.505549 22076 raft_consensus.cc:993] T 580a58e30dcb430aaf3b33473a277984 P c51023bde9f346c1af16edaf4c858f98: : Instructing follower 49d13a11243a439581313cbf2389dea7 to start an election
I20251023 08:00:22.506060 22076 raft_consensus.cc:1081] T 580a58e30dcb430aaf3b33473a277984 P c51023bde9f346c1af16edaf4c858f98 [term 1 LEADER]: Signalling peer 49d13a11243a439581313cbf2389dea7 to start an election
I20251023 08:00:22.507881 21955 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "580a58e30dcb430aaf3b33473a277984"
dest_uuid: "49d13a11243a439581313cbf2389dea7"
from {username='slave'} at 127.0.0.1:56996
I20251023 08:00:22.508998 21955 raft_consensus.cc:493] T 580a58e30dcb430aaf3b33473a277984 P 49d13a11243a439581313cbf2389dea7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 08:00:22.509397 21955 raft_consensus.cc:3060] T 580a58e30dcb430aaf3b33473a277984 P 49d13a11243a439581313cbf2389dea7 [term 1 FOLLOWER]: Advancing to term 2
I20251023 08:00:22.515376 22218 consensus_queue.cc:1048] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P 9927a56797194391a4c98a02c10f6f58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 08:00:22.516986 21955 raft_consensus.cc:515] T 580a58e30dcb430aaf3b33473a277984 P 49d13a11243a439581313cbf2389dea7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:22.520120 21880 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "580a58e30dcb430aaf3b33473a277984" candidate_uuid: "49d13a11243a439581313cbf2389dea7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9927a56797194391a4c98a02c10f6f58"
I20251023 08:00:22.520473 22027 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "580a58e30dcb430aaf3b33473a277984" candidate_uuid: "49d13a11243a439581313cbf2389dea7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c51023bde9f346c1af16edaf4c858f98"
I20251023 08:00:22.520807 21880 raft_consensus.cc:3060] T 580a58e30dcb430aaf3b33473a277984 P 9927a56797194391a4c98a02c10f6f58 [term 1 FOLLOWER]: Advancing to term 2
I20251023 08:00:22.521203 22027 raft_consensus.cc:3055] T 580a58e30dcb430aaf3b33473a277984 P c51023bde9f346c1af16edaf4c858f98 [term 1 LEADER]: Stepping down as leader of term 1
I20251023 08:00:22.521610 22027 raft_consensus.cc:740] T 580a58e30dcb430aaf3b33473a277984 P c51023bde9f346c1af16edaf4c858f98 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c51023bde9f346c1af16edaf4c858f98, State: Running, Role: LEADER
I20251023 08:00:22.522467 22027 consensus_queue.cc:260] T 580a58e30dcb430aaf3b33473a277984 P c51023bde9f346c1af16edaf4c858f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:22.523671 22027 raft_consensus.cc:3060] T 580a58e30dcb430aaf3b33473a277984 P c51023bde9f346c1af16edaf4c858f98 [term 1 FOLLOWER]: Advancing to term 2
I20251023 08:00:22.520246 21955 leader_election.cc:290] T 580a58e30dcb430aaf3b33473a277984 P 49d13a11243a439581313cbf2389dea7 [CANDIDATE]: Term 2 election: Requested vote from peers 9927a56797194391a4c98a02c10f6f58 (127.16.126.1:43563), c51023bde9f346c1af16edaf4c858f98 (127.16.126.3:36947)
I20251023 08:00:22.525569 22168 raft_consensus.cc:993] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P 9927a56797194391a4c98a02c10f6f58: : Instructing follower 49d13a11243a439581313cbf2389dea7 to start an election
I20251023 08:00:22.526019 22153 raft_consensus.cc:1081] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P 9927a56797194391a4c98a02c10f6f58 [term 1 LEADER]: Signalling peer 49d13a11243a439581313cbf2389dea7 to start an election
I20251023 08:00:22.532593 22027 raft_consensus.cc:2468] T 580a58e30dcb430aaf3b33473a277984 P c51023bde9f346c1af16edaf4c858f98 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49d13a11243a439581313cbf2389dea7 in term 2.
I20251023 08:00:22.532827 22153 consensus_queue.cc:1048] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P 9927a56797194391a4c98a02c10f6f58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 08:00:22.534034 21921 leader_election.cc:304] T 580a58e30dcb430aaf3b33473a277984 P 49d13a11243a439581313cbf2389dea7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49d13a11243a439581313cbf2389dea7, c51023bde9f346c1af16edaf4c858f98; no voters:
I20251023 08:00:22.534958 22215 raft_consensus.cc:2804] T 580a58e30dcb430aaf3b33473a277984 P 49d13a11243a439581313cbf2389dea7 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 08:00:22.535439 22215 raft_consensus.cc:697] T 580a58e30dcb430aaf3b33473a277984 P 49d13a11243a439581313cbf2389dea7 [term 2 LEADER]: Becoming Leader. State: Replica: 49d13a11243a439581313cbf2389dea7, State: Running, Role: LEADER
I20251023 08:00:22.535476 21955 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "68421eae3c714c6ca0dffaa6c3d5f3f1"
dest_uuid: "49d13a11243a439581313cbf2389dea7"
from {username='slave'} at 127.0.0.1:57000
I20251023 08:00:22.536175 21955 raft_consensus.cc:493] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P 49d13a11243a439581313cbf2389dea7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 08:00:22.536583 21955 raft_consensus.cc:3060] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P 49d13a11243a439581313cbf2389dea7 [term 1 FOLLOWER]: Advancing to term 2
I20251023 08:00:22.536312 22215 consensus_queue.cc:237] T 580a58e30dcb430aaf3b33473a277984 P 49d13a11243a439581313cbf2389dea7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:22.545047 21955 raft_consensus.cc:515] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P 49d13a11243a439581313cbf2389dea7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:22.547122 21880 raft_consensus.cc:2468] T 580a58e30dcb430aaf3b33473a277984 P 9927a56797194391a4c98a02c10f6f58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49d13a11243a439581313cbf2389dea7 in term 2.
I20251023 08:00:22.548019 21955 leader_election.cc:290] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P 49d13a11243a439581313cbf2389dea7 [CANDIDATE]: Term 2 election: Requested vote from peers 9927a56797194391a4c98a02c10f6f58 (127.16.126.1:43563), c51023bde9f346c1af16edaf4c858f98 (127.16.126.3:36947)
I20251023 08:00:22.550566 22029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "68421eae3c714c6ca0dffaa6c3d5f3f1" candidate_uuid: "49d13a11243a439581313cbf2389dea7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c51023bde9f346c1af16edaf4c858f98"
I20251023 08:00:22.551180 22029 raft_consensus.cc:3060] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P c51023bde9f346c1af16edaf4c858f98 [term 1 FOLLOWER]: Advancing to term 2
I20251023 08:00:22.551268 21880 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "68421eae3c714c6ca0dffaa6c3d5f3f1" candidate_uuid: "49d13a11243a439581313cbf2389dea7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9927a56797194391a4c98a02c10f6f58"
I20251023 08:00:22.552105 21880 raft_consensus.cc:3055] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P 9927a56797194391a4c98a02c10f6f58 [term 1 LEADER]: Stepping down as leader of term 1
I20251023 08:00:22.552500 21880 raft_consensus.cc:740] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P 9927a56797194391a4c98a02c10f6f58 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9927a56797194391a4c98a02c10f6f58, State: Running, Role: LEADER
I20251023 08:00:22.553195 21880 consensus_queue.cc:260] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P 9927a56797194391a4c98a02c10f6f58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:22.554527 21880 raft_consensus.cc:3060] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P 9927a56797194391a4c98a02c10f6f58 [term 1 FOLLOWER]: Advancing to term 2
I20251023 08:00:22.557029 21775 catalog_manager.cc:5649] T 580a58e30dcb430aaf3b33473a277984 P 49d13a11243a439581313cbf2389dea7 reported cstate change: term changed from 1 to 2, leader changed from c51023bde9f346c1af16edaf4c858f98 (127.16.126.3) to 49d13a11243a439581313cbf2389dea7 (127.16.126.2). New cstate: current_term: 2 leader_uuid: "49d13a11243a439581313cbf2389dea7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } health_report { overall_health: UNKNOWN } } }
I20251023 08:00:22.558770 22029 raft_consensus.cc:2468] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P c51023bde9f346c1af16edaf4c858f98 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49d13a11243a439581313cbf2389dea7 in term 2.
I20251023 08:00:22.560051 21921 leader_election.cc:304] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P 49d13a11243a439581313cbf2389dea7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49d13a11243a439581313cbf2389dea7, c51023bde9f346c1af16edaf4c858f98; no voters:
I20251023 08:00:22.560860 22215 raft_consensus.cc:2804] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P 49d13a11243a439581313cbf2389dea7 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 08:00:22.561370 22215 raft_consensus.cc:697] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P 49d13a11243a439581313cbf2389dea7 [term 2 LEADER]: Becoming Leader. State: Replica: 49d13a11243a439581313cbf2389dea7, State: Running, Role: LEADER
I20251023 08:00:22.562251 22215 consensus_queue.cc:237] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P 49d13a11243a439581313cbf2389dea7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:22.564801 21880 raft_consensus.cc:2468] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P 9927a56797194391a4c98a02c10f6f58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49d13a11243a439581313cbf2389dea7 in term 2.
I20251023 08:00:22.567683 22076 consensus_queue.cc:1048] T 095923a5d18140f2bd7a676fc516acdc P c51023bde9f346c1af16edaf4c858f98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 08:00:22.574121 22076 consensus_queue.cc:1048] T 992be711bf964771a0eae249e906e021 P c51023bde9f346c1af16edaf4c858f98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 08:00:22.575518 22076 raft_consensus.cc:993] T 095923a5d18140f2bd7a676fc516acdc P c51023bde9f346c1af16edaf4c858f98: : Instructing follower 49d13a11243a439581313cbf2389dea7 to start an election
I20251023 08:00:22.575973 22076 raft_consensus.cc:1081] T 095923a5d18140f2bd7a676fc516acdc P c51023bde9f346c1af16edaf4c858f98 [term 1 LEADER]: Signalling peer 49d13a11243a439581313cbf2389dea7 to start an election
I20251023 08:00:22.579896 21955 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "095923a5d18140f2bd7a676fc516acdc"
dest_uuid: "49d13a11243a439581313cbf2389dea7"
from {username='slave'} at 127.0.0.1:56996
I20251023 08:00:22.581382 22196 consensus_queue.cc:1048] T 095923a5d18140f2bd7a676fc516acdc P c51023bde9f346c1af16edaf4c858f98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 08:00:22.582762 21955 raft_consensus.cc:493] T 095923a5d18140f2bd7a676fc516acdc P 49d13a11243a439581313cbf2389dea7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 08:00:22.583472 21955 raft_consensus.cc:3060] T 095923a5d18140f2bd7a676fc516acdc P 49d13a11243a439581313cbf2389dea7 [term 1 FOLLOWER]: Advancing to term 2
I20251023 08:00:22.597477 21955 raft_consensus.cc:515] T 095923a5d18140f2bd7a676fc516acdc P 49d13a11243a439581313cbf2389dea7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:22.614727 21775 catalog_manager.cc:5649] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P 49d13a11243a439581313cbf2389dea7 reported cstate change: term changed from 1 to 2, leader changed from 9927a56797194391a4c98a02c10f6f58 (127.16.126.1) to 49d13a11243a439581313cbf2389dea7 (127.16.126.2). New cstate: current_term: 2 leader_uuid: "49d13a11243a439581313cbf2389dea7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } health_report { overall_health: UNKNOWN } } }
I20251023 08:00:22.622109 21877 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "095923a5d18140f2bd7a676fc516acdc" candidate_uuid: "49d13a11243a439581313cbf2389dea7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9927a56797194391a4c98a02c10f6f58"
I20251023 08:00:22.622377 21955 leader_election.cc:290] T 095923a5d18140f2bd7a676fc516acdc P 49d13a11243a439581313cbf2389dea7 [CANDIDATE]: Term 2 election: Requested vote from peers 9927a56797194391a4c98a02c10f6f58 (127.16.126.1:43563), c51023bde9f346c1af16edaf4c858f98 (127.16.126.3:36947)
I20251023 08:00:22.622454 22029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "095923a5d18140f2bd7a676fc516acdc" candidate_uuid: "49d13a11243a439581313cbf2389dea7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c51023bde9f346c1af16edaf4c858f98"
I20251023 08:00:22.622857 21877 raft_consensus.cc:3060] T 095923a5d18140f2bd7a676fc516acdc P 9927a56797194391a4c98a02c10f6f58 [term 1 FOLLOWER]: Advancing to term 2
I20251023 08:00:22.623335 22029 raft_consensus.cc:3055] T 095923a5d18140f2bd7a676fc516acdc P c51023bde9f346c1af16edaf4c858f98 [term 1 LEADER]: Stepping down as leader of term 1
I20251023 08:00:22.623661 22029 raft_consensus.cc:740] T 095923a5d18140f2bd7a676fc516acdc P c51023bde9f346c1af16edaf4c858f98 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c51023bde9f346c1af16edaf4c858f98, State: Running, Role: LEADER
I20251023 08:00:22.624459 22029 consensus_queue.cc:260] T 095923a5d18140f2bd7a676fc516acdc P c51023bde9f346c1af16edaf4c858f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:22.625638 22029 raft_consensus.cc:3060] T 095923a5d18140f2bd7a676fc516acdc P c51023bde9f346c1af16edaf4c858f98 [term 1 FOLLOWER]: Advancing to term 2
I20251023 08:00:22.631366 22193 consensus_queue.cc:1048] T 992be711bf964771a0eae249e906e021 P c51023bde9f346c1af16edaf4c858f98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 08:00:22.638772 22029 raft_consensus.cc:2468] T 095923a5d18140f2bd7a676fc516acdc P c51023bde9f346c1af16edaf4c858f98 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49d13a11243a439581313cbf2389dea7 in term 2.
I20251023 08:00:22.640439 21921 leader_election.cc:304] T 095923a5d18140f2bd7a676fc516acdc P 49d13a11243a439581313cbf2389dea7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49d13a11243a439581313cbf2389dea7, c51023bde9f346c1af16edaf4c858f98; no voters:
I20251023 08:00:22.641732 22215 raft_consensus.cc:2804] T 095923a5d18140f2bd7a676fc516acdc P 49d13a11243a439581313cbf2389dea7 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 08:00:22.642407 22215 raft_consensus.cc:697] T 095923a5d18140f2bd7a676fc516acdc P 49d13a11243a439581313cbf2389dea7 [term 2 LEADER]: Becoming Leader. State: Replica: 49d13a11243a439581313cbf2389dea7, State: Running, Role: LEADER
I20251023 08:00:22.643543 22215 consensus_queue.cc:237] T 095923a5d18140f2bd7a676fc516acdc P 49d13a11243a439581313cbf2389dea7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:22.645006 21877 raft_consensus.cc:2468] T 095923a5d18140f2bd7a676fc516acdc P 9927a56797194391a4c98a02c10f6f58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49d13a11243a439581313cbf2389dea7 in term 2.
I20251023 08:00:22.648171 22228 consensus_queue.cc:1048] T 1d1e3ddac9204211924d2187d73ecd72 P c51023bde9f346c1af16edaf4c858f98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 08:00:22.661873 22193 raft_consensus.cc:993] T 1d1e3ddac9204211924d2187d73ecd72 P c51023bde9f346c1af16edaf4c858f98: : Instructing follower 9927a56797194391a4c98a02c10f6f58 to start an election
I20251023 08:00:22.662343 22193 raft_consensus.cc:1081] T 1d1e3ddac9204211924d2187d73ecd72 P c51023bde9f346c1af16edaf4c858f98 [term 1 LEADER]: Signalling peer 9927a56797194391a4c98a02c10f6f58 to start an election
I20251023 08:00:22.666074 21880 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "1d1e3ddac9204211924d2187d73ecd72"
dest_uuid: "9927a56797194391a4c98a02c10f6f58"
from {username='slave'} at 127.0.0.1:55974
I20251023 08:00:22.666306 21775 catalog_manager.cc:5649] T 095923a5d18140f2bd7a676fc516acdc P 49d13a11243a439581313cbf2389dea7 reported cstate change: term changed from 1 to 2, leader changed from c51023bde9f346c1af16edaf4c858f98 (127.16.126.3) to 49d13a11243a439581313cbf2389dea7 (127.16.126.2). New cstate: current_term: 2 leader_uuid: "49d13a11243a439581313cbf2389dea7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } health_report { overall_health: UNKNOWN } } }
I20251023 08:00:22.668704 21880 raft_consensus.cc:493] T 1d1e3ddac9204211924d2187d73ecd72 P 9927a56797194391a4c98a02c10f6f58 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 08:00:22.669117 21880 raft_consensus.cc:3060] T 1d1e3ddac9204211924d2187d73ecd72 P 9927a56797194391a4c98a02c10f6f58 [term 1 FOLLOWER]: Advancing to term 2
I20251023 08:00:22.675320 21880 raft_consensus.cc:515] T 1d1e3ddac9204211924d2187d73ecd72 P 9927a56797194391a4c98a02c10f6f58 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:22.676719 22076 consensus_queue.cc:1048] T 1d1e3ddac9204211924d2187d73ecd72 P c51023bde9f346c1af16edaf4c858f98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251023 08:00:22.678550 21880 leader_election.cc:290] T 1d1e3ddac9204211924d2187d73ecd72 P 9927a56797194391a4c98a02c10f6f58 [CANDIDATE]: Term 2 election: Requested vote from peers 49d13a11243a439581313cbf2389dea7 (127.16.126.2:36187), c51023bde9f346c1af16edaf4c858f98 (127.16.126.3:36947)
I20251023 08:00:22.678923 21955 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1d1e3ddac9204211924d2187d73ecd72" candidate_uuid: "9927a56797194391a4c98a02c10f6f58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "49d13a11243a439581313cbf2389dea7"
I20251023 08:00:22.681303 22029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1d1e3ddac9204211924d2187d73ecd72" candidate_uuid: "9927a56797194391a4c98a02c10f6f58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c51023bde9f346c1af16edaf4c858f98"
I20251023 08:00:22.681985 22029 raft_consensus.cc:3055] T 1d1e3ddac9204211924d2187d73ecd72 P c51023bde9f346c1af16edaf4c858f98 [term 1 LEADER]: Stepping down as leader of term 1
I20251023 08:00:22.682339 22029 raft_consensus.cc:740] T 1d1e3ddac9204211924d2187d73ecd72 P c51023bde9f346c1af16edaf4c858f98 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c51023bde9f346c1af16edaf4c858f98, State: Running, Role: LEADER
I20251023 08:00:22.683075 22029 consensus_queue.cc:260] T 1d1e3ddac9204211924d2187d73ecd72 P c51023bde9f346c1af16edaf4c858f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:22.684113 22029 raft_consensus.cc:3060] T 1d1e3ddac9204211924d2187d73ecd72 P c51023bde9f346c1af16edaf4c858f98 [term 1 FOLLOWER]: Advancing to term 2
I20251023 08:00:22.690227 22029 raft_consensus.cc:2468] T 1d1e3ddac9204211924d2187d73ecd72 P c51023bde9f346c1af16edaf4c858f98 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9927a56797194391a4c98a02c10f6f58 in term 2.
I20251023 08:00:22.691157 21846 leader_election.cc:304] T 1d1e3ddac9204211924d2187d73ecd72 P 9927a56797194391a4c98a02c10f6f58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9927a56797194391a4c98a02c10f6f58, c51023bde9f346c1af16edaf4c858f98; no voters: 49d13a11243a439581313cbf2389dea7
I20251023 08:00:22.691859 22168 raft_consensus.cc:2804] T 1d1e3ddac9204211924d2187d73ecd72 P 9927a56797194391a4c98a02c10f6f58 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 08:00:22.692265 22168 raft_consensus.cc:697] T 1d1e3ddac9204211924d2187d73ecd72 P 9927a56797194391a4c98a02c10f6f58 [term 2 LEADER]: Becoming Leader. State: Replica: 9927a56797194391a4c98a02c10f6f58, State: Running, Role: LEADER
I20251023 08:00:22.693022 22168 consensus_queue.cc:237] T 1d1e3ddac9204211924d2187d73ecd72 P 9927a56797194391a4c98a02c10f6f58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:22.699225 21778 catalog_manager.cc:5649] T 1d1e3ddac9204211924d2187d73ecd72 P 9927a56797194391a4c98a02c10f6f58 reported cstate change: term changed from 1 to 2, leader changed from c51023bde9f346c1af16edaf4c858f98 (127.16.126.3) to 9927a56797194391a4c98a02c10f6f58 (127.16.126.1). New cstate: current_term: 2 leader_uuid: "9927a56797194391a4c98a02c10f6f58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } health_report { overall_health: UNKNOWN } } }
I20251023 08:00:22.735364 22200 consensus_queue.cc:1048] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 49d13a11243a439581313cbf2389dea7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 08:00:22.747336 22215 consensus_queue.cc:1048] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 49d13a11243a439581313cbf2389dea7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251023 08:00:22.755867 22144 raft_consensus.cc:993] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 49d13a11243a439581313cbf2389dea7: : Instructing follower 9927a56797194391a4c98a02c10f6f58 to start an election
I20251023 08:00:22.756335 22144 raft_consensus.cc:1081] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 49d13a11243a439581313cbf2389dea7 [term 1 LEADER]: Signalling peer 9927a56797194391a4c98a02c10f6f58 to start an election
I20251023 08:00:22.757746 21880 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "0274899ee0b94ca6ad23688cfc1ffeb5"
dest_uuid: "9927a56797194391a4c98a02c10f6f58"
from {username='slave'} at 127.0.0.1:55982
I20251023 08:00:22.758219 21880 raft_consensus.cc:493] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 9927a56797194391a4c98a02c10f6f58 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 08:00:22.758564 21880 raft_consensus.cc:3060] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 9927a56797194391a4c98a02c10f6f58 [term 1 FOLLOWER]: Advancing to term 2
I20251023 08:00:22.766433 21880 raft_consensus.cc:515] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 9927a56797194391a4c98a02c10f6f58 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:22.768198 21880 leader_election.cc:290] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 9927a56797194391a4c98a02c10f6f58 [CANDIDATE]: Term 2 election: Requested vote from peers 49d13a11243a439581313cbf2389dea7 (127.16.126.2:36187), c51023bde9f346c1af16edaf4c858f98 (127.16.126.3:36947)
I20251023 08:00:22.769197 21953 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0274899ee0b94ca6ad23688cfc1ffeb5" candidate_uuid: "9927a56797194391a4c98a02c10f6f58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "49d13a11243a439581313cbf2389dea7"
I20251023 08:00:22.769320 22029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0274899ee0b94ca6ad23688cfc1ffeb5" candidate_uuid: "9927a56797194391a4c98a02c10f6f58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c51023bde9f346c1af16edaf4c858f98"
I20251023 08:00:22.770069 21953 raft_consensus.cc:3055] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 49d13a11243a439581313cbf2389dea7 [term 1 LEADER]: Stepping down as leader of term 1
I20251023 08:00:22.770159 22029 raft_consensus.cc:3060] T 0274899ee0b94ca6ad23688cfc1ffeb5 P c51023bde9f346c1af16edaf4c858f98 [term 1 FOLLOWER]: Advancing to term 2
I20251023 08:00:22.770469 21953 raft_consensus.cc:740] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 49d13a11243a439581313cbf2389dea7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 49d13a11243a439581313cbf2389dea7, State: Running, Role: LEADER
I20251023 08:00:22.771307 21953 consensus_queue.cc:260] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 49d13a11243a439581313cbf2389dea7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:22.772676 21953 raft_consensus.cc:3060] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 49d13a11243a439581313cbf2389dea7 [term 1 FOLLOWER]: Advancing to term 2
I20251023 08:00:22.777086 22029 raft_consensus.cc:2468] T 0274899ee0b94ca6ad23688cfc1ffeb5 P c51023bde9f346c1af16edaf4c858f98 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9927a56797194391a4c98a02c10f6f58 in term 2.
I20251023 08:00:22.778098 21846 leader_election.cc:304] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 9927a56797194391a4c98a02c10f6f58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9927a56797194391a4c98a02c10f6f58, c51023bde9f346c1af16edaf4c858f98; no voters:
I20251023 08:00:22.778870 22168 raft_consensus.cc:2804] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 9927a56797194391a4c98a02c10f6f58 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 08:00:22.779261 22168 raft_consensus.cc:697] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 9927a56797194391a4c98a02c10f6f58 [term 2 LEADER]: Becoming Leader. State: Replica: 9927a56797194391a4c98a02c10f6f58, State: Running, Role: LEADER
I20251023 08:00:22.779707 21953 raft_consensus.cc:2468] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 49d13a11243a439581313cbf2389dea7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9927a56797194391a4c98a02c10f6f58 in term 2.
I20251023 08:00:22.779997 22168 consensus_queue.cc:237] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 9927a56797194391a4c98a02c10f6f58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:22.787034 21778 catalog_manager.cc:5649] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 9927a56797194391a4c98a02c10f6f58 reported cstate change: term changed from 1 to 2, leader changed from 49d13a11243a439581313cbf2389dea7 (127.16.126.2) to 9927a56797194391a4c98a02c10f6f58 (127.16.126.1). New cstate: current_term: 2 leader_uuid: "9927a56797194391a4c98a02c10f6f58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } health_report { overall_health: UNKNOWN } } }
I20251023 08:00:23.028159 21880 raft_consensus.cc:1275] T 580a58e30dcb430aaf3b33473a277984 P 9927a56797194391a4c98a02c10f6f58 [term 2 FOLLOWER]: Refusing update from remote peer 49d13a11243a439581313cbf2389dea7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 08:00:23.030125 22144 consensus_queue.cc:1048] T 580a58e30dcb430aaf3b33473a277984 P 49d13a11243a439581313cbf2389dea7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 08:00:23.030865 22173 raft_consensus.cc:993] T cc63d5c82e054028bd3c0cfe4599d490 P 49d13a11243a439581313cbf2389dea7: : Instructing follower 9927a56797194391a4c98a02c10f6f58 to start an election
I20251023 08:00:23.031427 22144 raft_consensus.cc:1081] T cc63d5c82e054028bd3c0cfe4599d490 P 49d13a11243a439581313cbf2389dea7 [term 1 LEADER]: Signalling peer 9927a56797194391a4c98a02c10f6f58 to start an election
I20251023 08:00:23.033129 21880 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "cc63d5c82e054028bd3c0cfe4599d490"
dest_uuid: "9927a56797194391a4c98a02c10f6f58"
from {username='slave'} at 127.0.0.1:55982
I20251023 08:00:23.033740 21880 raft_consensus.cc:493] T cc63d5c82e054028bd3c0cfe4599d490 P 9927a56797194391a4c98a02c10f6f58 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 08:00:23.034138 21880 raft_consensus.cc:3060] T cc63d5c82e054028bd3c0cfe4599d490 P 9927a56797194391a4c98a02c10f6f58 [term 1 FOLLOWER]: Advancing to term 2
I20251023 08:00:23.034725 22029 raft_consensus.cc:1275] T 580a58e30dcb430aaf3b33473a277984 P c51023bde9f346c1af16edaf4c858f98 [term 2 FOLLOWER]: Refusing update from remote peer 49d13a11243a439581313cbf2389dea7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 08:00:23.036312 22173 consensus_queue.cc:1048] T 580a58e30dcb430aaf3b33473a277984 P 49d13a11243a439581313cbf2389dea7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 08:00:23.048910 21880 raft_consensus.cc:515] T cc63d5c82e054028bd3c0cfe4599d490 P 9927a56797194391a4c98a02c10f6f58 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:23.051121 21880 leader_election.cc:290] T cc63d5c82e054028bd3c0cfe4599d490 P 9927a56797194391a4c98a02c10f6f58 [CANDIDATE]: Term 2 election: Requested vote from peers 49d13a11243a439581313cbf2389dea7 (127.16.126.2:36187), c51023bde9f346c1af16edaf4c858f98 (127.16.126.3:36947)
I20251023 08:00:23.051765 21953 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cc63d5c82e054028bd3c0cfe4599d490" candidate_uuid: "9927a56797194391a4c98a02c10f6f58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "49d13a11243a439581313cbf2389dea7"
I20251023 08:00:23.052445 21953 raft_consensus.cc:3055] T cc63d5c82e054028bd3c0cfe4599d490 P 49d13a11243a439581313cbf2389dea7 [term 1 LEADER]: Stepping down as leader of term 1
I20251023 08:00:23.052698 21953 raft_consensus.cc:740] T cc63d5c82e054028bd3c0cfe4599d490 P 49d13a11243a439581313cbf2389dea7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 49d13a11243a439581313cbf2389dea7, State: Running, Role: LEADER
I20251023 08:00:23.052578 22029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cc63d5c82e054028bd3c0cfe4599d490" candidate_uuid: "9927a56797194391a4c98a02c10f6f58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c51023bde9f346c1af16edaf4c858f98"
I20251023 08:00:23.053275 22029 raft_consensus.cc:3060] T cc63d5c82e054028bd3c0cfe4599d490 P c51023bde9f346c1af16edaf4c858f98 [term 1 FOLLOWER]: Advancing to term 2
I20251023 08:00:23.053532 21953 consensus_queue.cc:260] T cc63d5c82e054028bd3c0cfe4599d490 P 49d13a11243a439581313cbf2389dea7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:23.054811 21953 raft_consensus.cc:3060] T cc63d5c82e054028bd3c0cfe4599d490 P 49d13a11243a439581313cbf2389dea7 [term 1 FOLLOWER]: Advancing to term 2
I20251023 08:00:23.058879 22029 raft_consensus.cc:2468] T cc63d5c82e054028bd3c0cfe4599d490 P c51023bde9f346c1af16edaf4c858f98 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9927a56797194391a4c98a02c10f6f58 in term 2.
I20251023 08:00:23.059993 21846 leader_election.cc:304] T cc63d5c82e054028bd3c0cfe4599d490 P 9927a56797194391a4c98a02c10f6f58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9927a56797194391a4c98a02c10f6f58, c51023bde9f346c1af16edaf4c858f98; no voters:
I20251023 08:00:23.060783 22168 raft_consensus.cc:2804] T cc63d5c82e054028bd3c0cfe4599d490 P 9927a56797194391a4c98a02c10f6f58 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 08:00:23.061252 22168 raft_consensus.cc:697] T cc63d5c82e054028bd3c0cfe4599d490 P 9927a56797194391a4c98a02c10f6f58 [term 2 LEADER]: Becoming Leader. State: Replica: 9927a56797194391a4c98a02c10f6f58, State: Running, Role: LEADER
I20251023 08:00:23.062163 21953 raft_consensus.cc:2468] T cc63d5c82e054028bd3c0cfe4599d490 P 49d13a11243a439581313cbf2389dea7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9927a56797194391a4c98a02c10f6f58 in term 2.
I20251023 08:00:23.062110 22168 consensus_queue.cc:237] T cc63d5c82e054028bd3c0cfe4599d490 P 9927a56797194391a4c98a02c10f6f58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:23.069875 21777 catalog_manager.cc:5649] T cc63d5c82e054028bd3c0cfe4599d490 P 9927a56797194391a4c98a02c10f6f58 reported cstate change: term changed from 1 to 2, leader changed from 49d13a11243a439581313cbf2389dea7 (127.16.126.2) to 9927a56797194391a4c98a02c10f6f58 (127.16.126.1). New cstate: current_term: 2 leader_uuid: "9927a56797194391a4c98a02c10f6f58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } health_report { overall_health: UNKNOWN } } }
I20251023 08:00:23.072362 21880 raft_consensus.cc:1275] T 095923a5d18140f2bd7a676fc516acdc P 9927a56797194391a4c98a02c10f6f58 [term 2 FOLLOWER]: Refusing update from remote peer 49d13a11243a439581313cbf2389dea7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 08:00:23.073757 22173 consensus_queue.cc:1048] T 095923a5d18140f2bd7a676fc516acdc P 49d13a11243a439581313cbf2389dea7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 08:00:23.081231 22029 raft_consensus.cc:1275] T 095923a5d18140f2bd7a676fc516acdc P c51023bde9f346c1af16edaf4c858f98 [term 2 FOLLOWER]: Refusing update from remote peer 49d13a11243a439581313cbf2389dea7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 08:00:23.082545 22173 consensus_queue.cc:1048] T 095923a5d18140f2bd7a676fc516acdc P 49d13a11243a439581313cbf2389dea7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 08:00:23.090082 22027 raft_consensus.cc:1275] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P c51023bde9f346c1af16edaf4c858f98 [term 2 FOLLOWER]: Refusing update from remote peer 49d13a11243a439581313cbf2389dea7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 08:00:23.091408 22200 consensus_queue.cc:1048] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P 49d13a11243a439581313cbf2389dea7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 08:00:23.100279 21880 raft_consensus.cc:1275] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P 9927a56797194391a4c98a02c10f6f58 [term 2 FOLLOWER]: Refusing update from remote peer 49d13a11243a439581313cbf2389dea7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 08:00:23.104719 22173 consensus_queue.cc:1048] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P 49d13a11243a439581313cbf2389dea7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20251023 08:00:23.116307 22027 raft_consensus.cc:1275] T 1d1e3ddac9204211924d2187d73ecd72 P c51023bde9f346c1af16edaf4c858f98 [term 2 FOLLOWER]: Refusing update from remote peer 9927a56797194391a4c98a02c10f6f58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 08:00:23.117908 22168 consensus_queue.cc:1048] T 1d1e3ddac9204211924d2187d73ecd72 P 9927a56797194391a4c98a02c10f6f58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 08:00:23.126113 21953 raft_consensus.cc:3060] T 1d1e3ddac9204211924d2187d73ecd72 P 49d13a11243a439581313cbf2389dea7 [term 1 FOLLOWER]: Advancing to term 2
I20251023 08:00:23.132238 21953 raft_consensus.cc:1275] T 1d1e3ddac9204211924d2187d73ecd72 P 49d13a11243a439581313cbf2389dea7 [term 2 FOLLOWER]: Refusing update from remote peer 9927a56797194391a4c98a02c10f6f58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 08:00:23.180043 22153 consensus_queue.cc:1048] T 1d1e3ddac9204211924d2187d73ecd72 P 9927a56797194391a4c98a02c10f6f58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20251023 08:00:23.330494 21955 raft_consensus.cc:1275] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 49d13a11243a439581313cbf2389dea7 [term 2 FOLLOWER]: Refusing update from remote peer 9927a56797194391a4c98a02c10f6f58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 08:00:23.331974 22236 consensus_queue.cc:1048] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 9927a56797194391a4c98a02c10f6f58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 08:00:23.343130 22027 raft_consensus.cc:1275] T 0274899ee0b94ca6ad23688cfc1ffeb5 P c51023bde9f346c1af16edaf4c858f98 [term 2 FOLLOWER]: Refusing update from remote peer 9927a56797194391a4c98a02c10f6f58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 08:00:23.344717 22168 consensus_queue.cc:1048] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 9927a56797194391a4c98a02c10f6f58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20251023 08:00:23.485707 21953 raft_consensus.cc:1275] T cc63d5c82e054028bd3c0cfe4599d490 P 49d13a11243a439581313cbf2389dea7 [term 2 FOLLOWER]: Refusing update from remote peer 9927a56797194391a4c98a02c10f6f58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 08:00:23.487120 22236 consensus_queue.cc:1048] T cc63d5c82e054028bd3c0cfe4599d490 P 9927a56797194391a4c98a02c10f6f58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 08:00:23.501801 22027 raft_consensus.cc:1275] T cc63d5c82e054028bd3c0cfe4599d490 P c51023bde9f346c1af16edaf4c858f98 [term 2 FOLLOWER]: Refusing update from remote peer 9927a56797194391a4c98a02c10f6f58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 08:00:23.503785 22168 consensus_queue.cc:1048] T cc63d5c82e054028bd3c0cfe4599d490 P 9927a56797194391a4c98a02c10f6f58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 08:00:23.695008 22173 raft_consensus.cc:493] T ec26529ef6c64b259b8428285a2ad427 P 49d13a11243a439581313cbf2389dea7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 08:00:23.695557 22173 raft_consensus.cc:515] T ec26529ef6c64b259b8428285a2ad427 P 49d13a11243a439581313cbf2389dea7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:23.697503 22173 leader_election.cc:290] T ec26529ef6c64b259b8428285a2ad427 P 49d13a11243a439581313cbf2389dea7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9927a56797194391a4c98a02c10f6f58 (127.16.126.1:43563), c51023bde9f346c1af16edaf4c858f98 (127.16.126.3:36947)
I20251023 08:00:23.698486 21880 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec26529ef6c64b259b8428285a2ad427" candidate_uuid: "49d13a11243a439581313cbf2389dea7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9927a56797194391a4c98a02c10f6f58" is_pre_election: true
I20251023 08:00:23.698582 22027 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec26529ef6c64b259b8428285a2ad427" candidate_uuid: "49d13a11243a439581313cbf2389dea7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c51023bde9f346c1af16edaf4c858f98" is_pre_election: true
I20251023 08:00:23.700369 21921 leader_election.cc:304] T ec26529ef6c64b259b8428285a2ad427 P 49d13a11243a439581313cbf2389dea7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 49d13a11243a439581313cbf2389dea7; no voters: 9927a56797194391a4c98a02c10f6f58, c51023bde9f346c1af16edaf4c858f98
I20251023 08:00:23.701082 22173 raft_consensus.cc:2749] T ec26529ef6c64b259b8428285a2ad427 P 49d13a11243a439581313cbf2389dea7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251023 08:00:23.741909 22196 raft_consensus.cc:493] T ec26529ef6c64b259b8428285a2ad427 P c51023bde9f346c1af16edaf4c858f98 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 49d13a11243a439581313cbf2389dea7)
I20251023 08:00:23.742735 22196 raft_consensus.cc:515] T ec26529ef6c64b259b8428285a2ad427 P c51023bde9f346c1af16edaf4c858f98 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:23.744572 22196 leader_election.cc:290] T ec26529ef6c64b259b8428285a2ad427 P c51023bde9f346c1af16edaf4c858f98 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9927a56797194391a4c98a02c10f6f58 (127.16.126.1:43563), 49d13a11243a439581313cbf2389dea7 (127.16.126.2:36187)
I20251023 08:00:23.745268 21880 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec26529ef6c64b259b8428285a2ad427" candidate_uuid: "c51023bde9f346c1af16edaf4c858f98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9927a56797194391a4c98a02c10f6f58" is_pre_election: true
I20251023 08:00:23.745687 21953 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec26529ef6c64b259b8428285a2ad427" candidate_uuid: "c51023bde9f346c1af16edaf4c858f98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "49d13a11243a439581313cbf2389dea7" is_pre_election: true
I20251023 08:00:23.746338 21880 raft_consensus.cc:2393] T ec26529ef6c64b259b8428285a2ad427 P 9927a56797194391a4c98a02c10f6f58 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c51023bde9f346c1af16edaf4c858f98 in current term 2: Already voted for candidate 9927a56797194391a4c98a02c10f6f58 in this term.
I20251023 08:00:23.746469 21953 raft_consensus.cc:2468] T ec26529ef6c64b259b8428285a2ad427 P 49d13a11243a439581313cbf2389dea7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c51023bde9f346c1af16edaf4c858f98 in term 2.
I20251023 08:00:23.748042 21992 leader_election.cc:304] T ec26529ef6c64b259b8428285a2ad427 P c51023bde9f346c1af16edaf4c858f98 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 49d13a11243a439581313cbf2389dea7, c51023bde9f346c1af16edaf4c858f98; no voters: 9927a56797194391a4c98a02c10f6f58
I20251023 08:00:23.748934 22196 raft_consensus.cc:2804] T ec26529ef6c64b259b8428285a2ad427 P c51023bde9f346c1af16edaf4c858f98 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251023 08:00:23.749307 22196 raft_consensus.cc:493] T ec26529ef6c64b259b8428285a2ad427 P c51023bde9f346c1af16edaf4c858f98 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 49d13a11243a439581313cbf2389dea7)
I20251023 08:00:23.749722 22196 raft_consensus.cc:3060] T ec26529ef6c64b259b8428285a2ad427 P c51023bde9f346c1af16edaf4c858f98 [term 1 FOLLOWER]: Advancing to term 2
I20251023 08:00:23.757480 22196 raft_consensus.cc:515] T ec26529ef6c64b259b8428285a2ad427 P c51023bde9f346c1af16edaf4c858f98 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:23.759128 22196 leader_election.cc:290] T ec26529ef6c64b259b8428285a2ad427 P c51023bde9f346c1af16edaf4c858f98 [CANDIDATE]: Term 2 election: Requested vote from peers 9927a56797194391a4c98a02c10f6f58 (127.16.126.1:43563), 49d13a11243a439581313cbf2389dea7 (127.16.126.2:36187)
I20251023 08:00:23.760084 21880 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec26529ef6c64b259b8428285a2ad427" candidate_uuid: "c51023bde9f346c1af16edaf4c858f98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9927a56797194391a4c98a02c10f6f58"
I20251023 08:00:23.760200 21953 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec26529ef6c64b259b8428285a2ad427" candidate_uuid: "c51023bde9f346c1af16edaf4c858f98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "49d13a11243a439581313cbf2389dea7"
I20251023 08:00:23.761062 21880 raft_consensus.cc:2393] T ec26529ef6c64b259b8428285a2ad427 P 9927a56797194391a4c98a02c10f6f58 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c51023bde9f346c1af16edaf4c858f98 in current term 2: Already voted for candidate 9927a56797194391a4c98a02c10f6f58 in this term.
I20251023 08:00:23.767379 21953 raft_consensus.cc:2468] T ec26529ef6c64b259b8428285a2ad427 P 49d13a11243a439581313cbf2389dea7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c51023bde9f346c1af16edaf4c858f98 in term 2.
I20251023 08:00:23.768517 21992 leader_election.cc:304] T ec26529ef6c64b259b8428285a2ad427 P c51023bde9f346c1af16edaf4c858f98 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 49d13a11243a439581313cbf2389dea7, c51023bde9f346c1af16edaf4c858f98; no voters: 9927a56797194391a4c98a02c10f6f58
I20251023 08:00:23.769217 22196 raft_consensus.cc:2804] T ec26529ef6c64b259b8428285a2ad427 P c51023bde9f346c1af16edaf4c858f98 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 08:00:23.770202 22196 raft_consensus.cc:697] T ec26529ef6c64b259b8428285a2ad427 P c51023bde9f346c1af16edaf4c858f98 [term 2 LEADER]: Becoming Leader. State: Replica: c51023bde9f346c1af16edaf4c858f98, State: Running, Role: LEADER
I20251023 08:00:23.771234 22196 consensus_queue.cc:237] T ec26529ef6c64b259b8428285a2ad427 P c51023bde9f346c1af16edaf4c858f98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:23.778605 21777 catalog_manager.cc:5649] T ec26529ef6c64b259b8428285a2ad427 P c51023bde9f346c1af16edaf4c858f98 reported cstate change: term changed from 1 to 2, leader changed from 49d13a11243a439581313cbf2389dea7 (127.16.126.2) to c51023bde9f346c1af16edaf4c858f98 (127.16.126.3). New cstate: current_term: 2 leader_uuid: "c51023bde9f346c1af16edaf4c858f98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } health_report { overall_health: HEALTHY } } }
I20251023 08:00:23.978082 22168 raft_consensus.cc:493] T ec26529ef6c64b259b8428285a2ad427 P 9927a56797194391a4c98a02c10f6f58 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251023 08:00:23.978731 22168 raft_consensus.cc:515] T ec26529ef6c64b259b8428285a2ad427 P 9927a56797194391a4c98a02c10f6f58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:23.981261 22168 leader_election.cc:290] T ec26529ef6c64b259b8428285a2ad427 P 9927a56797194391a4c98a02c10f6f58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 49d13a11243a439581313cbf2389dea7 (127.16.126.2:36187), c51023bde9f346c1af16edaf4c858f98 (127.16.126.3:36947)
I20251023 08:00:23.982085 21953 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec26529ef6c64b259b8428285a2ad427" candidate_uuid: "9927a56797194391a4c98a02c10f6f58" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "49d13a11243a439581313cbf2389dea7" is_pre_election: true
I20251023 08:00:23.982823 21953 raft_consensus.cc:2468] T ec26529ef6c64b259b8428285a2ad427 P 49d13a11243a439581313cbf2389dea7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9927a56797194391a4c98a02c10f6f58 in term 2.
I20251023 08:00:23.982894 22027 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec26529ef6c64b259b8428285a2ad427" candidate_uuid: "9927a56797194391a4c98a02c10f6f58" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c51023bde9f346c1af16edaf4c858f98" is_pre_election: true
I20251023 08:00:23.983907 21843 leader_election.cc:304] T ec26529ef6c64b259b8428285a2ad427 P 9927a56797194391a4c98a02c10f6f58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49d13a11243a439581313cbf2389dea7, 9927a56797194391a4c98a02c10f6f58; no voters:
I20251023 08:00:23.984612 22168 raft_consensus.cc:2804] T ec26529ef6c64b259b8428285a2ad427 P 9927a56797194391a4c98a02c10f6f58 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251023 08:00:23.984983 22168 raft_consensus.cc:493] T ec26529ef6c64b259b8428285a2ad427 P 9927a56797194391a4c98a02c10f6f58 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251023 08:00:23.985262 22168 raft_consensus.cc:3060] T ec26529ef6c64b259b8428285a2ad427 P 9927a56797194391a4c98a02c10f6f58 [term 2 FOLLOWER]: Advancing to term 3
I20251023 08:00:23.992977 22168 raft_consensus.cc:515] T ec26529ef6c64b259b8428285a2ad427 P 9927a56797194391a4c98a02c10f6f58 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:23.994590 22168 leader_election.cc:290] T ec26529ef6c64b259b8428285a2ad427 P 9927a56797194391a4c98a02c10f6f58 [CANDIDATE]: Term 3 election: Requested vote from peers 49d13a11243a439581313cbf2389dea7 (127.16.126.2:36187), c51023bde9f346c1af16edaf4c858f98 (127.16.126.3:36947)
I20251023 08:00:23.995258 21953 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec26529ef6c64b259b8428285a2ad427" candidate_uuid: "9927a56797194391a4c98a02c10f6f58" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "49d13a11243a439581313cbf2389dea7"
I20251023 08:00:23.995558 22029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec26529ef6c64b259b8428285a2ad427" candidate_uuid: "9927a56797194391a4c98a02c10f6f58" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c51023bde9f346c1af16edaf4c858f98"
I20251023 08:00:23.995812 21953 raft_consensus.cc:3060] T ec26529ef6c64b259b8428285a2ad427 P 49d13a11243a439581313cbf2389dea7 [term 2 FOLLOWER]: Advancing to term 3
I20251023 08:00:24.001490 21953 raft_consensus.cc:2468] T ec26529ef6c64b259b8428285a2ad427 P 49d13a11243a439581313cbf2389dea7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9927a56797194391a4c98a02c10f6f58 in term 3.
I20251023 08:00:24.002468 21843 leader_election.cc:304] T ec26529ef6c64b259b8428285a2ad427 P 9927a56797194391a4c98a02c10f6f58 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 49d13a11243a439581313cbf2389dea7, 9927a56797194391a4c98a02c10f6f58; no voters: c51023bde9f346c1af16edaf4c858f98
I20251023 08:00:24.003109 22168 raft_consensus.cc:2804] T ec26529ef6c64b259b8428285a2ad427 P 9927a56797194391a4c98a02c10f6f58 [term 3 FOLLOWER]: Leader election won for term 3
I20251023 08:00:24.003526 22168 raft_consensus.cc:697] T ec26529ef6c64b259b8428285a2ad427 P 9927a56797194391a4c98a02c10f6f58 [term 3 LEADER]: Becoming Leader. State: Replica: 9927a56797194391a4c98a02c10f6f58, State: Running, Role: LEADER
I20251023 08:00:24.004328 22168 consensus_queue.cc:237] T ec26529ef6c64b259b8428285a2ad427 P 9927a56797194391a4c98a02c10f6f58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:24.012601 21777 catalog_manager.cc:5649] T ec26529ef6c64b259b8428285a2ad427 P 9927a56797194391a4c98a02c10f6f58 reported cstate change: term changed from 2 to 3, leader changed from c51023bde9f346c1af16edaf4c858f98 (127.16.126.3) to 9927a56797194391a4c98a02c10f6f58 (127.16.126.1). New cstate: current_term: 3 leader_uuid: "9927a56797194391a4c98a02c10f6f58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } health_report { overall_health: UNKNOWN } } }
I20251023 08:00:24.238591 21953 raft_consensus.cc:1240] T ec26529ef6c64b259b8428285a2ad427 P 49d13a11243a439581313cbf2389dea7 [term 3 FOLLOWER]: Rejecting Update request from peer c51023bde9f346c1af16edaf4c858f98 for earlier term 2. Current term is 3. Ops: []
I20251023 08:00:24.239902 22196 consensus_queue.cc:1059] T ec26529ef6c64b259b8428285a2ad427 P c51023bde9f346c1af16edaf4c858f98 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 08:00:24.240691 22240 raft_consensus.cc:3055] T ec26529ef6c64b259b8428285a2ad427 P c51023bde9f346c1af16edaf4c858f98 [term 2 LEADER]: Stepping down as leader of term 2
I20251023 08:00:24.240955 22240 raft_consensus.cc:740] T ec26529ef6c64b259b8428285a2ad427 P c51023bde9f346c1af16edaf4c858f98 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c51023bde9f346c1af16edaf4c858f98, State: Running, Role: LEADER
I20251023 08:00:24.241614 22240 consensus_queue.cc:260] T ec26529ef6c64b259b8428285a2ad427 P c51023bde9f346c1af16edaf4c858f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:24.242483 22240 raft_consensus.cc:3060] T ec26529ef6c64b259b8428285a2ad427 P c51023bde9f346c1af16edaf4c858f98 [term 2 FOLLOWER]: Advancing to term 3
I20251023 08:00:24.539887 22027 raft_consensus.cc:1275] T ec26529ef6c64b259b8428285a2ad427 P c51023bde9f346c1af16edaf4c858f98 [term 3 FOLLOWER]: Refusing update from remote peer 9927a56797194391a4c98a02c10f6f58: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20251023 08:00:24.540266 22027 pending_rounds.cc:85] T ec26529ef6c64b259b8428285a2ad427 P c51023bde9f346c1af16edaf4c858f98: Aborting all ops after (but not including) 1
I20251023 08:00:24.540504 22027 pending_rounds.cc:107] T ec26529ef6c64b259b8428285a2ad427 P c51023bde9f346c1af16edaf4c858f98: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20251023 08:00:24.540729 22027 raft_consensus.cc:2889] T ec26529ef6c64b259b8428285a2ad427 P c51023bde9f346c1af16edaf4c858f98 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20251023 08:00:24.542088 22168 consensus_queue.cc:1048] T ec26529ef6c64b259b8428285a2ad427 P 9927a56797194391a4c98a02c10f6f58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 08:00:24.554142 21953 raft_consensus.cc:1275] T ec26529ef6c64b259b8428285a2ad427 P 49d13a11243a439581313cbf2389dea7 [term 3 FOLLOWER]: Refusing update from remote peer 9927a56797194391a4c98a02c10f6f58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20251023 08:00:24.556288 22168 consensus_queue.cc:1048] T ec26529ef6c64b259b8428285a2ad427 P 9927a56797194391a4c98a02c10f6f58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 08:00:25.463685 21775 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:54932:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20251023 08:00:25.484174 21775 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:54932:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20251023 08:00:25.512807 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20251023 08:00:25.780560 22285 log.cc:927] Time spent T 0274899ee0b94ca6ad23688cfc1ffeb5 P c51023bde9f346c1af16edaf4c858f98: Append to log took a long time: real 0.079s user 0.001s sys 0.000s
I20251023 08:00:25.774359 22293 tablet.cc:1722] T 1d1e3ddac9204211924d2187d73ecd72 P 9927a56797194391a4c98a02c10f6f58: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251023 08:00:25.814742 22289 tablet.cc:1722] T 9cd5e272db7a47c2b5f84af9bf661b1d P 9927a56797194391a4c98a02c10f6f58: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
W20251023 08:00:25.838287 22296 log.cc:927] Time spent T ec26529ef6c64b259b8428285a2ad427 P c51023bde9f346c1af16edaf4c858f98: Append to log took a long time: real 0.078s user 0.000s sys 0.001s
I20251023 08:00:25.824127 22292 tablet.cc:1722] T 1d1e3ddac9204211924d2187d73ecd72 P 49d13a11243a439581313cbf2389dea7: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251023 08:00:25.849933 21880 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "a773cc2cdf5045c09ec36f401421de47"
dest_uuid: "9927a56797194391a4c98a02c10f6f58"
mode: GRACEFUL
new_leader_uuid: "c51023bde9f346c1af16edaf4c858f98"
from {username='slave'} at 127.0.0.1:34178
I20251023 08:00:25.850945 21880 raft_consensus.cc:606] T a773cc2cdf5045c09ec36f401421de47 P 9927a56797194391a4c98a02c10f6f58 [term 1 LEADER]: Received request to transfer leadership to TS c51023bde9f346c1af16edaf4c858f98
I20251023 08:00:25.871833 22306 tablet.cc:1722] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P c51023bde9f346c1af16edaf4c858f98: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251023 08:00:25.873610 22305 tablet.cc:1722] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P 49d13a11243a439581313cbf2389dea7: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251023 08:00:25.906898 22312 tablet.cc:1722] T cc63d5c82e054028bd3c0cfe4599d490 P 9927a56797194391a4c98a02c10f6f58: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251023 08:00:25.907121 22316 tablet.cc:1722] T 095923a5d18140f2bd7a676fc516acdc P 49d13a11243a439581313cbf2389dea7: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251023 08:00:25.931026 22309 tablet.cc:1722] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 9927a56797194391a4c98a02c10f6f58: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251023 08:00:25.933784 22313 tablet.cc:1722] T cc63d5c82e054028bd3c0cfe4599d490 P c51023bde9f346c1af16edaf4c858f98: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251023 08:00:25.966022 22292 tablet.cc:1722] T 9cd5e272db7a47c2b5f84af9bf661b1d P 49d13a11243a439581313cbf2389dea7: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251023 08:00:25.977253 22317 tablet.cc:1722] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 49d13a11243a439581313cbf2389dea7: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251023 08:00:25.986997 22314 tablet.cc:1722] T ec26529ef6c64b259b8428285a2ad427 P c51023bde9f346c1af16edaf4c858f98: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251023 08:00:25.998389 22315 tablet.cc:1722] T 1d1e3ddac9204211924d2187d73ecd72 P c51023bde9f346c1af16edaf4c858f98: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251023 08:00:26.004204 22293 tablet.cc:1722] T 095923a5d18140f2bd7a676fc516acdc P 9927a56797194391a4c98a02c10f6f58: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251023 08:00:26.011613 22316 tablet.cc:1722] T 580a58e30dcb430aaf3b33473a277984 P 49d13a11243a439581313cbf2389dea7: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251023 08:00:26.031208 22306 tablet.cc:1722] T 9cd5e272db7a47c2b5f84af9bf661b1d P c51023bde9f346c1af16edaf4c858f98: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251023 08:00:26.033339 22313 tablet.cc:1722] T 0274899ee0b94ca6ad23688cfc1ffeb5 P c51023bde9f346c1af16edaf4c858f98: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251023 08:00:26.037003 22315 tablet.cc:1722] T 992be711bf964771a0eae249e906e021 P c51023bde9f346c1af16edaf4c858f98: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251023 08:00:26.039348 22309 tablet.cc:1722] T ec26529ef6c64b259b8428285a2ad427 P 9927a56797194391a4c98a02c10f6f58: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251023 08:00:26.042631 22317 tablet.cc:1722] T 992be711bf964771a0eae249e906e021 P 49d13a11243a439581313cbf2389dea7: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251023 08:00:26.046110 22312 tablet.cc:1722] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P 9927a56797194391a4c98a02c10f6f58: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251023 08:00:26.054334 22306 tablet.cc:1722] T 580a58e30dcb430aaf3b33473a277984 P c51023bde9f346c1af16edaf4c858f98: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251023 08:00:26.064497 22289 tablet.cc:1722] T 992be711bf964771a0eae249e906e021 P 9927a56797194391a4c98a02c10f6f58: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251023 08:00:26.084335 22305 tablet.cc:1722] T cc63d5c82e054028bd3c0cfe4599d490 P 49d13a11243a439581313cbf2389dea7: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251023 08:00:26.089962 22315 tablet.cc:1722] T 095923a5d18140f2bd7a676fc516acdc P c51023bde9f346c1af16edaf4c858f98: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251023 08:00:26.091463 22293 tablet.cc:1722] T 580a58e30dcb430aaf3b33473a277984 P 9927a56797194391a4c98a02c10f6f58: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251023 08:00:26.114914 21952 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "e446af5509c84a799ff7fa3d89cdbc8f"
dest_uuid: "49d13a11243a439581313cbf2389dea7"
mode: GRACEFUL
new_leader_uuid: "c51023bde9f346c1af16edaf4c858f98"
from {username='slave'} at 127.0.0.1:33914
I20251023 08:00:26.115567 21952 raft_consensus.cc:606] T e446af5509c84a799ff7fa3d89cdbc8f P 49d13a11243a439581313cbf2389dea7 [term 2 LEADER]: Received request to transfer leadership to TS c51023bde9f346c1af16edaf4c858f98
I20251023 08:00:26.121722 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20251023 08:00:26.122392 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 08:00:26.123943 22305 tablet.cc:1722] T ec26529ef6c64b259b8428285a2ad427 P 49d13a11243a439581313cbf2389dea7: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251023 08:00:26.134280 22173 raft_consensus.cc:993] T e446af5509c84a799ff7fa3d89cdbc8f P 49d13a11243a439581313cbf2389dea7: : Instructing follower c51023bde9f346c1af16edaf4c858f98 to start an election
I20251023 08:00:26.134842 22173 raft_consensus.cc:1081] T e446af5509c84a799ff7fa3d89cdbc8f P 49d13a11243a439581313cbf2389dea7 [term 2 LEADER]: Signalling peer c51023bde9f346c1af16edaf4c858f98 to start an election
I20251023 08:00:26.136891 22023 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "e446af5509c84a799ff7fa3d89cdbc8f"
dest_uuid: "c51023bde9f346c1af16edaf4c858f98"
from {username='slave'} at 127.0.0.1:40662
I20251023 08:00:26.141170 22023 raft_consensus.cc:493] T e446af5509c84a799ff7fa3d89cdbc8f P c51023bde9f346c1af16edaf4c858f98 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 08:00:26.141701 22023 raft_consensus.cc:3060] T e446af5509c84a799ff7fa3d89cdbc8f P c51023bde9f346c1af16edaf4c858f98 [term 2 FOLLOWER]: Advancing to term 3
I20251023 08:00:26.143255 22282 raft_consensus.cc:993] T a773cc2cdf5045c09ec36f401421de47 P 9927a56797194391a4c98a02c10f6f58: : Instructing follower c51023bde9f346c1af16edaf4c858f98 to start an election
I20251023 08:00:26.143898 22282 raft_consensus.cc:1081] T a773cc2cdf5045c09ec36f401421de47 P 9927a56797194391a4c98a02c10f6f58 [term 1 LEADER]: Signalling peer c51023bde9f346c1af16edaf4c858f98 to start an election
I20251023 08:00:26.145903 22024 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "a773cc2cdf5045c09ec36f401421de47"
dest_uuid: "c51023bde9f346c1af16edaf4c858f98"
from {username='slave'} at 127.0.0.1:40674
I20251023 08:00:26.146473 22024 raft_consensus.cc:493] T a773cc2cdf5045c09ec36f401421de47 P c51023bde9f346c1af16edaf4c858f98 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251023 08:00:26.146797 22024 raft_consensus.cc:3060] T a773cc2cdf5045c09ec36f401421de47 P c51023bde9f346c1af16edaf4c858f98 [term 1 FOLLOWER]: Advancing to term 2
I20251023 08:00:26.156009 22024 raft_consensus.cc:515] T a773cc2cdf5045c09ec36f401421de47 P c51023bde9f346c1af16edaf4c858f98 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:26.159335 21880 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a773cc2cdf5045c09ec36f401421de47" candidate_uuid: "c51023bde9f346c1af16edaf4c858f98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9927a56797194391a4c98a02c10f6f58"
I20251023 08:00:26.159581 21955 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a773cc2cdf5045c09ec36f401421de47" candidate_uuid: "c51023bde9f346c1af16edaf4c858f98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "49d13a11243a439581313cbf2389dea7"
I20251023 08:00:26.159969 21880 raft_consensus.cc:3055] T a773cc2cdf5045c09ec36f401421de47 P 9927a56797194391a4c98a02c10f6f58 [term 1 LEADER]: Stepping down as leader of term 1
I20251023 08:00:26.160219 21955 raft_consensus.cc:3060] T a773cc2cdf5045c09ec36f401421de47 P 49d13a11243a439581313cbf2389dea7 [term 1 FOLLOWER]: Advancing to term 2
I20251023 08:00:26.160287 21880 raft_consensus.cc:740] T a773cc2cdf5045c09ec36f401421de47 P 9927a56797194391a4c98a02c10f6f58 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9927a56797194391a4c98a02c10f6f58, State: Running, Role: LEADER
I20251023 08:00:26.161070 21880 consensus_queue.cc:260] T a773cc2cdf5045c09ec36f401421de47 P 9927a56797194391a4c98a02c10f6f58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:26.165848 21880 raft_consensus.cc:3060] T a773cc2cdf5045c09ec36f401421de47 P 9927a56797194391a4c98a02c10f6f58 [term 1 FOLLOWER]: Advancing to term 2
I20251023 08:00:26.173923 21880 raft_consensus.cc:2468] T a773cc2cdf5045c09ec36f401421de47 P 9927a56797194391a4c98a02c10f6f58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c51023bde9f346c1af16edaf4c858f98 in term 2.
I20251023 08:00:26.175499 21994 leader_election.cc:304] T a773cc2cdf5045c09ec36f401421de47 P c51023bde9f346c1af16edaf4c858f98 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9927a56797194391a4c98a02c10f6f58, c51023bde9f346c1af16edaf4c858f98; no voters:
I20251023 08:00:26.176673 22301 raft_consensus.cc:2804] T a773cc2cdf5045c09ec36f401421de47 P c51023bde9f346c1af16edaf4c858f98 [term 2 FOLLOWER]: Leader election won for term 2
I20251023 08:00:26.177182 22301 raft_consensus.cc:697] T a773cc2cdf5045c09ec36f401421de47 P c51023bde9f346c1af16edaf4c858f98 [term 2 LEADER]: Becoming Leader. State: Replica: c51023bde9f346c1af16edaf4c858f98, State: Running, Role: LEADER
I20251023 08:00:26.178298 22301 consensus_queue.cc:237] T a773cc2cdf5045c09ec36f401421de47 P c51023bde9f346c1af16edaf4c858f98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:26.179574 21955 raft_consensus.cc:2468] T a773cc2cdf5045c09ec36f401421de47 P 49d13a11243a439581313cbf2389dea7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c51023bde9f346c1af16edaf4c858f98 in term 2.
I20251023 08:00:26.181237 22024 leader_election.cc:290] T a773cc2cdf5045c09ec36f401421de47 P c51023bde9f346c1af16edaf4c858f98 [CANDIDATE]: Term 2 election: Requested vote from peers 9927a56797194391a4c98a02c10f6f58 (127.16.126.1:43563), 49d13a11243a439581313cbf2389dea7 (127.16.126.2:36187)
I20251023 08:00:26.155929 22023 raft_consensus.cc:515] T e446af5509c84a799ff7fa3d89cdbc8f P c51023bde9f346c1af16edaf4c858f98 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:26.187417 21879 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e446af5509c84a799ff7fa3d89cdbc8f" candidate_uuid: "c51023bde9f346c1af16edaf4c858f98" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9927a56797194391a4c98a02c10f6f58"
I20251023 08:00:26.188086 21879 raft_consensus.cc:3060] T e446af5509c84a799ff7fa3d89cdbc8f P 9927a56797194391a4c98a02c10f6f58 [term 2 FOLLOWER]: Advancing to term 3
I20251023 08:00:26.195219 21879 raft_consensus.cc:2468] T e446af5509c84a799ff7fa3d89cdbc8f P 9927a56797194391a4c98a02c10f6f58 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c51023bde9f346c1af16edaf4c858f98 in term 3.
I20251023 08:00:26.196499 21994 leader_election.cc:304] T e446af5509c84a799ff7fa3d89cdbc8f P c51023bde9f346c1af16edaf4c858f98 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9927a56797194391a4c98a02c10f6f58, c51023bde9f346c1af16edaf4c858f98; no voters:
I20251023 08:00:26.197507 22240 raft_consensus.cc:2804] T e446af5509c84a799ff7fa3d89cdbc8f P c51023bde9f346c1af16edaf4c858f98 [term 3 FOLLOWER]: Leader election won for term 3
I20251023 08:00:26.197685 21955 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e446af5509c84a799ff7fa3d89cdbc8f" candidate_uuid: "c51023bde9f346c1af16edaf4c858f98" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "49d13a11243a439581313cbf2389dea7"
I20251023 08:00:26.198347 21955 raft_consensus.cc:3055] T e446af5509c84a799ff7fa3d89cdbc8f P 49d13a11243a439581313cbf2389dea7 [term 2 LEADER]: Stepping down as leader of term 2
I20251023 08:00:26.198727 21955 raft_consensus.cc:740] T e446af5509c84a799ff7fa3d89cdbc8f P 49d13a11243a439581313cbf2389dea7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 49d13a11243a439581313cbf2389dea7, State: Running, Role: LEADER
I20251023 08:00:26.199753 21955 consensus_queue.cc:260] T e446af5509c84a799ff7fa3d89cdbc8f P 49d13a11243a439581313cbf2389dea7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:26.201558 22023 leader_election.cc:290] T e446af5509c84a799ff7fa3d89cdbc8f P c51023bde9f346c1af16edaf4c858f98 [CANDIDATE]: Term 3 election: Requested vote from peers 9927a56797194391a4c98a02c10f6f58 (127.16.126.1:43563), 49d13a11243a439581313cbf2389dea7 (127.16.126.2:36187)
I20251023 08:00:26.201395 21955 raft_consensus.cc:3060] T e446af5509c84a799ff7fa3d89cdbc8f P 49d13a11243a439581313cbf2389dea7 [term 2 FOLLOWER]: Advancing to term 3
I20251023 08:00:26.212702 22240 raft_consensus.cc:697] T e446af5509c84a799ff7fa3d89cdbc8f P c51023bde9f346c1af16edaf4c858f98 [term 3 LEADER]: Becoming Leader. State: Replica: c51023bde9f346c1af16edaf4c858f98, State: Running, Role: LEADER
I20251023 08:00:26.214332 22240 consensus_queue.cc:237] T e446af5509c84a799ff7fa3d89cdbc8f P c51023bde9f346c1af16edaf4c858f98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } }
I20251023 08:00:26.224215 21955 raft_consensus.cc:2468] T e446af5509c84a799ff7fa3d89cdbc8f P 49d13a11243a439581313cbf2389dea7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c51023bde9f346c1af16edaf4c858f98 in term 3.
I20251023 08:00:26.224718 21775 catalog_manager.cc:6194] T 00000000000000000000000000000000 P d62703c4b8174795af160c14e69d5120: soft_deleted_table [id=f270450e4ddd4e6897fe147881a078d4] alter complete (version 1)
I20251023 08:00:26.232229 21777 catalog_manager.cc:5649] T a773cc2cdf5045c09ec36f401421de47 P c51023bde9f346c1af16edaf4c858f98 reported cstate change: term changed from 1 to 2, leader changed from 9927a56797194391a4c98a02c10f6f58 (127.16.126.1) to c51023bde9f346c1af16edaf4c858f98 (127.16.126.3). New cstate: current_term: 2 leader_uuid: "c51023bde9f346c1af16edaf4c858f98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } health_report { overall_health: HEALTHY } } }
I20251023 08:00:26.234237 21777 catalog_manager.cc:5649] T e446af5509c84a799ff7fa3d89cdbc8f P c51023bde9f346c1af16edaf4c858f98 reported cstate change: term changed from 2 to 3, leader changed from 49d13a11243a439581313cbf2389dea7 (127.16.126.2) to c51023bde9f346c1af16edaf4c858f98 (127.16.126.3). New cstate: current_term: 3 leader_uuid: "c51023bde9f346c1af16edaf4c858f98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c51023bde9f346c1af16edaf4c858f98" member_type: VOTER last_known_addr { host: "127.16.126.3" port: 36947 } health_report { overall_health: HEALTHY } } }
I20251023 08:00:26.616317 21879 raft_consensus.cc:1275] T e446af5509c84a799ff7fa3d89cdbc8f P 9927a56797194391a4c98a02c10f6f58 [term 3 FOLLOWER]: Refusing update from remote peer c51023bde9f346c1af16edaf4c858f98: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251023 08:00:26.617554 22240 consensus_queue.cc:1048] T e446af5509c84a799ff7fa3d89cdbc8f P c51023bde9f346c1af16edaf4c858f98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 08:00:26.626895 21955 raft_consensus.cc:1275] T e446af5509c84a799ff7fa3d89cdbc8f P 49d13a11243a439581313cbf2389dea7 [term 3 FOLLOWER]: Refusing update from remote peer c51023bde9f346c1af16edaf4c858f98: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251023 08:00:26.629083 22301 consensus_queue.cc:1048] T e446af5509c84a799ff7fa3d89cdbc8f P c51023bde9f346c1af16edaf4c858f98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251023 08:00:26.646451 21955 raft_consensus.cc:1275] T a773cc2cdf5045c09ec36f401421de47 P 49d13a11243a439581313cbf2389dea7 [term 2 FOLLOWER]: Refusing update from remote peer c51023bde9f346c1af16edaf4c858f98: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 08:00:26.647598 22301 consensus_queue.cc:1048] T a773cc2cdf5045c09ec36f401421de47 P c51023bde9f346c1af16edaf4c858f98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49d13a11243a439581313cbf2389dea7" member_type: VOTER last_known_addr { host: "127.16.126.2" port: 36187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 08:00:26.655977 21879 raft_consensus.cc:1275] T a773cc2cdf5045c09ec36f401421de47 P 9927a56797194391a4c98a02c10f6f58 [term 2 FOLLOWER]: Refusing update from remote peer c51023bde9f346c1af16edaf4c858f98: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251023 08:00:26.658138 22325 consensus_queue.cc:1048] T a773cc2cdf5045c09ec36f401421de47 P c51023bde9f346c1af16edaf4c858f98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9927a56797194391a4c98a02c10f6f58" member_type: VOTER last_known_addr { host: "127.16.126.1" port: 43563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251023 08:00:27.123368 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 08:00:27.128947 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251023 08:00:27.129355 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 08:00:28.130322 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 08:00:28.136626 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251023 08:00:28.137132 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 08:00:29.137992 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 08:00:29.143296 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251023 08:00:29.143687 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 08:00:30.144701 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 08:00:30.151268 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251023 08:00:30.151875 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 08:00:31.153121 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 08:00:31.159406 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251023 08:00:31.159860 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 08:00:32.160768 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 08:00:32.166899 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251023 08:00:32.167347 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 08:00:33.168284 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 08:00:33.173305 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251023 08:00:33.173810 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251023 08:00:34.174842 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 08:00:34.180096 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251023 08:00:34.180503 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
W20251023 08:00:34.459499 21981 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:0274899ee0b94ca6ad23688cfc1ffeb5)
W20251023 08:00:34.462738 21981 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:0274899ee0b94ca6ad23688cfc1ffeb5)
W20251023 08:00:34.463215 21981 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:0274899ee0b94ca6ad23688cfc1ffeb5)
I20251023 08:00:35.181695 16888 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251023 08:00:35.187094 16888 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251023 08:00:35.187534 16888 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/master/auto_leader_rebalancer-test.cc:600: Failure
Expected: (leader.second) != (3), actual: 3 vs 3
I20251023 08:00:36.243988 16888 tablet_server.cc:178] TabletServer@127.16.126.1:0 shutting down...
W20251023 08:00:36.261932 21994 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 7 similar messages]
W20251023 08:00:36.267222 21994 consensus_peers.cc:597] T e84b3c7d7db24d86800d4a76767db682 P c51023bde9f346c1af16edaf4c858f98 -> Peer 9927a56797194391a4c98a02c10f6f58 (127.16.126.1:43563): Couldn't send request to peer 9927a56797194391a4c98a02c10f6f58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251023 08:00:36.282128 16888 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251023 08:00:36.283036 16888 tablet_replica.cc:333] T ec26529ef6c64b259b8428285a2ad427 P 9927a56797194391a4c98a02c10f6f58: stopping tablet replica
I20251023 08:00:36.283962 16888 raft_consensus.cc:2243] T ec26529ef6c64b259b8428285a2ad427 P 9927a56797194391a4c98a02c10f6f58 [term 3 LEADER]: Raft consensus shutting down.
I20251023 08:00:36.285079 16888 raft_consensus.cc:2272] T ec26529ef6c64b259b8428285a2ad427 P 9927a56797194391a4c98a02c10f6f58 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:36.287647 16888 tablet_replica.cc:333] T 992be711bf964771a0eae249e906e021 P 9927a56797194391a4c98a02c10f6f58: stopping tablet replica
I20251023 08:00:36.288736 16888 raft_consensus.cc:2243] T 992be711bf964771a0eae249e906e021 P 9927a56797194391a4c98a02c10f6f58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:36.289583 16888 raft_consensus.cc:2272] T 992be711bf964771a0eae249e906e021 P 9927a56797194391a4c98a02c10f6f58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:36.292985 16888 tablet_replica.cc:333] T cc63d5c82e054028bd3c0cfe4599d490 P 9927a56797194391a4c98a02c10f6f58: stopping tablet replica
W20251023 08:00:36.293087 21920 consensus_peers.cc:597] T 095923a5d18140f2bd7a676fc516acdc P 49d13a11243a439581313cbf2389dea7 -> Peer 9927a56797194391a4c98a02c10f6f58 (127.16.126.1:43563): Couldn't send request to peer 9927a56797194391a4c98a02c10f6f58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251023 08:00:36.293731 16888 raft_consensus.cc:2243] T cc63d5c82e054028bd3c0cfe4599d490 P 9927a56797194391a4c98a02c10f6f58 [term 2 LEADER]: Raft consensus shutting down.
I20251023 08:00:36.294752 16888 raft_consensus.cc:2272] T cc63d5c82e054028bd3c0cfe4599d490 P 9927a56797194391a4c98a02c10f6f58 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:36.297847 16888 tablet_replica.cc:333] T 095923a5d18140f2bd7a676fc516acdc P 9927a56797194391a4c98a02c10f6f58: stopping tablet replica
I20251023 08:00:36.298789 16888 raft_consensus.cc:2243] T 095923a5d18140f2bd7a676fc516acdc P 9927a56797194391a4c98a02c10f6f58 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:36.299616 16888 raft_consensus.cc:2272] T 095923a5d18140f2bd7a676fc516acdc P 9927a56797194391a4c98a02c10f6f58 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:36.302104 16888 tablet_replica.cc:333] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P 9927a56797194391a4c98a02c10f6f58: stopping tablet replica
I20251023 08:00:36.302776 16888 raft_consensus.cc:2243] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P 9927a56797194391a4c98a02c10f6f58 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:36.303275 16888 raft_consensus.cc:2272] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P 9927a56797194391a4c98a02c10f6f58 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:36.305682 16888 tablet_replica.cc:333] T 580a58e30dcb430aaf3b33473a277984 P 9927a56797194391a4c98a02c10f6f58: stopping tablet replica
I20251023 08:00:36.306236 16888 raft_consensus.cc:2243] T 580a58e30dcb430aaf3b33473a277984 P 9927a56797194391a4c98a02c10f6f58 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:36.307006 16888 raft_consensus.cc:2272] T 580a58e30dcb430aaf3b33473a277984 P 9927a56797194391a4c98a02c10f6f58 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:36.310681 16888 tablet_replica.cc:333] T 9cd5e272db7a47c2b5f84af9bf661b1d P 9927a56797194391a4c98a02c10f6f58: stopping tablet replica
I20251023 08:00:36.311475 16888 raft_consensus.cc:2243] T 9cd5e272db7a47c2b5f84af9bf661b1d P 9927a56797194391a4c98a02c10f6f58 [term 1 LEADER]: Raft consensus shutting down.
I20251023 08:00:36.312799 16888 raft_consensus.cc:2272] T 9cd5e272db7a47c2b5f84af9bf661b1d P 9927a56797194391a4c98a02c10f6f58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:36.315232 16888 tablet_replica.cc:333] T e446af5509c84a799ff7fa3d89cdbc8f P 9927a56797194391a4c98a02c10f6f58: stopping tablet replica
I20251023 08:00:36.315796 16888 raft_consensus.cc:2243] T e446af5509c84a799ff7fa3d89cdbc8f P 9927a56797194391a4c98a02c10f6f58 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:36.316376 16888 raft_consensus.cc:2272] T e446af5509c84a799ff7fa3d89cdbc8f P 9927a56797194391a4c98a02c10f6f58 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:36.318854 16888 tablet_replica.cc:333] T 1d1e3ddac9204211924d2187d73ecd72 P 9927a56797194391a4c98a02c10f6f58: stopping tablet replica
I20251023 08:00:36.319382 16888 raft_consensus.cc:2243] T 1d1e3ddac9204211924d2187d73ecd72 P 9927a56797194391a4c98a02c10f6f58 [term 2 LEADER]: Raft consensus shutting down.
I20251023 08:00:36.320303 16888 raft_consensus.cc:2272] T 1d1e3ddac9204211924d2187d73ecd72 P 9927a56797194391a4c98a02c10f6f58 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:36.322847 16888 tablet_replica.cc:333] T 2d3590750a9e499a9d0b125ab1c2d8bc P 9927a56797194391a4c98a02c10f6f58: stopping tablet replica
I20251023 08:00:36.323377 16888 raft_consensus.cc:2243] T 2d3590750a9e499a9d0b125ab1c2d8bc P 9927a56797194391a4c98a02c10f6f58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:36.323863 16888 raft_consensus.cc:2272] T 2d3590750a9e499a9d0b125ab1c2d8bc P 9927a56797194391a4c98a02c10f6f58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:36.326162 16888 tablet_replica.cc:333] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 9927a56797194391a4c98a02c10f6f58: stopping tablet replica
I20251023 08:00:36.326820 16888 raft_consensus.cc:2243] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 9927a56797194391a4c98a02c10f6f58 [term 2 LEADER]: Raft consensus shutting down.
I20251023 08:00:36.327637 16888 raft_consensus.cc:2272] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 9927a56797194391a4c98a02c10f6f58 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:36.330047 16888 tablet_replica.cc:333] T e84b3c7d7db24d86800d4a76767db682 P 9927a56797194391a4c98a02c10f6f58: stopping tablet replica
I20251023 08:00:36.330627 16888 raft_consensus.cc:2243] T e84b3c7d7db24d86800d4a76767db682 P 9927a56797194391a4c98a02c10f6f58 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:36.331091 16888 raft_consensus.cc:2272] T e84b3c7d7db24d86800d4a76767db682 P 9927a56797194391a4c98a02c10f6f58 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:36.333377 16888 tablet_replica.cc:333] T 2fa24c01f1114e93976301027c9d0a76 P 9927a56797194391a4c98a02c10f6f58: stopping tablet replica
I20251023 08:00:36.333972 16888 raft_consensus.cc:2243] T 2fa24c01f1114e93976301027c9d0a76 P 9927a56797194391a4c98a02c10f6f58 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:36.334475 16888 raft_consensus.cc:2272] T 2fa24c01f1114e93976301027c9d0a76 P 9927a56797194391a4c98a02c10f6f58 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:36.336966 16888 tablet_replica.cc:333] T 7456ec78bb664a40a6dde0929ea12d8f P 9927a56797194391a4c98a02c10f6f58: stopping tablet replica
I20251023 08:00:36.337566 16888 raft_consensus.cc:2243] T 7456ec78bb664a40a6dde0929ea12d8f P 9927a56797194391a4c98a02c10f6f58 [term 2 LEADER]: Raft consensus shutting down.
I20251023 08:00:36.338518 16888 raft_consensus.cc:2272] T 7456ec78bb664a40a6dde0929ea12d8f P 9927a56797194391a4c98a02c10f6f58 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:36.340958 16888 tablet_replica.cc:333] T a773cc2cdf5045c09ec36f401421de47 P 9927a56797194391a4c98a02c10f6f58: stopping tablet replica
I20251023 08:00:36.341558 16888 raft_consensus.cc:2243] T a773cc2cdf5045c09ec36f401421de47 P 9927a56797194391a4c98a02c10f6f58 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:36.342020 16888 raft_consensus.cc:2272] T a773cc2cdf5045c09ec36f401421de47 P 9927a56797194391a4c98a02c10f6f58 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:36.344165 16888 tablet_replica.cc:333] T 47b52375a02b4d348c0d45f6aab2dd8c P 9927a56797194391a4c98a02c10f6f58: stopping tablet replica
I20251023 08:00:36.344672 16888 raft_consensus.cc:2243] T 47b52375a02b4d348c0d45f6aab2dd8c P 9927a56797194391a4c98a02c10f6f58 [term 1 LEADER]: Raft consensus shutting down.
I20251023 08:00:36.345619 16888 raft_consensus.cc:2272] T 47b52375a02b4d348c0d45f6aab2dd8c P 9927a56797194391a4c98a02c10f6f58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:36.347862 16888 tablet_replica.cc:333] T b555f281b922436fa19baf6f373d0aac P 9927a56797194391a4c98a02c10f6f58: stopping tablet replica
I20251023 08:00:36.348399 16888 raft_consensus.cc:2243] T b555f281b922436fa19baf6f373d0aac P 9927a56797194391a4c98a02c10f6f58 [term 2 LEADER]: Raft consensus shutting down.
I20251023 08:00:36.349323 16888 raft_consensus.cc:2272] T b555f281b922436fa19baf6f373d0aac P 9927a56797194391a4c98a02c10f6f58 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:36.351517 16888 tablet_replica.cc:333] T eda010f13927475e9cb3af93eed06d3e P 9927a56797194391a4c98a02c10f6f58: stopping tablet replica
I20251023 08:00:36.352039 16888 raft_consensus.cc:2243] T eda010f13927475e9cb3af93eed06d3e P 9927a56797194391a4c98a02c10f6f58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:36.352515 16888 raft_consensus.cc:2272] T eda010f13927475e9cb3af93eed06d3e P 9927a56797194391a4c98a02c10f6f58 [term 1 FOLLOWER]: Raft consensus is shut down!
W20251023 08:00:36.371627 21920 consensus_peers.cc:597] T 2fa24c01f1114e93976301027c9d0a76 P 49d13a11243a439581313cbf2389dea7 -> Peer 9927a56797194391a4c98a02c10f6f58 (127.16.126.1:43563): Couldn't send request to peer 9927a56797194391a4c98a02c10f6f58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251023 08:00:36.389374 21994 consensus_peers.cc:597] T 992be711bf964771a0eae249e906e021 P c51023bde9f346c1af16edaf4c858f98 -> Peer 9927a56797194391a4c98a02c10f6f58 (127.16.126.1:43563): Couldn't send request to peer 9927a56797194391a4c98a02c10f6f58. Status: Network error: Client connection negotiation failed: client connection to 127.16.126.1:43563: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251023 08:00:36.398134 16888 tablet_server.cc:195] TabletServer@127.16.126.1:0 shutdown complete.
I20251023 08:00:36.443223 16888 tablet_server.cc:178] TabletServer@127.16.126.2:0 shutting down...
I20251023 08:00:36.470232 16888 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251023 08:00:36.471038 16888 tablet_replica.cc:333] T 095923a5d18140f2bd7a676fc516acdc P 49d13a11243a439581313cbf2389dea7: stopping tablet replica
I20251023 08:00:36.471877 16888 raft_consensus.cc:2243] T 095923a5d18140f2bd7a676fc516acdc P 49d13a11243a439581313cbf2389dea7 [term 2 LEADER]: Raft consensus shutting down.
I20251023 08:00:36.472883 16888 raft_consensus.cc:2272] T 095923a5d18140f2bd7a676fc516acdc P 49d13a11243a439581313cbf2389dea7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:36.475286 16888 tablet_replica.cc:333] T 9cd5e272db7a47c2b5f84af9bf661b1d P 49d13a11243a439581313cbf2389dea7: stopping tablet replica
I20251023 08:00:36.475965 16888 raft_consensus.cc:2243] T 9cd5e272db7a47c2b5f84af9bf661b1d P 49d13a11243a439581313cbf2389dea7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:36.476493 16888 raft_consensus.cc:2272] T 9cd5e272db7a47c2b5f84af9bf661b1d P 49d13a11243a439581313cbf2389dea7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:36.479058 16888 tablet_replica.cc:333] T 992be711bf964771a0eae249e906e021 P 49d13a11243a439581313cbf2389dea7: stopping tablet replica
I20251023 08:00:36.479676 16888 raft_consensus.cc:2243] T 992be711bf964771a0eae249e906e021 P 49d13a11243a439581313cbf2389dea7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:36.480204 16888 raft_consensus.cc:2272] T 992be711bf964771a0eae249e906e021 P 49d13a11243a439581313cbf2389dea7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:36.482651 16888 tablet_replica.cc:333] T cc63d5c82e054028bd3c0cfe4599d490 P 49d13a11243a439581313cbf2389dea7: stopping tablet replica
I20251023 08:00:36.483218 16888 raft_consensus.cc:2243] T cc63d5c82e054028bd3c0cfe4599d490 P 49d13a11243a439581313cbf2389dea7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:36.483754 16888 raft_consensus.cc:2272] T cc63d5c82e054028bd3c0cfe4599d490 P 49d13a11243a439581313cbf2389dea7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:36.486052 16888 tablet_replica.cc:333] T 580a58e30dcb430aaf3b33473a277984 P 49d13a11243a439581313cbf2389dea7: stopping tablet replica
I20251023 08:00:36.486656 16888 raft_consensus.cc:2243] T 580a58e30dcb430aaf3b33473a277984 P 49d13a11243a439581313cbf2389dea7 [term 2 LEADER]: Raft consensus shutting down.
I20251023 08:00:36.487645 16888 raft_consensus.cc:2272] T 580a58e30dcb430aaf3b33473a277984 P 49d13a11243a439581313cbf2389dea7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:36.490001 16888 tablet_replica.cc:333] T 1d1e3ddac9204211924d2187d73ecd72 P 49d13a11243a439581313cbf2389dea7: stopping tablet replica
I20251023 08:00:36.490582 16888 raft_consensus.cc:2243] T 1d1e3ddac9204211924d2187d73ecd72 P 49d13a11243a439581313cbf2389dea7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:36.491072 16888 raft_consensus.cc:2272] T 1d1e3ddac9204211924d2187d73ecd72 P 49d13a11243a439581313cbf2389dea7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:36.493371 16888 tablet_replica.cc:333] T e446af5509c84a799ff7fa3d89cdbc8f P 49d13a11243a439581313cbf2389dea7: stopping tablet replica
I20251023 08:00:36.493963 16888 raft_consensus.cc:2243] T e446af5509c84a799ff7fa3d89cdbc8f P 49d13a11243a439581313cbf2389dea7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:36.494416 16888 raft_consensus.cc:2272] T e446af5509c84a799ff7fa3d89cdbc8f P 49d13a11243a439581313cbf2389dea7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:36.496475 16888 tablet_replica.cc:333] T a773cc2cdf5045c09ec36f401421de47 P 49d13a11243a439581313cbf2389dea7: stopping tablet replica
I20251023 08:00:36.497016 16888 raft_consensus.cc:2243] T a773cc2cdf5045c09ec36f401421de47 P 49d13a11243a439581313cbf2389dea7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:36.497484 16888 raft_consensus.cc:2272] T a773cc2cdf5045c09ec36f401421de47 P 49d13a11243a439581313cbf2389dea7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:36.499488 16888 tablet_replica.cc:333] T 47b52375a02b4d348c0d45f6aab2dd8c P 49d13a11243a439581313cbf2389dea7: stopping tablet replica
I20251023 08:00:36.500010 16888 raft_consensus.cc:2243] T 47b52375a02b4d348c0d45f6aab2dd8c P 49d13a11243a439581313cbf2389dea7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:36.500478 16888 raft_consensus.cc:2272] T 47b52375a02b4d348c0d45f6aab2dd8c P 49d13a11243a439581313cbf2389dea7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:36.502585 16888 tablet_replica.cc:333] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P 49d13a11243a439581313cbf2389dea7: stopping tablet replica
I20251023 08:00:36.503140 16888 raft_consensus.cc:2243] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P 49d13a11243a439581313cbf2389dea7 [term 2 LEADER]: Raft consensus shutting down.
I20251023 08:00:36.504014 16888 raft_consensus.cc:2272] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P 49d13a11243a439581313cbf2389dea7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:36.506124 16888 tablet_replica.cc:333] T ec26529ef6c64b259b8428285a2ad427 P 49d13a11243a439581313cbf2389dea7: stopping tablet replica
I20251023 08:00:36.506781 16888 raft_consensus.cc:2243] T ec26529ef6c64b259b8428285a2ad427 P 49d13a11243a439581313cbf2389dea7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:36.507330 16888 raft_consensus.cc:2272] T ec26529ef6c64b259b8428285a2ad427 P 49d13a11243a439581313cbf2389dea7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:36.509454 16888 tablet_replica.cc:333] T b555f281b922436fa19baf6f373d0aac P 49d13a11243a439581313cbf2389dea7: stopping tablet replica
I20251023 08:00:36.509943 16888 raft_consensus.cc:2243] T b555f281b922436fa19baf6f373d0aac P 49d13a11243a439581313cbf2389dea7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:36.510450 16888 raft_consensus.cc:2272] T b555f281b922436fa19baf6f373d0aac P 49d13a11243a439581313cbf2389dea7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:36.512454 16888 tablet_replica.cc:333] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 49d13a11243a439581313cbf2389dea7: stopping tablet replica
I20251023 08:00:36.512971 16888 raft_consensus.cc:2243] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 49d13a11243a439581313cbf2389dea7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:36.513468 16888 raft_consensus.cc:2272] T 0274899ee0b94ca6ad23688cfc1ffeb5 P 49d13a11243a439581313cbf2389dea7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:36.515441 16888 tablet_replica.cc:333] T 2d3590750a9e499a9d0b125ab1c2d8bc P 49d13a11243a439581313cbf2389dea7: stopping tablet replica
I20251023 08:00:36.515946 16888 raft_consensus.cc:2243] T 2d3590750a9e499a9d0b125ab1c2d8bc P 49d13a11243a439581313cbf2389dea7 [term 1 LEADER]: Raft consensus shutting down.
I20251023 08:00:36.516788 16888 raft_consensus.cc:2272] T 2d3590750a9e499a9d0b125ab1c2d8bc P 49d13a11243a439581313cbf2389dea7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:36.519004 16888 tablet_replica.cc:333] T eda010f13927475e9cb3af93eed06d3e P 49d13a11243a439581313cbf2389dea7: stopping tablet replica
I20251023 08:00:36.519526 16888 raft_consensus.cc:2243] T eda010f13927475e9cb3af93eed06d3e P 49d13a11243a439581313cbf2389dea7 [term 1 LEADER]: Raft consensus shutting down.
I20251023 08:00:36.520360 16888 raft_consensus.cc:2272] T eda010f13927475e9cb3af93eed06d3e P 49d13a11243a439581313cbf2389dea7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:36.522792 16888 tablet_replica.cc:333] T 2fa24c01f1114e93976301027c9d0a76 P 49d13a11243a439581313cbf2389dea7: stopping tablet replica
I20251023 08:00:36.523411 16888 raft_consensus.cc:2243] T 2fa24c01f1114e93976301027c9d0a76 P 49d13a11243a439581313cbf2389dea7 [term 2 LEADER]: Raft consensus shutting down.
I20251023 08:00:36.524223 16888 raft_consensus.cc:2272] T 2fa24c01f1114e93976301027c9d0a76 P 49d13a11243a439581313cbf2389dea7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:36.526182 16888 tablet_replica.cc:333] T e84b3c7d7db24d86800d4a76767db682 P 49d13a11243a439581313cbf2389dea7: stopping tablet replica
I20251023 08:00:36.526614 16888 raft_consensus.cc:2243] T e84b3c7d7db24d86800d4a76767db682 P 49d13a11243a439581313cbf2389dea7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:36.527061 16888 raft_consensus.cc:2272] T e84b3c7d7db24d86800d4a76767db682 P 49d13a11243a439581313cbf2389dea7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:36.529016 16888 tablet_replica.cc:333] T 7456ec78bb664a40a6dde0929ea12d8f P 49d13a11243a439581313cbf2389dea7: stopping tablet replica
I20251023 08:00:36.529445 16888 raft_consensus.cc:2243] T 7456ec78bb664a40a6dde0929ea12d8f P 49d13a11243a439581313cbf2389dea7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:36.529824 16888 raft_consensus.cc:2272] T 7456ec78bb664a40a6dde0929ea12d8f P 49d13a11243a439581313cbf2389dea7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:36.571949 16888 tablet_server.cc:195] TabletServer@127.16.126.2:0 shutdown complete.
I20251023 08:00:36.608561 16888 tablet_server.cc:178] TabletServer@127.16.126.3:0 shutting down...
W20251023 08:00:36.638653 21994 consensus_peers.cc:597] T a773cc2cdf5045c09ec36f401421de47 P c51023bde9f346c1af16edaf4c858f98 -> Peer 9927a56797194391a4c98a02c10f6f58 (127.16.126.1:43563): Couldn't send request to peer 9927a56797194391a4c98a02c10f6f58. Status: Network error: Client connection negotiation failed: client connection to 127.16.126.1:43563: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251023 08:00:36.643743 16888 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251023 08:00:36.644739 16888 tablet_replica.cc:333] T 095923a5d18140f2bd7a676fc516acdc P c51023bde9f346c1af16edaf4c858f98: stopping tablet replica
I20251023 08:00:36.645675 16888 raft_consensus.cc:2243] T 095923a5d18140f2bd7a676fc516acdc P c51023bde9f346c1af16edaf4c858f98 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:36.646282 16888 raft_consensus.cc:2272] T 095923a5d18140f2bd7a676fc516acdc P c51023bde9f346c1af16edaf4c858f98 [term 2 FOLLOWER]: Raft consensus is shut down!
W20251023 08:00:36.647330 21992 consensus_peers.cc:597] T 992be711bf964771a0eae249e906e021 P c51023bde9f346c1af16edaf4c858f98 -> Peer 49d13a11243a439581313cbf2389dea7 (127.16.126.2:36187): Couldn't send request to peer 49d13a11243a439581313cbf2389dea7. Status: Network error: Client connection negotiation failed: client connection to 127.16.126.2:36187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251023 08:00:36.648912 16888 tablet_replica.cc:333] T 580a58e30dcb430aaf3b33473a277984 P c51023bde9f346c1af16edaf4c858f98: stopping tablet replica
I20251023 08:00:36.649682 16888 raft_consensus.cc:2243] T 580a58e30dcb430aaf3b33473a277984 P c51023bde9f346c1af16edaf4c858f98 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:36.650214 16888 raft_consensus.cc:2272] T 580a58e30dcb430aaf3b33473a277984 P c51023bde9f346c1af16edaf4c858f98 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:36.652292 16888 tablet_replica.cc:333] T 992be711bf964771a0eae249e906e021 P c51023bde9f346c1af16edaf4c858f98: stopping tablet replica
I20251023 08:00:36.652817 16888 raft_consensus.cc:2243] T 992be711bf964771a0eae249e906e021 P c51023bde9f346c1af16edaf4c858f98 [term 1 LEADER]: Raft consensus shutting down.
I20251023 08:00:36.653617 16888 raft_consensus.cc:2272] T 992be711bf964771a0eae249e906e021 P c51023bde9f346c1af16edaf4c858f98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:36.655682 16888 tablet_replica.cc:333] T cc63d5c82e054028bd3c0cfe4599d490 P c51023bde9f346c1af16edaf4c858f98: stopping tablet replica
I20251023 08:00:36.656190 16888 raft_consensus.cc:2243] T cc63d5c82e054028bd3c0cfe4599d490 P c51023bde9f346c1af16edaf4c858f98 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:36.656663 16888 raft_consensus.cc:2272] T cc63d5c82e054028bd3c0cfe4599d490 P c51023bde9f346c1af16edaf4c858f98 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:36.658866 16888 tablet_replica.cc:333] T 9cd5e272db7a47c2b5f84af9bf661b1d P c51023bde9f346c1af16edaf4c858f98: stopping tablet replica
I20251023 08:00:36.659379 16888 raft_consensus.cc:2243] T 9cd5e272db7a47c2b5f84af9bf661b1d P c51023bde9f346c1af16edaf4c858f98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:36.659834 16888 raft_consensus.cc:2272] T 9cd5e272db7a47c2b5f84af9bf661b1d P c51023bde9f346c1af16edaf4c858f98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:36.661906 16888 tablet_replica.cc:333] T a773cc2cdf5045c09ec36f401421de47 P c51023bde9f346c1af16edaf4c858f98: stopping tablet replica
I20251023 08:00:36.662390 16888 raft_consensus.cc:2243] T a773cc2cdf5045c09ec36f401421de47 P c51023bde9f346c1af16edaf4c858f98 [term 2 LEADER]: Raft consensus shutting down.
I20251023 08:00:36.663182 16888 raft_consensus.cc:2272] T a773cc2cdf5045c09ec36f401421de47 P c51023bde9f346c1af16edaf4c858f98 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:36.665252 16888 tablet_replica.cc:333] T 47b52375a02b4d348c0d45f6aab2dd8c P c51023bde9f346c1af16edaf4c858f98: stopping tablet replica
I20251023 08:00:36.665836 16888 raft_consensus.cc:2243] T 47b52375a02b4d348c0d45f6aab2dd8c P c51023bde9f346c1af16edaf4c858f98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:36.666195 16888 raft_consensus.cc:2272] T 47b52375a02b4d348c0d45f6aab2dd8c P c51023bde9f346c1af16edaf4c858f98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:36.668097 16888 tablet_replica.cc:333] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P c51023bde9f346c1af16edaf4c858f98: stopping tablet replica
I20251023 08:00:36.668586 16888 raft_consensus.cc:2243] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P c51023bde9f346c1af16edaf4c858f98 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:36.669008 16888 raft_consensus.cc:2272] T 68421eae3c714c6ca0dffaa6c3d5f3f1 P c51023bde9f346c1af16edaf4c858f98 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:36.670951 16888 tablet_replica.cc:333] T ec26529ef6c64b259b8428285a2ad427 P c51023bde9f346c1af16edaf4c858f98: stopping tablet replica
I20251023 08:00:36.671474 16888 raft_consensus.cc:2243] T ec26529ef6c64b259b8428285a2ad427 P c51023bde9f346c1af16edaf4c858f98 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:36.671892 16888 raft_consensus.cc:2272] T ec26529ef6c64b259b8428285a2ad427 P c51023bde9f346c1af16edaf4c858f98 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:36.673904 16888 tablet_replica.cc:333] T 0274899ee0b94ca6ad23688cfc1ffeb5 P c51023bde9f346c1af16edaf4c858f98: stopping tablet replica
I20251023 08:00:36.674397 16888 raft_consensus.cc:2243] T 0274899ee0b94ca6ad23688cfc1ffeb5 P c51023bde9f346c1af16edaf4c858f98 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:36.674799 16888 raft_consensus.cc:2272] T 0274899ee0b94ca6ad23688cfc1ffeb5 P c51023bde9f346c1af16edaf4c858f98 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:36.676745 16888 tablet_replica.cc:333] T 2d3590750a9e499a9d0b125ab1c2d8bc P c51023bde9f346c1af16edaf4c858f98: stopping tablet replica
I20251023 08:00:36.677258 16888 raft_consensus.cc:2243] T 2d3590750a9e499a9d0b125ab1c2d8bc P c51023bde9f346c1af16edaf4c858f98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:36.677665 16888 raft_consensus.cc:2272] T 2d3590750a9e499a9d0b125ab1c2d8bc P c51023bde9f346c1af16edaf4c858f98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:36.679507 16888 tablet_replica.cc:333] T eda010f13927475e9cb3af93eed06d3e P c51023bde9f346c1af16edaf4c858f98: stopping tablet replica
I20251023 08:00:36.679960 16888 raft_consensus.cc:2243] T eda010f13927475e9cb3af93eed06d3e P c51023bde9f346c1af16edaf4c858f98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:36.680348 16888 raft_consensus.cc:2272] T eda010f13927475e9cb3af93eed06d3e P c51023bde9f346c1af16edaf4c858f98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:36.682333 16888 tablet_replica.cc:333] T b555f281b922436fa19baf6f373d0aac P c51023bde9f346c1af16edaf4c858f98: stopping tablet replica
I20251023 08:00:36.682787 16888 raft_consensus.cc:2243] T b555f281b922436fa19baf6f373d0aac P c51023bde9f346c1af16edaf4c858f98 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:36.683153 16888 raft_consensus.cc:2272] T b555f281b922436fa19baf6f373d0aac P c51023bde9f346c1af16edaf4c858f98 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:36.684979 16888 tablet_replica.cc:333] T e84b3c7d7db24d86800d4a76767db682 P c51023bde9f346c1af16edaf4c858f98: stopping tablet replica
I20251023 08:00:36.685482 16888 raft_consensus.cc:2243] T e84b3c7d7db24d86800d4a76767db682 P c51023bde9f346c1af16edaf4c858f98 [term 2 LEADER]: Raft consensus shutting down.
I20251023 08:00:36.686292 16888 raft_consensus.cc:2272] T e84b3c7d7db24d86800d4a76767db682 P c51023bde9f346c1af16edaf4c858f98 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:36.688090 16888 tablet_replica.cc:333] T 2fa24c01f1114e93976301027c9d0a76 P c51023bde9f346c1af16edaf4c858f98: stopping tablet replica
I20251023 08:00:36.688531 16888 raft_consensus.cc:2243] T 2fa24c01f1114e93976301027c9d0a76 P c51023bde9f346c1af16edaf4c858f98 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:36.688917 16888 raft_consensus.cc:2272] T 2fa24c01f1114e93976301027c9d0a76 P c51023bde9f346c1af16edaf4c858f98 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:36.690722 16888 tablet_replica.cc:333] T 7456ec78bb664a40a6dde0929ea12d8f P c51023bde9f346c1af16edaf4c858f98: stopping tablet replica
I20251023 08:00:36.691135 16888 raft_consensus.cc:2243] T 7456ec78bb664a40a6dde0929ea12d8f P c51023bde9f346c1af16edaf4c858f98 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:36.691527 16888 raft_consensus.cc:2272] T 7456ec78bb664a40a6dde0929ea12d8f P c51023bde9f346c1af16edaf4c858f98 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:36.693327 16888 tablet_replica.cc:333] T 1d1e3ddac9204211924d2187d73ecd72 P c51023bde9f346c1af16edaf4c858f98: stopping tablet replica
I20251023 08:00:36.693769 16888 raft_consensus.cc:2243] T 1d1e3ddac9204211924d2187d73ecd72 P c51023bde9f346c1af16edaf4c858f98 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251023 08:00:36.694180 16888 raft_consensus.cc:2272] T 1d1e3ddac9204211924d2187d73ecd72 P c51023bde9f346c1af16edaf4c858f98 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:36.696208 16888 tablet_replica.cc:333] T e446af5509c84a799ff7fa3d89cdbc8f P c51023bde9f346c1af16edaf4c858f98: stopping tablet replica
I20251023 08:00:36.696590 16888 raft_consensus.cc:2243] T e446af5509c84a799ff7fa3d89cdbc8f P c51023bde9f346c1af16edaf4c858f98 [term 3 LEADER]: Raft consensus shutting down.
I20251023 08:00:36.697327 16888 raft_consensus.cc:2272] T e446af5509c84a799ff7fa3d89cdbc8f P c51023bde9f346c1af16edaf4c858f98 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:36.737066 16888 tablet_server.cc:195] TabletServer@127.16.126.3:0 shutdown complete.
I20251023 08:00:36.772491 16888 master.cc:561] Master@127.16.126.62:45855 shutting down...
I20251023 08:00:36.795387 16888 raft_consensus.cc:2243] T 00000000000000000000000000000000 P d62703c4b8174795af160c14e69d5120 [term 1 LEADER]: Raft consensus shutting down.
I20251023 08:00:36.796106 16888 raft_consensus.cc:2272] T 00000000000000000000000000000000 P d62703c4b8174795af160c14e69d5120 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251023 08:00:36.796439 16888 tablet_replica.cc:333] T 00000000000000000000000000000000 P d62703c4b8174795af160c14e69d5120: stopping tablet replica
I20251023 08:00:36.817479 16888 master.cc:583] Master@127.16.126.62:45855 shutdown complete.
I20251023 08:00:36.852108 16888 test_util.cc:183] -----------------------------------------------
I20251023 08:00:36.852319 16888 test_util.cc:184] Had failures, leaving test files at /tmp/dist-test-taskLxM79k/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1761206251627710-16888-0
[ FAILED ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1, where GetParam() = true (20471 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (41219 ms total)
[----------] Global test environment tear-down
[==========] 7 tests from 2 test suites ran. (185058 ms total)
[ PASSED ] 5 tests.
[ SKIPPED ] 1 test, listed below:
[ SKIPPED ] LeaderRebalancerTest.TestMaintenanceMode
[ FAILED ] 1 test, listed below:
[ FAILED ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1, where GetParam() = true
1 FAILED TEST
I20251023 08:00:36.858821 16888 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 215 messages since previous log ~2 seconds ago
I20251023 08:00:36.859030 16888 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 215 messages since previous log ~2 seconds ago
I20251023 08:00:36.859169 16888 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 215 messages since previous log ~2 seconds ago
I20251023 08:00:36.859310 16888 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/master/catalog_manager.cc:5101: suppressed but not reported on 17 messages since previous log ~31 seconds ago
I20251023 08:00:36.859440 16888 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 44 messages since previous log ~58 seconds ago
I20251023 08:00:36.859573 16888 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 44 messages since previous log ~58 seconds ago
I20251023 08:00:36.859704 16888 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/master/catalog_manager.cc:4712: suppressed but not reported on 1 messages since previous log ~70 seconds ago
I20251023 08:00:36.859833 16888 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/master/catalog_manager.cc:5179: suppressed but not reported on 1 messages since previous log ~80 seconds ago
I20251023 08:00:36.860013 16888 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 5 messages since previous log ~0 seconds ago
I20251023 08:00:36.860304 16888 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/tablet/tablet.cc:2378: suppressed but not reported on 80 messages since previous log ~36 seconds ago